1 to 25 of 28 Contract Apache Airflow Jobs in England

Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer ...

communicate clearly with technical and non-technical stakeholders Nice to Have Experience with dbt or other transformation frameworks Exposure to data orchestration tools (Airflow, etc.) Understanding of data governance, lineage, and metadata management Experience supporting BI tools (Power BI, Tableau, Looker, etc.) Python experience for data tooling or automation ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

tasks, working with the Snowflake Data Marketplace, Performance Tuning and Knowledge of ETL/ELT pipelines and data integration tools (e.g., Informatica, Matillion, DBT, Airflow). Experience with APIs, stored procedures, and automation scripts is a plus. Strong analytical and problem-solving mindset. Clear communicator, able to work across ...

Oracle, SQL Server, PostgreSQL, MySQL). Knowledge of data warehouse and lakehouse architectures. Familiarity with ETL/ELT and orchestration tools (e.g., Informatica, Talend, Apache Airflow). Experience establishing and maintaining data governance frameworks. Experience complying with data security requirements. Experience designing data models. Excellent problem-solving, communication ...

data structures, performance, and optimisation strategies Familiarity with GCP and ecosystem knowledge: BigQuery, Composer, Dataproc, Cloud Run, Dataplex Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment Experience with analytical data modelling (star and snowflake schemas), DWH, ETL/ELT patterns ...

position will require 2 days per week in Leeds city centre. The key skills required for this Data Engineer position are: Python AWS DBT Airflow If you do have the relevant experience for this Data Engineer position, please do apply. ...

position will require 2 days per week in Leeds city centre. The key skills required for this Data Engineer position are: Python AWS DBT Airflow If you do have the relevant experience for this Data Engineer position, please do apply click apply for full job details ...

Technical expertise in designing, building, and maintaining data pipelines and warehouses Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive) Knowledge of programming languages (e.g., Python, SQL) Hands-on experience with SQL/NoSQL database design Degree in a STEM field; a master ...

Technical expertise in designing, building, and maintaining data pipelines and warehouses Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive) Knowledge of programming languages (e.g., Python, SQL) Hands-on experience with SQL/NoSQL database design Degree in a STEM field; a master ...

Proven Data Engineering experience in operational or live service environments Strong competency with ETL/ELT tools, such as: Azure Data Factory Informatica SSIS Airflow Strong SQL proficiency Experience using monitoring tools, including: Application Insights Splunk Grafana CloudWatch Experience with scheduling systems such as Cron, Autosys, or Control ...

cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ML data pipelines or analytics platforms Experience using UML/SysML Security ...

environment * Good problem-solving skills and attention to detail * Excellent communication skills to work effectively with senior engineers and stakeholders Desirable Skills: * Experience with Apache Airflow for workflow orchestration * Familiarity with Alteryx for data preparation * Knowledge of REST APIs and integration patterns * Awareness of Agile methodologies Qualifications: * Bachelor ...

environment Good problem-solving skills and attention to detail Excellent communication skills to work effectively with senior engineers and stakeholders Desirable Skills: Experience with Apache Airflow for workflow orchestration Familiarity with Alteryx for data preparation Knowledge of REST APIs and integration patterns Awareness of Agile methodologies Qualifications: Bachelor ...

experience with Google Cloud Platform (GCP), ideally BigQuery. Proficiency in SQL for data transformation and optimisation. Experience with automation tools such as Python, Airflow, dbt, Power Automate, or similar. Understanding of data security, permissions, and governance best practices. Soft Skills: Excellent communication and ability to translate complex data concepts ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark or PyTorch. Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer. Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI). Experience with CI/CD pipelines and automation ...

with analytics, architecture, and delivery stakeholders. Balance operational leadership with longer-term planning and strategy. YOUR SKILLS & EXPERIENCE Essential: Strong experience with Snowflake, AWS, Airflow, and dbt. Proven background leading data engineers in production environments. Experience supporting data platform migrations or major transformations. Confident making technical trade-offs ...

product". Ability to influence senior stakeholders and collaborate effectively with technology architects. Familiarity with contemporary data engineering tooling (e.g. Snowflake-centric stacks, DBT, Airflow, Fivetran). If you'd like to learn more, please contact Jacob Ferdinand ...

cases are developed in a scalable and sustainable way Communicate complex technical decisions clearly to non-technical stakeholders Technical Environment Strong experience required: Snowflake Airflow dbt Nice to have: AWS (lower priority) Ideal Background Senior or Lead Data Engineer who has progressed into a management/technical leadership role ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

deliver reliable, high-performance data solutions using Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine … data pipelines, architectures, and best practices Required Qualifications 3+ years of experience in data engineering or a similar role Strong experience with Databricks and Apache Spark Proficiency in Python and SQL Experience with Delta Lake, data modeling, and performance tuning Hands-on experience with cloud platforms (AWS, Azure ...

clearly. Excellent problem-solving skills and the ability to translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience … platforms such as Snowflake and Azure Data Lake. Understanding of monitoring, model performance tracking and observability best practices. Familiarity with orchestration tools such as Airflow or Azure Data Factory. ...

skills with the ability to work cross-functionally with stakeholders, engineers, and analysts. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable skills/knowledge/… Experience deploying models as APIs (FastAPI, Azure Functions). Understanding of monitoring, model performance tracking, and observability best practices. Familiarity with orchestration tools like Airflow or Azure Data Factory. ...

version management, model registry, canary/blue-green rollouts, and rollback plans. Data engineering: Build reliable data pipelines (batch/stream) using Spark/Airflow/Beam; ensure data quality, lineage, and governance. Technical leadership: Lead design reviews, mentor engineers, enforce coding standards, documentation, and SRE best practices. Partner … prompt/context engineering, multimodal workflows, and observability. Experience with MLOps/model serving (e.g., MLflow, SageMaker, Vertex AI) and data pipelines (e.g., Spark, Airflow, Beam). Security-first mindset and familiarity with compliance (PII handling, RBAC/IAM,key management). Nice-to-Have Experience with function/ ...

Strong interpersonal skills with the ability to work cross-functionally with stakeholders, engineers, and analysts. * Languages: Python (primary), SQL, Bash * Cloud: Azure, AWS * Tools: Airflow, DBT, Docker * Data: Snowflake, Delta Lake, Redis, Azure Data Lake * Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable skills/knowledge/… Experience deploying models as APIs (FastAPI, Azure Functions). * Understanding of monitoring, model performance tracking, and observability best practices. * Familiarity with orchestration tools like Airflow or Azure Data Factory. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site ...