276 to 300 of 468 Apache Airflow Jobs in England

including building and publishing images to internal registries Implement Infrastructure as Code using Terraform (including network, security and compute resources) Support workflow orchestration, including Airflow Contribute to platform security, auditing and cost management best practices Participate as a core contributor within the team and support architecture discussions/working ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US Our client is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US Our client is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

functionally with Product/Design/Engineering and bring teams along on decisions. To share extra context, our current tech stack includes GCP, BigQuery, Airflow, Python, SQL on the Data side and AWS, Kotlin, Javascript, Typescript on the Product side while our infrastructure is containerised with Kubernetes. Experience across ...

with expertise in Python and experience building reusable tooling and platform services. Experience with modern platform and engineering tooling such as GitHub Actions, Apigee, Airflow, and related cloud‐native technologies. Expertise with observability platforms such as Data Dog, Prometheus, Grafana, ELK, Splunk or equivalent, including monitoring, logging, tracing, reliability ...

stack and multi-modal representation learning is a plusWe'd love to see that you've worked with big data systems (Spark, S3, and Airflow) and can program (Java, Scala, or Python)Good understanding of system architecture. Have experience in big data technologies and streaming architecture, data pipelines, etc. ...

Batch, ECS, EKS, S3, RDS or Postgres, Athena, SageMaker, Bedrock, or equivalent services. Scientific workflow and data orchestration frameworks such as Nextflow, Dagster, Airflow or similar. Platform security, privacy or governance controls for sensitive biomedical or clinical data. Identity platforms and federation technologies such as Entra ...

bioinformatics or clinical data platforms, including formats such as VCF, BAM or FASTQ Standards such as GA4GH, OMOP or FHIR Orchestration technologies such as Airflow, Prefect or AWS Glue Lakehouse or data mesh approaches, and batch, streaming, distributed or event‐driven architectures Secure Data Environments, federated research platforms ...

practices (Git, CI/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutionsNice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithmsCustomer collaborator: Comfortable working directly with clients and cross-functional teams ...

cloud-native data architecture (AWS/GCP/Snowflake).Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT.Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms.Build and optimize schemas, transformations, and ETL logic … pipelines.QualificationsHands-on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases.Expert-level proficiency in Python, SQL, and Apache Spark for data pipeline development.Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks.Solid understanding of data modeling, dimensional design, and schema normalization ...

cloud‐native data architecture (AWS/GCP/Snowflake). Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT. Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms. Build and optimize schemas, transformations … Hands‐on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert‐level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design ...

cloud-native data architecture (AWS/GCP/Snowflake).Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT.Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms. Build and optimize schemas, transformations … QualificationsHands-on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert-level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design ...

services, a good understanding of cloud architecture, and proficiency with Terraform for provisioning and managing cloud infrastructure Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake … Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience with networking and security concepts within AWS, including VPCs, subnets, routing, security groups, IAM, etc. Nice to have Experience: Exposure to or interest in the cryptocurrency technology ecosystem Experience working with different blockchain technologies ...

throughput batch and streaming data pipelines using Kafka, Flink, and ETL technologiesDesign and build unified analytics engine designed for processing large-scale data using Apache Spark and related toolsDevelop and optimize analytical data models for time-series, financial metrics, and trading activityImplement and manage analytical databases (ClickHouse, MongoDB, BigQuery … ExpertiseAdvanced SQL with window functions and query optimization, realtime data synchronization together with database design and infrastructure supportExperience with data workflow and messaging orchestration (Airflow, Jenkins, AMPS etc.)Metric design and implementation for trading analytics (PnL, risk, balance and trade reconciliation, backfill and performance tuning)Time-series data visualization ...

months. Hybrid: London or Manchester - 2 days per week. This role requires the ability to hold an active security clearance. Skills: Python and SQL. Apache Airflow for DAG orchestration and monitoring. AWS data services: Redshift, OpenSearch, Lambda, Glue, Step Functions, Batch. CI/CD pipelines and YAML-based ...

Hybrid : London or Manchester - 2 days per week. This role requires the ability to hold an active security clearance. Skills : Python and SQL . Apache Airflow for DAG orchestration and monitoring. AWS data services: Redshift , OpenSearch , Lambda , Glue , Step Functions , Batch . CI/CD pipelines and YAML ...

Hybrid : London or Manchester - 2 days per week. This role requires the ability to hold an active security clearance. Skills : Python and SQL . Apache Airflow for DAG orchestration and monitoring. AWS data services: Redshift , OpenSearch , Lambda , Glue , Step Functions , Batch . CI/CD pipelines and YAML ...

infrastructure. Well versed and proven experiencein programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

join our Data Engineering team in the UK. You will build and govern data infrastructure powering our platforms, using Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks to move data securely from source to decision-ready output. You will implement end-to-end ingestion sources, investigate ...

reporting systems, ensuring data is accurate, timely and trusted. You’ll own data models, contracts and quality checks, work with Kafka, dbt and Airflow, and partner with engineers, product and compliance to scale a regulated data platform. #J-18808-Ljbffr ...

ingestion to data products, focusing on reliable, scalable architectures. You'll work with SQL, Python, and cloud warehouses (BigQuery, Snowflake, Redshift) and orchestration tools (Airflow, Prefect, Dagster) while collaborating with analytics, data science, and product engineering to deliver impact across the organization. #J-18808-Ljbffr ...

analytics and governance while promoting self-service insights for business users. Key skills include data lakehouse design (Iceberg), AWS/Azure data services, dbt, Airflow, and BI/dashboard experience. The role emphasizes automation, quality, and collaboration with architects. #J-18808-Ljbffr ...

given real ownership, exposure to experienced director level mentors & Senior Data Engineers, alongside the opportunity to grow towards senior-level responsibilities. Tech Stack Spark | Airflow | Kubernetes | Azure | CubeJS What You'll Be Doing Data Pipeline Development - designing & developing efficient, scalable & robust Data Pipelines Support and main the data platform ...

improve platform reliability. Required Skills & Qualifications: Extensive hands-on experience with Google Cloud Platform , including BigQuery , GCS , IAM , and Kubernetes . Proficiency in Python, Airflow, dbt, and familiarity with Terraform and CI/CD pipelines. Experience with data governance tools like Alation , Fivetran , and Tableau . Strong understanding ...