1 to 25 of 34 Contract Apache Airflow Jobs

technical delivery of data platforms and pipelines built in AWS-with a focus on AWS Glue, Managed Workflows for Apache Airflow (MWAA), and Python-and collaborate closely with Directors, Senior Architects, and Program Leadership to deliver business outcomes at scale. This is a player-coach role: you will … Your Responsibilities: Lead the design and implementation of scalable, secure, and cost-efficient ETL/ELT pipelines using AWS Glue, Python (PySpark), and MWAA (Airflow). Define solution architectures, data models, orchestration patterns, and CI/CD for data workflows. Own the technical roadmap, decomposition, and delivery plan-including ...

Platform DevOps team to build and run highly reliable CI/CD pipelines and infrastructure for the bank’s modern data estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform ...

Platform DevOps team to build and run highly reliable CI/CD pipelines and infrastructure for the bank’s modern data estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management ...

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: Apache Airflow Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit ...

with dimensional modelling, star schemas, SCDs etc.Experience within regulated financial servicesDesirableExperience in pensions, asset management or institutional investingUnderstanding of performance measurement and attributionExposure to Airflow or dbtCloud platform familiarity (Azure or AWS)Knowledge of data governance best practiceAbout YouHighly detail-driven with a strong approach to data qualityComfortable operating ...

/CD for data pipelines. Good to have skills Although not essential, the following skills are desired by the client: Kafka/Kinesis, Airflow, CodePipeline. BI tools (Power BI/Tableau). Docker/OpenShift; metadata driven pipelines. 3-8+ years Data Engineering experience. Cloud data engineering ...

behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start and finish times Data ...

Owning features end-to-end - from stakeholder requirements through to algorithm hardening, edge-case handling, and value measurement Working with orchestration frameworks (Dagster/Airflow), experiment tracking (MLflow), and containerised infrastructure (Docker/ECS) Collaborating closely with business stakeholders and contributing to roadmap and feature prioritisation What ...

Overview Lead a team of Data Analysts and own the delivery of high-impact analytical products using modern data engineering tooling (AWS, Databricks, dbt, Airflow). You will bridge the gap between business stakeholders and the data platform. Key Responsibilities Lead and mentor a team of Data Analysts Build … maintain self-serve analytical assets using dbt models and Databricks Design and orchestrate analytical pipelines in Airflow Translate complex business requirements into actionable insights and dashboards Perform deep-dive analysis across Retail, Commercial, Risk and Marketing domains Ensure all deliverables meet strict data governance and regulatory standards Work closely ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/ ...

Greenfield project. What you'll need to succeed Strong Python and SQL are crucial to this role On-prem to Snowflake migration experience Airflow and DBT experience GitHub experience as you will be building CI/CD pipelines as part of this role Any experience within post-trade ...

Familiarity with cloud platforms such as AWS, Azure or Google Cloud and associated MLOps practices. Experience with automation and orchestration tooling such as UiPath, Airflow or Kubeflow. Experience and Capability Strong experience delivering AI or automation solutions within enterprise environments. Ability to work with cross functional teams and translate ...

understanding ML pipelines and models in a production setting. Direct experience with Google Cloud Platform, BigQuery, and associated tooling. Experience with workflow tools like Airflow or Kubeflow. Familiarity with dbt (Data Build Tool). Please send your CV for more information on these roles. Reasonable Adjustments: Respect and equality ...

data platforms and backend systems. Familiarity with data governance frameworks, privacy compliance, and automated data quality checks. Hands-on experience with big data tools (Airflow, Databricks) and data observability platforms. Collaborative mindset and experience working with cross-functional teams including ML and analytics specialists. Curiosity and enthusiasm for continuous ...

with Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms. AWS administration and platform management experience. Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus). Agile experience with Scrum, and tools including Jira, Slack. Familiarity with PowerBI, CI/ ...

MLflow) Experience with cloud-based ML tools (e.g. SageMaker), data and model versioning (e.g. DVC), CI/CD (e.g. GitHub Actions), workflow orchestration (e.g. Airflow/Dagster) and containerised solutions (e.g. Docker, ECS) nice to have Experience in code testing (unit, integration, end-to-end tests) Strong data engineering ...

match/merge, survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data ...

team of 6–10 Data Engineers (onshore + offshore) Own the technical roadmap for the data platform (AWS + Databricks + dbt + Airflow) Architect scalable, cost-efficient and governed data solutions Drive best practices in engineering, testing, observability and documentation Act as senior technical point of contact … Experience 8+ years total experience with at least 3 years in a Lead/Principal Data Engineer role Expert-level AWS , Databricks , dbt and Apache Airflow Proven experience leading teams in a regulated financial services environment Strong stakeholder management and ability to translate business needs into technical solutions ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

Familiarity with cloud platforms (AWS, Azure or Google Cloud) and MLOps practices. Knowledge of automation technologies including RPA platforms (e.g. UiPath) and orchestration tools (Airflow, Kubeflow). Soft Skills: Excellent problem-solving and analytical capabilities. Strong written and verbal communication skills. Effective stakeholder management, with the ability to liaise ...

robust, maintainable, and scalable. Required Skills Programming: Advanced proficiency in Python. ML Engineering & MLOps: Hands-on experience with widely used ML tooling (e.g., MLflow, Airflow, Docker, Kubernetes). CI/CD & DevOps: Familiarity with CI/CD workflows and automation tools (e.g., GitLab, Jenkins) for streamlined deployments. Data Engineering ...

initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Knowledge of older coding standards and practices. AWS Airflow, Python nice to have. If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without ...

MLOps tooling such as SageMaker, MLflow, or TFServing * Experience with Spark, Databricks, CI/CD tools, and streaming or orchestration systems like Kafka or Airflow How to Apply If you are interested in this Machine Learning Engineer position, please apply with your CV. ...