1 to 25 of 27 Contract Apache Airflow Jobs

environment Proven experience delivering at least one production-grade data platform Strong hands-on capability with modern data engineering tools such as Python, SQL, Airflow, Spark, Kafka, dbt, Snowflake (Essential) Experience with backend technologies (e.g. Java/Spring Boot) Experiencewith cloud platforms (AWS, Azure, or GCP) and cloud-native ...

experience. Hands-on experience with Hadoop - configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such ...

efficient methods * Multi-modal AI systems combining text, image, and structured data * Reinforcement Learning from Human Feedback (RLHF) for model alignment Production ML Systems: * Apache Airflow/Dagster for ML workflow orchestration and ETL pipeline management * Model versioning and experiment tracking (MLflow, Weights & Biases) * Real-time model serving ...

processes with strong monitoring, logging and error handling Develop and maintain data models to support reporting and analytics Manage workflow orchestration and scheduling (e.g. Airflow or similar) Support CI/CD, version control and deployments across dev, test and production environments Implement data quality checks, governance and documentation Collaborate ...

learn new systems and business contexts Technical Requirements Experience with Azure SQL Databases Familiarity with Azure-hosted environments (including Ubuntu VMs) Working knowledge of Apache Airflow for pipeline orchestration Strong Power BI skills (data modelling, report building, optimisation) Proficiency in Python for data processing and automation Experience integrating ...

reporting alongside project work Strong communication skills, particularly around handover and knowledge transfer Technology in use: Azure SQL Databases Azure Ubuntu Virtual Machines Apache Airflow Power BI Python REST & SOAP APIs To apply for this role please submit your CV or contact David Airey on or at . ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest ...

understanding ML pipelines and models in a production setting. Direct experience with Google Cloud Platform, BigQuery, and associated tooling. Experience with workflow tools like Airflow or Kubeflow. Familiarity with dbt (Data Build Tool). Please send your CV for more information on these roles. Reasonable Adjustments: Respect and equality ...

with non-technical teams Experience working with operational or business process data Desirable: Experience with Zendesk or similar customer/operations platforms Familiarity with Airflow Python experience Experience working with operational data ...

with non-technical teams Experience working with operational or business process data Desirable: Experience with Zendesk or similar customer/operations platforms Familiarity with Airflow or similar orchestration tools Python experience for data processing or automation Experience working with operational, transactional, or workflow-driven datasets ...

match/merge, survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data ...

experience (Lightdash, Looker or similar) Experience identifying automation opportunities within data workflows Strong stakeholder engagement skills (non-technical teams) Nice to Have Exposure to Airflow Python experience ...

experience (Lightdash, Looker or similar) Experience identifying automation opportunities within data workflows Strong stakeholder engagement skills (non-technical teams) Nice to Have Exposure to Airflow Python experience ...

needs to be an IBM Certified TM1 developer as well as have a formal SQL qualification. Intermediate knowledge of Python & Django Intermediate Knowledge of Airflow and its application Awareness of cloud technologies and their application Administrator of Planning Analytics (TM1) and Oracle (systems admin) Experience of coaching & mentoring ...

analytical data modeling in BigQuery using dbt . Build reliable data pipelines utilizing SQL, Python, and distributed processing frameworks (Apache Spark, Scio, Beam, or Flink). Develop clear, story-driven dashboards using tools like Looker or Tableau . Champion data quality , implement CI/CD for dbt models … years of experience in analytics or data engineering, with deep expertise in SQL. Extensive experience with dbt, a cloud data warehouse , and workflow orchestrators (Airflow, Dagster, Prefect, or Flyte). Proficiency in Python for data analysis and automation. Bonus: Experience with experimentation, ML/AI metrics, or platform productivity ...

scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding … management Ability to work in cross functional, agile environments Preferred Qualifications Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding ...

secrets and access control using Azure Key Vault and Azure AD Enable hybrid connectivity between on-premises and cloud environments Support orchestration workflows using Apache Airflow Monitor system performance using tools such as Azure Monitor, Prometheus, and Grafana Collaborate across engineering teams to ensure reproducibility, scalability, and compliance … Solid understanding of cloud networking (hub/spoke, private endpoints) Experience troubleshooting infrastructure and deployment issues Strong collaboration and communication skills Desirable: Experience with Airflow or similar orchestration tools Knowledge of observability tooling (Prometheus, Grafana) Exposure to AI/ML platform environments Qualifications Relevant degree or equivalent industry experience ...

initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Knowledge of older coding standards and practices. AWS Airflow, Python nice to have. If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

Azure) Solid understanding of environment management, deployments & testing lifecycle Exposure to CI/CD pipelines (GitLab), automation, or IaC Nice to have: Experience with Airflow or scheduling tools Broader DevOps/platform engineering mindset If you are interested in this role, please feel free to submit your CV. ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

images to registries, and ensures secure and efficient AKS cluster deployments. Implements infrastructure as code using Terraform, including network, security, and compute resources. Supports Airflow as part of platform orchestration. Collaborates closely with Data Engineers, MLOps Engineers, and Solution Architects to ensure the infrastructure and pipelines meet performance, scalability ...

warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience ...

root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte DBT Apache Spark Grafana ...

Backend: Scala, Java (Python desirable) Frontend: HTML, CSS, JavaScript Frameworks: Play, Spark Data: Postgres, MongoDB, Hudi Cloud: AWS (S3, ECS, Aurora, Lambda) DevOps: Jenkins, Airflow, Terraform Monitoring: Kibana, Grafana Ways of working: Agile (Scrum/Kanban), CI/CD, 'you build it, you run it' What We're Looking … modern DevOps practices Experience working in Agile, multidisciplinary teams Strong analytical and problem-solving skills Clear communicator and collaborative team player Desirable Python, Docker, Airflow Big data tools (e.g. Spark, EMR) Experience with data platforms or risk/fraud systems How You'll Work Deliver value iteratively and early ...