26 to 50 of 77 Apache Airflow Jobs in the UK excluding London

designing enterprise-scale cloud data platforms using Azure, AWS, or Google Cloud. Expertise with technologies such as Databricks, Azure Data Factory, Microsoft Fabric, Snowflake, Airflow, Spark, SQL, and Python. Proven experience building scalable ETL/ELT pipelines and modern data architectures. Between £600 – £900 Per day inside IR35 This ...

within multi-disciplinary teams, delivering modern data platforms into large organisations. Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life Strong Snowflake experience is preferred, and Databricks experience ...

preparation specifically geared toward AI model integration Technical Fluency: A strong conceptual understanding of modern data ecosystems, data warehousing, pipeline orchestration tools (e.g., dbt, Airflow), and data governance standards Cross-Functional Communication: Outstanding stakeholder management skills, with a demonstrated ability to foster collaboration between technical developers and non-technical ...

Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache … Lambda Working experience with Terraform Experience in creating workflows for Apache Airflow What the job involves As a senior technical lead, you consider yourself a platform services developer and develop innovative solutions using modern software frameworks and paradigms You are self‐driven and a problem solver, with ...

Data Engineer to design, build, and maintain scalable data pipelines powering Moody’s next-generation digital content platform. You will work with DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS, driving platform optimizations and cross-functional collaboration. In this role, you’ll collaborate with product owners ...

software and site reliability engineering. Preferred experience with distributed ML frameworks such as Horovod or TensorFlow Distributed, familiarity with data engineering pipelines such as Apache Airflow or Spark, and knowledge of chaos engineering tools and compliance frameworks such as GDPR, SOC 2, or ISO 27001. Benefits Relocation benefits ...

production-grade data pipelines Solid understanding of integration patterns including REST APIs, webhooks, OAuth and event-driven architectures Experience with orchestration tools such as Airflow, Prefect or Dagster Familiarity with cloud environments (AWS, GCP or Azure) Experience with containerisation tools such as Docker and Kubernetes Proven experience integrating multiple ...

join their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work ...

learning services. Experience with machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn. Knowledge of pipeline orchestration and data workflow tools such as Airflow, Dataform, or dbt. Experience delivering advanced measurement and modelling solutions, including marketing mix modelling, incrementality testing, causal impact analysis, attribution modelling, propensity modelling, churn ...

platform as the business continues to invest Tech Environment: Azure Python SQL Server Azure Data Services Data Warehousing Data Engineering & ETL Workflow orchestration (Airflow, Luigi or similar) You'll probably be someone who: Has experience leading or mentoring Data Engineers Still enjoys writing code and solving engineering problems ...

modern cloud based data platforms. Solid understanding of data modelling and data transformation principles. Ability to work effectively within collaborative engineering teams. Desirable Experience: Airflow Databricks Experience supporting AI or machine learning initiatives. Semantic layer experience. Exposure to Azure and multi cloud environments. Understanding of Inmon 3NF data modelling ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

requirements into Data Science deliverables. The opportunity to work with leading data engineering technologies, including Google Vertex AI tools, Google BigQuery, BigQuery Pipelines, and Airflow, with leading Data Science tools and emerging technologies for model building and deployment. Opportunities to develop your career in a friendly, diverse, innovative, international ...

Python Experience with AWS and modern data technologies Familiarity with version control systems such as Git Experience with orchestration tools such as Airflow Ability to troubleshoot and improve data platform performance Strong attention to detail and focus on data quality Excellent communication and collaboration skills Willingness to learn ...

working as a Data Engineer Strong understanding of data engineering principles, ETL processes and data warehousing concepts Experience using workflow orchestration tools such as Airflow to schedule, monitor and manage data pipelines Experience working with at least one major cloud data platform, preferably Azure Strong data modelling skills, including ...

Cloud Run), AWS (Bedrock, SageMaker) Experience building and automating AI/ML pipelines using tools such as MLflow, Kubeflow, Azure ML, Vertex Pipelines, Airflow or Google ADK Hands-on experience with Generative and Agentic AI frameworks such as LangChain, LlamaIndex, CrewAI, Autogen, Google ADK, or similar. Ability to design ...

talks, or threads about building with AI. MLOps and model serving experience (BentoML, MLflow, Vertex AI, SageMaker). Streaming and batch ingestion pipelines (Spark, Airflow, Beam, Glue). Healthcare or life sciences domain exposure. AWS Professional certification or other relevant industry certifications. What We Offer At Newpage ...

native solutions that support analytics, automation, and digital transformation. Data Engineering, Full Stack & Platform Development Design and implement scalable data pipelines using tools like Apache Spark, Airflow, or dbt.Build and maintain data lakes, warehouses, and real-time streaming solutions. Develop APIs and microservices to expose data securely ...

demonstrable experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience with Azure ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or Azure Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

abstraction layers Model the cost, feasibility and risk of different LLMs and implementation approaches THE STACK AWS, Bedrock, LangGraph, LangChain, Python, FastAPI, PostgreSQL, Snowflake, Airflow, React, Next.js, Kubernetes. YOUR EXPERIENCE 15+ years in enterprise software engineering with a background in product engineering organisations or technology companies Deeply technical: recent ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

Python for data or platform engineering •Strong proficiency in Linux systems and command-line environments •Experience with MLOps tools such as MLflow, Kubeflow or Airflow •Familiarity with monitoring tools such as Prometheus or Grafana •Experience with containerisation and orchestration (Docker, Kubernetes, Terraform) •Understanding of CI/CD pipelines ...