101 to 125 of 128 Apache Airflow Jobs in the UK

/security implications. You might also have: Experience with Kubernetes for cloud-burst or elastic compute scenarios. Familiarity with workflow orchestration tools (e.g. Prefect, Airflow, Dagster) — not required to design flows, but useful for understanding deployment/runtime needs. Exposure to high-performance/scientific/technical computing environments ...

/security implications. You might also have: Experience with Kubernetes for cloud-burst or elastic compute scenarios. Familiarity with workflow orchestration tools (e.g. Prefect, Airflow, Dagster) — not required to design flows, but useful for understanding deployment/runtime needs. Exposure to high-performance/scientific/technical computing environments ...

develop. On the data pipeline side, we value awareness across both established tools such as SSIS/SSRS and newer approaches such as dbt, Airflow, or AWS Glue — dbt experience is essential, with the others a strong plus. DesirablePrevious experience in working in cloud environments (AWS preferred … definite plus. Familiarity with legacy SSIS/SSRS, useful for maintaining existing packages, as well as newer orchestration/ingestion tools such as Airflow or AWS Glue. Exposure to cloud data warehouse/data fabric platforms such as Snowflake or Databricks. A good understanding of financial markets. Background ...

Docker and Kubernetes experience, including deployment and management Previous experience working within air-gapped environments Strong understanding of APIs and microservices Experience with Prefect, Airflow or similar data pipeline/orchestration technologies Experience configuring and integrating workflow tooling such as Jira Experience with database and storage technologies such ...

experience, including deployment and management \n Previous experience working within air-gapped environments \n Strong understanding of APIs and microservices \n Experience with Prefect, Airflow or similar data pipeline/orchestration technologies \n Experience configuring and integrating workflow tooling such as Jira \n \n Experience with database and storage ...

deploying, monitoring and maintaining ML systems at scale Ability to balance hands-on engineering with people management responsibilities Experience with AWS, Snowflake, MLflow, Airflow or similar tooling would be advantageous SALARY AND BENEFITS £110,000 - £125,000 base salary Annual bonus Hybrid working model Private medical insurance Enhanced family ...

than one-off scripts or analysis tooling. Strong Python development skills, with experience building performant, maintainable applications. Experience with workflow orchestration tools such as Airflow, Dagster, or Prefect. Understanding of retries, dependency management, idempotency, backfills, and operational recovery. Experience with analytical or columnar databases such as ClickHouse or similar ...

Engineering, or MLOps environments Experience building, deploying, and supporting machine learning solutions at scale Experience working with AWS and ML tooling such as MLflow, Airflow, Metaflow, or Snowflake Ability to balance technical leadership, strategic thinking, and hands-on engineering contribution SALARY AND BENEFITS Up to £125,000 base salary ...

clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Experimentation & Statistics: Experience running A/B tests and analysing the results to drive product decisions Ownership: You enjoy working independently in a fast ...

maintain standardized data models, schemas, and metadata that make commodities datasets easy to understand, discover, and reuse. Schedule, monitor, and manage data pipelines using Airflow or similar workflow orchestration tools to ensure reliable, timely data delivery. Implement validation, reconciliation, and anomaly-detection controls to maintain data completeness, accuracy … building and maintaining ETL pipelines. Strong Python and SQL skills, including experience working with large datasets and complex data transformations. Hands-on experience with Airflow or comparable workflow orchestration tools. Experience with Git, CI/CD pipelines such as GitHub Actions, and automated testing frameworks such as PyTest. Strong ...

experience with cloud platforms (AWS, Azure, GCP)Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow)Practical experience with NLP and/or Search techniquesPrompt engineering, and LLMs for enterprise-scale applications. You have team lead experienceStrong ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

development API gateway technologies, including Tyk, Apigee or DataPower Cloud and application hosting using PCF, TAS or AWS Integration and batch processing using StreamSets, Airflow, ESP Services or GSS CI/CD pipelines and automated testing Technical design, code reviews and production troubleshooting You'll have the opportunity ...

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

sequenced engineering plan, and keep the team aligned to it. Own the technical quality of the platform: Snowflake infrastructure and RBAC, ingestion patterns, orchestration (Airflow), CI/CD, observability and cost controls. Make and record technical decisions. Run the decision-document process. Make the final call when the team … enterprise-grade dbt model development. Experience designing end-to-end data pipelines. Combining batch, file-based, and streaming ingestion (Kafka/CDC) managed with Airflow orchestration. A good understanding of data security and governance, including PII handling and access control. Strong infrastructure-as-code skills and CI/ ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn't just the Best Place to Play — it's also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As ...

needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking … experience with TerraformExperience in creating workflows for Apache Airflow#LI-GL1What's Roku's approach to hybrid working? Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned ...

Build data solutions for complex Defence challenges while broadening your technical experience across varied consultancy projects. Develop your skills across modern data engineering technologies and production environments. What you will need Hands-on data engineering ...

role). Cloud Infrastructure & Data Pipelines: Build with AWS and Azure services to construct ETL workflows and dynamic systems using orchestration platforms like Apache Airflow. Production Operations: Support production applications, maintain SLAs, and create continuous evaluation metrics for ML solution performance. Qualifications & Skills 2-5 years' hands-on software … Hands-on experience building GenAI applications, LLM workflows, and data pipelines. Cloud experience across AWS or Azure ecosystems along with data orchestration tools (e.g., Airflow). Practical understanding of AI safety, prompt injection handling, and PII/MNPI compliance guardrails. If you have 2-5 years' experience ...

streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows … Databricks Asset Bundles CI/CD and GitHub Actions Ability to work autonomously in a fast-moving environment Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial. Location: London Rate: £800£900 per day IR35: Inside IR35 ...

scalable APIs (FastAPI, etc.) for model deployment, implement MLOps pipelines, leverage cloud platforms (AWS/Azure) to optimize AI infrastructure, and use orchestration tools (Airflow) for complex ML workflows Champion ML governance and operational excellence – Ensure adherence to AI/ML governance guidelines, monitor model performance and SLAs, optimize … excellence – Strong understanding of MLOps, containerization (Docker, Kubernetes/AWS EKS), cloud platforms (AWS/Azure including Bedrock, SageMaker, Azure AI Search), workflow orchestration (Airflow), and API development for ML systems Software development fundamentals – Deep understanding of automated testing, source version control, code optimization, software architecture, and building scalable ...