51 to 75 of 102 Apache Airflow Jobs in England

Experience with CI/CD, microservices, TDD/BDD. Knowledge of secure system design. Desirable (AI & Data) Vector DBs: Milvus, Weaviate, Pinecone Data orchestration: Airflow, Prefect, Dagster Search: ElasticSearch/OpenSearch AI frameworks: LangChain, Hugging Face MLOps: MLflow, Kubeflow If you are looking for an opportunity to work ...

responsibilities Own, assess, improve, or rebuild existing ETL/ELT pipelines Build reliable data workflows using Python Work with orchestration tools such as Airflow or similar Improve data quality, validation, lineage, and troubleshooting Collaborate with consultants and non-technical stakeholders Help translate messy business/client data into structured ...

data services (e.g. S3, Glue, Redshift, Lambda, Step Functions, Kinesis) and infrastructure-as-code (Terraform or CDK) Experience with workflow orchestration tools such as Airflow or similar Ability to design scalable architectures, make pragmatic trade-offs, and communicate effectively with both technical and non-technical stakeholders Processing Your Data ...

familiarity with common AI/ML libraries (scikit-learn, PyTorch, HuggingFace, OpenAI API). Bonus Points Experience with data engineering tools (SQL, pandas, dbt, Airflow). Exposure to LLMs or generative AI in a practical context. GitHub profile demonstrating collaborative projects and consistent contributions. Who we are: Here ...

data stack including a mix of structured and unstructured data sources, orchestration tooling, and distributed storage. RDS Postgres, MongoDB, AWS Athena, Parquet, AWS Glue, Airflow, Python, Docker, S3, GraphQL, REST. You won't know all of it, you'll be strong in your core area and curious about ...

technical field Experience with Infrastructure as Code (Terraform, OpenTofu) DataOps and CI/CD pipeline design - especially with dbt or SQLMesh Experience with Kubernetes, Airflow or Prefect Experience deploying on-premises infrastructure Exposure to geospatial, NLP, image processing, signals or financial data Experience working in or alongside blended analyst ...

Looking For Strong experience with SAS 9.x and SAS Viya Solid background in data engineering, ETL, and data modelling Experience with workflow orchestration (e.g., Airflow or similar) Understanding of performance optimisation and scalable systems Strong communication and stakeholder engagement skills Why Join? Work on meaningful, high-impact public sector ...

Data Engineer in secure or government environments Strong skills in Python, SQL, and data pipeline development Experience with data integration tools (e.g. Airflow, NiFi, Azure Data Factory, AWS Glue, or similar) Hands-on experience with cloud platforms (AWS, Azure, or GCP - secure tenants preferred) Knowledge of data modelling, data … environments Strong understanding of data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply ...

What they're looking for Strong Python + data engineering fundamentals Experience building scalable data pipelines/platforms Exposure to distributed systems (Kafka, Spark, Airflow etc.) Interest in AI/ML systems is a plus ...

+ 20% Bonus Location : Central London (Hybrid – 3 days per week) Tech: Python | Java | SQL | Azure | Spark | Flink | Kubernetes | Terraform | CI/CD | Airflow We’re working with one of the UK’s leading enterprise businesses as it continues to invest heavily in its Cyber Data & Platform capability. This ...

work independently and help drive things forward Nice to have: Time-series, high-volume or event-driven data experience Orchestration exposure such as Airflow, Dagster, Prefect, Temporal or similar Finance or market data experience Details: Permanent role London/hybrid Small, technically strong team Salary flexible depending ...

GitHub Copilot) with significant examples of delivery improvement AWS (S3, Lambda, EC2, Glue), Snowflake, Git, CI/CD, Datadog, MS SQL Server, REST, GraphQL, Airflow (as many as possible) Degree educated or higher in a relevant technical discipline from a leading university This is a £650-700/ ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation: experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

APIs can be exposed to LLM-based agents. Experience with search relevance & recommendation systems — ranking algorithms, semantic search, personalisation. Hands-on with Snowflake, Databricks, Airflow, Kafka . Why Join Us Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC Shape ...

peer to peer feedback and evolving healthy, curious and humble teams. Tech Stack: Python, Javascript/Typescript, React/React Native, AWS, GraphQL, Snowflake, Airflow, DDD. This is an incredible opportunity for a Senior Software Engineer to join a unique company as they embark on a period of significant ...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded ...

load balancers, VMware vSphere, HashiCorp Vault, Keycloak, ArgoCD, Helm Charts, SonarQube, Snyk. Implement object storage platforms using S3-compatible storage and MinIO. Setting up Apache Airflow, Cisco NSO, Itential at platform level. Develop, test and maintain backup and disaster recovery strategies. DevOps, CI/CD development and DevSecOps ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

images to registries, and ensures secure and efficient AKS cluster deployments. Implements infrastructure as code using Terraform, including network, security, and compute resources. Supports Airflow as part of platform orchestration. Collaborates closely with Data Engineers, MLOps Engineers, and Solution Architects to ensure the infrastructure and pipelines meet performance, scalability ...

right questions, and making reasonable bets. Bonus Experience with IoT/telemetry, energy data, or time-series workloads Familiarity with event-driven architectures, GraphQL, Airflow, or Python Personal interest in energy, climate tech, or automation Track record of owning complex systems end-to-end 5+ years of experience This ...