76 to 100 of 120 Apache Airflow Jobs in England

Complex modelling and performance-aware DML and DDL across Snowflake/Clickhouse• Kubernetes and Docker• Kafka• Strong understanding of Git, code review, CI, TDD• Apache Airflow - desirable, but not essentialResponsibilities• Design, build and own bespoke low latency pipelines for our most demanding data sources.• On-call rota, owning ...

demonstrable experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience with Azure ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

Backend Engineering background Experience building APIs and system integrations Experience working within complex, data-intensive environments Strong understanding of software engineering best practices Desirable Airflow Snowflake AWS Exposure to data warehousing and modern analytics platforms Experience supporting reporting, commercial analytics, or performance data solutions IDEAL BACKGROUND We're especially ...

development.Excellent SQL skills and fluency in Python or R, with experience applying analytical and statistical methods to business problems.Experience with orchestration tools (e.g., DBT, Airflow) for deploying reliable data workflows.Strong communication and empathy - ability to translate complex data concepts for non-technical stakeholders.Collaborativeproduct mindset- comfort working closely with Sales ...

We are recruiting for an Analytical Engineer on behalf of one of the UK's most recognised and celebrated personal lines insurers. The successful candidate will be working alongside a talented team of Data & AI ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

join our dynamic, expanding team. Over the last few years we've built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way.About Zapp:Zapp is London's leading ...

this role.Key Skills:Azure StackELT ExperienceData ModelingData Integration & IngestionData Manipulation and ProcessingGitHub, GitHub Actions, Azure DevOpsData Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTestKey CharacteristicsTechnology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.Deep data focus ...

building and optimising Semantic Layers for BI, reporting and analytics consumption Expert Level Data Modelling Strong hands-on experience with: Snowflake AWS dbt Databricks Airflow Ability to work in a fast-paced delivery environment and remain close to the technical implementation Desirable -Customer Loyalty, Rewards or Membership Programme experience ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

theorem.A good understanding of functional paradigms and type theory.Confident JVM knowledge.Modern programming languages knowledge in our primary languages (Java, Python, Clojure).Experience with Airflow or other Python-based workflow orchestration tools.Proficiency in domain-driven design and domain modeling.Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git.Working knowledge ...

data quality and consistency across platforms while complying with governance policies.What You Bring:Core Development Skills:- Proficient in Python and SQL, with experience in Apache Spark.- Strong experience building backend services and APIs.Database Expertise:- Solid understanding of relational databases (SQL Server, PostgreSQL) and distributed NoSQL databases (Cassandra, MongoDB, Cosmos … lakehouse architectures.- Familiarity with big data processing frameworks like Spark.Data Engineering Knowledge:- Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory).- Understanding of JSON, XML, APIs, and data ingestion technologies.Cloud Experience:- Familiarity with cloud platforms (Azure, AWS, GCP) is a plus.Preferred Qualifications ...

quality and consistency across platforms while complying with governance policies. What You Bring: Core Development Skills:- Proficient in Python and SQL, with experience in Apache Spark.- Strong experience building backend services and APIs. Database Expertise:- Solid understanding of relational databases (SQL Server, PostgreSQL) and distributed NoSQL databases (Cassandra, MongoDB … lakehouse architectures.- Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge:- Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory).- Understanding of JSON, XML, APIs, and data ingestion technologies. Cloud Experience:- Familiarity with cloud platforms (Azure ...

quality and consistency across platforms while complying with governance policies. What You Bring: Core Development Skills: - Proficient in Python and SQL, with experience in Apache Spark. - Strong experience building backend services and APIs. Database Expertise: - Solid understanding of relational databases (SQL Server, PostgreSQL) and distributed NoSQL databases (Cassandra, MongoDB … lakehouse architectures. - Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge: - Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory). - Understanding of JSON, XML, APIs, and data ingestion technologies. Cloud Experience: - Familiarity with cloud platforms (Azure ...

pipelines for data and ML engineering workflows, applying infrastructure-as-code and automated quality gates as standard practice.Apply containerisation and orchestration tooling (e.g. Docker, Airflow, or equivalent) to production data and ML workflows.Partner across architecture, governance, data modelling, and reporting to deliver coherent, end-to-end data … clear approach to validating their output.MLOps — CI/CD for data and ML pipelines, infrastructure as code, containerisation, and orchestration tools such as Airflow or equivalent.Data quality & observability — hands-on experience with testing frameworks, monitoring, and quality controls in production environments.LLMs and generative AI — practical understanding ...

stakeholder communication skills Desirable: Experience overseeing or supporting data ingestion pipelines, including APIs and event driven data sources Familiarity with orchestration tools such as Airflow and modern ELT architectures Experience governing or implementing data CI/CD pipelines (e.g. dbt tests, deployment pipelines, automated checks). We currently … design input, reviews, and mentoring Influence how analytics data is built, trusted, and operated at scale Work with a modern stack: AWS, Snowflake, dbt, Airflow, SQL, and Python Join us as we redefine travel experiences and create memories for millions of passengers. At Jet2.com and Jet2holidays , your potential ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

experience GIS or geospatial data handling Machine learning or data science background Time-series data and databases (e.g. InfluxDB, TimescaleDB) Data workflow orchestration (e.g. Airflow, Dagster) This role is 100% onsite, so you need to live within commutable distance. If you are interested, please apply to Matt Andrews ...

influencing architecture direction across multiple engineering and data teams. Key experience: Enterprise-scale Data Architecture AWS cloud data platforms Spark/PySpark/Python Airflow & ELT/data processing Data Lakehouse & Data Products Streaming/Event-Driven Architecture Data Governance Architecture standards, patterns & technical design reviews Experience with delivering ...

driving engineering best practices. Ability to influence technical direction and architectural decisions. Comfortable remaining hands-on while operating in a leadership capacity. Desirable Skills Airflow Databricks AI-focused development experience Semantic layer experience Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse ...

lifecycle, exception management. · Experience troubleshooting market and static data related issues that impact trade flow. · Familiarity with enterprise scheduling tools such as Active Batch, Airflow, Control-M, AutoSys · Experience using/building monitoring on platforms like ITRS Geneos, Zabbix ...

management * Software testing lifecycle/defect management * CI/CD & DevOps practices Desirable: HMRC/public sector experience, AWS/Azure/SAS PaaS, Airflow or SAS Migration Factory experience. If you are interested in this role or wish to apply, please submit your CV. ...

Experience setting technical direction and influencing engineering practices across teams. Hands‐on experience with cloud ML platforms (e.g., AWS SageMaker) and orchestration tools (e.g., Airflow, Step Functions) Strong communication skills and the ability to collaborate across Data Science, Engineering, and Data Platforms. How you work You are comfortable operating ...

methodsStrong experience with cloud environments, ideally Azure (Azure OpenAI, AI Foundry, AI Search)Competence in containerized deployments, CI/CD, and MLOps tooling (MLFlow, Airflow)Experience with Microsoft Agent Framework, Azure AI Agent ServiceKnowledge of vector databases (Pinecone, Weaviate, Qdrant, Milvus)Familiarity with guardrail and AI safety techniques (output ...