126 to 150 of 194 Apache Airflow Jobs in England

join our dynamic, expanding team. Over the last few years we’ve built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way.About Zapp:Zapp is London’s leading ...

this role.Key Skills:Azure StackELT ExperienceData ModelingData Integration & IngestionData Manipulation and ProcessingGitHub, GitHub Actions, Azure DevOpsData Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTestKey CharacteristicsTechnology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.Deep data focus ...

building and optimising Semantic Layers for BI, reporting and analytics consumption Expert Level Data Modelling Strong hands-on experience with: Snowflake AWS dbt Databricks Airflow Ability to work in a fast-paced delivery environment and remain close to the technical implementation Desirable -Customer Loyalty, Rewards or Membership Programme experience ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

what happens next.Technical Mastery: You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines using dbt, Airflow, and Snowflake. Beyond querying, you use Python for advanced automation and forecasting, and you apply statistical rigor (e.g., Bayesian statistics, causal inference) to solve ...

team is working on the most impactful opportunitiesNICE TO HAVE BUT NOT ESSENTIALExperience delivering high quality data and self-serve analytics using tools like Airflow, dbt and Looker.Practically used + applied AI/machine learning techniques and built predictive models to get deeper insightsKnowledge of the FinTech ecosystemAdditional InformationWhat ...

theorem.A good understanding of functional paradigms and type theory.Confident JVM knowledge.Modern programming languages knowledge in our primary languages (Java, Python, Clojure).Experience with Airflow or other Python-based workflow orchestration tools.Proficiency in domain-driven design and domain modeling.Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git.Working knowledge ...

with a proactive and autonomous approach to workBonus points:Experience in driving product decisions and taking ownership of featuresFamiliarity with the following systems: Fivetran, Airflow, Snowflake, Plotly, Starrocks, MetabaseExperience in writing ELT pipelines with SQL and PythonUse of Claude Code, including MCPs for data reading and skills for common ...

visualization tools like Looker, Grafana, Lightdash, or SupersetAbility to build and manage data pipelines that are modularised and scalable, using tools like DBT and Airflow Familiarity with observability/reliability concepts (SLIs, SLOs, incidents)Some experience with Python/data transformation (DBT, etc.) is helpfulThis is not a data ...

tools like Looker, Grafana, Lightdash, or Superset Ability to build and manage data pipelines that are modularised and scalable, using tools like DBT and Airflow Familiarity with observability/reliability concepts (SLIs, SLOs, incidents) Some experience with Python/data transformation (DBT, etc.) is helpful This ...

visualization tools like Looker, Grafana, Lightdash, or SupersetAbility to build and manage data pipelines that are modularised and scalable, using tools like DBT and Airflow Familiarity with observability/reliability concepts (SLIs, SLOs, incidents)Some experience with Python/data transformation (DBT, etc.) is helpfulThis is not a data ...

quality and consistency across platforms while complying with governance policies. What You Bring: Core Development Skills:- Proficient in Python and SQL, with experience in Apache Spark.- Strong experience building backend services and APIs. Database Expertise:- Solid understanding of relational databases (SQL Server, PostgreSQL) and distributed NoSQL databases (Cassandra, MongoDB … lakehouse architectures.- Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge:- Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory).- Understanding of JSON, XML, APIs, and data ingestion technologies. Cloud Experience:- Familiarity with cloud platforms (Azure ...

data quality and consistency across platforms while complying with governance policies.What You Bring:Core Development Skills:- Proficient in Python and SQL, with experience in Apache Spark.- Strong experience building backend services and APIs.Database Expertise:- Solid understanding of relational databases (SQL Server, PostgreSQL) and distributed NoSQL databases (Cassandra, MongoDB, Cosmos … lakehouse architectures.- Familiarity with big data processing frameworks like Spark.Data Engineering Knowledge:- Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory).- Understanding of JSON, XML, APIs, and data ingestion technologies.Cloud Experience:- Familiarity with cloud platforms (Azure, AWS, GCP) is a plus.Preferred Qualifications ...

quality and consistency across platforms while complying with governance policies. What You Bring: Core Development Skills: - Proficient in Python and SQL, with experience in Apache Spark. - Strong experience building backend services and APIs. Database Expertise: - Solid understanding of relational databases (SQL Server, PostgreSQL) and distributed NoSQL databases (Cassandra, MongoDB … lakehouse architectures. - Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge: - Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow, Azure Data Factory). - Understanding of JSON, XML, APIs, and data ingestion technologies. Cloud Experience: - Familiarity with cloud platforms (Azure ...

pipelines for data and ML engineering workflows, applying infrastructure-as-code and automated quality gates as standard practice.Apply containerisation and orchestration tooling (e.g. Docker, Airflow, or equivalent) to production data and ML workflows.Partner across architecture, governance, data modelling, and reporting to deliver coherent, end-to-end data … clear approach to validating their output.MLOps — CI/CD for data and ML pipelines, infrastructure as code, containerisation, and orchestration tools such as Airflow or equivalent.Data quality & observability — hands-on experience with testing frameworks, monitoring, and quality controls in production environments.LLMs and generative AI — practical understanding ...

pipelines for data and ML engineering workflows, applying infrastructure-as-code and automated quality gates as standard practice.Apply containerisation and orchestration tooling (e.g. Docker, Airflow, or equivalent) to production data and ML workflows.Partner across architecture, governance, data modelling, and reporting to deliver coherent, end-to-end data … clear approach to validating their output.MLOps — CI/CD for data and ML pipelines, infrastructure as code, containerisation, and orchestration tools such as Airflow or equivalent.Data quality & observability — hands-on experience with testing frameworks, monitoring, and quality controls in production environments.LLMs and generative AI — practical understanding ...

stakeholder communication skills Desirable: Experience overseeing or supporting data ingestion pipelines, including APIs and event driven data sources Familiarity with orchestration tools such as Airflow and modern ELT architectures Experience governing or implementing data CI/CD pipelines (e.g. dbt tests, deployment pipelines, automated checks). We currently … design input, reviews, and mentoring Influence how analytics data is built, trusted, and operated at scale Work with a modern stack: AWS, Snowflake, dbt, Airflow, SQL, and Python Join us as we redefine travel experiences and create memories for millions of passengers. At Jet2.com and Jet2holidays , your potential ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

experience GIS or geospatial data handling Machine learning or data science background Time-series data and databases (e.g. InfluxDB, TimescaleDB) Data workflow orchestration (e.g. Airflow, Dagster) This role is 100% onsite, so you need to live within commutable distance. If you are interested, please apply to Matt Andrews ...

influencing architecture direction across multiple engineering and data teams. Key experience: Enterprise-scale Data Architecture AWS cloud data platforms Spark/PySpark/Python Airflow & ELT/data processing Data Lakehouse & Data Products Streaming/Event-Driven Architecture Data Governance Architecture standards, patterns & technical design reviews Experience with delivering ...

given real ownership, exposure to experienced director level mentors & Senior Data Engineers, alongside the opportunity to grow towards senior-level responsibilities.Tech StackSpark | Airflow | Kubernetes | Azure | CubeJSWhat You’ll Be DoingData Pipeline Development – designing & developing efficient, scalable & robust Data PipelinesSupport and main the data platform to ensure security, reliability ...

driving engineering best practices. Ability to influence technical direction and architectural decisions. Comfortable remaining hands-on while operating in a leadership capacity. Desirable Skills Airflow Databricks AI-focused development experience Semantic layer experience Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse ...

lifecycle, exception management. · Experience troubleshooting market and static data related issues that impact trade flow. · Familiarity with enterprise scheduling tools such as Active Batch, Airflow, Control-M, AutoSys · Experience using/building monitoring on platforms like ITRS Geneos, Zabbix ...

coursework in financial engineering, or industry internshipsExperience developing in a production-facing environment and familiarity with standard concepts and tooling, e.g., CI/CD, Airflow“Friends of Voleon” Candidate Referral ProgramIf you have a great candidate in mind for this role and would like to have the potential ...

Responsibilities Own the feature engineering roadmap for ETA & Destination Forecast across all 4 commodity types — propose and implement new features as dbt models using Airflow to orchestrate the data pipelines, and validate their impact through structured experiments.Design and run experiments using kpler-ml framework, logging all runs from train ...