251 to 275 of 1,802 Data Pipeline Jobs in England

Role Title: Senior Data Engineer Duration: 12 months with possibility of extension Location: London. Hybrid, 2 days per week onsite Rate: TBC Role purpose/summary We see a world in which advanced applications of machine learning (ML) and artificial intelligence (AI) will allow us to develop novel … candidates will have a track record of shipping data products derived from complex sources and will have owned that process from initial pipeline design through to production scale. We have a commitment to quality, so successful candidates will be able to use modern cloud tooling and techniques ...

contribute to standards, patterns, and best practices across the team. What You’ll Bring Strong ownership mindset: ability to move from task execution > pipeline ownership > system design accountability. Ability to balance scale, latency, cost, and governance when making design decisions. Solid communication skills to: - Explain technical trade-offs clearly … keys, and data grain, and balances normalisation versus performance using established and reusable modelling patterns. Data Governance: Embeds governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification ...

Data Engineer - Databricks, Python, SQL & Oracle 6-month contract | £400-£450 per day | Hybrid - London, 3 days per week About the role We are looking for an experienced, hands-on Data Engineer to join a major data transformation and cloud modernisation programme within … highly regulated banking environment. You will design, build and maintain scalable data pipelines, support cloud migration initiatives and deliver reliable enterprise data solutions. This role is ideal for a strong developer and delivery-focused engineer rather than a technical lead. You should be comfortable working independently ...

Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level of experience) Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the UK on an ad hoc basis) Please Note: Any offer of employment is subject … proficiency in Python Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Containerisation ...

Your mission As part of the Data Science team, the Scientific Data Engineer will divide their time between digitalization and data analysis. The candidate will develop and maintain the R&D department's data model, data pipelines and dashboarding … support R&D activities. These span a wide range of areas including electronic lab notebook templatization and integrations, data capture and storage, results processing, dashboarding, and statistical analysis activities. They will also share responsibility with the wider Data Science team for providing technical support to scientists ...

Data Engineer London - Hybrid £65,000 - £75,000 Azure Data/SQL/Financial Services I'm currently working with a growing data and technology consultancy who are looking to bring a Data Engineer into their expanding delivery team. The business works … with a range of organisations across telecommunications, financial services, insurance and healthcare, helping clients develop modern data platforms and turn complex data into valuable business insights. Joining a client-facing consulting team, you'll have the opportunity to work across a variety of data ...

client is a public sector technology consultancy. Description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain … these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Your role at our client As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands ...

strengthen data quality and retention practices. Projects could include moving large and non‐operational data out of PostgreSQL, improving pipeline orchestration with Prefect, and evolving our search and analytical capabilities with technologies such as OpenSearch and column databases. You’ll bring the experience and judgement … modelling skills. Experience with NoSQL databases (like MongoDB, DocumentDB or DynamoDB) and warehousing solutions (like DuckDB, ClickHouse, Redshift) Solid Python and data pipeline engineering skills. Confidence using AI tools for development, investigation and documentation, with sound judgement about their value and limitations. What we offer in return ...

customers can achieve better outcomes and stay ahead of what’s next. Job Summary We are seeking a highly skilled Azure Data Engineer to design, build, and maintain our enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable … supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified ecosystem built on Microsoft Fabric and Azure Databricks. A heavy emphasis is placed ...

seeking a highly technical Business Intelligence Engineer to join our growing BI team. Sitting at the crucial intersection of Data Engineering and Business Intelligence, you will be the technical cornerstone of our BI function. You will architect robust data solutions, automate data ingestion, quality … governance checks, build user-friendly dashboards, and promote a culture of data-driven decision-making across the organization. You will be a self-starter, taking the initiative to understand the whole data lifecycle, Trayport's products and business to transform complex data into actionable ...

execute on time-sensitive, critical initiatives. Advanced Technical Skills: Full independence in your technical abilities. You are an expert in SQL, data pipeline tools (like dbt), and data analysis, with the ability to design and architect scalable, future-proofed data solutions. Leadership … execute on time-sensitive, critical initiatives. Advanced Technical Skills: Full independence in your technical abilities. You are an expert in SQL, data pipeline tools (like dbt), and data analysis, with the ability to design and architect scalable, future-proofed data solutions. Leadership ...

Data Engineer London - Hybrid £65,000 - £75,000 Azure Data/SQL/Financial Services I'm currently working with a growing data and technology consultancy who are looking to bring a Data Engineer into their expanding delivery team. The business works … with a range of organisations across telecommunications, financial services, insurance and healthcare, helping clients develop modern data platforms and turn complex data into valuable business insights. Joining a client-facing consulting team, you'll have the opportunity to work across a variety of data ...

client is a geospatial and data technology company. Join the Growth Story at our client Our client operates at the heart of the UKs most sensitive and high-profile operations. Our approach is entirely mission-focused, enabling customers to see more, decide faster, and act with confidence across … complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. Our solutions are secure-by-design, built ...

Data Manager | BigQuery | Data Governance | ETL | SQL | 3-4 Month Contract | £600-£650 per day | Outside IR35 | Manchester We're working with a well known client based in Manchester looking for a Data Manager to support their data function on an initial … hands-on role focused on maintaining and improving a BigQuery environment. What you'll be doing: Owning and maintaining the BigQuery platform Managing data pipelines and resolving issues Supporting data governance and data quality initiatives Enhancing data models and warehouse structures Working ...

envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorganChase within the Asset Management Core Data & Analytics Engineering organization, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products … diverse array of challenges that span multiple technologies and applications. You will be part of a development team responsible for designing and implementing data and analytics solutions and AI ready capabilities on a federated data platform to support business initiatives. The role includes building performant, automated ...

Atom Learning and our mission is to help every child reach their potential. We combine exceptional teacher-made content with technology, data science and machine learning to make high-quality, personalised education more accessible. Our aim is to give every child access to the kind of insight, support … London, our team of over 100 people (and counting) works across 10 countries. The role We’re looking for a Senior Data Engineer to help shape the data platform behind some of our most important products. Data at Atom isn't simply a reporting ...

focuses on building and optimising data infrastructure that enables advanced marketing and customer data capabilities. You will create scalable pipelines, data models, and governance practices that support analytics, segmentation, and real-time engagement. Working closely with cross-functional teams, you will help deliver reliable … MarTech, and marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data ...

Senior Data Engineer Location: Wiltshire Contract: 2 months Pay: Up to 62.50p/h Inside IR35 (DOE) Due to the nature of the work, we require candidates who already hold active MOD DV clearance . Responsibilities: Design, build and maintain secure, scalable data solutions across … engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST API integration. Experience ...

Senior Data Engineer Location: Wiltshire Contract: 2 months Pay: Up to£62.50p/h Inside IR35 (DOE) Due to the nature of the work, we require candidates who already hold active MOD DV clearance . Responsibilities: Design, build and maintain secure, scalable data solutions across … engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST API integration. Experience ...

Senior Data Analyst BI & Data London Intermediate Full-time Description Minute Media is a global technology and content company built for the future of sports consumption. Minute Media’s proprietary technology platform enables the creation, distribution, and monetization of digital content experiences, powering Minute Media … shared globally, and trusted by millions of fans and the partners we serve. For more information, visit www.minutemedia.com. We are looking for a data-driven Data Analyst specializing in LTV (Lifetime Value) & Subscriptions to join our London team. You will support all analytics related ...

summary NHS West Yorkshire Integrated Care Board (ICB) is seeking an experienced and innovative Lead Data Engineer to provide technical leadership across our data engineering function. This is a key senior role responsible for shaping and delivering the data and analytics platforms, pipelines … from all the functions of the ICB as well as partner organisations, you will lead the development of scalable, innovative and high performing data solutions, drive automation and continuous improvement, and support the delivery of our data strategy. This is an exciting opportunity for an experienced ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...