226 to 250 of 840 Data Pipeline Jobs in England

needs of the BioPharma sector. IDBS, a Danaher company, leverages 35 years of scientific informatics expertise to help organizations design, execute and orchestrate processes, manage, contextualize and structure data and gain valuable insights throughout the product lifecycle, from R&D through manufacturing. Known for its signature IDBS E-WorkBook software, IDBS has extended its flexible, scalable solutions to … fail and fun environment which is founded on trust, empowerment and autonomy? Do you enjoy solving complex customer problems as a team? We are currently seeking a Principal Data Engineer who will be a vital cog in our team, designing and developing IDBS's data driven products. You will deliver data-rich software and … design, technical approach and implementation mechanisms adopted by the team.You will be directly involved in the development of data-centric products from ingest to egress via pipelines, data warehousing, cataloguing, integrations and other mechanisms. The role will be involved in all aspects of the software delivery lifecycle including the creation and elaboration of business requirements, functional More ❯

and we need your skills to support us on this exciting journey! Don't look back and submit your application before the opportunity passes you by Department: Analytics & Data Reporting to: Lead Data Engineer Who we are We're part of Super Group, the NYSE-listed digital gaming company behind some of the world's leading … on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision. As a Data Engineer you'll play a vital role in leveraging cutting-edge data technologies in Azure to drive innovation across our industry-leading brands. Design and develop robust … data frameworks, power real-time data pipelines, and create data services that deliver actionable insights to our global customer base. At Betway, we foster a culture of innovation and continuous improvement. Collaborate with a diverse team of experts, embrace technical challenges, and unleash your creativity. Thrive in an environment that values authenticity, responsibility, and More ❯

Business Intelligence Engineer I, Retail Business Service Data Engineering Team Retail Business Services (RBS) supports Amazon's Retail business growth worldwide through three core tasks: (a) Selection, sourcing, creating, and enriching ASINs to drive GMS growth; (b) Defect Elimination, resolving inbound supply chain defects and developing root cause fixes to improve free cash flow; and (c) supporting operational … processes for worldwide Retail teams. Our team of high-caliber software developers, applied scientists, data engineers, product managers, and Business Intelligence Engineers use rigorous machine learning and deep learning approaches to identify and fix catalog defects, ensuring a good shopping experience for our customers. We are seeking a customer-obsessed Business Intelligence Engineer who thrives in a data … Proficiency in scripting languages such as Python, Java, or R. PREFERRED QUALIFICATIONS Master's degree or advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical and correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need workplace accommodations More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … you’ll be doing: Coming in as the Senior Data Engineer, you’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform.You’ll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. You'll be collaborating closely with engineers and scientists, helping to bridge the gap between their experiments and actionable data. That might mean streaming data off DNA sequencers, integrating with LIMS systems, or improving how they trace results back to original More ❯

control for subscribers. The world's largest content providers, including Amazon, Google and Microsoft trust Bango technology to reach subscribers everywhere. Bango, where people subscribe. Role As Product Data Analyst you will play a key role in building the Bango Digital Vending Machine that makes Bango the place where people subscribe. Reporting to VP Product, you will play … ignite ideas and opportunities to drive the growth of the DVM as well as design dashboards for tracking performance. We are seeking a highly motivated and detail-oriented Data Analyst to join our team. In this role, you will be responsible for turning raw data into actionable insights that drive strategic decisions across the business. Responsibilities … Discover opportunities in data for Bango to drive the performance of the Bango Digital Vending Machine and new data product opportunities. Conduct in-depth exploratory, descriptive, and diagnostic analysis to identify patterns, trends, and anomalies. Build and maintain dashboards and reports to track key performance indicators (KPIs) Collaborate with stakeholders across product, marketing, engineering, operations, sales More ❯

have ambitious plans and are passionate about developing new products, which means we're always growing and looking for passionate people to join us. The Job As a Data Engineer, you will work in the Red Engine technology team, helping to build out the existing data and analytics platform. This role is within a small team … allowing the successful candidate to design and implement bespoke features and enhancements to our data platform using the latest technology. You will assist senior engineers in meeting with key business stakeholders to gather technical requirements and drive the design and implementation of data solutions within the Data & Analytics platform. Key Responsibilities Develop and maintain … data pipelines to orchestrate the ingestion of data from disparate source systems into a centralized data analytics platform. Design and implement data engineering solutions using T-SQL and Python in the Azure cloud environment. Work with Data Analysts to promote business logic into the analytics platform, supporting reports and dashboards. More ❯

Role Profile: Data Engineer Reporting to : Lead Data Engineer Background A rapidly growing specialist (re)insurance organisation is building out its technology and data infrastructure. This role supports the delivery of secure, scalable cloud data solutions, aligning with business and compliance needs. Key Responsibilities Design, build, and maintain cloud-native data pipelines (Azure/GCP) Implement scalable data management frameworks: observability, validation, lineage Translate business needs into effective technical prototypes and solutions Collaborate with stakeholders, data teams, and service partners Ensure data security, governance, and regulatory compliance Monitor and optimise cloud resource usage and performance Automate data lifecycle tasks to improve … speed, consistency, and reliability Support analytics teams with clean, modelled data for self-service tools Mentor peers, share documentation, and support technical best practices Integrate infrastructure and data services across cloud platforms Skills and Experience Expertise in cloud platforms: Azure : Data Factory, Synapse, Monitor, ARM GCP : BigQuery, Dataflow, Cloud Composer, Pub/Sub Strong More ❯

sold tens of millions of policies and raised over $200 million in funding. And were only just getting started. About the Role Were looking for a Head of Data Engineering to lead and grow our high-impact team of four Data Engineers. You'll play a pivotal role in shaping the future of Zegos data infrastructure- ensuring it scales with our ambitions while remaining resilient, efficient, and safeguarding user data privacy. This is a hands-on leadership role that combines technical depth, strategic vision, and team enablement. Youll partner with cross-functional leaders in Engineering, Data Science, Analytics, and Product to drive our data strategy, evolve our … to-end architecture and reliability of Zegos data platform, from ingestion and transformation to governance and observability. Guide the team in evolving our ETL/ELT pipelines, data models, and real-time processing frameworks. Lead the development of new data architectures and the introduction of new technologies. Innovation & Delivery Drive the adoption of modern More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

of millions of policies and raised over $200 million in funding. And we're only just getting started. About the Role We're looking for a Head of Data Engineering to lead and grow our high-impact team of four Data Engineers. You'll play a pivotal role in shaping the future of Zego's data infrastructure- ensuring it scales with our ambitions while remaining resilient, efficient, and safeguarding user data privacy. This is a hands-on leadership role that combines technical depth, strategic vision, and team enablement. You'll partner with cross-functional leaders in Engineering, Data Science, Analytics, and Product to drive our data strategy, evolve … end architecture and reliability of Zego's data platform, from ingestion and transformation to governance and observability. Guide the team in evolving our ETL/ELT pipelines, data models, and real-time processing frameworks. Lead the development of new data architectures and the introduction of new technologies. Innovation & Delivery Drive the adoption of modern More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools. * Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools.* Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure More ❯

eSC Cleared Data Engineer Bristol or London (Mostly working from home) Up to 745 per day (Umbrella, Inside IR35) Must hold live and transferrable Enhanced SC Security Clearance About the Role We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll … be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems. If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact. Key Responsibilities Design & Optimise Pipelines - Build and refine ETL/… ELT workflows using Apache Airflow for orchestration. Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services. Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift). Data Quality & Governance - Implement automated validation, testing, and monitoring More ❯

eSC Cleared Data Engineer Bristol or London (Mostly working from home) Up to £745 per day (Umbrella, Inside IR35) Must hold live and transferrable Enhanced SC Security Clearance About the Role We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll … be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems. If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact. Key Responsibilities Design & Optimise Pipelines - Build and refine ETL/… ELT workflows using Apache Airflow for orchestration. Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services. Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift). Data Quality & Governance - Implement automated validation, testing, and monitoring More ❯

BRAND NEW DATA ENGINEER OPPORTUNITY IN MANCHESTER - HYBRID WORKING Salary up to £55,000 p/a plus bonus & excellent benefits Work on complex, large-scale data pipelines with cutting-edge tech We're looking for strong Python, SQL, and AWS skills, plus experience in ETL processes Hybrid working - 2-3 days in the office ABOUT … SQL, Apache Spark, and AWS services such as EMR, Athena, and Lambda to deliver robust, high-performance solutions.You'll also play a key role in optimising data pipeline architecture, supporting knowledge sharing within the team, and collaborating with stakeholders to translate business requirements into technical solutions. KEY SKILLS/EXPERIENCE: Proven experience as a Data Engineer, with Python & SQL expertise Familiarity with AWS services (or equivalent cloud platforms) Experience with large-scale datasets and ETL pipeline development Knowledge of Apache Spark (Scala or Python) beneficial Understanding of agile development practices, CI/CD, and automated testing Strong problem-solving and analytical skills Positive team player with excellent communication abilities TO BE CONSIDERED More ❯

Brahma brings together Hollywood's leading creative technologists, innovators in AI and Generative AI, and thought leaders in the ethical creation of AI content. Job Description As a Data Engineer, you'll architect and maintain the pipelines that power our products and services. You'll work atthe intersection of ML, media processing, and infrastructure; owning the data … Work with other teams to identify workflow optimisation potential, design and develop automation tools, using AI-driven tools and custom model integrations and scripts. Write and maintain tests for pipeline reliability. Build and maintain observability tooling in collaboration with other engineers to track data pipeline health and system performance. Collaborate with data scientists, operators … and product teams to deliver data solutions. Debug and resolve complex data issues to ensure system performance. Optimise storage, retrieval, and caching strategies for large media assets across environments. Deploy scalable data infrastructure using cloud platforms as well as on-premise and containerization. Deepen your knowledge of machine learning workflows to support AI projects. More ❯

acquired FullCircl. This position will be within our FullCircl brand, which was established in 2021 through the merger of Artesian Solutions and DueDil. FullCircl subsequently acquired W2 Global Data Solutions to further enhance its capabilities. FullCircl connects the insight you need when it matters most. We partner with more than 500 of the UKs leading banks, insurers and … development of best practices and standards for the team. Challenge team to always break work down into smallest unit possible. Drive team to be a high-performance team. Data Plan, Design, and Implement scalable data pipelines. Develop and implement data models and algorithms to support data science and machine learning initiatives. Optimize … data storage and retrieval systems for maximum performance. Continuously monitor and improve the performance of the data solutions to meet our clients' needs. Software Plan, Design, and Implement secure scalable APIs and Backend Services. Optimize APIs and Backend Services to maximize performance. Monitor and improve the performance of APIs and Backend Services. Enterprise Level software development More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Job Title : Data Engineer - Snowflake | DBT | SQL £700/day (Umbrella) London - 3 days per week on-site 6 months (Initial Contract) Are you ready to play a key role in shaping the future of a high-impact enterprise data platform? Join a fast-growing data team working on a greenfield data warehousing project at one of the world's most respected financial institutions. This is an opportunity to work on cutting-edge data infrastructure using Snowflake, DBT, and Sigma, supporting business-critical data needs and enabling meaningful insights at scale. You'll be part of a collaborative team split across London and Ireland, contributing to … a platform that directly supports secure, scalable data sharing and real-time decision-making. What You'll Be Doing : Model and build robust, scalable data pipelines and warehouse structures using Snowflake and DBT Collaborate with stakeholders to ensure data solutions meet customer and business needs Develop and optimise data models to support More ❯

Job Title : Data Engineer - Snowflake | DBT | SQL £700/day (Umbrella) London - 3 days per week on-site 6 months (Initial Contract) Are you ready to play a key role in shaping the future of a high-impact enterprise data platform? Join a fast-growing data team working on a greenfield data warehousing project at one of the world's most respected financial institutions. This is an opportunity to work on cutting-edge data infrastructure using Snowflake, DBT, and Sigma, supporting business-critical data needs and enabling meaningful insights at scale. You'll be part of a collaborative team split across London and Ireland, contributing to … a platform that directly supports secure, scalable data sharing and real-time decision-making. What You'll Be Doing : Model and build robust, scalable data pipelines and warehouse structures using Snowflake and DBT Collaborate with stakeholders to ensure data solutions meet customer and business needs Develop and optimise data models to support More ❯

what our teams have to say about life at DeepL on LinkedIn , Instagram and our Blog . Meet the team behind this journey DeepL is seeking an experienced Data Engineering Manager with a strong background in enterprise B2B and product-focused data needs. In this role, you will lead a growing team responsible for designing, building … and maintaining scalable data products and pipelines. You will partner closely with Product Management, Engineering, and Customer Success to ensure our data systems are optimized for delivering insights and value to our enterprise B2B customers. Your responsibilities Lead, mentor, and grow a team of data engineers, fostering a culture of collaboration, innovation, and continuous … improvement Design and oversee data pipelines, data models, and ETL/ELT processes to ensure efficient, reliable data products that support product development and enterprise customer needs Collaborate with cross-functional stakeholders (Product, Sales, Marketing, Customer Success) to define data requirements, identify key metrics, and deliver strategic insights that shape product roadmaps More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum About the Role Are you an experienced Senior Data Engineer ready to step into a managerial role? We are seeking a Data Engineering Manager to lead our Leeds-based team, working mostly remotely with one day … on-site per week. In this role, you will manage the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL. You will lead and mentor a team of data engineers, drive engineering best practices, and own the data architecture strategy in an agile environment. Key Responsibilities Manage the development … of data pipelines and solutions using Databricks, Python, and SQL Oversee the design and maintenance of data models that support analytics and business intelligence needs Ensure efficient ELT/ETL processes on AWS or Azure cloud platforms Collaborate with analysts, architects, and stakeholders to deliver high-quality data products Promote best practices in testing More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there's now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes on-prem SQL Server, Excel-based claims processes, and reporting that leans heavily on SQL and VBA. Power … present, the forward-looking architecture is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data Catalogue Building modern, scalable More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯