151 to 175 of 541 Data Pipeline Jobs in England

what our teams have to say about life at DeepL on LinkedIn , Instagram and our Blog . Meet the team behind this journey DeepL is seeking an experienced Data Engineering Manager with a strong background in enterprise B2B and product-focused data needs. In this role, you will lead a growing team responsible for designing, building … and maintaining scalable data products and pipelines. You will partner closely with Product Management, Engineering, and Customer Success to ensure our data systems are optimized for delivering insights and value to our enterprise B2B customers. Your responsibilities Lead, mentor, and grow a team of data engineers, fostering a culture of collaboration, innovation, and continuous … improvement Design and oversee data pipelines, data models, and ETL/ELT processes to ensure efficient, reliable data products that support product development and enterprise customer needs Collaborate with cross-functional stakeholders (Product, Sales, Marketing, Customer Success) to define data requirements, identify key metrics, and deliver strategic insights that shape product roadmaps More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum About the Role Are you an experienced Senior Data Engineer ready to step into a managerial role? We are seeking a Data Engineering Manager to lead our Leeds-based team, working mostly remotely with one day … on-site per week. In this role, you will manage the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL. You will lead and mentor a team of data engineers, drive engineering best practices, and own the data architecture strategy in an agile environment. Key Responsibilities Manage the development … of data pipelines and solutions using Databricks, Python, and SQL Oversee the design and maintenance of data models that support analytics and business intelligence needs Ensure efficient ELT/ETL processes on AWS or Azure cloud platforms Collaborate with analysts, architects, and stakeholders to deliver high-quality data products Promote best practices in testing More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech, or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Senior Data/Power BI Engineer West Midlands/HybridPermanent - Full Time Are you passionate about turning data into powerful insights? TXP is looking for a Senior Data/Power BI Engineer to help our clients unlock the full potential of their data. In … this role, you'll: Design and deploy Power BI models and dashboards Collaborate with stakeholders to shape intelligent analytics solutions Support data warehousing and data pipeline development Drive analytics maturity and best practices across client organisations Mentor junior team members and lead by example What you'll bring: Expertise in Power BI, DAX, and SQL … Experience with Microsoft Fabric or similar platforms Strong understanding of manufacturing processes and ERP systems A passion for data storytelling and business impact Join a consultancy that values innovation, diversity, and continuous learning. Be part of a team that's shaping the future of data-driven decision-making. Apply now and help us build smarter, data More ❯

Team: The Academic Information Systems ( AI S) DataOps team is a shared technology group responsible for building, administering, governing, and setting standards for a growing number of strategic data platforms and services. Our capabilities enable data to be extracted, centralized, transformed, transmitted, and analyzed across a range of products in the AIS space. Due to our … footprint across the enterprise, we are relied upon to ensure our systems are trusted, reliable and available.The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Astronomer/Airflow, Kubernetes , DBT, Tableau, Sisense , Collibra, and Kafka/Debezium . Our mission is to enable frictionless experiences for our AIS colleagues and customers so … that they can openly and securely consume trustworthy data, enhancing everyday interactions and decisions. About the Role: As a S enior Data Engineer I , you will be responsible for helping to creat e a data infrastructure that is secure, scalable, well-connected, thoughtfully architected while also building a deep domain knowledge of our business More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process More ❯

DATABRICKS ENGINEER 6-MONTH CONTRACT £450-£550 PER DAY (OUTSIDE IR35) This role is a great opportunity for a skilled Databricks Engineer to join a data-driven financial services firm undergoing a major transformation of their data infrastructure. You'll be a key player in modernising their data platform with Databricks and Azure, while … supporting scalable data pipelines and machine learning workflows. THE COMPANY This business is investing heavily in data as it digitises operations across its risk, product, and customer intelligence teams. They're building a modern Lakehouse architecture using Databricks, Delta Lake, and Azure Data Lake. You'll be part of a collaborative, forward-thinking team … with a focus on best practices, automation, and end-to-end data enablement. THE ROLE You'll work closely with Data Engineers, Scientists, and Architects to design, build, and optimise core data pipelines on Databricks. Your focus will be on enabling analytics and machine learning at scale, using best-in-class tools across the More ❯

sector-leading financial services clients! They are currently looking for a skilled ELK Engineer to join their team for a six-month contract. Job Responsibilities/Objectives Integrate data science models and algorithms into existing applications to enhance decision-making processes and provide data-driven insights. Collaborate with data scientists to deploy, monitor, and … maintain machine-learning models in production environments. Develop data pipelines and extract, transform and load (ETL) processes to support data integration and analysis. Experience with data science integration, machine-learning models, and data-processing frameworks is essential. Collaborate with cross-functional teams to design, implement, and maintain CI/CD pipelines for … flow within distributed systems. Experience integrating ELK with packet capture/analysis tools to enhance observability of Real Time systems. Hands-on expertise in data pipeline creation, ingestion strategies, and performance tuning of Logstash and Beats for scalable telemetry. Knowledge of Corvil and/or Pico tools is highly beneficial but not essential, particularly for More ❯

sector-leading financial services clients! They are currently looking for a skilled ELK Engineer to join their team for a six-month contract. Job Responsibilities/Objectives Integrate data science models and algorithms into existing applications to enhance decision-making processes and provide data-driven insights. Collaborate with data scientists to deploy, monitor, and … maintain machine-learning models in production environments. Develop data pipelines and extract, transform and load (ETL) processes to support data integration and analysis. Experience with data science integration, machine-learning models, and data-processing frameworks is essential. Collaborate with cross-functional teams to design, implement, and maintain CI/CD pipelines for … flow within distributed systems. Experience integrating ELK with packet capture/analysis tools to enhance observability of real-time systems. Hands-on expertise in data pipeline creation, ingestion strategies, and performance tuning of Logstash and Beats for scalable telemetry. Knowledge of Corvil and/or Pico tools is highly beneficial but not essential, particularly for More ❯

Director for Technology for Group and Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Groups technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology strategies, focusing on scalability, security … eFront, Yardi, Viewpoint, Fenergo, and Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to the transformation of legacy systems … relevant to enhance scalability and performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztecs ecosystem. Oversee the development of data pipelines, master data management (MDM), and More ❯

you would like to help us prevent crime and protect the world's biggest online businesses. The Team You will be joining the Detection team, a team of data scientists and machine learning engineers. The Detection team is responsible for keeping fraud rates low - and clients happy - by continuously training and deploying machine learning models. We aim to … free as code deployments. Google's Best Practices for ML Engineering is our bible. Our models are trained to spot multiple types of fraud, using a variety of data sources and techniques in real time. The prediction pipelines are under strict SLAs; every prediction must be returned in under 300ms. When models are not performing as expected, it … Rust). Experience with deep learning frameworks like PyTorch or TensorFlow. Experience with large-scale data processing engines like Spark and Dataproc. Familiarity with data pipeline tools like dbt. Benefits Flexible Working Hours & Remote-First Environment - Work when and where you're most productive, with flexibility and support. Comprehensive BUPA Health Insurance - Stay covered with More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You'll be a trusted technical advisor, collaborating More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You’ll be a trusted technical advisor, collaborating More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You'll be a trusted technical advisor, collaborating More ❯

US$121 billion on behalf of major pension funds, endowments, foundations, governments and other investors based in the U.S. and abroad. Position Overview: We're looking for a Data Implementation Engineer to help drive our data transformation efforts. This role is crucial in reimagining and rebuilding our data platform to ensure we stay ahead … in a rapidly evolving landscape. You'll be hands-on, using the latest tools like Apache Arrow, Polars, and Dagster to craft a data architecture that aligns with our innovative investment strategies. In this position, you'll be deeply involved in building and optimizing data pipelines that are reliable, scalable, and fast. Your work will directly … the Boston office 3 days a week. What You'll Do: System Deep Dive: Quickly understand our current data systems, identifying strengths, weaknesses, and opportunities for improvement. Pipeline Development: Use the latest tools and foundations from our Data Platform Engineering group to develop new data pipelines that integrate with existing systems. System Transition More ❯

/12/2025 with intent to extend. Rate: from £26.44 per hour Hours: Normal working hours (Hybrid, 3 days per week office based) Overview: Looking for a data engineer/software engineer that would support data onboarding and filtering effort in a project on LLM agents for research. The engineer will onboard data … The goal is to proactively mitigate potential risks associated with these datasets. Role Duties: Preprocessing: converting original datasets into a format that can be consumed by filtering pipelines.Filtering: Data cleaning, improvement and running filtering using client pipelines.Post-processing: consuming filtering results to filter videos/images in the original datasets, repackaging, and re-ingestion.Technical skills: Experience building and … maintaining data pipelines, knowledge of data storage solutions;Data Management: Data preprocessing and cleaning, transformation and formatting, data quality control and validationCommunication - effective communication skills to collaborate with stakeholders and team membersSoftware engineering skills: Python, data pipelines. Skills & Experience: Top 3 Must – have hard skills: Data More ❯