26 to 50 of 991 Data Pipeline Jobs in England

Job Title: Lead Data Engineer (AWS) Business Unit/Segment: Data Management/Analytics Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent - Salary -£80k to £100k Summary of the Role: A leading global data and AI company is looking for a Lead … with emerging data technologies and recommend improvements to data engineering practices. Develop and enforce best practices for data pipeline orchestration, testing, and deployment. Provide mentorship, feedback, and leadership across project and operational initiatives. Collaborate with cross-functional teams to design a consistent and … CD practices and code versioning systems. Key Skills and Attributes: Cloud & Data Engineering: Deep expertise in AWS services and data pipeline development. Data Modelling & Architecture: Strong background in data warehousing and modern modelling frameworks. Leadership: Ability to lead teams, provide feedback More ❯

Head of Data Engineering/Hybrid working Leeds Our Client entering an exciting phase of growth and succession, which has in turn lead to an investment in the expansion of the Data Team. As Hands-On Head of Data Engineering, you will shape and … develop the Data Engineering capability, building and overseeing the team, leading the design and management of enterprise grade data infrastructure, data architecture, robust data pipelines, and data solutions. We are seeking a visionary and experienced Head of Data Engineering to join a growing team. This is a brand-new role designed for someone who is passionate about driving data strategy, building data infrastructure, and ensuring seamless integration of new data sets. You'll have the unique opportunity to take ownership More ❯

As a Tech Manager - Data Engineer with AWS experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven … initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such … as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance. Data Quality: Implement data More ❯

We are currently recruiting for an experienced Data Architect to work for Lincolnshire Police at their headquarters in Nettleham. This role will be hybrid working Monday to Friday 37 hours a week. This is a temporary role until October 2026 PLEASE NOTE DUE TO POLICE VETTING CRITERIA YOU … YEARS AT THE TIME OF APPLICATION. UNFORTUNATELY ANYTHING LESS THAN THIS WILL NOT BE CONSIDERED. JOB PURPOSE AND SCOPE The Force's Data Architect is accountable for the design and build of the Force's overall data architecture, taking full responsibility for its implementation and its … ability to serve the data required to produce information, intelligence and insights products for the Force and its partners. CORE WORK AREAS Leadership Subject matter expert on data architecture for the Force and, as required provides expertise to partner organisations, and representing the Force's interest More ❯

Technical Data Specialist Contract onsite in London Day rate: £650 - £858 per day inside IR35 We're currently seeking an accomplished and highly ambitious Technical Data Specialist to work with our exceptional client, a world class brand in a secure environment to drive major business transformation … process and technical change across this complex organisation. This contract roles will require you to conduct security clearance prior to assignment. The Technical Data Specialist role is conducted in an environment that is far from ordinary, therefore, we're not looking for ordinary. The Technical Data Specialists set the vision for the organisation's use of data (through data design) to ensure that data is managed properly and meets the organisation's needs. You will work with key internal and external partners to deliver data architecture More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and communicating … enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience or an … data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Ability to implement data processing and transformation pipelines in Databricks Experience in leading data platform development teams Knowledge of More ❯

Job Title: Data Migration Analyst Location: Manchester, UK Role Overview The Data Migration Analyst will play a pivotal role in a large-scale IT transformation programme, supporting the implementation of a robust data migration strategy. This position involves extensive collaboration with stakeholders across the … business and technical teams to ensure data accessibility, quality, and integrity during system transitions. The analyst will contribute to the broader data strategy, data governance, and support the development of processes, systems, and standards to enhance data quality and management across the … organisation. Key Responsibilities Analyse source systems to map data structures to target systems. Develop technical specifications for ETL processes to support migration. Collaborate with Data Engineers to develop data pipelines. Design and implement data validation rules and tests. Coordinate with Data More ❯

Title: Head of Data Engineering Industry: FinTech Location: London Salary: Up to £140,000 Seeking an experienced Head of Data Engineering to lead data strategy, architecture, and team management in a fast-paced fintech environment. This role involves designing scalable Apache Spark , Databricks , and … Snowflake solutions on Azure , optimizing ETL/ELT pipelines , ensuring data security and compliance, and driving innovation in big data processing. The ideal candidate has 8+ years of data engineering experience , strong leadership skills, and deep expertise in cloud-based data infrastructure. … Stakeholders: Work closely with product, analytics, and engineering teams to deliver data-driven insights and support business growth. ETL & Data Pipeline Management: Design, implement, and optimize ETL/ELT workflows using modern cloud technologies. Performance Optimization: Drive continuous improvement in data infrastructure performance More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust … scalable data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology … first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

who think big, act fearlessly, and create an inclusive environment that drives positive impact to join our team. What you'll do The Data Led Sales team is a central function within the Product Management division. We build software tools to help the sales teams in the business … organizations systems and processes. The team has a variety of skills and experience in technical domains such as Software development, Automation, Data-pipeline-modelling, IT project management, Data visualisation. We also pride ourselves on our close integration with non-technical/non-data … full back-end data architecture on behalf of the Data Led Sales team • Create and maintain optimal data pipeline architectures • Design and implement data quality monitoring and testing frameworks • Work with customers to define and apply data modeling guidelines More ❯

fixed term contract) Location : Peterborough (Hybrid - One day per week in the office) This role is perfect for someone with a passion for data storytelling, who excels at translating complex data into impactful insights that drive strategic decisions. As a Business Intelligence Developer, you will play … a critical role in shaping data-driven narratives and enabling our stakeholders to see the actionable stories behind the numbers. Join the team at AB Agri to contribute to the innovation and evolution of agriculture and food production practices. Key Responsibilities: Data Storytelling : Craft and deliver … visualisation tools (e.g., Tableau) and analytics software is an advantage. Data Operations : Understanding of data warehousing and data pipeline development for seamless data access/movement . Location Hybrid, a mix of office and homeworking.This role will be based at our More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Data Engineer (DV Cleared) 6 Month Contract (Inside IR35) Location: London Rate: £700 - £800 per day Skills: DV Clearance ESSENTIAL - Must already hold DV clearance, Cloud technology experience We are looking to recruit a DV Cleared Data Engineer to join a defence organisation based in Central … office based in Central London. Key Responsibilities: Technical Leadership: Lead and guide the technical direction of data engineering projects. Data Pipeline Development: Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and SQL Server. Data … teams to ensure seamless integration and effective communication. Essential Skills and Experience: Proven experience in data engineering roles, including data pipeline development and data integration. Experience working with diverse data sets and data sources. Excellent communication and collaboration skills. More ❯

Role: Data Lead Location: Knutsford Contract Role Job Description: AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge Language & Scripting: Python and Spark ETL: DBT Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata Responsibilities: Serve as the primary … point of contact for all AWS related data initiatives and projects. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform. Gather and analyze business requirements to develop scalable and efficient data … data lakes. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS. Strong leadership and project management skills with the ability to effectively lead a team More ❯

and we're still growing. JOB PURPOSE The Senior Analytics Engineer leads the development and optimisation of our advanced analytics ecosystem, ensuring that data is not only fit for purpose but also robustly designed for scalability, reusability, and actionable insights. This role bridges technical expertise and strategic vision … making. Key responsibilities include designing scalable data architectures in conjunction with Domain and Product Data Architects, overseeing data pipeline development, and maintaining data integrity. This role involves collaboration with Domain and Business Data Stewards to align data … is demonstrated through rigorous validation and monitoring processes throughout the data pipeline. Strong problem-solving abilities are essential for diagnosing and resolving pipeline issues while optimising performance for scalability. Knowledge of analytics platforms, such as Tableau and ThoughtSpot, ensures compatibility with data visualisation and reporting More ❯

We are seeking a Data Support Engineer (Level 3) to provide expert technical support and drive the performance and reliability of our data infrastructure. In this role, you will serve as the go-to expert for complex data issues, collaborate with data engineers, analysts, and IT teams to optimize data pipelines, and resolve integration and performance challenges. You will play a key role in ensuring data quality and supporting data-driven decision-making while leveraging your expertise in cloud and on-premises technologies. A … integration and processing issues, troubleshoot performance bottlenecks, and ensure high availability of critical data services with minimal downtime. Data Pipeline Management & Optimization : Oversee and optimize data pipelines (ETL/ELT) across on-premise and cloud environments, ensuring seamless data flow More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

of technology and build a more sustainable, more inclusive world. Your Role We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer (SME) to join our dynamic Payment Gateway team in Fleet UK for a Full time Hybrid role. As an SME you will serve … expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in … cloud data engineering providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data More ❯

Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with cutting-edge technology? If so, we have an exciting new role for … you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance data pipelines and REST APIs that drive AI More ❯

in August 2023, followed by the launch of its direct-to-customer retail banking proposition in December 2024. We are seeking a skilled Data Engineer with a strong focus on modern data warehousing , data product development , and data democratization . You will … play a key role in designing, building, and optimizing scalable data pipelines and clean data layers that empower teams across the organization to make informed, data-driven decisions. This is a hands-on role that blends engineering excellence with product thinking, metadata management, and … a passion for enabling self-service analytics and data literacy across the business. Key Responsibilities: Build & Maintain Scalable Data Warehousing Solutions: Design, build, and maintain robust ELT pipelines and transformation workflows Model and maintain curated data layers to support reporting, analytics, and decision-making More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

up our clients' potential, thereby fulfilling our own. Take it seriously. Make it fun. Know it matters. As we develop an enterprise-wide data and digital strategy that moves us toward greater focus on the use of data and data-driven insights, we are … seeking a Data & Digital Solutions Architect. The Data & Digital Solutions Architect is a hands-on, execution focused role helping translate the data and digital strategy to architecture and to execution. In this role you will have an understanding of our data and … monitoring Container and Container Orchestration UX and UI Azure cloud platform environment Data access control and security Integration and Data Pipeline/ETL/ELT technologies DevOps and CI/CD AXA XL is committed to equal employment opportunity and will consider applicants regardless of More ❯