26 to 50 of 400 Data Pipeline Jobs in England

AWS Data Engineer - VP Level Location: London (Canary Wharf)Salary: £115000 - 120000 A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities … Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies.* Implement robust data governance, quality, and security practices.* Collaborate with data scientists to deploy machine learning models.* Lead or contribute to strategic planning, risk management, and stakeholder engagement.* Drive innovation through advanced analytics and research-based problem solving. To be successful you … should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf) Salary: £(phone number removed) - (phone number removed) A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across … business units. Key Responsibilities: * Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies. * Implement robust data governance, quality, and security practices. * Collaborate with data scientists to deploy machine learning models. * Lead or contribute to strategic planning, risk management, and stakeholder engagement. * Drive innovation through advanced analytics and research-based problem solving. … To be successful you should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency More ❯

products and ship updates to customers rapidly. Could you be the next innovator to join us? What’s it all about? Insight and Intelligence drives Atom. As a Data Engineer you will be creating an efficient, sustainable, and agile data analytics platform for a data driven digital bank. You will be using a range … of database technologies and a combination of event driven techniques and batch processing methodologies. In addition you will be expanding and optimizing our cloud-based data & data pipelines as part of a cross functional team. As a Data Engineer at Atom, you will support our software engineers, data architects, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. What will your ‘typical’ day look like.... (there’s no 2 days the same in Atom): Build and maintain data ETL jobs using a range of tools & techniques Effective use of database and streaming techniques and More ❯

Principal Data Engineer - Core Systems Team Hybrid in London/Remote within UK The company Imagine a world where every small business has the power to thrive. That's the world we're building at iwoca. Small businesses aren't just statistics - they're the heartbeat of our communities, the character of our high streets, and the engine … leading fintech innovators. But we're just getting started. Our mission? To empower one million businesses with the financial tools they deserve. We combine cutting-edge technology and data science with genuine human understanding to make finance feel less like a barrier and more like a superpower. Whether it's managing cash flow or seizing unexpected opportunities, we … funds they need - often within minutes. The team You'll join the Core Systems team, who are responsible for driving innovation across the business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. More ❯

Data Engineer Location: Hammersmith - Hybrid after probation Salary: £38,000 -£45,000 Join Our Team as a Data Engineer! About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace. What … You'll Do : As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include : Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems. Data … star schema, data vault, dimensional modelling). Proficiency in Excel-based data workflows for various Agile Retail projects. Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar). Benefits: Unlimited holiday Annual Wellbeing Allowance Flexible work culture Monthly socials and events Complimentary snack bar Employer pension contribution If you More ❯

Data Engineer Location: Hammersmith - Hybrid after probation Salary: £38,000 -£45,000 Join Our Team as a Data Engineer! About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace. What … You'll Do : As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include : Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems. Data … star schema, data vault, dimensional modelling). Proficiency in Excel-based data workflows for various Agile Retail projects. Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar). Benefits: Unlimited holiday Annual Wellbeing Allowance Flexible work culture Monthly socials and events Complimentary snack bar Employer pension contribution If you More ❯

Role: Head of Data Management Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £55,000 - £70,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data Management to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

Data Manager–£36,000- £47,000 + Benefits– Liverpool, L3 The Role Are you experienced in managing clinical data and ensuring its accuracy? Do you have the technical skills to handle imaging-related datasets and streamline workflows with Python?If so, this could be the perfect opportunity for you! We are MyCardium AI , an innovative company … at the forefront of cardiac imaging and AI technology. We are now seeking a Data Manager to join our growing team in Liverpool. You will be responsible for managing the lifecycle of clinical study data, ensuring accuracy, compliance and smooth data handling processes. Working closely with project managers, imaging analysts and sponsor representatives, you … will help ensure that study data is reliable, secure and supports high-quality clinical outcomes. If this sounds like the right opportunity for you, we'd love to hear from you. Apply today and join us on our journey to transform healthcare with AI. This role is 4 days office based (Liverpool)/1 day WFH. Key Responsibilities More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Lead Data Engineer to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision … making across our insurance business. What you’ll do: Lead on data engineering projects, managing a sub- team within engineering, building out our data warehouse & pipelines Collaborate effectively across data science, analytics, product, engineering and commercial business teams Build and support esure’s data products within our industry leading platform Work with More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Senior Data Engineer to play a key role in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from … scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect for you. This is a unique opportunity to influence the data strategy and define data architecture from the outset … ll work in a collaborative, forward thinking environment where innovation is encouraged, with flexible working arrangements and opportunities for professional growth. Responsibilities Design, build, and optimise scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to More ❯

FDM is a global business and technology consultancy seeking a Senior Data Engineer to work for our client within the transport sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role based in Manchester. Our client is looking for an experienced Senior Data Engineer with a strong … background in Azure Data Services and Data Fabric to support the design, build, and optimisation of enterprise-grade data solutions. The role requires hands-on expertise in developing advanced data pipelines, architecting data lake structures, aligning governance frameworks, and enabling robust reporting capabilities. The ideal candidate will be someone who … can take end-to-end ownership of data engineering initiatives and deliver solutions aligned with enterprise data architecture as well as governance principles. Responsibilities Build complex ETL/ELT pipelines from scratch, integrating multiple data sources while implementing advanced transformations using mapping data flows Optimise performance and manage dependencies, ensuring robust monitoring More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? We're seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through … collaboration with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

Job summary Data Engineering Team supports decision-making within the Trust through the provision of a comprehensive information and analysis service by managing and optimizing the flow, storage, and accessibility of data from clinical\non-clinical systems within the Trust. The post holder plays a pivotal role in ensuring that data flows smoothly, remains … consistent, and is available for decision-making, insights and analytics. Main duties of the job The post holder will contribute to the smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure while supporting the current data platform and infrastructure. The post holder plays a pivotal role in ensuring … that data flows smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will also be responsible for maintaining the current data warehouse solutions by ensuring operational efficiency, routine maintenance, issue resolution, monitoring and reporting About us St George's University Hospitals NHS Foundation Trust is one of the country's More ❯

Role: Data Team Lead Location: Milton Keynes (Hybrid 3 Days On-site Weekly) Salary: £55,000 - £65,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Data Team Lead to join a leading organisations UK IT function. This role will see you managing and developing a high-performing data team, while ensuring the delivery of effective and scalable data solutions. Youll play a key role in setting direction, building capability, and aligning data initiatives with business priorities. The role requires strong leadership, stakeholder management, and the ability to oversee data programmes from strategy through to delivery. Key Responsibilities: Lead, mentor, and … data leadership roles within complex organisations. Proven track record of leading and developing technical teams. Good understanding of data warehousing, ETL, and data pipeline solutions. Experience with data governance, compliance, and security frameworks. Strong stakeholder engagement, vendor management, and planning skills. Experience managing budgets and resources effectively. Excellent communication, leadership, and More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. • Troubleshoot and optimize NiFi More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. • Troubleshoot and optimize NiFi More ❯

Qualifications Bachelor's or Master's degree in Computer Science, Mathematics or similar field (PhDs will be given preference) 7+ years of experience working with massive data Strong knowledge of public cloud (AWS) Experience with data acquisition (API calls/FTP downloads), ETL, transformation/normalization Proficiency in ETL process is mandatory Experienced building components for … enterprise central data platforms (data warehouses, Operational Data Stores, Access layers with APIs, file extracts, user queries) Hands-on experience with SQL, Python, Spark, Kafka Excellent communication skills, including a good working proficiency in verbal and written English About this Job Scopeworker Business Intelligence real time processes enterprise customer data. We develop and maintain … design, build and automate, scalable solutions, massive data sets and bring software engineering experience to the complex process of data processing and data pipeline development. You will lead big data challenges in an agile way and build data models to deliver insightful analytics while ensuring the highest standard of More ❯

Overview Role: Data Team Lead Location: Milton Keynes (Hybrid - 3 Days On-site Weekly) Salary: £55,000 - £65,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Data Team Lead to join a leading organisation's UK IT function. This role will see you managing and developing a high-performing data team, while ensuring the delivery of effective and scalable data solutions. You'll play a key role in setting direction, building capability, and aligning data initiatives with business priorities. The role requires strong leadership, stakeholder management, and the ability to oversee data programmes from strategy through to delivery. Key Responsibilities Lead, mentor … data leadership roles within complex organisations. Proven track record of leading and developing technical teams. Good understanding of data warehousing, ETL, and data pipeline solutions. Experience with data governance, compliance, and security frameworks. Strong stakeholder engagement, vendor management, and planning skills. Experience managing budgets and resources effectively. Excellent communication, leadership, and More ❯

We are searching for an experienced GIS Data Specialist/Geospatial Data Specialist for an extremely exciting technology focused business, someone who has extensive experience of working with and managing Geospatial Data and Geodata . This role is offered on a hybrid or remote working basis. You MUST however be able to attend team … will need to live within a commutable distance of one of the above offices, either Reading or Exeter. We are searching for someone who is very passionate about data, automation, and driving change through smart processes. You will be leading the way with regards to transforming how data is managed, processed and delivered across our client … s business. You will take ownership of complex ETL workflows, you will be developing automation tools, and you will ensure data is accurate, delivered in a timely fashion whilst making sure it is fit for purpose. Key Duties: - Lead and maintain ETL processes, improving automation and data quality. Use tools like Power BI/Excel or More ❯

about new technology experimentation? Are you looking for a new challenge that stretches your talents? Then this could be the role for you. We are looking for a Data Engineer that likes solving complex problems across a full spectrum of technologies. You will help ensure our technological infrastructure operates seamlessly in support of our business objectives. You will … help us to create and develop data as we move forward into our new Snowflake environment to ensure we deliver accurate and timely information to the rest of the business. Duties Include: Develop and implement data pipelines that extract, transform and load data using into our Snowflake environment for use with reporting tools such … as Power BI and SSRS.Work on ingesting, storing, processing and analysing large data setsAssist in the creation and maintenance of a scalable and high-performance data warehouse.Translate complex technical and functional requirements into detailed designsInvestigate and analyse alternative solutions to data storing, processing etc. to ensure the most streamlined approaches are implemented. Responsibilities Include More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst … installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations … such as Ansible. Knowledge of data requirements for AI and machine learning workloads. Familiarity with Data Federation and Cached Services Familiarity with Data pipeline (Series of steps that move and transform data from one source to another for analyses and storage) Experience with Dell Data Lakehouse administration. Experience in More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst … installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations … such as Ansible. Knowledge of data requirements for AI and machine learning workloads. Familiarity with Data Federation and Cached Services Familiarity with Data pipeline (Series of steps that move and transform data from one source to another for analyses and storage) Experience with Dell Data Lakehouse administration. Experience in More ❯

Snowflake Data Engineer Up to £60,000 per annum 1 day a fortnight in Birmingham. VIQU have partnered with a consultancy looking to expand their data teams, so are seeking a Data Engineer with prior experience using the Snowflake platform. You will play a key role in building and maintaining data environments … with a particular focus on Snowflake and Azure. Duties of the Snowflake Data Engineer: Develop data pipelines into and in Snowflake. Manipulate data using SQL and Python. Maintain data security throughout. Contribute to the development of a scalable data warehouse. Contribute to data governance and quality projects. Strong … Engineer: Hands on experience with Python development. SQL optimisation skills. Previously worked on greenfield projects, helping to build data platforms. Experience with large scale data pipeline creation/optimisation. Previously used Snowflake tool like Snowpark, Snow pipe, and SnowSQL. Experience of working with cloud services (Azure, AWS, GCP). Previous work in a consultancy would More ❯