251 to 275 of 3,491 Data Pipeline Jobs in England

Senior Data Engineer - Greater Manchester An exciting opportunity has arisen for a Senior Data Engineer to join my client’s dynamic and growing data team. In this role, you will work across the full data lifecycle—streaming, enrichment, and curation—within a cloud-based environment. You will be responsible for ensuring data quality, integrating key data sets, and supporting the insights and data science teams. As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access to advanced training in ML Ops. Additionally, you will play a key role in mentoring and developing junior data engineers. Key Responsibilities: Automate and maintain data pipelines within a cloud-based environment (AWS/GCP/Azure). Source and verify data from multiple sources, ensuring it is ready for ingestion. Gain experience in data infrastructure and contribute to the development of new cloud-based methodologies. Analyse large datasets using Python More ❯

Social network you want to login/join with: BI & Data Engineering Lead, London (Hammersmith) Client: Delaney & Bourton Location: London (Hammersmith), United Kingdom Job Category: Other EU work permit required: Yes Job Views: 2 Posted: 10.06.2025 Expiry Date: 25.07.2025 Job Description: Role: BI & Data Engineering Lead Location: Hybrid (2 days in the office, Hammersmith, London) Organisation … A B2B organisation with significant untapped data and a Fortune 500 client base, positioned for growth. Role: This role offers variety and challenge, covering all aspects of BI & Data Engineering from strategy to implementation. It involves working closely with the organization to extract value from complex, unstructured data. This is a player/coach role, managing … a small team while actively participating in architecture, data pipelines, data warehouses, and transformation logic. The role also involves delivering BI reporting solutions (Power BI). The role is crucial in enabling data-driven decision-making, creating significant business value, and shaping the future of BI & Data Engineering leadership. The current tech More ❯

Senior Data Engineer - Banking, Machine Learning sought by leading investment bank based in the city of London. **Inside IR35 - 3 days a week on site** Job Overview We are seeking an experienced Data Engineer to design, build, and optimize our complex data pipelines and big data infrastructure. The ideal candidate will have … deep expertise in architecting scalable data solutions, integrating machine learning workflows, and optimizing data processing systems. This role requires both technical excellence and the ability to influence architectural decisions that align with business objectives. Key Responsibilities Design and implement robust, scalable data pipelines for processing large volumes of structured and unstructured data Architect end-to-end data solutions that support machine learning model training and deployment Develop and maintain data infrastructure that ensures data quality, reliability, and accessibility Optimize existing data workflows for performance, cost-efficiency, and maintainability Contribute to strategic architectural decisions and technical roadmaps Implement data governance and More ❯

help the world’s leading organizations unlock the value of technology and build a more sustainable, inclusive world. Your Role: We are seeking a highly skilled and motivated Data Engineer with strong experience in Python programming, Microsoft Azure cloud services, and a solid background in the banking and financial domain. The ideal candidate will be responsible for designing … building, and maintaining scalable data pipelines and solutions that support critical business operations and analytics. Design, develop, and maintain robust and scalable data pipelines using Python and Azure Data Services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks). Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions. Implement data ingestion, transformation, and storage strategies for structured and unstructured data. Ensure data quality, integrity, and security across all data platforms. Optimize data workflows for performance and cost-efficiency in the Azure environment. Work with large-scale datasets from banking More ❯

Job Description Description: We are actively seeking a Data Engineer responsible for designing, building, and maintaining infrastructure that supports data storage, processing, and retrieval. The role involves working with large data sets and developing data pipelines to transfer data from source systems to data warehouses, data lakes, and other storage and processing systems. The Data Engineer will collaborate with stakeholders to address data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the KR data architecture and data-driven solutions. Note: Due to federal security clearance requirements … time employment after the contract. Benefits include Medical, Dental, Vision, 401k with company matching, and life insurance. Rate: $80 - $86/hr W2 Responsibilities: Develop, optimize, and maintain data ingestion flows using Apache Kafka, Apache Nifi, and MySQL/PostgreSQL. Develop within AWS cloud services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena. Coordinate with data More ❯

Get AI-powered advice on this job and more exclusive features. Role/Job Title: Senior GCP Data Engineer Work Location: London The Role An excellent opportunity has emerged for a Senior GCP Data Engineer to join the Cyber Security domain of an investment bank. In this role, you will be responsible for providing top-tier … data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key Responsibilities API Development: Design, develop, and maintain robust and scalable backend systems and APIs Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load into Google Cloud environments Data Transformation … Implement data transformation processes including cleansing, normalization, and aggregation to ensure data quality and consistency Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval on Google Cloud platforms Data Integration: Integrate data from multiple sources (on-prem and cloud More ❯

Direct message the job poster from twentyAI twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role … diverse group of engineers and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics … and machine learning efforts across the business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and More ❯

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Glocomms AVP Recruitment Consultant - Hiring Data Science, Machine Learning, Data Engineering & Data Analytics experts across the EU Job title: Senior Data Solutions Architect Type: Contract Duration: 12 months Location: London, UK (Hybrid) Daily rate: DOE … Description: We're working with a large, established client in the Banking sector who are looking to welcome Senior Data Solutions Architects onto the team as they undergo a large transformation program. Key responsibilities: Take ownership of designing solution architectures, crafting strategic roadmaps for evolution, and overseeing the successful implementation of technology solutions that align with business objectives … designs , ensuring they meet functional requirements and align with long-term technology roadmaps . Oversee architecture management , driving continuous refinement and improvement of systems. Work with cutting-edge data technology stacks and cloud infrastructure, balancing foundational data solutions with emerging AI and ML capabilities . Collaborate with delivery teams and engineers to define project scopes and More ❯

Social network you want to login/join with: As our new Senior Data and Analytics Engineer , you'll work as part of a multi-disciplinary, agile, data delivery team focused on the delivery of innovative, robust, and efficient data solutions to complex business problems. You'll work alongside a team of passionate data professionals including other data and analytics engineers, test engineers, data scientists and data visualisation specialists. As our Senior Data and Analytics Engineer , you’ll have access to a wide range of benefits including: Remote working Annual pay reviews Access to a generous discretionary profit share scheme At Jet2.com and Jet2holidays … creating unforgettable package holidays and flights. We couldn’t do it without our wonderful people. What you’ll be doing: You’ll be responsible for delivery of complex data and analytics solutions including the ingest of data from a wide variety of data sources into our analytics platforms (typically cloud-based but some work More ❯

Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I'm working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to hire a talented Data Engineer .This is a fantastic opportunity to join a forward … thinking company where you'll play a key role in developing and optimising their data platform. The Role: As a Data Engineer , you'll be working closely with the front office to understand data needs and help shape the company's data capabilities.You'll be responsible for building and optimising data pipelines, automating data processes, and ensuring high data quality and governance. Key Responsibilities: Collaborate with the front office to scope and understand data requirements. Build and maintain the data platform using in-house and third-party tools. Automate data processes to improve efficiency and scalability. Develop robust data More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform … data from sources such as Social, Reviews, Search, and broader marketing and sales data. These reveal fresh insights for our clients; helping them to build better products and brands, to deliver effective marketing to consumers. Our software, machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends … themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer data to understand each client's consumer base, building personalisation and other machine learning models to better More ❯

Management. Own business-wide initiatives including the implementation of Salesforce, to support initially the delivery of CRM capability across the UK Business. Therefore, we are looking for a Data Engineer to join a growing team to support Data Migration activity, ensuring seamless integration and data flow between new and legacy systems. Requirements: Must Have … 3+ years of experience) Strong experience with data integration and migration, particularly with Salesforce. Experience with programming languages such as Python, C#, or PowerShell. Strong experience in writing text cleansing routines in Databricks Python/SQL and the ability to measure data quality/execute data validation tests, ideally in Databricks. Proficiency in Azure … data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Databricks. Proficiency in building pipelines and utilising python/SQL within Databricks. Experience with DevOps practices, including CI/CD, unit testing, and version control. Excellent written and verbal communication skills. A minimum of 2 years of experience in a data More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced Lead GCP Data Architect to join their team. They are a leader within the consulting space, experiencing growth and looking to enhance their team. Backed by a major multi-asset firm, they aim to strengthen their financial position and are adopting cutting … in enterprise-grade data modeling with tools like ERwin, PowerDesigner, or ER/Studio, ensuring models are optimized for performance, scalability, and maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting real-time and batch processing. Governance & Data … Leadership & Talent Development: Mentor global, cross-functional teams of data professionals, fostering innovation, excellence, and continuous learning. The right candidate will have: Extensive coding, data pipeline building, digital transformation, and ingestion experience within GCP. Understanding of presales activities, workshops, budgets, proposals, etc. Strong knowledge of data modeling (physical, logical, conceptual). Understanding of More ❯

Join to apply for the Senior Data Engineer role at IBM . 2 days ago Be among the first 25 applicants. Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), delivering deep technical and industry expertise to clients worldwide. Our centres provide local skills and technical expertise to foster … and parental leave schemes. Traditional benefits like holiday allowance, discounts, Employee Assistance Program, and a pension plan with company contributions. Your Role and Responsibilities We seek a Senior Data Engineer to focus on public sector accounts, designing and managing scalable data pipelines, integrating heterogeneous systems, and implementing data models. You will collaborate with cross … functional teams to ensure data integrity, security, and compliance with public sector regulations. Preferred Education Bachelor's Degree in Computer Science, Information Systems, or related field. Responsibilities Design, build, and maintain data pipelines and ETL processes. Collaborate with data scientists and engineers on complex data systems. Ensure data quality and More ❯

in August 2023, followed by the launch of its direct-to-customer retail banking proposition in December 2024. For more information, visit lhv.com. We are seeking a skilled Data Engineer with a strong focus on modern data warehousing , data product development , and data democratization . You will play a key role in … designing, building, and optimizing scalable data pipelines and clean data layers that empower teams across the organization to make informed, data-driven decisions. This is a hands-on role that blends engineering excellence with product thinking, metadata management, and a passion for enabling self-service analytics and data literacy across the business. … Key Responsibilities: Build & Maintain Scalable Data Warehousing Solutions: Design, build, and maintain robust ELT pipelines and transformation workflows Model and maintain curated data layers to support reporting, analytics, and decision-making Ensure high availability, scalability, and performance of data warehouse systems (cloud-based, e.g., Redshift) Develop & Manage Data Products: Collaborate with business More ❯

with curiosity, openness and a collaborative spirit driven by the passion of enhancing everyday experiences. How will you make an impact in this role? We are seeking a Data Engineer to help drive the design and development of a robust data infrastructure, through building databases and pipelines that will support our planning processes, Machine Learning use … cases and leadership reporting. As a Data Engineer, you will be part of a team responsible for the development and execution of world-class advanced analytics projects, leveraging automation and machine learning to enhance and streamline business processes. You will build scalable solutions that benefit our internal customers – from technical design, prototyping, testing, deploying and monitoring production data. … The ideal candidate will have the skills to collaborate in a cross-functional environment – planning, operations, finance, forecasting, data science – to test new ideas and challenge conventions. Responsibilities: Support GCCM colleagues migrating production-grade data and pipelines to the Google Cloud Platform Help define and apply data governance requirements for accurate and consistent storing More ❯

Social network you want to login/join with: Data Infrastructure Engineer, warrington, cheshire col-narrow-left Client: The Citation Group Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Job Title: Senior Data Engineer Location: Hybrid – 1 day per fortnight … in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to work in the data engineering team, to expand and maintain the … data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement processes on our modern tech More ❯

JOB TITLE: Senior Solution Architect (Data) SALARY : £90,440 - £106,400 LOCATION(S): Bristol HOURS: Full-time - 35 hours per week WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or 40% of our time, at our Bristol office. About this opportunity: We're on an exciting journey to transform our … workplaces, and colleagues to make our Group a great place for everyone. Including you! As the UK's largest Digital, Retail and Commercial bank we realise that our data is a significant business differentiator and plays a pivotal role in achieving our sustainable growth ambitions. This role is in Transaction Classification Services lab, where we're on a … mission to provide a world class transaction data enrichment capability to power commercialisation. We're delivering one of the UKs richest transaction datasets, revolutionising financial insights and market intelligence for LBG and our customers. It's a critical role to us, as you'll drive the evolution of data analytics solutions and AI capabilities, by developing More ❯

savings market via deposit aggregators in August 2023, followed by the launch of its direct-to-customer retail banking proposition in December 2024. We are seeking a skilled Data Engineer with a strong focus on modern data warehousing , data product development , and data democratization . You will play a key role in … designing, building, and optimizing scalable data pipelines and clean data layers that empower teams across the organization to make informed, data-driven decisions. This is a hands-on role that blends engineering excellence with product thinking, metadata management, and a passion for enabling self-service analytics and data literacy across the business. … Key Responsibilities: Build & Maintain Scalable Data Warehousing Solutions: Design, build, and maintain robust ELT pipelines and transformation workflows Model and maintain curated data layers to support reporting, analytics, and decision-making Ensure high availability, scalability, and performance of data warehouse systems (cloud-based, e.g., Redshift) Develop & Manage Data Products: Collaborate with business More ❯

Join to apply for the Azure Data Engineer - SC Cleared role at ShareForce . This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring … control of their data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and stakeholders to gather requirements and propose … solutions. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinement and work estimation. Skills and Experiences Design and develop end-to-end data More ❯

Join to apply for the Head of Data and Analytics role at Bestway Retail Join to apply for the Head of Data and Analytics role at Bestway Retail We are looking for a Head of Data and Analytics to join us here at Bestway! Responsibilities: Develop and execute the data and analytics … strategy to drive commercial value and operational efficiency in retail/wholesale. Lead, mentor and scale data teams, fostering a culture of analytical excellence and innovation. Oversee the design, implementation and optimisation of scalable data infrastructure, pipelines, and cloud data warehouses (including Snowflake). Deliver actionable insights across pricing, margin, product performance, customer behaviour … and market trends to support business decisions. Champion data governance, quality, security and compliance (e.g. GDPR), ensuring robust data management processes. Integrate and structure data from multiple business systems (e.g. POS, CRM, ERP, e-commerce) for effectuive reporting and analytics. Drive adoption of advanced analytics, AI, and automation to unlock new opportunities and efficiencies. More ❯

Join to apply for the Senior Data Engineer - Snowflake role at INOVERSE GROUPE 2 days ago Be among the first 25 applicants Join to apply for the Senior Data Engineer - Snowflake role at INOVERSE GROUPE Get AI-powered advice on this job and more exclusive features. Salary: Up to £100,000 D.O.E Location: London (Hybrid … Days on site) Are you a Data Engineer ready to make a real impact in a company that values innovation, autonomy, and excellence? Title: Senior Data Engineer Salary: Up to £100,000 D.O.E Location: London (Hybrid 3 Days on site) Are you a Data Engineer ready to make a real impact in a company … excellence? iO Associates is recruiting for a high-growth, forward-thinking investment firm that sits at the intersection of finance and technology - and they're looking for a Data Engineering Specialist to join their collaborative data team. This is a unique chance to step into a role that offers both technical ownership and strategic influence, within More ❯

for Action.; Act Boldly.; Deliver Results.; Hire and Develop the Best.; Be Curious and Learn.; Win as a Team.; Grow or Die. Moultrie is looking for a CX Data Engineer to optimize, maintain, and analyze customer experience data to drive engagement, retention, and business insights. This role will ensure data quality, scalable analytics infrastructure … and predictive modeling capabilities to support CX decision-making. In addition to building and maintaining data pipelines, this role will develop foundational predictive models to analyze customer behavior and enhance personalization. The ideal candidate has strong data engineering skills and a working knowledge of predictive analytics to support Moultrie's long-term CX strategy. Key Responsibilities … CX Data Infrastructure & ETL Optimization Design, implement, and optimize CX data pipelines and databases for scalable, real-time analytics. Maintain ETL workflows (Fivetran, dbt, Airflow, Azure Data Factory) to automate data ingestion from Zendesk, NPS, e-commerce reviews, app reviews, and cancellation data. Write stored procedures and ETL packages to support CX More ❯

Senior Data Platform Engineer - 12 month FTC Funding Circle London, United Kingdom Apply now Posted 2 days ago Hybrid Job Contract Competitive Senior Data Platform Engineer We are looking for a Senior Data Platform Engineer to join our Data Platform Engineering team which sits under Tech and Data. Data is … the finance they need to grow. With more than a decade of expertise under our belt, we've built a game-changer of a platform with cutting-edge data and technology that's reshaping the landscape of SME lending. Say goodbye to lengthy applications and hello to lightning-fast decisions! In just minutes, SMEs across the UK can … ourselves on providing meaningful, human support as well as fast, hassle free processes to deliver an unbeatable customer experience. The role Participate in design decisions and implementation of data platform tools and infrastructure Ensure systems follow the agreed principles and architecture defined at Funding Circle Actively contribute to initiatives to enhance data quality, data More ❯

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of … silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key Responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data, and make the most of it. Establish yourself as a trusted advisor in data … the benefits of different branch strategies. Strong experience in IaC and able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data More ❯