251 to 275 of 990 Data Pipeline Jobs in England

Akkodis is partnering with a reputable client in Finance and they are looking for a Data Engineer with strong Databricks experience to expand their IT Team. They are currently improving their CX transformation programme and making changes to their institutional reporting suite. Job title: Data Engineer - Data BricksSTART :ASAPLocation: Liverpool Street - 3 days a … eek (NON Negotiable), the rest WFHDuration: 3 months rolling contractType of contract : Freelance, Inside IR35Level: mid-Senior Duties and Tasks: Develop and optimize data pipelines using Databricks and Spark.Design and implement data models and ETL processes in Snowflake.Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, and security across platforms.Monitor and troubleshoot data workflows and performance issues. Requirements: Proven experience with Databricks and Snowflake.Strong proficiency in SQL and Python.Extract Load Transform procedures, Data Lineage & Analysis.Familiarity with cloud platforms (e.g., Azure, AWS, or GCP).Experience with CI/CD and version control tools (e.g., Git).Excellent problem-solving and More ❯

Your New Role We're seeking a Senior Data Engineer to help shape and maintain a modern enterprise data platform. In this role, you'll design and optimise scalable data pipelines and models that bring data from core business systems into Snowflake, enabling analytics, reporting, and data-driven insights across … pipelines and models in Snowflake to support analytics and reporting needs. Architecture Implementation: Apply defined data architecture standards to ingestion, transformation, storage, and optimisation processes. Pipeline Development: Develop robust ELT/ETL workflows using dbt and orchestration tools, ensuring reliability and maintainability. Performance & Cost Optimisation: Configure Snowflake warehouses and implement query optimisation techniques for efficiency. … What You'll Need to Succeed Proven experience delivering cloud-based data engineering solutions, ideally with Snowflake. Strong proficiency in SQL, Python, and dbt for transformations and pipeline automation. Practical experience with Snowflake features and RBAC management. Familiarity with ingestion tools (Airbyte, Fivetran, Hevo) and cloud services (AWS preferred). Solid understanding of data modelling More ❯

Title: Senior Data Engineer (Databricks) Salary: Up to £60,000 Location: Birmingham (Hybrid) Are you a Data Engineer looking to work on large-scale, global data solutions that actually make an impact? This is a fantastic opportunity to join a market-leading automotive technology company that's shaping the future of connected data and intelligent platforms worldwide. You'll be joining a collaborative, forward-thinking data team focused on building a modern, scalable data infrastructure that powers insights for thousands of dealerships across the globe. What you'll be doing: Building and maintaining a unified data platform for global data processing. Developing reusable … and scalable data solutions using Databricks, Python/PySpark, and Azure. Working closely with the data visualisation team to align back-end and front-end needs. Designing secure data access models and integrating external data sources via Azure Data Factory. Supporting CI/CD processes, implementing testing practices, and optimising More ❯

Head of Data Engineering Our longstanding financial services client is currently hiring a Head of Data Engineering to lead a high-performing Data Engineering function overseeing the delivery and optimisation of two enterprise-scale data platforms on Azure. With a blend of technical leadership and strategic vision, you'll chair our clients … Data Board, define the data strategy, and drive the roadmap that underpins innovation across the business as our client continues their journey into Azure Cloud Services. To be successful, you will have recent experience owning & delivering an Azure-based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled … with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between £120,000 to £140, % bonus/40% LTIP + 7.5k car allowance + additional benefits to be based in Wolverhampton or Chatham on a hybrid basis. More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior … Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data … scientists, economists, and technical teams to translate requirements into solutions. Communicate effectively with technical and non-technical audiences. Participate in code reviews and knowledge-sharing sessions. Automate pipeline deployments and implement CI/CD processes in collaboration with DevOps teams. Promote best practices for automation and environment management. Interested? Please submit your updated CV to Lewis Rushton More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior … Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data … scientists, economists, and technical teams to translate requirements into solutions. Communicate effectively with technical and non-technical audiences. Participate in code reviews and knowledge-sharing sessions. Automate pipeline deployments and implement CI/CD processes in collaboration with DevOps teams. Promote best practices for automation and environment management. Interested? Please submit your updated CV to Lewis Rushton More ❯

Data Science Engineer – Azure | Databricks | AI Innovation Permanent | Birmingham (Hybrid) Amtis is proud to partner with an advanced, data-driven organisation — a business that’s not just talking about AI, but actively building intelligent systems powered by Azure, Databricks, and real-world machine learning applications. This is a hands-on engineering role where you’ll be … at the core of designing, developing, and optimising modern data platforms that enable predictive analytics, AI experimentation, and large-scale automation. You’ll work in an environment where data truly drives business decisions — not just dashboards. If you’re excited by high-volume, high-velocity data challenges and want to work on next-gen … infrastructure that supports advanced analytics and AI workloads, this is your opportunity. What You’ll Be Doing Designing and building scalable, reusable data pipelines using Azure Databricks, Data Factory, and modern cloud tooling Developing secure, flexible data models and optimising performance across massive datasets Collaborating with data scientists to productionise AI models More ❯

Senior Data Engineer (Snowflake) Manchester Based - Hybrid working 4 days in office Salary £75K to £80K A Consultancy firm is looking for an experienced Senior Data Engineer to their data team. You will drive innovative data solutions within our organisation. The main focus of this Senior Data Engineer/Snowflake … Specialist role is to serve as the technical authority and leader for complex data engineering initiatives, with a specialised emphasis on Snowflake Cloud Data Warehouse architecture and its internal features. You will be responsible for the following activities Design and Build Data Pipelines: The role involves leveraging expertise in ANSI-SQL and Python to … design and construct robust and efficient data pipelines. Implement Data Models: You will be responsible for applying deep expertise in various data models, specifically Dimensional, ER (Entity-Relationship), and Data Vault, to structure data. Manage Key Stakeholders: A critical function is managing product owners and stakeholders to align technical delivery with business More ❯

Senior Data Engineer (Snowflake) Manchester Based - Hybrid working 4 days in office Salary £75K to £80K A Consultancy firm is looking for an experienced Senior Data Engineer to their data team. You will drive innovative data solutions within our organisation. The main focus of this Senior Data Engineer/Snowflake … Specialist role is to serve as the technical authority and leader for complex data engineering initiatives, with a specialised emphasis on Snowflake Cloud Data Warehouse architecture and its internal features. You will be responsible for the following activities Design and Build Data Pipelines: The role involves leveraging expertise in ANSI-SQL and Python to … design and construct robust and efficient data pipelines. Implement Data Models: You will be responsible for applying deep expertise in various data models, specifically Dimensional, ER (Entity-Relationship), and Data Vault, to structure data. Manage Key Stakeholders: A critical function is managing product owners and stakeholders to align technical delivery with business More ❯

Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity to shape the data foundation behind … one of the UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing and customer insights. THE ROLE: As a Data Engineer , you will … Design and build robust data pipelines to consolidate customer data into a single, trusted view. Clean, transform, and enrich data for marketing activation and segmentation within the CDP. Collaborate with cross-functional teams to translate business requirements into technical solutions. Automate data ingestion, transformation, and testing processes aligned with DevOps best practices. More ❯

Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity to shape the data foundation behind … one of the UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing and customer insights. THE ROLE: As a Data Engineer , you will … Design and build robust data pipelines to consolidate customer data into a single, trusted view. Clean, transform, and enrich data for marketing activation and segmentation within the CDP. Collaborate with cross-functional teams to translate business requirements into technical solutions. Automate data ingestion, transformation, and testing processes aligned with DevOps best practices. More ❯

Position: Azure Data Engineer Employment Type: Contract Start: ASAP (November/December 2025) Duration: 6 Months Location: West Midlands, UK Language(s): English Focus on SAP is a specialist SAP and ERP Recruitment organisation offering both permanent and contract staffing solutions on a global scale. Client – Partnered with a global leader in digital transformation and IT services, working … people and communities they serve. For you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are seeking an experienced Azure Data Engineer to join a leading technology-driven organisation. You will play a key role in designing, building, and optimising data pipelines and integration workflows within the Microsoft … Azure ecosystem. You will work closely with cross-functional teams to deliver efficient, scalable, and secure data solutions that enable advanced analytics and business intelligence capabilities. Key Responsibilities: Design, build, and maintain data pipelines using Azure Data Factory (ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and More ❯

lead in the preparation and development of key business intelligence to enable efficient, effective and commercially focussed performance reporting within the business. The role will also ensure the data requirements of claims processing activity are met to ensure the business submits its claims in a timely and efficient manner. The Business Intelligence Analyst is responsible for researching reporting … requirements for a variety of stakeholders for current and newly awarded contracts, including designing robust controls to ensure the accuracy of the data presented. The role will work closely with other departments to ensure business reporting requirements are delivered in an efficient and cost-effective manner and will ensure usage of the BI tool is maximised. This Job … of Power BI dashboards and reports, ensuring they are insightful, scalable, and user-friendly. Collaborate with stakeholders to understand business needs and translate them into actionable insights and data products. Influence and inform decision-makers using compelling data storytelling, strategic analysis, and visual narratives. Act as a subject matter expert in Power BI, including DAX, data More ❯

three-time gold investor in people award winner, an advocate of supporting women in engineering and developing their people to be the best they can be? As a data engineer specialising in generative AI; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. The opportunity: The business is looking for a Data Engineer to join an Information Management GenAI delivery Office, who will be able to evaluate design, deploy, improve and support the companies data sets. The Data Engineer will ensure data pipelines … are designed to be resilient, secure and responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. The Data Engineer will provide knowledge in data management and data quality to guarantee compliance to company More ❯

Duration: initial contract until end of March 26, with possible extension Daily rate : £495 inside IR35 Location: Remote Clearance : active SC Key Responsibilities: Design, develop, and optimize data pipelines using Microsoft Fabric and Azure services (eg, Azure Data Factory, Azure Synapse Analytics, Azure Databricks). Build and maintain scalable, high-performance data architectures to … support analytics, reporting, and machine learning workloads. Implement data ingestion, ETL/ELT processes, and data warehousing solutions. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. Ensure data quality, security, and compliance with organizational and regulatory standards. Monitor and troubleshoot data pipelines … optimizing for performance and cost-efficiency. Experience: Strong hands-on experience with Microsoft Fabric. Proficient in Python for data engineering (eg, Pandas, PySpark, asyncio, automation scripts). Strong SQL skills (T-SQL or similar) for transforming and modeling data. Experience building scalable ETL/ELT pipelines using cloud technologies. Good understanding of data modeling (star/ More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process More ❯

Mid/Senior Data Engineer | 🚀 Series C Scale-up | $50m raise in 2025(Python,, GCP) | Permanent | London (1 day a week on-site) My client are a fast-scaling SaaS scale-up (Series C, $50m raised in 2025) that is redefining how global powerhouses operate. Their AI-enabled platform supports over 1,000+ brands worldwide, streamlining business processes … like never seen before. With 10× revenue growth in the past year and aggressive expansion across the UK, US, and EU, the company is scaling at pace. Data is the backbone: from APIs and pipelines to governance and observability, their data platform directly powers customer-facing products and AI-driven insights. They’re now hiring a … flexibility to work from anywhere What you’ll be doing: API strategy & development – own and scale FastAPI endpoints that deliver real-time access to platform data. Data pipeline development – build ingestion and replication pipelines with best-in-class observability, latency, and resilience. Platform technical vision – influence architecture and orchestration, shaping how the business handles data More ❯

Mid/Senior Data Engineer | 🚀 Series C Scale-up | $50m raise in 2025(Python,, GCP) | Permanent | London (1 day a week on-site) My client are a fast-scaling SaaS scale-up (Series C, $50m raised in 2025) that is redefining how global powerhouses operate. Their AI-enabled platform supports over 1,000+ brands worldwide, streamlining business processes … like never seen before. With 10× revenue growth in the past year and aggressive expansion across the UK, US, and EU, the company is scaling at pace. Data is the backbone: from APIs and pipelines to governance and observability, their data platform directly powers customer-facing products and AI-driven insights. They’re now hiring a … flexibility to work from anywhere What you’ll be doing: API strategy & development – own and scale FastAPI endpoints that deliver real-time access to platform data. Data pipeline development – build ingestion and replication pipelines with best-in-class observability, latency, and resilience. Platform technical vision – influence architecture and orchestration, shaping how the business handles data More ❯

Senior Data Engineer - (AI/ML Deployment Experience Required) Location: London (Hybrid: Monday-Wednesday in office) Salary: £65,000-£75,000 DoE Job Ref: J13026 An AI-first SaaS company on a mission to help organisations unlock the full potential of their first-party data is seeking a forward-thinking Senior Data Engineer with … strong deployment experience to help manage and scale its intelligent platform. Data sits at the heart of everything they do - transforming complex, messy datasets into actionable insights that empower smarter decisions and accelerate growth across industries. As they enter an exciting phase of rapid expansion, they're looking for a talented engineer to join them on this journey … and help shape the future of their data-driven platform. The Role The Senior Data Engineer will take ownership, shape the data foundations, and help power the next generation of AI-driven solutions. This is a hands-on, high-impact role where you'll design and build cloud-native data pipelines, champion More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Data Architect to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making … across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using DBT, Delta Live Tables, and dimensional modelling to deliver consistent More ❯

Data Migration Delivery Lead (SQL to BigQuery) Location: Hybrid (must be able to travel to London when required) Contract Type: Fixed-Term Contract (9-12 months) We’re supporting a fast-growing cycling and lifestyle brand as they modernise their data ecosystem, migrating from an on-premise SQL database (within Nvision ERP) into a new, scalable … Google Cloud BigQuery environment. This role is critical in ensuring the successful replatforming, consolidation, and optimisation of core business data to power next-generation analytics and reporting. We’re seeking a Delivery/Product Lead with hands-on experience leading data migration or cloud data platform programmes. You will act as the key interface … business stakeholders, the existing BI consultant, and the external Google Cloud partner responsible for the technical execution. You will oversee delivery governance, coordinate cross-functional teams, and ensure data accuracy, integrity, and accessibility throughout the migration process. You will also manage a junior resource supporting documentation, communications, and coordination. Key Responsibilities End-to-end delivery of the data More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯