476 to 500 of 1,220 Data Pipeline Jobs in England

Data Engineer (SC) Croydon - 2-4 days per month on site £500/day outside IR-35 Contract until the end of the financial year We are seeking an experienced AWS Data Engineer to support a major government programme delivering secure, scalable data solutions. … Responsibilities Design and implement data pipelines on AWS using services such as Glue, Lambda, S3, and Redshift. Develop ETL processes and optimise data workflows for performance and security. Collaborate with analysts and architects to ensure compliance with government security standards. Troubleshoot and resolve issues in complex ...

statistical and machine learning models using Azure ML. Optimize model performance and computational efficiency. Ensure that applications run smoothly and handle large-scare data efficiently. Implement and maintain monitoring of model drifts, data-quality alerts, scheduled r-training pipelines. Data Management and Preprocessing: Collect … clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control, testing and code review. Work ...

Title: Senior Data Engineer (Contract) Salary Range: £500–£550 per day (Outside IR35) Location/Working model: London | Hybrid (3 days on-site) Join a forward-thinking data environment where innovation meets scale. You’ll take ownership of designing and delivering high-performing data … platform to make real impact, ideal for a seasoned engineer who enjoys solving end-to-end challenges in the cloud. The Senior Data Engineer (Contract) will architect, build, and maintain robust data solutions within a Google Cloud Platform ecosystem. Role Highlights – Design and deliver scalable ...

Title: Senior Data Engineer (Contract) Salary Range: £500–£550 per day (Outside IR35) Location/Working model: London | Hybrid (3 days on-site) Join a forward-thinking data environment where innovation meets scale. You'll take ownership of designing and delivering high-performing data … platform to make real impact, ideal for a seasoned engineer who enjoys solving end-to-end challenges in the cloud. The Senior Data Engineer (Contract) will architect, build, and maintain robust data solutions within a Google Cloud Platform ecosystem. Role Highlights – Design and deliver scalable ...

Python Developer, Full Stack Engineer, Backend Engineer, Generative AI, LLM, LangChain, RAG, Microservices, CI/CD, GitHub Actions, AWS, GCP, Azure, Vector Databases, Data Pipelines, Applied AI, MLOps ...

with digital twin frameworks (topology/graph modeling, intent-based orchestration), AIOps platforms (anomaly detection, noise reduction, predictive insights), and streaming/data pipelines (Kafka, Pub/Sub, Dataflow) Familiarity with cloud-native (GCP/Azure/AWS), Kubernetes, API-first integration, and observability stacks (metrics, logs, traces ...

Senior Snowflake Data Engineer - Remote - £competitive About the Role We are looking for an experienced Senior Snowflake Data Engineer to join a dynamic team working on cutting-edge data solutions. This is an exciting opportunity to design, build, and optimise high-performance data pipelines using Snowflake, dbt, and modern engineering practices. If you are passionate about data engineering, test-driven development, and cloud technologies, we'd love to hear from you. Key Responsibilities Design, develop, and optimise scalable data pipelines in Snowflake. Build and maintain dbt models ...

CONTRACT ROLE - POWER BI DEVELOPER & DATA ENGINEER UK-Based Candidates Only | 7 Week Contract (Feb 2026 Start) | £500-550 Per Day | Remote with Occasional Onsite (Covent Garden) To apply, email: THE OPPORTUNITY We're looking for an experienced Power BI Developer with strong Data Engineering skills … deliver a defined dashboard and data integration project for a major client. This is a hands-on, delivery-focused engagement suited to someone who enjoys working end-to-end, from requirements gathering through to deployment and handover - within a fixed timeframe. THE ROLE You will take ownership ...

ready to be part of an exciting digital transformation using innovative technologies? This is an opportunity for a mid-level Data Engineer to play a key role in a major digital transformation. You will be shaping the future of data using innovative technologies like Azure Databricks … Fabric. You'll design and optimise modern data pipelines, work with diverse data sources, and collaborate with BI teams and stakeholders to deliver high-quality, well-modelled data that powers analytics and AI-driven solutions. What You'll Do Build and maintain scalable data ...

Senior Manager We are looking for a Senior Manager with deep Palantir Foundry expertise to lead the design and delivery of production-grade data and AI solutions. You will shape end-to-end architectures, lead multidisciplinary teams and work directly with senior client stakeholders to turn complex data … platform. Skills and experience Significant hands-on experience delivering Palantir Foundry solutions in complex client environments. Deep Foundry technical expertise across the full stack: Pipeline Builder, Ontology, Workshop, OSDK, Code Repositories, Actions and AIP or agentic capabilities, able to build production-grade applications not just prototypes. Strong proficiency ...

heading up a recruitment drive for a global consultancy that require a SC Cleared Data Engineer to join them on a major government project that's based in Telford. Key Responsibilities: Lead the design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo … Talend, and SAS. Architect and implement scalable data pipelines and services that support Business Intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous ...

models for education - solving the ultimate learning task of predicting student knowledge and optimal 'next task' Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable … English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create ...

models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable … English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create ...

Test Analyst SQL Test Analyst - BI Solutions, SQL, Power BI, ETL, Agile, Data Testing, Data Pipelines, Data Platforms, Dashboards, Reports - Hybrid (Warrington) - 6 months Initially - Outside IR35 - £450-475 per day A specialist SQL Test Analyst with strong BI, SQL and Data ...

Working On Infrastructure Management: Docker management, Jenkins pipelines, Kubernetes deployments, VM management, and application/tool deployment. Automation: Deploy tools and scripts to data pipelines for processing incoming data, including Apache NiFi development . UI & Application Development: Build user and system interfaces to make information accessible … infrastructure, automation, or UI development. Hands-on experience with Docker , Kubernetes , Jenkins , and scripting for automation. Familiarity with Apache NiFi and data pipeline development. Ability to work collaboratively in a fast-paced environment and deliver high-quality solutions. Why Join Us? This is a chance to work ...

Performance Data Analyst London Bridge £43,925 - £47,743 Pro Rata 28 Hours per week (Part Time) Hyde is looking for a Performance Data Analyst to join our collaborative and values-driven team. This is a fantastic opportunity to grow your career in a supportive environment … that champions employee wellbeing, continuous learning, and long-term development. As a Performance Data Analyst at Hyde, you will support the Operations Analytics team to design, develop, and deliver data models and analytics solutions that inform business decisions across Hydes Operations directorate. You will provide insight ...

Outside IR35 | £500–£525 per day | Milton Keynes | Hybrid Working | 6-Month Initial Term We are currently looking for an experienced Senior Data Engineer to support a major data modernisation programme. You’ll be instrumental in reshaping and enhancing data pipelines as the business … moves towards a Databricks Lakehouse setup. The work centres on creating scalable, high-quality data flows that underpin analytics, reporting, and strategic insight across the organisation.This contract is outside IR35, requires one on-site day each week, and offers an immediate start with strong extension prospects. What ...

autonomy, impact, and tech stack to do your best work. What you'll do Lead Azure integration development using Logic Apps, Functions, APIM, Data Factory/Synapse Design automated CI/CD pipelines for Dynamics 365 and Power Platform Deliver scalable ETL and data pipelines Integrate … bring Deep Azure Integration Services expertise Strong Azure DevOps and CI/CD experience Solid API, Power Platform, and data pipeline knowledge Background in enterprise-level integrations and automation The working arrangements are flexible around a network of UK sites and agreed with your line manager around ...

autonomy, impact, and tech stack to do your best work. What you’ll do Lead Azure integration development using Logic Apps, Functions, APIM, Data Factory/Synapse Design automated CI/CD pipelines for Dynamics 365 and Power Platform Deliver scalable ETL and data pipelines Integrate … bring Deep Azure Integration Services expertise Strong Azure DevOps and CI/CD experience Solid API, Power Platform, and data pipeline knowledge Background in enterprise-level integrations and automation The working arrangements are flexible around a network of UK sites and agreed with your line manager around ...

hiring at Analytics Engineer and Senior Analytics Engineer level on a permanent basis. This is a great opportunity to join a modern data team and play a key role in building scalable, high-quality analytics foundations that support self-service BI and data-driven decision-making. … Role You'll focus on designing and building analytics-ready data models and pipelines, working closely with data engineers, analytics specialists, and product owners. Key responsibilities include: Building data pipelines in dbt , transforming data from bronze to gold layers using Kimball methodologies ...

Dover Fueling Solutions are looking for a Graduate Data Engineer to join our growing team at Fairbanks, Dover Fueling Solutions on a full-time and permanent basis in Skelmersdale. You will work as part of a large agile Software Development team incorporating Data Architects, Software Developers … Product Owners, Data Engineers, and Software Testers to deliver world leading products to our customers. What we do: Wetstock is the process of tracking fuel on a petrol station, from the point it is delivered to when it is sold. At Fairbanks, we are collecting data ...

Senior Data Scientist Up to £100K Xcede is currently partnering with the world's largest multinational services company as they continue to expand their central data solutions capability. In this role, your work will be rolled out across a truly global legal organisation, shaping how advice … delivered to clients in 80+ countries worldwide. You'll use data and machine learning to enhance legal processes, support strategic decision-making, and deliver forward-looking insights to an international client base. This includes designing innovative, data-driven solutions, building proof-of-concepts, and converting them ...

Senior Data Scientist Up to £100K Xcede is currently partnering with the world’s largest multinational services company as they continue to expand their central data solutions capability. In this role, your work will be rolled out across a truly global legal organisation, shaping how advice … delivered to clients in 80+ countries worldwide. You’ll use data and machine learning to enhance legal processes, support strategic decision-making, and deliver forward-looking insights to an international client base. This includes designing innovative, data-driven solutions, building proof-of-concepts, and converting them ...

exciting opportunity has arisen for a proven Data Architect with deep expertise in Snowflake and extensive knowledge of the insurance industry to lead the design and evolution of our enterprise data infrastructure. This role requires developing scalable, secure, and high-performance data solutions, including … data warehouses and lakes, with a focus on Snowflake as the cloud data platform on AWS. You will have a proven track record of migrating significant data workloads-such as claims management and fraud detection-to Snowflake, optimising data pipelines and establishing ...

Senior Data Engineer (Quant & Alternative Data) Location: Abu Dhabi, UAE (relocation support provided) Compensation: Highly competitive, fully guaranteed The Role We are building a data engineering function to support quantitative research and production teams working with large-scale financial and alternative data. The work … open-ended technical problems. Much of the stack is built in-house and largely greenfield. What You’ll Do Design and build scalable data pipelines Own datasets end-to-end, from ingestion and validation to downstream delivery Develop ingestion, transformation, and quality-control frameworks Build tooling to support ...