1 to 25 of 58 Contract Data Pipeline Jobs in the UK excluding London

Job summary The post-holder will provide technical expertise and leadership in data engineering, ensuring that data solutions are designed, developed, and deployed in line with NHS and organisational best practices. They will work within the Business Intelligence team to support the delivery of scalable, efficient, and innovative data solutions. Main duties of the … job The Lead Data & Systems Architect will oversee the development and implementation of cloud-based data pipelines, ensuring data quality, accessibility, and security. They will also support the Head of Data Engineering in defining best practices, supporting team development, and fostering a culture of continuous improvement. The post-holder will collaborate with … internal and external stakeholders to align data engineering solutions with national and local data strategies. They will ensure that data solutions support operational and analytical needs, contributing to effective decision-making and service improvements across the organisation. About us We are a multi award-winning organisation that has achieved the prestigious Investors in People More ❯

Are you a Data Engineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a Data Engineer to join their Customer Relationship Centre team. As a Data Engineer you will play a key … Engineering, or a related field * Experience as a Data Engineer, ideally within a customer service or contact centre environment * Knowledge of SQL, Python, and data pipeline development * Skilled in Google Cloud Platform (GCP) and cloud data tools * Background in CRM systems and customer data structures * Understanding of data warehousing … concepts and cloud architecture * Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline * Data Insights reporting experience * Competent with real-time data processing and streaming technologies * Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE NOTE ** To meet with current legislation, right to work checks will be carried More ❯

Are you a Data Engineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a Data Engineer to join their Customer Relationship Centre team. As a Data Engineer you will play a key … Engineering, or a related field Experience as a Data Engineer, ideally within a customer service or contact centre environment Knowledge of SQL, Python, and data pipeline development Skilled in Google Cloud Platform (GCP) and cloud data tools Background in CRM systems and customer data structures Understanding of data warehousing … concepts and cloud architecture Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline Data Insights reporting experience Competent with real-time data processing and streaming technologies Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE NOTE ** To meet with current legislation, right to work checks will be carried More ❯

Purpose of the Role: To design, build, and maintain the systems that collect, process, and analyse data - including pipelines, data warehouses, and data lakes - ensuring data is accurate, accessible, and secure. Key Responsibilities: Develop, maintain, and optimise scalable data pipelines and data storage solutions. Design and implement data warehousing and data lake architectures. Ensure robust data governance, security, and compliance across all systems. Collaborate with cross-functional teams to gather requirements and deliver solutions that support business objectives. Apply machine learning and data mining techniques where appropriate to add value. Support change and transformation initiatives by providing reliable data systems. Identify risks, implement controls, and follow secure coding practices. Provide strategic input on data architecture, technology adoption, and best practices. Skills & Competencies: Strong knowledge of database structures, data modelling, and data engineering practices. Proficiency in requirements analysis, problem-solving, and strategic thinking. Ability to work collaboratively with technical and non-technical More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in Real Time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯

Data & Analytics Engineer 12 Month FTC Liberty Wines is modernising its data estate: migrating from on-prem Analysis Services to the cloud, moving our WMS, ERP and bespoke apps to scalable platforms, and expanding AI/ML initiatives. We are evaluating both Fabric and Databricks as a potential strategic fit. As our hands-on Data … needs based on your experience and contributing to successful delivery on either. You will work end-to-end, from schema design to dashboard storytelling, and be the pivotal data voice in the Technology team. This role offers broad ownership across tooling, standards, engineering and enablement rather than being confined to a narrow BI silo. Key Responsibilities Data … tools such as Data Factory, Dataflow Gen2, Databricks Workflows, or similar orchestration frameworks Experience with Python and/or PySpark for data transformation, automation, or pipeline development Familiarity with cloud services and deployment automation (e.g., Azure, AWS, Terraform, CI/CD, Git) Ability to deliver clear, insightful, and performant data visualisations and dashboards More ❯

Principal Data Engineer - Azure Databricks (Unity Catalog) - Contract Location: Bristol - Hybrid - 2 days a week in the office Contract Length: 12 Months Day Rate: Negotiable Job Ref: J12998 A data for good organisation that is in the early stages of building a modern Analytics and Data Engineering function, are looking to bring in a … Principal Data Engineer to support and lead key elements of this transformation. This is a fantastic opportunity for someone who enjoys building data platforms from the ground up, mentoring teams, and deploying cutting edge solutions in a collaborative environment. In this role, the successful candidate will be responsible for designing and implementing scalable, reusable data … team upskill, and embed best practices across the function. They will also lead on bringing AI models into production, ensuring robust monitoring, alerting, and data pipeline reliability are in place to support long-term success. Key Responsibilities: Build and maintain scalable data pipelines for analytics and AI use cases. Lead the deployment of More ❯

We're looking for a technical steward of enterprise metadata assets , ensuring governance, quality, and regulatory compliance across complex data landscapes. You will be the subject matter expert for data cataloguing, metadata synchronisation, and stewardship best practices. helping us build a trusted foundation for AI, analytics, and digital transformation. What You'll Do Metadata Curation & Governance … Define and implement enterprise metadata standards, business glossaries, and classification schemas. Establish data quality KPIs, SLAs, and governance metrics. Build automated discovery workflows to enable self-service analytics. Champion adoption of governed data assets across business and technical teams. Technical Stewardship Configure cross-platform metadata synchronisation between Alation, Databricks (Unity Catalog) , and downstream systems. Implement schema … BI spaces. Hands-on with data quality tools such as Great Expectations, Ataccama, Monte Carlo (or similar). Experience with metadata orchestration and modern data pipeline tools. More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

DATA/PYTHON ENGINEER £500 - £600 per day Outside IR35 Full Remote 3-month Company Overview We are working with a fast-growing digital marketing consultancy working at the intersection of data, media, and technology. Their mission is to help brands understand their customers better and drive performance through data-driven decision-making. With … a diverse team of technologists, analysts, and marketing specialists, they deliver cutting-edge solutions across iGaming, Sports, Retail, and Financial Services. Role Overview & Responsibilities We are looking for Data Engineers to join a central data engineering function, supporting a high-priority data project following recent team changes. You'll be working end-to-end … high-quality data products for dashboards and reporting. Technical Skills & Experience We're looking for candidates who bring: Strong hands-on experience with Python for API ingestion, pipeline automation, and data transformation. Solid SQL skills with Snowflake (or similar cloud data warehouses). Experience with Airflow or other orchestration tools. Knowledge of data More ❯

experienced Analytics Engineer to join their revenue management team on a 3-month contract. This is an exciting opportunity to lead the design and implementation of a cloud data warehouse, building on existing plans to streamline reporting and automate data workflows. What you'll do: Collaborate with the analytics and engineering teams to set up a … data warehouse using modern data modelling techniques, focusing on … Kimball methodology and a Medallion architecture (bronze, silver, gold layers). Develop and maintain DBT projects and configure incremental loads with built-in unit testing. Support data pipeline orchestration with Airflow and work with AWS cloud tools. Help deliver a production-ready Data Mart with star schema design to power business reporting and dashboards (PowerBI More ❯

The Data Engineer/BI Developer will play a pivotal role in designing, developing, and maintaining data pipelines and systems to support analytics needs within the industrial and manufacturing sector. You will also create a number of bespoke reports using Power BI. Client Details The client is a small to medium manufacturer based in Manchester. Description … Design, build, and optimise scalable data pipelines to support analytics operations. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Maintain and improve existing data systems and infrastructure. Ensure data quality, consistency, and security across the organisation. Implement ETL processes to integrate data from multiple sources. Develop … and maintain documentation for data engineering processes and workflows. Monitor system performance and troubleshoot issues as they arise. Provide technical support to the analytics team for data-related tasks. Profile A successful Data Engineer should have: A strong understanding of data engineering principles and best practices. Strong Power BI skills Proficiency in More ❯

fortnight Job Specification Microsoft Fabric Developer Reviewing business use cases to identify the underlying problem and therefore solution required Develop excel input templates with validations Building and maintaining data pipelines (utilising data pipelines or dataflow Gen 2) from the Fabric Lakehouse files into the PowerBI semantic model. i.e. support the Extract, Transform, Load data side. Create Power BI reports in a timely manner for stakeholders Clearly document process' and procedures utilised The candidate ideally must have: Experience in the full data lifecycle, including ingesting and cleansing raw data, building robust data models, and delivering actionable insights through Power BI A Microsoft certification relevant to the role … is highly desirable. This could include: DP-600: Implementing Analytics Solutions Using Microsoft Fabric or PL300: Microsoft Power BI Data Analyst. Or a comparable certification in data engineering, data warehousing, or business intelligence. Provide examples of your work, such as a link to a GitHub repository with documented code, a personal website with project More ❯

fortnight Job Specification Microsoft Fabric Developer Reviewing business use cases to identify the underlying problem and therefore solution required Develop excel input templates with validations Building and maintaining data pipelines (utilising data pipelines or dataflow Gen 2) from the Fabric Lakehouse files into the PowerBI semantic model. i.e. support the Extract, Transform, Load data side. Create Power BI reports in a timely manner for stakeholders Clearly document process' and procedures utilised The candidate ideally must have: Experience in the full data lifecycle, including ingesting and cleansing raw data, building robust data models, and delivering actionable insights through Power BI A Microsoft certification relevant to the role … is highly desirable. This could include: DP-600: Implementing Analytics Solutions Using Microsoft Fabric or PL300: Microsoft Power BI Data Analyst. Or a comparable certification in data engineering, data warehousing, or business intelligence. Provide examples of your work, such as a link to a GitHub repository with documented code, a personal website with project More ❯

months (Mid-December start - End of June) Security Clearance : SC Clearance required Overview We're looking for a talented Front-End Developer to join a newly formed Data Team within a public sector organisation. This role is central to building a unified, user-friendly interface - a "single pane of glass" - that consolidates dashboards, reports, and outputs from various … data roles into one cohesive experience. The interface will serve as the primary access point for stakeholders to explore data, monitor performance, and make informed decisions. Key Responsibilities Interface Development :Design and build a centralised front-end application that integrates outputs from dashboards, reports, models, and data pipelines into a single, intuitive view. Accessibility … 2.2 standards, promoting inclusive access for all users. Performance Optimisation :Deliver fast load times, responsive design, and smooth user interactions across devices. Cross-Functional Collaboration :Work closely with Data Analysts, Data Scientists, Engineers, Business Analysts, and User Researchers to understand data outputs and user needs. Data Visualisation :Implement dynamic visual components such More ❯

Databricks Data Engineer - Newcastle (hybrid) - £450/pd Please note - this role will require you to attend the Newcastle-upon-tyne based office 2-3 days per week. To be eligible for this role you must have the unrestricted right to work in the UK - this organisation is not able to offer sponsorship. A leading construction organisation is … seeking an experienced Azure Databricks Data Engineer to support the ongoing development and optimisation of their cloud data platform. Key Responsibilities: Enhance and scale the existing Azure Databricks environment. Collaborate with data architects and analysts to deliver robust data pipelines. Implement best practices for data engineering, performance tuning, and security. … Work closely with stakeholders to understand data requirements and deliver solutions. Required experience: Strong hands-on experience with Azure Databricks and Spark. Solid understanding of Azure Data Lake, Data Factory, and Synapse. Proven track record in building scalable data pipelines and ETL processes. Experience working in hybrid environments and cross-functional teams. More ❯

FDM is a global business and technology consultancy seeking Data Engineers to work for our client within the IT consulting sector. This is initially a 6-month contract with the potential to extend and will be a fully remote role. Our client is looking for experienced Data Engineers to join their Customer Due Diligence (CDD) Insight … within one of the functions, leveraging cutting-edge technologies to deliver meaningful insights supporting Artificial Intelligence (AI) and Machine Learning (ML) driven solutions. Responsibilities Design, build, and optimize data pipelines using Apache Spark and Snowflake Collaborate with data scientists and analysts to support AI/ML model development and deployment Work closely with stakeholders to understand … business requirements and translate them into technical solutions Ensure data quality, integrity, and governance across all engineering processes Contribute to the development of scalable and reusable data engineering frameworks Support the team in delivering high-impact analytical solutions Manage data warehouses ensuring data organisation and optimisation Monitor data systems for More ❯

Senior Data Engineer (AI & MLOps) - Software - Newcastle/Hybrid or Remote Day rate: £300 - £500 (Inside IR35) Duration: 6 months Start: ASAP My new client is looking for a Senior Data Engineer with expertise in AI, MLOps, and AWS architecture to design and deliver production-grade machine learning pipelines. The ideal candidate will be passionate about … Engineer, MLOps Engineer, or similar role. Strong background in data structures, algorithms, and software engineering principles. Advanced proficiency in Python for data wrangling, pipeline automation, and ML workflows. Expertise in AWS services, including databases (RDS, DynamoDB, Redshift) and machine learning/AI (SageMaker, AI/ML frameworks). Hands-on experience with ML … pipeline orchestration, CI/CD, and deployment automation. Deep understanding of ML Ops practices, including monitoring, scaling, and retraining strategies. Familiarity with AIOps concepts and tools for operational automation. Preferred Skills Experience with data science and machine learning model development. Knowledge of containerization (Docker, Kubernetes, EKS). Exposure to infrastructure-as-code (Terraform, CloudFormation). Strong problem More ❯

Senior Data Engineer UK Remote, £500/day, Outside IR35 A Senior Data Engineer is required by fast-growing HealthTech/Tech for Good start-up. This is a 3-month contract initially with scope for extension. In this role, you will design, build, and maintain robust data pipelines using streaming and batch processing … technologies and help to lead the modernization of their data lakehouse. You will implement and manage secure cloud infrastructure using AWS, championing a culture of data quality, security, and technical excellence. Key Responsibilities: Architect and maintain data pipelines (streaming & batch) Build and manage scalable data storage solutions (data lakehouse) Design … and maintain secure AWS cloud infrastructure Implement and manage CI/CD and DevOps pipelines Champion data quality, security, and best practices Collaborate with cross-functional teams Implement and manage MLOps capabilities Essential Skills: Advanced Python programming skills Expertise in data engineering tools and frameworks (Apache Flink) Hands-on AWS experience (Serverless, CloudFormation, CDK) Strong understanding More ❯

Contract Data Engineer – Up to £500 per day (Outside IR35) 6 months | 3 days per week on-site in Gloucester We’re supporting a leading organisation through a period of growth and transformation, seeking an experienced Data Engineer to join on a contract basis. This role sits within a global data team and will … focus on designing, developing, and maintaining data architecture and pipelines. You’ll be working with stakeholders across the business to ensure data is accessible, reliable, and driving actionable insight. The role: Design, build, and maintain data pipelines and warehouse solutions Administer and optimise Snowflake in line with best practice Build data models … using Kimball Dimensional Modelling Leverage dbt, Fivetran, and Power BI for data transformation and reporting Deliver dashboards and reports up to executive level Support data governance, quality, and compliance across multiple environments Collaborate with a global team and business stakeholders to ensure data strategy aligns with wider objectives Skills & experience required: Strong Data More ❯

team on a long-term contract. This role will focus on developing and maintaining ETL processes, supporting cloud migration initiatives, and ensuring the delivery of accurate and reliable data solutions. Key Responsibilities * Design, develop, and optimise ETL processes to extract, transform, and load data into data warehouses or data marts. * Support the … setup and cloud migration of Informatica IDMC. * Write efficient SQL queries, including joins and data comparisons across multiple tables. * Collaborate with business and technical teams to gather requirements and translate them into robust technical solutions. * Maintain and enhance existing ETL processes, ensuring accuracy, performance, and reliability. * Perform data quality checks and resolve issues across data pipelines. * Participate in code reviews and recommend improvements. * Document workflows and processes to ensure clarity and maintainability. * Apply and share best practices in ETL development and data integration. * Leverage scripting languages such as Python or Shell scripting (advantageous). Skills & Experience * Strong experience in Informatica development and IDMC cloud migration. * Solid understanding of data More ❯

Data Engineer - Azure & Databricks Location: Hebburn (Hybrid) Contract Length: 6 months (with potential to extend) (outside IR35 - to be confirmed) A leading organisation is seeking an experienced Data Engineer with strong expertise in the Azure Data Stack and Databricks to support a key data transformation initiative. This is a hands-on delivery … role, ideal for someone who thrives in a fast-paced environment and can work closely with stakeholders to build scalable, cloud-native data solutions. Key Details: * Onsite presence required at the Hebburn office - frequency to be confirmed with the client * Initial 6-month contract with strong potential for extension Required Skills: * Proven experience with the Azure Data Stack (Azure Data Factory, Azure Synapse, Azure SQL, ADLS Gen2) * Strong hands-on expertise with Databricks (Spark, Delta Lake, notebooks, orchestration) * Experience building and optimising data pipelines for analytics and reporting * Ability to work collaboratively with cross-functional teams and stakeholders * Strong communication and problem-solving skills Please send CV's over to (url More ❯

Senior Data Engineer Edinburgh 3 days per week on-site 6 months (likely extension) £550 - £615 per day outside IR35 Primus is partnering with a leading Financial Services client who are embarking on a greenfield data transformation programme. Their current processes offer limited digital customer interaction, and the vision is to modernise these processes by: Building … a modern data platform in Databricks Creating a single customer view across the organisation. Enabling new client-facing digital services through real-time and batch data pipelines. You will join a growing team of engineers and architects, with strong autonomy and ownership. This is a high-value greenfield initiative for the business, directly impacting customer experience … and long-term data strategy. Key Responsibilities: Design and build scalable data pipelines and transformation logic in Databricks Implement and maintain Delta Lake physical models and relational data models. Contribute to design and coding standards, working closely with architects. Develop and maintain Python packages and libraries to support engineering work. Build and run automated More ❯

Role Title: Data Analyst/Engineer Duration: contract to run until 28/11/2025 Location: Sheffield … Hybrid 3 days per week onsite Rate: up to £271.97 p/d Umbrella inside IR35 Key Skills/requirements Tool integration & Configuration (Control management). Data Pipeline & Dashboard development. Reporting, Automation & Exception Tracking. Data mapping Any experience of Reporting solution use cases, wireframes, process design, data mapping, test case development and co More ❯