276 to 300 of 719 Data Pipeline Jobs in the UK

Contract Data Engineer - Azure, Databricks, SQL, Python 6 Weeks Outside IR35 £500-£600 per day Remote (occasional travel to Manchester or Glasgow) My client is delivering a high-impact data migration programme and is looking for a Data Engineer to join on a 6-week contract. This role will suit someone who thrives in … fast-moving delivery environments and has hands-on experience with modern data engineering tools. The Role Join a focused delivery team to execute a business-critical data migration Build, optimise and maintain data pipelines using Azure and Databricks Translate business requirements into technical solutions that ensure data accuracy, integrity and security Deliver … a strong focus on clean, reliable code and documentation Skills & Experience Required Advanced SQL skills for querying, modelling and migration tasks Ability to write production-quality Python for data engineering and automation Proven experience of data migration projects, ideally at enterprise scale Experience with Databricks and the wider Azure stack (Data Lake, Synapse, ADF More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

Job Title: Business Intelligence Data Analyst Location: Middlesex 12 Month Contract Salary up to £65k + Benefits Job Type: Full-time Department: Sales Operations/Business Analytics Job Overview Are you passionate about transforming data into strategic insights that drive business success? We are looking for a Business Intelligence Data Analyst to support our … Global Virtual Sales (GVS) team across EMEA. This role is essential to enabling data-driven decision-making that maximizes sales effectiveness and enhances operational efficiency. As part of a dynamic and collaborative environment, you'll work closely with cross-functional teams-including Sales, Finance, Operations, Strategy & Planning, and IT-to analyze complex datasets and deliver actionable insights. Your … work will directly influence how we execute our Sales Go-to-Market strategy and shape the future of virtual selling Key Responsibilities Enable and support data-driven decision-making across sales operations to enhance productivity and revenue growth. Conduct advanced analysis of complex datasets spanning sales, operations, marketing, and planning. Design and develop reports and dashboards to track More ❯

few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering to regulatory requirements (e.g., GDPR, HIPAA) and implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge and Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with … Python and .NET Experience in implementing data solutions adhering to regulatory requirements and security measures Experience with Python with libraries such as Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation More ❯

Job Title: Data Engineer Role Type: Permanent Location: Birmingham (Hybrid) Role Overview Our client is seeking a skilled Data Engineer to join their dynamic team. You'll play a key role in designing and maintaining data solutions that support business intelligence and analytics across the organisation. Key Responsibilities: Develop curated business models for accurate … decision-making. Build and optimize data pipelines using Azure Synapse and Data Factory. Design reporting solutions with SSRS, SSAS, and SSIS. Extract and integrate data from Dynamics into Synapse/Power BI. Ensure data security and compliance in Azure environments. Support cloud migration from on-premise technologies. Key Skills: Proficiency in Microsoft … BI stack (SSRS, SSAS, SSIS). Hands-on experience with Azure Synapse, Data Factory, and data lakes. Strong analytical skills and ability to derive insights from complex data. Effective communicator and team collaborator. Experience designing curated business models for reporting. If you are a skilled Lead/Senior Data Engineer, we would like to More ❯

Position: Data EngineerLocation: HerefordshireSalary: £50,000 to £65,000 base salary (depending on seniority) Security Clearance: DV Clearance Required Are you a talented Data Engineer ready to take on exciting, customer-facing projects? Our client is expanding their data engineering team and is looking for a proactive, technically sharp individual to help build and … maintain bespoke data pipelines and applications using proprietary commercial software. This is a fantastic opportunity to work on end-to-end data solutions, collaborate with cross-functional teams, and contribute to rapid prototyping and delivery of data-driven products. The Role: As a Data Engineer, you'll be responsible for: Developing intuitive … skills (or similar programming language). Solid experience with relational databases. Familiarity with APIs for data retrieval and integration. Experience gathering requirements and managing stakeholders. Understanding of pipeline scheduling, health checks, and failure mitigation. Exposure to front-end design or development. Benefits Package: £5,000 annual professional development budget. Private healthcare + £100/month wellness fund. More ❯

THIS ROLE IS OFFICE BASED - CITY OF LONDON We’re looking for a curious, driven Data Engineer to help modernize legacy platforms, build cutting-edge data pipelines, and shape the future of our data strategy. You’ll design ETL processes, develop APIs, and turn messy data into powerful insights that fuel every … corner of our business. What you’ll do: Build and own robust, scalable data pipelines & APIs. Design smart cloud solutions with SQL, dbt, and Azure. Champion data quality — because data is a product, not just a process. Collaborate on architectural decisions and mission-critical projects. Solve complex data challenges with creativity and … precision. What you bring: BS in Computer Science, Engineering, or equivalent. 7+ years plus experience working with Azure/Data Strong SQL, Python, and data warehousing/ETL expertise. Hands-on Azure experience (certification = a big plus). Experience with IaC, CI/CD, and modern DevOps tools. Excellent communication skills — you can talk tech with More ❯

a SAS Viya Consultant to work at a leading consultancy client on a contract basis. The successful candidate will be responsible for the design, development, and deployment of data integration and transformation solutions that utilise SAS Viya tools and functionalities alongside Pentaho and Talend. Responsibilities include: - Architect and implement scalable data pipelines and services that support … Business Intelligence and analytics platforms. - Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. - Define and maintain the data technology architecture, including metadata, integration and Business Intelligence or data warehouse architecture - Ensure data quality, governance, and security standards are upheld across all solutions. - Develop and … deliver Risk and ingestion functionalities within the SAS digital platform. Experience required: - Expert skills in designing and deploying data-driven solutions based on SAS Viya, and SAS Data Integration software. - Management of dependencies utilising Platform LSF and Jira - Strong skills in using ETL tools such as Pentaho and Talend - Experience with SAS for data More ❯

required: SC Cleared IR35 Status: Outside IR35 Start date: 01/12/2025 Pay rate: 400-500/d Front-End Developer We are forming a new Data Team to deliver a unified, user-friendly interface that consolidates dashboards, reports, and analytical outputs from across the organisation. This "single pane of glass" will serve as the central … hub for stakeholders to explore data, monitor performance, and make informed decisions. As the Front-End Developer , you will play a pivotal role in designing and building this interface from the ground up. You'll work closely with Data Analysts, Data Scientists, Engineers, and Business Analysts to understand their outputs and translate them into … intuitive, dynamic visual experiences. Your work will directly influence how data is consumed and acted upon across the organisation. Responsibilities Design and develop a unified front-end interface that integrates dashboards, reports, models, and data pipelines into a single, intuitive view Ensure the interface adheres to accessibility standards (e.g. WCAG 2.2), enabling inclusive access for all More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Contract Data Engineer - Google Cloud | Scientific Data | Research-Focused Organisation London (2-3 days a week onsite) £750 per day (Inside IR35) | 6-month contract The Company Harnham is partnering with a leading research and technology organisation that's leveraging data and AI to accelerate scientific innovation. They're looking for an experienced Data Engineer to join on a 6-month contract and help build and optimise data pipelines supporting large-scale scientific and R&D initiatives. The Role You'll be responsible for designing, developing, and maintaining robust data pipelines on Google Cloud. Working closely with other engineers and scientists, you'll ensure the delivery of clean … scalable data solutions that power high-impact research. Key Responsibilities Build and maintain data pipelines using modern tools on Google Cloud, including Python, Spark, SQL, BigQuery, and Cloud Storage. Ensure data pipelines meet the analytical and scientific needs of key applications. Deliver high-quality, production-grade code with testing and documentation. Develop, measure, and More ❯

Contract Data Engineer - Google Cloud | Scientific Data | Research-Focused Organisation London (2-3 days a week onsite) £750 per day (Inside IR35) | 6-month contract The Company Harnham is partnering with a leading research and technology organisation that's leveraging data and AI to accelerate scientific innovation. They're looking for an experienced Data Engineer to join on a 6-month contract and help build and optimise data pipelines supporting large-scale scientific and R&D initiatives. The Role You'll be responsible for designing, developing, and maintaining robust data pipelines on Google Cloud. Working closely with other engineers and scientists, you'll ensure the delivery of clean … scalable data solutions that power high-impact research. Key Responsibilities Build and maintain data pipelines using modern tools on Google Cloud, including Python, Spark, SQL, BigQuery, and Cloud Storage. Ensure data pipelines meet the analytical and scientific needs of key applications. Deliver high-quality, production-grade code with testing and documentation. Develop, measure, and More ❯

Contract Data Engineer - Google Cloud | Scientific Data | Research-Focused Organisation London (2-3 days a week onsite) £750 per day (Inside IR35) | 6-month contract The Company Harnham is partnering with a leading research and technology organisation that's leveraging data and AI to accelerate scientific innovation. They're looking for an experienced Data Engineer to join on a 6-month contract and help build and optimise data pipelines supporting large-scale scientific and R&D initiatives. The Role You'll be responsible for designing, developing, and maintaining robust data pipelines on Google Cloud. Working closely with other engineers and scientists, you'll ensure the delivery of clean … scalable data solutions that power high-impact research. Key Responsibilities Build and maintain data pipelines using modern tools on Google Cloud, including Python, Spark, SQL, BigQuery, and Cloud Storage. Ensure data pipelines meet the analytical and scientific needs of key applications. Deliver high-quality, production-grade code with testing and documentation. Develop, measure, and More ❯

is a huge opportunity to help us unlock the full potential of our market leading data. We're facing exciting technical challenges - from re architecting our data pipeline, to enabling users to query and interact with complex datasets intuitively, and scaling how we acquire entirely new swathes of data. We also believe Tussell is uniquely positioned to … The ideal candidate will have strong experience with any or all of Ruby on Rails, Python, PostgreSQL, and React, along with a track record of working with live, data heavy applications. As a senior hire, you will collaborate closely with the product team and other key stakeholders to ensure that technical decisions support business objectives, user needs, and … pixel perfect, accessible designs Optimize frontend performance and ensure cross browser compatibility Build reusable component libraries and maintain design systems Release & deployment Maintain and enhance the CI/CD pipeline Create and implement managed data migrations Drive the move to infrastructure as code and managed environments Ensure the apps are secure, highly available and performant Architecture & ecosystem More ❯

Senior Data Engineer Edinburgh 4 days per week on-site 6 months (likely extension) 550 - 615 per day outside IR35 Primus is partnering with a leading Financial Services client who are embarking on a greenfield data transformation programme. Their current processes offer limited digital customer interaction, and the vision is to modernise these processes by: Building … a modern data platform in Databricks Creating a single customer view across the organisation. Enabling new client-facing digital services through real-time and batch data pipelines. You will join a growing team of engineers and architects, with strong autonomy and ownership. This is a high-value greenfield initiative for the business, directly impacting customer experience … and long-term data strategy. Key Responsibilities: Design and build scalable data pipelines and transformation logic in Databricks Implement and maintain Delta Lake physical models and relational data models. Contribute to design and coding standards, working closely with architects. Develop and maintain Python packages and libraries to support engineering work. Build and run automated More ❯

Senior Data Engineer Edinburgh 4 days per week on-site 6 months (likely extension) £550 - £615 per day outside IR35 Primus is partnering with a leading Financial Services client who are embarking on a greenfield data transformation programme. Their current processes offer limited digital customer interaction, and the vision is to modernise these processes by: Building … a modern data platform in Databricks Creating a single customer view across the organisation. Enabling new client-facing digital services through real-time and batch data pipelines. You will join a growing team of engineers and architects, with strong autonomy and ownership. This is a high-value greenfield initiative for the business, directly impacting customer experience … and long-term data strategy. Key Responsibilities: Design and build scalable data pipelines and transformation logic in Databricks Implement and maintain Delta Lake physical models and relational data models. Contribute to design and coding standards, working closely with architects. Develop and maintain Python packages and libraries to support engineering work. Build and run automated More ❯

Datasmoothie is a data analysis solution designed specifically for market researchers.They are part … of the Global Data Management Tower within Ipsos and their products offer an all-in-one solutions that helps users create and manage their data pipeline automating the process to assist in handling the full breadth of data processing and analysis tasks. This is a leadership role within the team building Promptly, our … revolutionary AI agent platform that is transforming market research. You will be at the forefront of innovation, shaping a product that allows researchers to analyze complex survey data instantly using natural language. As a senior Python developer, you will lead architecture and backend development, taking ownership of key features from concept to deployment. You will design and implement More ❯

Senior Data Engineer (Kafka Python AWS) London/WFH to £80k Are you a data technologist with fluent Python coding skills who enjoys working with and continually learning new technologies? You could be progressing your career in a senior, hands-on role at a "Tech for Good" company that is enabling life changing education to be … accessed by millions of students across the globe (currently 22 countries and growing). As a Data Engineer you'll help to design, build and operate the data pipelines and data services that power learning experiences. Collaborating with software engineers, data scientists and product managers, you will grow your expertise while contributing … as well as reporting and analytics requirements across the business as it scales to 10's of millions of students. Typically you'll be developing and maintaining reliable data pipelines for both real-time streaming and batch workloads, assisting with the evolution of the Lakehouse, collaborating with analytics, product and machine learning teams to make data More ❯

Senior Data Engineer (Kafka Python AWS) London/WFH to £80k Are you a data technologist with fluent Python coding skills who enjoys working with and continually learning new technologies? You could be progressing your career in a senior, hands-on role at a "Tech for Good" company that is enabling life changing education to be … accessed by millions of students across the globe (currently 22 countries and growing). As a Data Engineer you'll help to design, build and operate the data pipelines and data services that power learning experiences. Collaborating with software engineers, data scientists and product managers, you will grow your expertise while contributing … as well as reporting and analytics requirements across the business as it scales to 10's of millions of students. Typically you'll be developing and maintaining reliable data pipelines for both real-time streaming and batch workloads, assisting with the evolution of the Lakehouse, collaborating with analytics, product and machine learning teams to make data More ❯

Senior Data Engineer (Kafka Python AWS) London/WFH to £80k Are you a data technologist with fluent Python coding skills who enjoys working with and continually learning new technologies? You could be progressing your career in a senior, hands-on role at a "Tech for Good" company that is enabling life changing education to be … accessed by millions of students across the globe (currently 22 countries and growing). As a Data Engineer you'll help to design, build and operate the data pipelines and data services that power learning experiences. Collaborating with software engineers, data scientists and product managers, you will grow your expertise while contributing … as well as reporting and analytics requirements across the business as it scales to 10's of millions of students. Typically you'll be developing and maintaining reliable data pipelines for both real-time streaming and batch workloads, assisting with the evolution of the Lakehouse, collaborating with analytics, product and machine learning teams to make data More ❯

The role of Data Engineer in the industrial and manufacturing industry involves designing, building, and maintaining robust data pipelines and systems to support analytics. This temporary position in Manchester requires technical expertise and a focus on delivering data solutions. Client Details They are a leading manufacturing company based in Greater Manchester. Description Develop and … maintain scalable data pipelines and systems to support analytics requirements. Collaborate with analytics teams to understand data needs and provide tailored solutions. Ensure data quality, integrity, and security across all systems and processes. Optimise database performance and troubleshoot issues as they arise. Integrate data from various sources to create unified datasets for … analysis. Document data workflows, systems, and processes clearly and comprehensively. Stay up-to-date with emerging technologies and recommend improvements to existing systems. Support ad-hoc data requests and provide technical expertise to stakeholders. Profile A successful Data Engineer should have: Proven experience with data engineering tools and technologies. Strong knowledge of More ❯