176 to 200 of 490 Data Pipeline Jobs in the UK

Data Engineer - 2 month assignment Outside IR35 - £500-£600 per day - Hybrid with client visits to Southampton We're looking for an experienced contractor to support a key data project for an initial 2-month engagement, with strong potential to extend. This role is outside IR35 … and offers hybrid working, with onsite visits to our client's office in Southampton as required. You'll be working largely independently, taking ownership of marketing data pipeline and aactivities using DBT, Snowflake and AWS. Must have: Strong SQL experience Hands-on DBT experience, including DBT administration Strong Snowflake experience, including Snowflake administration Solid AWS knowledge to … integrate into a Snowflake instance Proven ability to work independently and unsupervised Experience using JIRA and Confluence Additional Experience:- Snowflake/AWS DevOps-style experience Experience with marketing data and marketing attribution Power BI experience If you're available at short notice and match the above, please send your CV asap and i will call to talk you More ❯

Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog) 3 - 6 months Remote (UK Candidates Only) £550 - £600 per day Outside IR35 We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts. As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner … with responsibilities of end-to-end design, build and deployment of industry-leading big data and AI applications. Your work will be varied and your responsibilities will include: Designing, developing, and managing end-to-end data pipelines Data processing and transformation using Spark Providing technical governance to enhance ways of working Champion DevOps and … CI/CD methodologies to ensure agile collaboration and robust data solutions Engineer and orchestrate data models and pipelines Lead development activities using Python, PySpark and other technologies Write high-quality code that contributes to a scalable and maintainable data platform To be successful in this role, you will need to have the following More ❯

Data Engineer (Azure & Databricks) Location: London (Hybrid - 2 days in office) Salary: £65,000 + Benefits Level: Mid-Level About the Role: We're looking for a talented Data Engineer to join a leading consultancy and work on cutting-edge data solutions for global clients. You'll design and build scalable data pipelines using Azure and Databricks, ensuring high-quality, reliable data delivery for advanced analytics and AI initiatives. Key Responsibilities: Develop and optimize data pipelines on Azure and Databricks Collaborate with data scientists and analysts to deliver actionable insights Implement best practices for data governance and security Work in a hybrid … setup (2 days per week in our London office) What We're Looking For: Strong experience with Azure Data Services (Data Factory, Synapse, etc.) Hands-on expertise with Databricks and Python Solid understanding of ETL processes and data modelling Excellent problem-solving and communication skills Benefits: Work on high-impact projects with top-tier More ❯

Data Engineer (Azure & Databricks) Location: London (Hybrid - 2 days in office) Salary: £65,000 + Benefits Level: Mid-Level About the Role: We're looking for a talented Data Engineer to join a leading consultancy and work on cutting-edge data solutions for global clients. You'll design and build scalable data pipelines using Azure and Databricks, ensuring high-quality, reliable data delivery for advanced analytics and AI initiatives. Key Responsibilities: Develop and optimize data pipelines on Azure and Databricks Collaborate with data scientists and analysts to deliver actionable insights Implement best practices for data governance and security Work in a hybrid … setup (2 days per week in our London office) What We're Looking For: Strong experience with Azure Data Services (Data Factory, Synapse, etc.) Hands-on expertise with Databricks and Python Solid understanding of ETL processes and data modelling Excellent problem-solving and communication skills Benefits: Work on high-impact projects with top-tier More ❯

cutting-edge analytics solutions that make a real impact. This role combines hands-on technical expertise with strategic thinking. Enabling clients to unlock insights and value from their data using Microsoft’s latest analytics stack. As an expert in Power BI and Microsoft Fabric, you’ll architect scalable, modern data solutions that unlock real business value … and guide delivery teams through implementation. With your deep knowledge in Power BI, Microsoft Fabric, and Azure data services, and your passion for innovation, technical expertise with strategic thinking to support data-driven transformation. Here, you’ll partner with stakeholders, guide delivery teams, and help clients harness the full potential of Microsoft’s newest analytics ecosystem. … Key Responsibilities: Lead the design and architecture of end-to-end analytics solutions using Power BI and Microsoft Fabric Translate business requirements into scalable data models, lakehouse architectures, and reporting frameworks Develop and optimize Power BI reports, dashboards, and semantic models using DAX and Power Query Implement Fabric components including Data Factory, Lakehouse, Dataflows Gen2, and More ❯

Data Engineer - 12 Month FTC Up to £75,000 * London or Birmingham * Hybrid A leading UK-wide property business is seeking a Data Engineer to join their growing analytics and digital function on a 12-month fixed-term contract. The Role In this role you'll take ownership of the organisation's data warehouse … ensuring reliable data flows, resolving issues, and recommending improvements across the wider data ecosystem. You'll work closely with digital, product, and analytics teams to support ongoing business operations while contributing ideas to shape the future-state data platform. This is a great opportunity for a hands-on Data Engineer who enjoys … both maintenance and innovation, and who thrives in customer-focussed, commercially minded environments. Key Responsibilities Manage and maintain the central data warehouse and associated pipelines. Ensure data quality and availability across customer, sales, and operational datasets. Support the onboarding and ingestion of third-party vendor data (e.g. Google Analytics). Troubleshoot and resolve data More ❯

Data Engineer (Microsoft Fabric) Please note this role is Fully remote based. We're partnering with a leading organisation that’s driving innovation through modern data engineering practices, and they’re looking for a Fabric Data Engineer to join their growing team. In this role, you'll work at the forefront of Microsoft Fabric … helping to build robust, scalable data solutions. Responsibilities Delivering high-quality data engineering solutions within the Microsoft Fabric ecosystem. Writing advanced SQL and optimising complex queries. Building and orchestrating data pipelines across modern cloud platforms. Applying expert knowledge of data integration tools and methods. Designing ELT/ETL workflows using medallion architecture … and lakehouse principles. Developing and maintaining data warehouses and data marts. Skills Needed 2+ years’ experience in data engineering, with at least 1 year on Microsoft cloud technologies. Strong hands-on experience with Microsoft Fabric, especially around data engineering and warehousing workflows. Familiarity with Azure DevOps for CI/CD and deployment. More ❯

We're a fast-growing company on a big mission: to unlock the potential of every person, team, and organization on the planet. We're passionate about data being at the core of our decision-making process. After seeing the impact our analytics have had on customers, we know they feel the same. We're now on a … mission to make our customer analytics capabilities a successful revenue stream at Blink Our app offers an all-in-one solution for frontline workers, allowing us to collect data on everything from employee engagement and turnover to survey results, shift booking, and payslips. This potential to transform both our own and our customers' decisions makes analytics at Blink … an incredibly exciting opportunity The Role As our first dedicated data engineer, you will be the bridge between data infrastructure and analytics. You'll own how raw data is turned into trusted, well-modelled datasets that power decision-making. This means building and optimizing dbt models, defining core business metrics, establishing data More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy … leveraging Azure and Databricks to deliver scalable, high-performance solutions that empower analytics and decision-making across the business. What You'll Do Own the data strategy: Shape and evolve a modern hybrid data platform to meet current and future business needs. Architect and optimize: Design robust data pipelines for large-scale ingestion, transformation … and delivery across diverse sources. Champion best practices: Ensure orchestration, monitoring, and governance standards for reliable, secure data flows. Drive innovation: Implement smart storage, compute allocation, and caching techniques for performance and cost efficiency. Lead and inspire: Manage and mentor a team of data engineers and BI developers, fostering collaboration and technical excellence. Deliver insights: Oversee More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy … leveraging Azure and Databricks to deliver scalable, high-performance solutions that empower analytics and decision-making across the business. What You'll Do Own the data strategy: Shape and evolve a modern hybrid data platform to meet current and future business needs. Architect and optimize: Design robust data pipelines for large-scale ingestion, transformation … and delivery across diverse sources. Champion best practices: Ensure orchestration, monitoring, and governance standards for reliable, secure data flows. Drive innovation: Implement smart storage, compute allocation, and caching techniques for performance and cost efficiency. Lead and inspire: Manage and mentor a team of data engineers and BI developers, fostering collaboration and technical excellence. Deliver insights: Oversee More ❯

BI Developer - London - £65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

BI Developer - London - 65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

BI Developer - London - £65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

BI Developer - London - £65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

Python Development - Strong proficiency in Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine Learning Frameworks - Deep expertise in … powered automation solutions that leverage natural language understanding. Appian BPA Platform - Strong experience with Appian low-code platform including process modelling, interface design, expression rules, integration objects, and data modelling. Skilled in building end-to-end business process applications, configuring workflows, implementing business rules, managing records, and integrating Appian with external systems via REST APIs, web services, and … system integration. Ability to assess when RPA vs. API integration vs. AI solutions are most appropriate, and experience building hybrid automation solutions combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). Experience with SQL databases (SQL More ❯

Data Engineer (Microsoft Fabric) Please note this role is Fully remote based. We're partnering with a leading organisation that’s driving innovation through modern data engineering practices, and they’re looking for a Fabric Data Engineer to join their growing team. In this role, you'll work at the forefront of Microsoft Fabric … helping to build robust, scalable data solutions. Responsibilities Delivering high-quality data engineering solutions within the Microsoft Fabric ecosystem. Writing advanced SQL and optimising complex queries. Building and orchestrating data pipelines across modern cloud platforms. Applying expert knowledge of data integration tools and methods. Designing ELT/ETL workflows using medallion architecture … and lakehouse principles. Developing and maintaining data warehouses and data marts. Skills Needed 2+ years’ experience in data engineering, with at least 1 year on Microsoft cloud technologies. Strong hands-on experience with Microsoft Fabric, especially around data engineering and warehousing workflows. Familiarity with Azure DevOps for CI/CD and deployment. More ❯

Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven business, where you'd drive the Data function … holiday (raising to 32), L&D budget, Health insurance, excellent maternity/paternity/adoption leave. What you'll like: You'd scale & improve a top brand's Data function, optimising retention of millions of users & having a real life impact You'd have autonomy over Tech to pick the latest, best languages/frameworks for the job … You'll have broad career progression opportunities across Group, which includes several high profile household name What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. More ❯

Senior Data Engineer This company is leading the way in reshaping how property is managed across the UK. Blending technology, insight, and people, they’re on a mission to create smarter, more sustainable estates. This Senior Data Engineer role is central to that mission, building data platforms that power informed decisions at scale. Role … Location: Leicestershire, 1 day per week in the office Package: £60,000- £70,000pa & Benefits Industry: Property & Facilities Management What You’ll Be Doing: Building and maintaining scalable data pipelines using Microsoft Fabric, Data Factory, OneLake, Dataflows, and Notebooks. Creating robust data models to support analytics and reporting functions. Integrating and transforming data from cloud and on-premise sources using metadata-driven processes. Developing secure, governed multi-tenant data environments with row- and tenant-level access controls. Ensuring data quality, consistency, and compliance across the stack, aligned with industry standards like Uniclass and SFG20. Collaborating with analysts and developers to turn business requirements into scalable data More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

I'm working with a highly successful tech-driven organisation in Edinburgh who are looking for a Principal Software/Data Engineer to take ownership of their growing Snowflake platform ( hybrid - 2 days in office per week ). They've recently begun their Snowflake journey after partnering with a third party to get things off the ground and … is used across the business. This is a hands-on technical leadership role where you'll be the go-to expert for everything Snowflake related within the wider Data Platform group. You'll work closely with a talented team of Software and Data Engineers who handle everything from data integration to infrastructure and APIs. … and data engineering where one day you'll be deploying new infrastructure on AWS, the next you'll be writing Python to enhance a data pipeline - so are looking for individuals with experience in both fields. You'll bring a strong technical background and deep Snowflake expertise, with a solid understanding of its architecture, scalability More ❯

I'm working with a highly successful tech-driven organisation in Edinburgh who are looking for a Principal Software/Data Engineer to take ownership of their growing Snowflake platform ( hybrid - 2 days in office per week ). They've recently begun their Snowflake journey after partnering with a third party to get things off the ground and … is used across the business. This is a hands-on technical leadership role where you'll be the go-to expert for everything Snowflake related within the wider Data Platform group. You'll work closely with a talented team of Software and Data Engineers who handle everything from data integration to infrastructure and APIs. … and data engineering where one day you'll be deploying new infrastructure on AWS, the next you'll be writing Python to enhance a data pipeline - so are looking for individuals with experience in both fields. You'll bring a strong technical background and deep Snowflake expertise, with a solid understanding of its architecture, scalability More ❯

At Neptune, we believe great technology starts with great people - and great decisions start with great data. From managing stock and inventory to understanding our customers, data drives everything we do. We're looking for a Data Engineer to help shape how we collect, structure, and use data across the business. You'll play … key role in delivering reliable, high-quality datasets that power smarter, faster decisions every day. This is a hands-on role where you'll design and maintain the data pipelines, integrations, and platforms that keep Neptune's data accurate, accessible, and secure. Your Key Responsibilities Design, build, and maintain robust ETL pipelines to efficiently extract, transform … and load data from multiple sources. Develop and optimise SQL queries, stored procedures, and database scripts to deliver high-performance data processing. Implement automated data flows that connect operational systems with analytics and business intelligence (BI) tools. Re-engineer manual or ad hoc data processes into scalable, repeatable workflows. Ensure data More ❯

Lead a high-performing data engineering team in Edinburgh, driving the development of large-scale, reliable data systems that enable analytics, insight, and operational decision-making across a fast-paced technology organisation. The Opportunity You'll oversee a team of skilled data engineers, guiding the design and delivery of scalable data pipelines … and platforms that handle massive datasets. You'll help your team solve complex engineering challenges while maintaining high standards of data quality, reliability, and operational excellence. We're looking for someone with a strong technical background who can provide strategic oversight, direct architectural discussions, review implementations, and ensure engineering best practices are applied, while mentoring and coaching your … experience with Java or Python, cloud platforms (AWS, GCP, or Azure), whilst working closely with cross functional teams to translate analytics and business needs into practical, high-impact data solutions. The Company This Edinburgh-based technology company is recognised globally for its innovative, data-driven approach. They foster a collaborative, forward-thinking culture where engineers work More ❯

big ambitions but needs more excellent minds to challenge the status-quo and help it reach new horizons. Where you come in? You'll be joining the Portfolio Data squad to tackle some of the most critical challenges in transforming how we manage insurance exposure and risk aggregations. The current data estate is siloed, inefficient, and … difficult to scale, so the team is designing a robust solution to support seamless data ingestion, scalable storage, and optimise for downstream use cases, including developing our algorithmic underwriting capability. Alongside this, the squad is building a trusted source of truth for insurance exposure data — aligning methodologies with the Exposure Management team and delivering intuitive, high … value views and dashboards for Portfolio Management. By joining us, you'll help modernize our data landscape, eliminate manual and unreliable processes, and empower the business with faster, smarter, and more reliable insights. What you will be doing: • Work with actuaries, data scientists and engineers to design, build, optimise and maintain production grade data More ❯

Data Vendor/Project Manager - Full time permanent role - Remote/home-based - Salary up to £80,000 plus bonus, excellemnt pension scheme, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Manager. This role will focus on overseeing data engineering and integration for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading the engineering and integration team - Managing 3rd party data engineering/platform provider - Build data pipelines for platform - Working to 'knit … systems together (hub/lake/warehouse) - Be the focal point for projects/project management To be considered suitable for this Data Manager role you will need to have experience across the following: - Team managment & leadership - Data engineering background with understanding of system integration - Experienced in managing 3rd party vendors/suppliers/data More ❯