626 to 650 of 1,155 Data Pipeline Jobs in the UK excluding London

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

Connections Policy Data Scientist/Analyst (Contractor) Location: Warwick (Hybrid - 1 day/week onsite) Contract: 6 Months (with potential for extension) Rate: £500/day via umbrella company We're looking for a skilled Data Scientist/Analyst to support policy and reform initiatives within the Connections directorate. You'll be at the heart of … modelling, forecasting, and analytics that shape strategic decisions and regulatory engagement. Working closely with the Data & Systems Lead and Reporting & Insights Lead, you'll build reproducible pipelines, run simulations, and deliver insights that influence real-world outcomes. This is a hands-on role ideal for a contractor who can onboard quickly and deliver value from week one. Key … lead times, capacity release). Run scenario and sensitivity modelling to support strategic decision-making. Design experiments to estimate the impact of policy/process changes. Engineer robust data pipelines using SQL/Python on Azure. Co-create dashboards and curated datasets in Power BI. Produce clear, concise decision papers for internal and external stakeholders. Improve data More ❯

into the clear and concise technical development specifications Managing and updating the project management board for responsible projects aligned with the I&D Analytics project roadmap Working with data engineers and business owners to create data pipelines for reporting and analytics with consideration of the planned system integration, transformation and data migration Delivering Power … BI data models and reports with the Power BI developers' best practise and compliance with the SNG data policies and procedures Supporting the maintenance, management and enhancement of I&D systems and ensuring they are fit for purpose and continuously improved, and supporting the routine review of the quality and completeness of data What … a similar role as an Insight Analyst, ideally in the Real Estate, or broader Investment and Development sectors. You will need strong Power BI reporting experience with advanced data analytics and visualisation skills. You'll also have: Strong financial acumen and commercial knowledge to interpret complex financial and investment analysis Excellent stakeholder management skills with clear communication and More ❯

into the clear and concise technical development specifications Managing and updating the project management board for responsible projects aligned with the I&D Analytics project roadmap Working with data engineers and business owners to create data pipelines for reporting and analytics with consideration of the planned system integration, transformation and data migration Delivering Power … BI data models and reports with the Power BI developers' best practise and compliance with the SNG data policies and procedures Supporting the maintenance, management and enhancement of I&D systems and ensuring they are fit for purpose and continuously improved, and supporting the routine review of the quality and completeness of data What … a similar role as an Insight Analyst, ideally in the Real Estate, or broader Investment and Development sectors. You will need strong Power BI reporting experience with advanced data analytics and visualisation skills. You'll also have: Strong financial acumen and commercial knowledge to interpret complex financial and investment analysis Excellent stakeholder management skills with clear communication and More ❯

Data Engineer 55,000 - 65,000 Telford (hybrid A leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services and deliver secure, reliable … data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performant data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements and align decisions to … and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

Data Analyst: Global Customer Success (10-Month Contract) Are you an 8+ year Data Analyst ready to drive global customer success for an industry leader in financial software? We're looking for a highly motivated Data Analyst to join the Global Customer Success Data Science Team in London, UK. This is a … critical 10-month contract role focused on establishing reliable data foundations and enabling actionable insights across multiple international markets. What You'll Do: Build the Foundation: Collaborate on data pipelines, improve integrity, and establish metric definitions tailored for non-US markets. Automate & Visualize: Create scalable, user-friendly dashboards to track core KPIs (tNPS, AHT, repeat contacts … improve the customer journey. Experiment: Support A/B testing and digital experience evaluations by analyzing performance and quantifying business impact. What You'll Bring: 8+ years in Data Analytics/Science. Expertise in SQL and dashboarding tools ( Tableau/Qlik ). Familiarity with big data tools ( Snowflake, Databricks ) and ETL . Experience with A/ More ❯

Data Engineer Must be London-based, able to work from site in London with occasional travel to Croydon SC Clearance required/or eligible for clearance Contract duration: 2 years + Up To 41,000 per annum, depending on experience Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high … Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/CD) efforts. Engage directly with clients and stakeholders, demonstrating excellent problem More ❯

Propel are working with a high-growth global fintech thats transforming financial access for international communities through AI-driven payments and lending solutions. Theyre looking for a Contract Data Engineer to help scale and optimise the data infrastructure behind their credit and lending products, enabling smarter, faster, data-led decisions across multiple markets. The … Role This hands-on role sits at the heart of the credit data ecosystem designing, building, and maintaining the pipelines that power underwriting, risk modelling, and portfolio analytics. Youll work closely with credit, product, and data science teams to deliver clean, reliable datasets that drive automation and insight at scale. What Youll Bring Proven experience as … a Data Engineer in fintech, lending, or financial services. Strong SQL, Python, and hands-on experience with Snowflake, dbt, and modern data stack tools. Skilled at building and maintaining robust data pipelines from multiple sources (APIs, ledgers, external data feeds). Knowledge of data governance and quality control in regulated More ❯

Data Engineer/Software Engineer – Data Consultancy (Gloucestershire) Salary: £50,000 – £70,000 + £5,000 Training & Development Budget Clearance: Active DV or DV Eligible Location: On-site, in Gloucestershire Type: Permanent | Multiple Roles Available Are you passionate about data engineering and looking to make an impact in a fast-growing, forward-thinking consultancy … We’re recruiting for a Data Consultancy that delivers cutting-edge data-driven solutions to clients across highly secure environments. 🔍 What You’ll Do As a Data Engineer/Software Engineer , you’ll be working on complex data challenges—designing, building, and maintaining data pipelines and analytical systems that drive … people from a variety of technical backgrounds — what matters most is your ability to code and solve problems. You’ll need: Strong SQL skills Proficiency in Python (for data processing, ETL, or automation) The ability to work effectively in a collaborative, on-site team environment Active DV clearance , or eligibility to obtain it 🎓 What’s On Offer More ❯

Data Engineer/Software Engineer – Data Consultancy (Gloucestershire) Salary: £50,000 – £70,000 + £5,000 Training & Development Budget Clearance: Active DV or DV Eligible Location: On-site, in Gloucestershire Type: Permanent | Multiple Roles Available Are you passionate about data engineering and looking to make an impact in a fast-growing, forward-thinking consultancy … We’re recruiting for a Data Consultancy that delivers cutting-edge data-driven solutions to clients across highly secure environments. 🔍 What You’ll Do As a Data Engineer/Software Engineer , you’ll be working on complex data challenges—designing, building, and maintaining data pipelines and analytical systems that drive … people from a variety of technical backgrounds — what matters most is your ability to code and solve problems. You’ll need: Strong SQL skills Proficiency in Python (for data processing, ETL, or automation) The ability to work effectively in a collaborative, on-site team environment Active DV clearance , or eligibility to obtain it 🎓 What’s On Offer More ❯

Data Engineer Watford | £85,000 + Excellent Benefits | Office-Based The Opportunity An excellent opportunity for a talented Data Engineer to join a well-established and growing financial services organisation based in Watford . Offering a salary of £85,000 plus a superb benefits package , this role is ideal for someone seeking a technically hands-on … position within a forward-thinking and data-driven environment. The company has been operating successfully for over 20 years, employs more than 300 staff, and is recognised as a market leader in specialist financial services. You'll be joining a collaborative data team where innovation, accuracy, and analytical thinking are highly valued. Duties & Responsibilities Design, build … and maintain robust data pipelines and reporting solutions using modern cloud technologies. Work closely with senior leadership to shape data and reporting strategies. Develop and enhance MI & BI reports, ensuring accuracy and integrity across all data outputs. Collaborate with Product Owners, Developers, and other technical teams to support business goals. Mentor junior members of More ❯

Senior Data Engineer (SQL BigQuery GCP) London/WFH to £110,000 Are you a data technologist with Media Streaming experience? You could be progressing your career in a senor, hands-on role at one of Europe's most successful streaming and social media platforms. As a Senior Data Engineer you'll design, build … and maintain high-performance services for content modelling, serving and integration, develop data pipelines (both batch and streaming) using cloud native tools and collaborate on rearchitecting the content model to support rich metadata. You'll also build and implement APIs and data services to expose the data to other teams across the business and … are seriously cool and offer a sociable environment with a range of perks and experiences. Please note you must be commutable to London. About you: You have strong Data Engineering experience including design and data modelling skills You can code with Golang, Python or Scala You have advanced SQL and NoSQL database knowledge You're familiar More ❯

Overview We are seeking an experienced Data Engineer (Python Enterprise Developer) to design, develop, and optimize data-driven solutions within enterprise environments. The ideal candidate will have deep expertise in Python programming, strong SQL skills, and hands-on experience with modern data platforms and cloud technologies. Key Responsibilities: Develop, test, and deploy scalable data engineering solutions using Python . Build and maintain data pipelines leveraging libraries such as NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, and Requests . Write and optimize complex SQL queries and manage databases including PostgreSQL . Integrate and automate workflows using DevOps tools (e.g., CI/CD, Jenkins, Git ). Collaborate on cloud-based data initiatives … Mentor team members and foster a positive, results-driven work environment. Qualifications: 8+ years of professional experience in Python development and scripting. Proven ability to design and implement data solutions within enterprise environments. Strong problem-solving, communication, and leadership skills. Familiarity with modern data engineering best practices and tools. If you believe this job description aligns More ❯

Overview We are seeking an experienced Data Engineer (Python Enterprise Developer) to design, develop, and optimize data-driven solutions within enterprise environments. The ideal candidate will have deep expertise in Python programming, strong SQL skills, and hands-on experience with modern data platforms and cloud technologies. Key Responsibilities: Develop, test, and deploy scalable data engineering solutions using Python . Build and maintain data pipelines leveraging libraries such as NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, and Requests . Write and optimize complex SQL queries and manage databases including PostgreSQL . Integrate and automate workflows using DevOps tools (e.g., CI/CD, Jenkins, Git ). Collaborate on cloud-based data initiatives … Mentor team members and foster a positive, results-driven work environment. Qualifications: 8+ years of professional experience in Python development and scripting. Proven ability to design and implement data solutions within enterprise environments. Strong problem-solving, communication, and leadership skills. Familiarity with modern data engineering best practices and tools. If you believe this job description aligns More ❯

Overview We are seeking an experienced Data Engineer (Python Enterprise Developer) to design, develop, and optimize data-driven solutions within enterprise environments. The ideal candidate will have deep expertise in Python programming, strong SQL skills, and hands-on experience with modern data platforms and cloud technologies. Key Responsibilities: Develop, test, and deploy scalable data engineering solutions using Python . Build and maintain data pipelines leveraging libraries such as NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, and Requests . Write and optimize complex SQL queries and manage databases including PostgreSQL . Integrate and automate workflows using DevOps tools (e.g., CI/CD, Jenkins, Git ). Collaborate on cloud-based data initiatives … Mentor team members and foster a positive, results-driven work environment. Qualifications: 8+ years of professional experience in Python development and scripting. Proven ability to design and implement data solutions within enterprise environments. Strong problem-solving, communication, and leadership skills. Familiarity with modern data engineering best practices and tools. If you believe this job description aligns More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

Microsoft Fabric Consultant | Data Engineering & DataOps? Hybrid (2 days onsite in London)?? Permanent | Full-time? £70,000 – £80,000 + 10% Bonus & 25 days holiday, pension & other benefitsAre you a Fabric Consultant or Data Engineer looking to work with cutting-edge tech and make a real impact We’re hiring for a hands-on role where … you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients.What You’ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience in data engineering with Microsoft Fabric Solid More ❯

EKS/Kubernetes , and integrated with modern mobile and analytics platforms. As part of a collaborative, Agile development team, you will be responsible for building robust microservices, managing data pipelines across PostgreSQL and Amazon Redshift , and delivering performant, secure RESTful APIs used across web and mobile platforms. You'll work closely with iOS and Android engineers to ensure More ❯

Job Title: Azure Data Engineer Location: Warwick, UK (Office Based) Job Type: Contract (Inside IR35) Duration: 6 months Job Summary: Join Tata Consultancy Services (TCS) as an Azure Data Engineer and play a key role in delivering innovative data solutions for some of the largest brands in the UK and worldwide. You will leverage … your expertise in Azure, ADF, and modern data platforms to support high-impact, data-driven projects that make a meaningful difference to our clients and communities. Key Responsibilities: Apply in-depth knowledge of Azure and SQL to develop and maintain robust data solutions. Utilize strong debugging skills to resolve issues efficiently. Design, build, and … manage data pipelines using Azure Data Factory (ADF) . Collaborate effectively with stakeholders, ensuring clear communication throughout project lifecycles. Skills, Experience, and Abilities Required: Essential: Expert-level experience with Azure Data Factory (ADF) Hands-on experience with Snowflake and Databricks Proficiency in Python programming Strong Azure and SQL knowledge Excellent debugging and troubleshooting abilities More ❯

solving, and hands-on contribution. The role involves Re-architecting an AWS environment that has grown inconsistently, addressing security, governance, and scalability. Designing and implementing distributed systems and data pipelines, with a focus on reliability and resilience. Working directly on code and infrastructure as code (around 50% of your time). Running proofs of concept to evaluate approaches … as Node.js, C#, or Java (currently use serverless architecture using Node.js and React). Understand SQL at a solid level, with broader experience across NoSQL and data pipeline design. Have experience with distributed systems or progressive web applications. Think carefully about problems, explore alternatives, and can explain the reasoning behind their choices. This role may suit someone … currently working as Lead Developer/Senior Software Engineer Lead DevOps Engineer Solutions Architect with hands-on coding experience Senior Data Engineer with strong AWS expertise Technical Lead in a small-to-medium software team It would particularly fit someone who enjoys combining practical engineering with higher-level architectural thinking, and who wants the space to solve technical More ❯