1 to 25 of 33 Permanent Data Pipeline Jobs in Stoke-on-Trent

Junior Data Engineer – Manufacturing - £30-35k – Hybrid or Remote Overview: An exciting opportunity has arisen for a Junior Data Engineer to join one of the world’s leading transportation manufacturers who specialise in providing safety and securement solutions for mobility devices. They are known best … the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Benefits Annual Leave More ❯

Azure Data Engineer/Consultant – Up to £75K + Bonus Location: Remote (UK-based, with very occasional travel) Salary: Up to £75,000 + bonus Company & role Join one of the UK’s most advanced Microsoft partners, specialising in Azure-led Data & AI solutions. This consultancy … is known for transforming data into tangible value through innovative platforms and strategic data services. With a collaborative team of experts, they deliver impactful solutions across enterprise clients, leveraging the very latest in Microsoft technology. Why This Role Stands Out Play a key role in shaping … across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion Architecture (Bronze, Silver, Gold layers) in lakehouse or Databricks environments Familiarity More ❯

collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and … C#. This role would suit an experienced Data platform engineer or Data Solutions Architect who thrives in working across multiple projects with a diverse range of clients, and who places the importance of bridging the gap between complex data problems and real life product More ❯

Job Title: Data Engineer Location: Remote Remuneration: Up to £86,000 annually Contract Details: Temporary, 12 months Responsibilities: Data Infrastructure Development Design, build, visualise, and maintain scalable data pipelines and ETL processes. 🛠️ Collaborate with engineers to integrate new data sources seamlessly. Data Analytics Support Partner with data scientists to provide clean, reliable datasets for reporting and analysis. 📊 Develop and maintain dashboards and visualisations as required. Data Management Ensure data quality, consistency, and accessibility across all platforms. Implement data governance best practises to … maintain high standards. 🔍 Support the team with on-call duties as necessary. Expected Outcomes: Improve the team's data-driven decision-making capabilities. 📈 Streamline data processes and reduce manual intervention. Enhance data accessibility and usability for the Partner Group team. Qualifications: Experience in data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable … Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data More ❯

Integration · Design, build and maintain AI-driven information retrieval and generation workflows · Securely integrate and manage external and internal AI services · Develop advanced data matching and search solutions · Architect effective interaction frameworks and context-management strategies · Collaborate on extending core model capabilities and protocols Data Engineering … Design and maintain data pipelines for efficient data processing · Ensure efficient data flow between systems and LLM components · Implement data validation, transformation, and enrichment processes · Optimise data storage and retrieval for AI/ML workloads Security & Compliance · Implement security best … understanding of software design principles and coding standards Preferred Skills and Capabilities · Experience with vector databases and embedding models · Knowledge of data pipeline tools and ETL processes · Familiarity with React or other frontend technologies for better cross-team collaboration · Experience implementing LLM integration frameworks · Background in pharmaceutical More ❯

and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work. Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back … in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains. We hold top-level partnership statuses with all … and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such More ❯

Kingdom) About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that … into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing … from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up More ❯

Lead Data Engineer Telford, Shropshire Up to £100k + Benefits A new role for a Lead Data Engineer has arisen with an international Tech company working on a major UK Government Programme designing and delivering a range of data solutions. This is an opportunity … to play a key role in a collaborative function architecting data pipelines and infrastructure, leading in both a technical sense but also through mentorship and establishing best practices and standards. The Role The Lead Data Engineer will design and implement complex data flows to … connect operational systems, build and maintain data environments, evaluate and develop tools to improve data analytics platforms and recognise opportunities to reuse existing data flows between teams. Requirements This is a leadership role and requires not only demonstrable experience of leading on data More ❯

client-side incubation support with ready-made out-of-the box capability supported by smart, execution-focussed practitioners. The Role Are you a data enthusiast with a passion for transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with … and Power BI to join our dynamic team. This role is perfect for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you're excited about helping organizations unlock the full potential of their data, we … d love to hear from you. Essential Expertise: Proven experience in data engineering with exposure to Azure Synapse or Azure Data Factory or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming with a focus More ❯

Who we are looking for A Product Analytics Engineer, who will play a pivotal role in transforming our Sportsbook product through data-driven insights. With over 100 million users, and tens of millions of bets processed daily, your expertise will help us to optimise user experiences and drive … innovation. You will collaborate closely with cross-functional teams, including Product Managers and Software Engineers, to design and implement scalable data solutions that enhance our understanding of user behaviour and product performance. In this dynamic role, you will have the opportunity to work with vast datasets, ensuring that … you! This role is eligible for inclusion in the Company’s hybrid working from home policy. Preferred skills and experience Proven experience in data engineering or analytics engineering, preferably in a high-transaction environment. Strong SQL skills and experience with data warehousing solutions such as BigQuery More ❯

Senior Cloud Data Engineer – Work from Home About the Role My client is looking for a Senior Data Engineer to help lead the transformation of their cloud data infrastructure. This is an exciting opportunity to work within a highly autonomous team building secure, scalable … and modern data solutions that support a software ecosystem. You’ll design and implement robust data pipelines, models, and platform architecture – enabling better decision-making, reporting, and real-time data services. The environment is agile, forward-thinking, and full of opportunities for ownership and … innovation. Key Responsibilities Design and deploy cloud-based data platforms using Snowflake, DBT, and related tools Develop performant, scalable ETL/ELT pipelines across varied data sources Build and maintain dimensional models using Kimball, Data Vault, or Data Mesh methodologies Collaborate with More ❯

Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a More ❯

Job Title: Data/Business Analyst Location: Remote (UK-based) with occasional client site visits Salary: £55–65k This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The … role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system … with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive More ❯

working directly with senior architects and distributed peers across the US and EMEA. You'll lead by doing — designing and building serverless microservices, data-rich APIs, and resilient infrastructure that scales. This is a hands-on role that also offers long-term opportunities to grow into technical leadership … Build and refine APIs (REST and GraphQL) using AppSync, API Gateway, and EventBridge • Work with DynamoDB, Aurora Serverless, and S3 for cloud-native data solutions • Collaborate with frontend (Vue.js) and data platform engineers (Snowflake, Airflow) • Contribute to CI/CD pipelines, observability, and day-2 operational … non-technical audiences Bonus Experience • Familiarity with IaC frameworks (CloudFormation, Terraform, SAM) • Exposure to Snowflake, DBT, Airflow, or cost analytics/data pipeline tools • Knowledge of FinOps practices or cost intelligence platforms • Experience contributing to open-source platforms or cloud-native communities • Working knowledge of ML or More ❯

Geospatial Data Engineer 6 month contract (initially) Remote-Working Outside IR35 Market Rates The Opportunity: ISR are proud to be supporting a high-profile digital transformation programme and we’re looking for an experienced Geospatial Data Engineer to join the team on a contract basis. In … this role, you'll work at the intersection of geospatial data and cloud engineering – designing, building and maintaining robust pipelines that enable the transformation and analysis of large-scale geospatial datasets. Skills and Experience: Strong programming skills in Python, with experience using libraries such as GeoPandas, Shapely and … GDAL Experience with cloud platforms (AWS, Azure or GCP) and infrastructure-as-code tools Proficiency in spatial databases (e.g., PostGIS) and data pipeline tools (e.g., Airflow) Familiarity with geospatial APIs, formats (GeoJSON, WKT) and data services Security Clearance: Candidates must be eligible to pass Baseline More ❯

of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for a motivated and technically capable Graduate Data & AI Engineer to join our growing Microsoft consultancy team. This is an exciting opportunity for someone early in their career to gain hands-on … experience delivering real-world Data and AI solutions on the Azure platform, while also developing consulting skills through direct customer engagement. In this role, you’ll support the design, development, and deployment of data pipelines, analytics solutions, and AI-powered applications. You’ll work alongside experienced … engineers and consultants, contributing to a wide range of projects- from traditional data engineering and reporting to modern machine learning and Generative AI initiatives. We’re looking for someone who is passionate about technology, eager to learn, and comfortable working in a dynamic environment. You should have a More ❯

Associate, Software Engineer – Data Focus I am searching for an Associate, Software Engineer – Data Focus for my client, a leading technology-driven commercial real estate firm focused on bringing digital innovation to the sector through advanced data and software solutions . You will join … a collaborative team of software engineers, machine learning scientists, and UX/UI designers, working on the buildout of transformative data-driven products. Key Responsibilities: Architect, build, and maintain efficient, scalable, and reliable data pipelines. Curate, onboard, and document external datasets for internal use. Conduct forensic … data analysis and troubleshooting to ensure data quality. Produce high-quality, maintainable code and contribute actively to peer reviews. Collaborate with stakeholders to understand analytical and product requirements. Integrate diverse data sources (APIs, S3 buckets, web interfaces) in multiple formats. Develop programmatically validated data More ❯

Data Engineer – GenAI Platform | Vertex Agility | Are you a driven data engineer passionate about enabling the next generation of GenAI tools? Join Vertex Agility and help shape scalable, cloud-native data pipelines for transformative internal AI solutions. We’re hiring a Data Engineer to build ingestion and processing pipelines in Python on AWS infrastructure, working with a global team of cloud engineers, data scientists, and product owners. What you’ll do: ✅ Build production-grade data pipelines for GenAI systems ✅ Collaborate with cross-functional teams across Europe … and vector stores ✅ Focus on code quality, automation, and diagnostics ✅ Work in a fast-paced agile environment You bring: 4+ years experience in data engineering (Python + AWS) High code quality and execution mindset Familiarity with GenAI, CI/CD, and performance optimization Bonus: Kedro, MLOps, or interest More ❯

Senior Data Engineer Competitive Salary and Benefits Package Fully Remote I am working with a leading Fintech business who are currently strengthening their data team. In this key role, you will be working in an agile environment supporting multiple teams to develop creative data-driven solutions, building high performance, resilient, automated data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be very keen to hear from you: Advanced SQL Knowledge (Oracle, PostgreSQL, MSSQL, etc.). Scripting languages … Python, PowerShell). Web service APIs (SOAP, REST). Data modelling experience. Knowledge of Snowflake Analytics Platform would be an advantage. Experience in working within an Agile environment. Knowledge of GIT, Jenkins (CI). Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For a More ❯

Senior Data Operations Engineer Fully Remote Competitive Salary and Benefits Package I am working with a leading fintech client who are strengthening their data team. This is a key role, working as part of a team tasked with designing and developing high-performance and resilient automated … data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be really keen to hear from you: Advanced SQL Knowledge (Snowflake, PostgreSQL, MSSQL, etc.). Scripting languages (Python, PowerShell). Data quality and resolving … related processes Cloud Data Warehousing solutions and ELT/ETL solutions (e.g., Snowflake, DBT). Experience in working within an Agile environment. Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For more information and a confidential chat about this role, contact Mark Raine at More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

Data Engineer London (Hybrid) or Remote (UK) Up to £75k | 4-day workweek | | Unlimited leave About us Climate Policy Radar is on a mission to help people access and understand long climate documents. Nearly 350,000 users from over 100 countries already use our open databases and AI … of that, we have embraced a flexible, hybrid approach to work, including a 4 day workweek. Role Overview: We are looking for a Data Engineer to join our Platform team. Working with the existing team of three engineers and collaborating with the data science and application … teams. In this role, you will help build and improve the data and machine learning infrastructure supporting our R&D and production platforms of high-impact tools and products for global climate law and policy, already serving 330,000 users annually and opening up 500,000 pages of More ❯