251 to 275 of 567 Data Pipeline Jobs in the UK excluding London

Data Engineer (Azure) - Outside IR35 - 3 Months+ - Remote/Glasgow We're currently looking for an experienced Data Engineer to join a Glasgow-based organisation going through a significant transformation. As the organisation looks to mature their data capabilities, this role will be pivotal … in building out their data infrastructure, specifically focusing on designing and developing scalable data pipelines. The data to be ingested will vary; however, a focus will be placed initially on the company's analytics platforms and the company's CRM, so experience here would … be advantageous. Desired Skills Designing and building robust data pipelines for scalable data processing Developing and maintaining ETL workflows to support analytics and reporting Hands-on with Azure ecosystem: Data Factory, Databricks, and Synapse Analytics Experience working with data warehousing solutions and More ❯

Senior Data Scientist at University of Edinburgh Sponsorship Available The University of Edinburgh is seeking a talented and experienced Senior Data Scientist to join its prestigious School of Informatics. This is an exciting opportunity for a data science professional to advance their career, contributing … to groundbreaking research at the intersection of AI and biological data. Candidates should have proven experience in a data science role, with strong skills in managing, structuring, visualising, and analysing data, as well as developing statistical or machine learning tools. The ideal applicant will have hands … role is ideal for someone looking to develop leadership skills within a newly established team focused on AI solutions using cutting-edge biological data modalities. As part of a leading research institution, the successful candidate will contribute to innovative interdisciplinary work that advances scientific discovery. Visa sponsorship is More ❯

Data Engineer | Bristol | Up to 70,000 depending on experience We are partnering with a growing energy company in their search for a Data Engineer to join their team. They are a leading energy trading company with a global presence, and they are making waves across … the market, so you won't want to miss out! Responsibilities: Acquire and store UK and EU energy market data efficiently. Develop and enhance batch and real-time data pipelines. Collaborate with frontend and data science teams to optimize data processes. Audit … databases and enhance data querying efficiency. Prepare datasets for modelling and analysis. Experience required: Proficiency in Python and SQL. Degree in a quantitative/computational discipline. 2+ years of relevant experience in data engineering. Experience in data modelling and end-to-end data More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key role in the … technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality Snowflake environment to … support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical solutions with strategic More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key role in the … technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality Snowflake environment to … support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical solutions with strategic More ❯

Data Solutions Architect (Azure) We are seeking a visionary Data Solutions Architect to design and implement data-driven systems at scale. This role combines technical expertise and leadership to develop high-quality data solutions that align with client needs. Your primary focus … will be on leveraging modern data platforms, particularly within the Microsoft ecosystem, to deliver impactful results. As a key member of the team, you will bridge the gap between business and technology, ensuring all stakeholders understand the transformative power of data. You'll also guide the technical team … through the lifecycle of data solutions, from conception to deployment, fostering collaboration and innovation. Key Responsibilities and Requirements: Partner with clients to identify how data can drive value, ensuring alignment with strategic objectives. Take ownership of data solution design and development, overseeing coding, testing More ❯

or follow us on Position Overview As an Application Developer, you will be working with colleagues focused on understanding the operational Use Cases, data scientists using ML models to deliver solutions to support business decisions, and data engineers to deliver an end-end solution. As a … UI Application Developer, you will be responsible for the development of User Interface providing data visualizations to help with business operations and decision making. You will have an eye for good user design and usability with a focus on developing tools for manufacturing operations. Key Responsibilities: Manage the … execution of data-focused projects within the EU&AF AME team, utilizing Lear's data analytics and application platform. Participate in multiple projects from their inception, contributing to defining the problem statement. Develop a standardized toolset across Lear for analyzing and presenting data effectively More ❯

Lead Data Solutions Architect – Azure, Databricks, Fabric, Terraform Private Banking | London | Hybrid (2 days on-site) | 6-Month Contract (Extendable) twentyAI are partnered with a prestigious Private Bank undergoing a major transformation to a cloud-native, data-driven operating model. Following a recent rebrief, there is … a renewed focus on strategic, solutions-led data architecture. They are now seeking a Lead-level Data Architect to drive forward critical initiatives and deliver enterprise-grade data solutions. The Role As a Lead Data Solutions Architect, you will operate as a … senior member of the data architecture function, working alongside the Lead Data Architect but with end-to-end ownership of high-impact projects. This is a hands-on, solutions-led role where you will design and deliver scalable, compliant, and business-aligned data platforms More ❯

Senior Data Engineer - Runcorn - £80K A growing manufacturing business in Runcorn is looking for a Senior Data Engineer to join their team. You'll design and optimise data pipelines, ensuring efficient data flow across the business. Working closely with the wider business … you'll ensure their data warehouse efficiently delivers high-quality insights. The role also offers fantastic career progression, with the potential to move into a Head of Data Engineering role in the future What's in it for you? Salary up to £80,000 + bonus … and wellness benefits Hybrid working from Runcorn Company discount on their products + much more Key Responsibilities Develop and maintain ETL/ELT data pipelines using Python and SQL. Work with enterprise-level cloud platforms, ideally GCP (BigQuery, Airflow, Cloud Functions). Integrate APIs and process data More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a … options aligned with the departments long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will … Factory (ADF): Incremental creation of data dimensions to optimise processing, reduce overheads, and improve cost efficiency across compute, storage, and networking. Enhancing pipeline security by replacing basic authentication with managed identities or service principals. Introducing parallelism into pipeline workflows to improve performance and scalability. Refactoring existing More ❯

Head of Data Engineering Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex … environments and collaborating with senior technical teams. This role falls inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. … Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability, and scalability of data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple More ❯

We are seeking a diligent and innovative Data Engineer to join our Analytics team, the successful Data Engineer with be able to demonstrate a strong business acumen. The ideal candidate will ideally worked with ETL processes, Snowflake, and Tableau, and will be instrumental in bridging the … gap between data engineering and business strategy. Client Details We are a global electronics and manufacturing company that operates in 100 countries. Our UK subsidiary is based in Manchester. We are on a journey to further develop our data first approach this role will play a … key part in bridging the gap between or data engineering team and the wider business. Description The successful Data Engineer will be responsible for but not limited to: Building robust, scalable data pipelines. Implement complex, large scale big data projects with a More ❯

Senior Data Engineer Location: London | Hybrid Tech Stack: Azure | Synapse | Databricks | Power BI Cloud Focus: Cloud-native + hybrid integration Salary: £80,000 - £100,000 + 20% bonus We’re hiring a Senior Data Engineer on behalf of a global financial services firm undergoing large-scale … and is critical to building scalable, secure data solutions using the Azure ecosystem. You’ll work across modern and hybrid environments, lead pipeline development, and play a hands-on role in shaping the firm’s data engineering framework — with real impact on decision-making, performance … and productivity. What You’ll Do Lead the design and build of end-to-end data pipelines on Azure Synapse and Databricks. Work with DevOps and Architecture teams to ensure seamless integration between cloud and legacy on-prem systems. Contribute to a cloud-native data engineering More ❯

Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and financial services. Our mission is simple: take away … Autonomy: Authority over technical strategy, decisions and implementation approach, so you can deliver using practices that align with your preferred ways of working. Data Driven: Utilise rich logs, metrics, and data to monitor and improve system performance & reliability. Culture: Enhancing a diverse engineering culture by taking … around the business to build relationships and act as a multiplier. What we look for in you Understand, assess and effectively apply modern data architectures (dimensional model, data mesh, data lake). Experience in applying and using data observability methods effectively. Experience More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the … Data and Analytics role within Mars's Global Pet Nutrition (PN) division. Pet Nutrition (PN) is a vibrant category in the FMCG sector. As we aim to transform this sector, the Digital First program has been launched by the PN leadership team. Digital First centers pet parents in … This initiative requires significant thought leadership, technical know-how, and the ability to navigate complex challenges while leading a team of top-tier data and analytics professionals. In this role, you will operate globally, collaborating with engineering teams across growth products, to develop and maintain robust data More ❯

engineering, and publishing in one role. This is a fantastic opportunity to join a growing, tech-forward quant research team. As a Senior Data Scientist, you’ll be joining a collaborative and innovation-focused environment where you’ll help solve complex problems using modern AI and machine learning … techniques. You’ll work on designing intelligent systems that uncover hidden signals in data and influence how assets are allocated. What you’ll be doing: This role is ideal for someone who’s motivated by research, enjoys working with large-scale data systems, and wants to … unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What you’ll get in return: A salary of between More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days’ work from home Salary: Negotiable to £70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery Monitor More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer- About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing within the team Senior Engineer - Desirable Skills More ❯

Data Manager | London 3 or 4 times a month |£74,000-£84,000 + Huge Bonus My client, a forward-thinking organisation in the interactive tech and entertainment space, is on the lookout for an experienced Engineering Manager to head up their data engineering function. This … a high-performing team to deliver it. You'll collaborate with analysts, scientists, and stakeholders to design fast, scalable pipelines and shape the data architecture that fuels innovation. What You'll Be Doing: Lead a team of data engineers, providing technical guidance, mentoring, and support. Oversee … the build and optimisation of scalable data pipelines and robust ETL workflows. Partner with teams across the business to gather data requirements and deliver accessible, reliable datasets. Champion best practices in data quality, governance, and platform security. Modernise and evolve the data More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days' work from home Salary: Negotiable to 70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery Monitor More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days' work from home Salary: Negotiable to £70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities ·Assist in the design, development, and maintenance of data pipelines and ETL processes ·Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery ·Monitor More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. … Azure certified Data Engineer/Architect Knowledge of Machine Learning and NLP unstructured data. Implemented ML platform in enterprise client experience of ML use-cases AIML Platforms: DataRobot, Dataiku, Anaconda, Sagemaker, Vertex etc. AIML Frameworks: MLFlow, KubeFlow, BentoML, TensorFlow etc. AIML Development: PyTorch, Jupyter Notebooks, XGBoost, Tensorflow etc. More ❯

cutting-edge AI Innovation Team, and we are looking for an exceptional Machine Learning Engineer/MLOps Engineer/AIOps Engineer/AI Data Engineer/Data Scientist/Data Science Engineer/Software Engineer Tech Lead to be at the heart of this … transformation. Call it what you want, but this is a critical role for someone who can bridge the gaps between data science, data engineering and software engineering, ensuring AI/ML models are successfully built, deployed and scaled. You will work on real-world machine learning … doing: Develop and deploy AL/ML artificial intelligence/machine learning models for large-scale business applications. Build and maintain high-performance data pipelines, integrating structured and unstructured data sources. Take AI models from prototype to fully scalable production systems. Implement CI/CD pipelines More ❯

re on a mission to create a virtual sales agent that performs better than a human sales agent. We’re looking for a Data Engineering Manager to lead a small team in building a key part of our data infrastructure - evolving and scaling the ingestion of … internal systems. This role blends people management, individual contribution, and technology leadership. People Management: You will lead and mentor a small team of Data Engineers, fostering a high-performance culture by guiding their professional growth and ensuring effective communication within the team and with stakeholders. Your strong interpersonal … Python and Docker in our pipelines. You’ll need to be highly proficient in these or similar tools and comfortable navigating a modern data ecosystem. The person we’re looking for Passionate about designing and delivering solutions to complex problems Curious with a desire for continuous learning Friendly More ❯