101 to 125 of 309 Data Pipeline Jobs in the UK excluding London

Senior Data Engineer - Databricks - London (Hybrid) - Up to £80,000 We're partnering with a fast-growing analytics and data business operating across the entertainment sector. As demand for real-time insight and advanced analytics continues to scale, the company is investing heavily in a modern … cloud-native data platform, with Databricks at its core. This role is ideal for a Senior Data Engineer who wants true end-to-end ownership: designing, building, deploying and operating production-grade data systems, while shaping engineering standards and CI/CD practices across ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial … markets. They are expanding their engineering capability in Newcastle and are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer ...

Lead Data Engineer | Microsoft Fabric | Azure | AI Birmingham Hybrid | 2-3 days per week £60,000 - £70,000 + 10% bonus + excellent benefits If you enjoy building data platforms rather than simply maintaining them, this could be worth a look. Were supporting a well-established … Experience around some of the following would be useful: Azure Data Engineering environments SQL and data modelling ETL/ELT pipeline design Azure Synapse Azure Data Lake Microsoft Fabric Power BI Azure DevOps API integrations Exposure to AI, ML or Copilot-enabled initiatives ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … Peoplevox or Google Analytics 4 (GA4) is beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model ...

Data Engineer Manchester, 2 days per week Millions of customers. One proprietary platform. Infinite possibilities. This global technology business has just completed a massive migration to their own platform, and now, the stage is set for scale, innovation, and speed. Products are being built at pace, technology … unlocking new capabilities, and the experiences delivered to customers worldwide are next-level. They're looking for a Data Engineer to become an integral part of their Data Engineering Team. Working within a modern AWS environment, you will be responsible for building scalable data ...

Package Description: Lead Data Engineer Remote: (UK-based) - Occasional travel to Ashford, Kent Full-time: Permanent 37.5 hours per week Salary: Up to £70,000 per annum About us CLEO Systems is a wholly owned subsidiary of IC24, a leading not-for-profit social enterprise delivering innovative, patient … to drive meaningful impact. Were particularly interested in candidates with: Proven experience in data engineering, data warehousing, and pipeline development Experience leading or mentoring technical teams At least 5 years within information, data architecture and engineering Strong stakeholder engagement skills across ...

biology, serving tens of thousands of users every year and widely cited in the scientific literature. We are recruiting a Bioinformatics Data Engineer to develop and maintain both the Rfam and RNAcentral databases. They are currently funded by the BBSRC and Wellcome . The RNA Resources team … processing, storage and retrieval for Rfam and RNAcentral. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability. The tasks will include: Analysing existing data curation and data production ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … Data Platform Engineer professional excited to work on impactful projects and shape the future of our data pipeline, we’d love to hear from you. Please email your CV with the heading ‘Data Platform Engineer’ to recruitment@realitymine.com ...

Data Engineer Salary up to £70,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're seeking a skilled Data … role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability ...

Data Engineer Day Rate: £469/day (Inside IR35) Duration: 6 months Location: Mostly remote (occasional on-site workshops in Telford) Security Clearance: ActiveSC Required Job Description We are seeking an experienced Data Engineer to support the delivery of critical data integration and reporting … enterprise data platforms Support testing activities including component, integration, and performance testing Investigate, troubleshoot, and resolve data and pipeline issues Contribute to CI/CD and source control practices (e.g. Git-based workflows) Collaborate with QA, engineering, and delivery teams across the lifecycle Maintain RAID ...

Data Scientist within the Analytics Team, you will contribute to data-driven strategies for our clients. Working closely with the Data & Analytics Manager and senior colleagues, you will deliver data science projects and collaborate with stakeholders across data strategy, sales … account management, delivery and marketing. You will bring solid technical skills and commercial awareness to deliver data solutions that drive measurable operational performance. This is a hands-on role - ideal for someone who thrives on translating data into actionable insight and producing high-quality outcomes. Responsibilities ...

Data Engineer – Newcastle upon Tyne We are seeking an experienced Data Engineer to join a high-performing engineering team based in Newcastle city centre. This is an opportunity to work on complex, high-impact projects within a collaborative and intellectually stimulating environment. The successful candidate will … play a key role in designing, building, and maintaining scalable data platforms and pipelines that support advanced analytics and decision-making. The Role As a Data Engineer, you will work closely with technical and non-technical stakeholders to develop reliable, scalable, and high-quality data ...

Gold layered models. Shape the platform’s architectural roadmap, ensuring alignment with cutting-edge engineering practices. Develop secure and observable ingestion and transformation pipelines. Pipeline Development & Operations: Spearhead the migration from legacy ETL tools to modern Azure-based pipelines, using Azure Functions, Azure Data Factory … architecture principles and scalable enterprise data design. Version Control: Proficient in Git, CI/CD, automated testing, and modern engineering practices. Pipeline Design: Experience with API ingestion, SFTP ingestion, and resilient pipeline design. Required Skills Exceptional problem-solving and architectural thinking abilities. Strong communication ...

Daily Rate: Inside IR35 We are seeking a hands-on Technical Lead to spearhead the design, engineering, and delivery of scalable, cloud-native data solutions across our enterprise data platform. This role is perfect for a technically adept engineering lead with expertise in data … building secure, scalable APIs and distributed applications. Expertise in data engineering & platforms including SQL, data warehousing, ETL/ELT pipelines, data modelling, and integration of data science and analytics. Experience delivering cloud-native solutions, ideally within Google Cloud Platform (GCP), or equivalent ...

Data Engineer Hybrid Manchester City Centre We’re hiring a Data Engineer to help build and scale a modern, cloud-first data platform. This is a great opportunity to work on high-volume data systems, shaping architecture and enabling real-time analytics … cases. What you’ll be doing: Build and optimise data pipelines & ETL processes Contribute to a cloud migration to AWS (S3, Redshift) Develop lakehouse/data warehousing solutions Improve data quality, performance & scalability Partner with Data Science & Analytics teams Tech stack ...

client, a prominent entity in the Defence and Security sector, is currently seeking a dedicated Data Engineer to join their team in a permanent capacity. Key Responsibilities: Build, configure, and maintain a modern cloud-based data platform in alignment with architectural blueprints and design standards. Develop … robust data pipelines that ingest, transform, and publish data from multiple source systems into trusted reporting layers. Ensure solutions support financial reporting requirements including accuracy, completeness, auditability, and traceability. Collaboration & Technical Input: Work closely with Data Architects to refine designs, challenge assumptions, and contribute ...

Marketing Data Engineer - Contract London - 2 days a week This freelance assignment stands out due to the immediate impact you will have on live marketing data platforms during a critical delivery period. You will focus primarily on data engineering, owning pipelines and transformations that … required. Work through a ticketing system, collaborating closely with project managers, analytics engineers and media teams to deliver changes. Proactively identify opportunities to improve pipeline efficiency, data quality and dashboard reliability. Your Skills & Experience Strong experience designing, building and maintaining data pipelines on GCP, with ...

Data Engineer (SQL Server/SSIS) – 3 Month Initial Contract – Remote/Cardiff VIQU have partnered with an NHS organisation to recruit a hands-on Data Engineer to support critical data integration and ETL workloads across a Microsoft-based environment. This Data Engineer role is focused on stabilising, improving and enhancing existing data pipelines, alongside supporting ongoing modernisation and cloud migration activities. The Role The successful Data Engineer will play a key role in ensuring the reliability and performance of existing ETL processes, working across ...

growing fleet of commercial vessels. Working across engineering , software , and commercial teams, you will own the end-to-end data and insight pipeline , designing how operational data flows from onboard systems through to internal engineering tools and customer-facing reporting. You will play a central … close the loop between real-world operation and product development . Responsibilities will include: Owning the end-to-end data and insight pipeline across operational performance reporting Designing how data flows from onboard systems into internal engineering tools and customer-facing outputs Building and maintaining ...

management consultancy and technology services company as a Technical Lead. This role involves driving the design, engineering, and delivery of scalable, cloud-native data solutions for a major postal service provider with a rich history. This position is ideal for a technically strong engineering lead with expertise across … building secure, scalable APIs and distributed applications). Proficiency in data engineering & platforms (SQL, data warehousing, ETL/ELT pipelines, data modeling, data wrangling). Experience delivering cloud-native solutions, ideally within Google Cloud Platform (GCP), or equivalent AWS or Azure experience. ...

Data Engineer Glasgow or Reading - required onsite for occasional meetings and workshops only 6 Month Contract £550 - £675/day inside IR35 Lorien's Utilities client are currently recruiting for a Data Engineer to join on a 6 month initial contract, inside IR35. As part … your role you will: Architect, create, improve, and operationalise integrated and reusable data pipelines, tools and processes. Measuring performance, efficiency and robustness of data provision and best practice process approaches. Deliver commercial value through working with key business stakeholders, IT experts and subject-matter experts ...

title: Junior Data Engineer Location : Edinburgh Hybrid role: working 2 days a week in the office Salary: £36,000 to £41,000 pa plus 5% bonus Contract: 12-month fixed term contract Our market-leading financial services client is seeking an a motivated, detail focused Junior Data Engineer to join the Business Transaction Banking division. This role involves building, optimising, and scale data pipelines and large-scale data processing workloads in a cloud-native environment. You will work with modern distributed data systems, contribute to data platform ...

Role Title: Data System Analyst Contract: 12 months Location: Marlow (hybrid) SRG are working with a global leader in the aesthetics industry, committed to driving innovation and providing high-quality products and services. Our client is dedicated to empowering confidence by providing the most advanced aesthetic solutions … user needs Data Management & Integration Support the collection, processing, and integration of large datasets from multiple sources Contribute to data pipeline development, ensuring accuracy, consistency, and reliability across platforms Participate in data governance and quality assurance processes in line with established standards Project ...

complex problems and building production-ready AI solutions that deliver measurable business value. Working alongside AI Technical Leads, Product Teams, Software Engineers and Data Scientists, you will design, develop and deploy cutting-edge AI applications using modern Machine Learning and Generative AI technologies. You will play … Learn LangChain LangGraph Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock SageMaker Lambda ...

Opportunity As a Performance Engineer, you will play a key role in owning and improving the full operational data and insight pipeline from onboard vessel systems through to engineering analysis and customer-facing reporting. You will work closely with engineering, software, and commercial teams to transform complex … performance is understood and communicated within a rapidly growing business. Key Responsibilities Own the end-to-end operational data and insight pipeline Design and improve how onboard system data flows into internal engineering tools and customer-facing outputs Build and maintain data pipelines ...