276 to 300 of 431 Data Pipeline Jobs in the UK excluding London

Reporting in to the Head of IT, the successful Data Engineer will work on building and maintaining data pipelines to support analytics and decision-making processes. This role is all about ensuring data flows smoothly and efficiently, helping the business make informed choices. Client … mission is to "enrich the lives of pets and their owners through visibly better pet food." We are currently looking to grow our Data Engineering & Analytics team Description The successful Data Engineer will be responsible for but not limited to: Design, build and maintain efficient ...

client is a digital consultancy. Senior Data Engineer 6 Month FTC Who we are: Were on a mission to close the worlds tech skills gap. We help organisations navigate the future of technology, combining human expertise, emerging tech and AI to deliver better outcomes, faster. Since 2014, weve … pipelines in Snowflake, dbt and Dagster You will lead the designing of scalable data models and machine learning models Key Responsibilities Pipeline & Architecture Ownership: Design and implement automated, modular transformation pipelines in a modern cloud data warehouse, following a clean, tiered physical data ...

Azure Databricks Engineer | Inside IR35 | £500 - £550 | Hybrid | London We're recruiting for an experienced Azure Databricks Engineer to join a growing data team. You'll be responsible for designing, developing and supporting scalable data solutions across Azure and Databricks, helping to deliver reliable, high-quality … data for the business. This role would require you to be onsite 4 days per week with the final day being remote. Key Responsibilities Develop Databricks solutions using SQL, PySpark and Python. Build and maintain ETL/ELT pipelines across Azure, SQL Server and Databricks. Support Lakeflow pipelines ...

pipelines running on top of it - and you'll push the boundaries of how we deliver, including leveraging AI agents to scale up pipeline delivery. Your work will directly enable our Analytics and AI teams to build the future of global language services. If you enjoy designing systems … services including BigQuery, Dataflow, Dataform, Cloud Composer and Knowledge Catalog. Scale Delivery with AI: You'll leverage AI agents and automation to accelerate pipeline delivery and raise the throughput of the wider engineering team. Skills & Experience Infrastructure Automation: Expert-level Terraform, with GitHub Actions or similar for automated build ...

Senior Data Engineers, alongside the opportunity to grow towards senior-level responsibilities. Tech StackSpark | Airflow | Kubernetes | Azure | CubeJSWhat You'll Be DoingData Pipeline Development – designing & developing efficient, scalable & robust Data PipelinesSupport and main the data platform to ensure security, reliability, and scalability. Working … with the wider engineering team to gather pipeline requirements, project goals & deliver insights where applicable. Collaborating with engineers, product teams, and customer-facing stakeholdersWhat We're Looking For3-7 years' commercial Data Engineering experienceExcellent understanding of data modelling principles and data warehousing concepts. ...

couple of years. Join us - and help us fulfil our mission to close the worlds digital skills gap. The role A hands-on Data Architect responsible for defining data strategy, architectural principles, guardrails and target/transition architectures within a complex, cloud-native environment. Combines strategic … leadership with deep technical expertise in data modelling, detailed design, distributed systems and engineering problem-solving. Key Responsibilities & Skills Data Architecture & Strategy: Define and evolve data strategy, architecture principles, standards and target-state roadmaps, balancing scalability, resilience, security, cost and delivery speed. Cloud-Native ...

Principal Data Engineer 12 Month Contract Inside IR35 - Up to £1000 per day (DOE) Manchester, UK - Hybrid - 4 days a week onsite Morson Edge are partnered with a leading investment management firm who are looking for an experienced Principal Data Engineer to join their established Data … Strong experience with: Snowflake - Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end-to-end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake-optimised SQL. ...

true value to numerous organisations across the Financial Services, Fintech, Public Sector and Utilities industries. They've got a huge demand across their Data practise and are looking to bring onboard multiple Senior and Lead Data Engineering (Python, SQL, AWS, Azure, GCP) experts who ideally have … strong Software Engineering knowledge. Scope of role: Strong experience with modern data engineering and reporting, data storage, data pipelines and analytical data reporting. Extensive knowledge using Python, Spark, SQL, PySpark, PowerBI Hands-on client facing roles, providing techical advise to clients ...

plans to become The Best and Biggest in the UK market. Over the past few years, we've made significant investments in our data and tech capabilities, particularly within our CIO function. Our CIO team is at the forefront of driving innovation and ensuring our technology infrastructure supports … team is always looking for passionate individuals who are eager to make a difference and contribute to our success. Job DetailsAs a Data & AI Engineer you will design, build and support scalable data and AI solutions that enable analytics, automation, and AI-driven business outcomes. Develop ...

invest in you!. Job DescriptionWrite a comprehensive Test Strategy/Approach and a Test Plan for the program. Experience testing how data is loaded and moved through data pipelines, including checking that the data is structured correctly and loads as expected. Able … validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible ...

invest in you!. Job DescriptionWrite a comprehensive Test Strategy/Approach and a Test Plan for the program. Experience testing how data is loaded and moved through data pipelines, including checking that the data is structured correctly and loads as expected. Able … validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible ...

invest in you!. Job DescriptionWrite a comprehensive Test Strategy/Approach and a Test Plan for the program. Experience testing how data is loaded and moved through data pipelines, including checking that the data is structured correctly and loads as expected. Able … validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible ...

summary Are you passionate about using data science to improve population health and reduce health inequalities? Public Health Wales is seeking an enthusiastic and innovative Advanced Data Scientist to join our growing Data Science Team. This is an exciting opportunity to apply advanced analytical … data science techniques to support national public health priorities across Wales. Main duties of the job You will work on a wide range of projects, including statistical and simulation modelling, machine learning, predictive analytics and data engineering. The role offers the opportunity to work with modern ...

Data Engineer Location: Milton Keynes/Hybrid Salary: £70k + benefits Type: Permanent Please Note We Do Not Offer Sponsorship The Opportunity Looking for a Data Engineer to build and maintain the data pipelines and platforms that power analytics, reporting and machine learning. … your work has real business impact. What You'll Be Doing Designing, building and optimising scalable ETL/ELT pipelines Developing and maintaining data warehouses and lakes in the cloud Ensuring data quality, reliability and security across the platform Working with Data Scientists, Analysts ...

Data Engineer | Python, SQL & AWS | Up to £80k | Fully Remote Fancy being part of a new data team, with the opportunity to help build and shape the platform from day one? I'm working with a growing financial services business looking for a Data Engineer to help develop its AWS data platform. What you'll be doing: Building data pipelines using Python and SQL. Working with AWS, including S3, Glue, Lambda and Redshift. Integrating data from internal systems and external sources. Automating reporting and improving data ...

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will … joining an established defence programme requiring additional engineering support across an existing data platform. You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment. Due to the nature of the work you will be required to work ...

Data Engineer 6 Month Contract Location: Hereford (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will … joining an established defence programme requiring additional engineering support across an existing data platform. You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment. Due to the nature of the work you will be required to work ...

Senior Data & AI Engineer - London (Hybrid) - Azure Databricks - AI & LLMs - Life Sciences - Up to £90,000 We're supporting a fast-growing technology business that is investing heavily in its data platform, AI capability and international growth plans. Their products help organisations across the Life Sciences … sector unlock greater value from complex scientific data, and they're now looking for a Senior Data & AI Engineer to play a key role in that journey. This is an opportunity to join at a pivotal stage of growth, where you'll have real influence over ...

Have you had a career break of 12+ months? Do you have 5+ years of commercial experience, including hands-on experience in Data, Analytics, or related technology roles? Are you ready to re-join the workforce with structured training, support and career coaching included? Then you’ll want … hear about the UK’s leading Returners Programme and the opportunities to join our Data & Analytics Practice . Our Returners Programme is specifically designed to support professionals returning to work after a career break. Having restarted over 550 careers since 2016, our Returners Team are here to support ...

Data Engineer (Python Databricks SQL) *Newcastle Onsite* to 120kDo you have a first class education combined with Data Engineering skills? You could be progressing your career at a scaling Technology Consultancy within the finance division. What's in it for you: As a Data … healthcareGenerous pension contributionContinuous career development opportunitiesSocial team atmosphere with a range of events and early finish for drinks on FridaysYour role: As a Data Engineer you will work closely with front office teams to understand and define their data needs, ensuring that data capabilities ...

annumSurrey, England Permanent Our client is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. This is a hands-on opportunity to help develop and optimise a Databricks data platform that supports … intelligence across the business. Key Responsibilities: Design, build and enhance a secure, scalable and reliable Databricks platformDevelop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta LakeContribute to platform architecture, engineering standards and best practices across the data estateWork with Product ...

Trellix ESMWorking with dashboarding and visualisation tools such as Kibana or GrafanaPreferredAnsible automation experienceKnowledge of monitoring networking equipment using SNMPUnderstanding of data pipeline tools like NiFiExperience working in operational environmentsKnowledge of data tuning and data quality processesBenefitsCompetitive salary10% on target bonus (Depending ...

pipelines, RAG architectures, sovereign AI platforms, and modern AI infrastructure. The AI Business Development Manager will be responsible for creating demand, generating qualified pipeline, and accelerating AI-related business growth across EMEA/LATAM. This is a highly strategic business development role focused on identifying opportunities, engaging customers … partners, and converting AI interest into measurable pipeline and bookings. Success is measured by pipeline creation, opportunity progression, and revenue impact. Key Responsibilities: Drive AI Pipeline & Growth Lead AI pipeline generation across EMEA/LATAM, creating qualified opportunities and driving business growth. Identify, prioritize, and engage ...

Security and Accessibility. Responsibilities: Plan and lead testing activities across sets of related user stories Design, implement and maintain automated test frameworks for data pipelines and applications Identify and escalate risks and quality issues identified through automated testing Analyse and report on test activity, results, issues and risks … Support live services through production data analysis and root cause investigation Operate and support ingest and publishing pipelines and services, identifying opportunities to improve resilience and stability Work closely with Product Owners, Business Analysts, developers and data users to understand requirements Take ownership of understanding ...

Location: London (Hybrid) with occasional client travel Salary: Up to £60,000 We're recruiting for a Data Engineer to join a growing consultancy, delivering production-grade data platforms for some of the UK's leading organisations. This is a client-facing role where … design and build scalable cloud-based data solutions, working with modern technologies including AWS, Databricks and Agentic AI . You'll benefit from structured training, clear career progression and the opportunity to work on complex, enterprise-scale projects. Key Responsibilities Design, build and maintain scalable ETL/ ...