76 to 100 of 345 Data Pipeline Jobs in the UK excluding London

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

Are you passionate about shaping and delivering data strategies that drive real change and innovation? Do you excel at both setting the vision and rolling up your sleeves to design and implement cutting-edge data solutions? Could you be our next Data Technology Manager, leading by example to modernise our data landscape … while staying hands-on in the work that makes it happen? Data Technology Manager Up to £66,000 Permanent/Full Time Stevenage with Hybrid Working At the IET, making our world a better place starts by creating a better place for our people. At the IET youll have more than just a job. Our work is exciting … quality, scalable solutions, and the leadership skills to inspire and develop a high-performing team. Youll be just as comfortable in a design meeting as you are debugging a pipeline or building a proof-of-concept. Your ability to balance big-picture thinking with practical delivery will be key to your success. Wed love to get to know you More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Analytics & AI - Data Science - Senior Consultant At EY, you'll have the chance to build a career as unique as you are, with the global scale, support … ability to work closely with cross-functional teams to develop, test, and deploy advanced machine learning models, ensuring alignment with business objectives and seamless integration into client operations. Data Analysis: The capability to … analyse large and complex datasets to extract actionable insights. Your analytical skills will be key in identifying trends, patterns, and anomalies that can inform business strategies. Data Pipeline Management: Be able to design, implement, and maintain data pipelines that are critical for model training and deployment. Your expertise will ensure the reliability and efficiency of More ❯

Reports to: Data Director/Executive Sponsor Location: Remote with occasional travel to London (2 times a month) Contract: Full-time, permanent Base Salary: £60,000 £75,000 dependent on location and experience + 10% bonus scheme Why This Role Exists Serve Legal is forging new ground: transforming operational data into market-ready products, algorithms, and … insights that redefine client value. As a driver of our Innovation Labs, you will experiment, prototype, and build compelling data solutions in a startup-within-a-business environmentboldly iterating and owning proofs-of-concept that scale. This is a position with a balance between data science and engineering. Besides exploring and analysing datasets, you will help … to establish a cloud native data foundations, with a data warehouse and supporting data pipelines. You will be expected to use AI tools where possible to help explore, analyse and transform data. What Youll Do Build Data Products & Algorithms: Prototype and refine predictive models (e.g., compliance forecasting, anomaly detection, NLP-based feedback More ❯

Data Scientist Monitoring & Alerting Infrastructure Location: Manchester Hybrid (Remote & Office-Based) Salary: £65-70K plus excellent benefits package Our client is a pioneering, data-driven company that has been delivering market-shaping insights to the media and research sectors for over a decade. Their cutting-edge platform empowers global brands to make smarter decisions through … actionable, real-time data. As they scale their operations and enhance data governance across their ecosystem, we are now seeking a Data Scientist with experience in monitoring and alerting infrastructure. This is a pivotal hands-on role with end-to-end ownership ideal for someone who enjoys blending engineering rigour with statistical thinking in a collaborative … models using Python and PySpark Deploying solutions within AWS cloud infrastructure Developing scalable frameworks to support future monitoring needs across departments Investigating and resolving data anomalies and pipeline irregularities Driving data quality standards and encouraging adoption across the business Mentoring junior team members and contributing to a culture of innovation, curiosity, and rigour Ensuring compliance More ❯

Data Engineer Permanent role Birmingham Based – Hybrid working Competitive Salary Based on Experience + Bonus scheme Amtis is proud to be recruiting for a Data Engineer to join a forward-thinking business building modern, scalable data solutions. This is a hands-on role focused on building robust data infrastructure that supports high … performance analytics. Responsibilities: Build scalable, reusable data pipelines using modern cloud technologies Design secure, flexible data models for internal and external users Optimise performance across large, complex datasets Collaborate with analytics and visualisation teams to align data flows Integrate external data sources using bespoke and automated pipelines Support CI/CD and … Factory, Blob Storage Python/PySpark SQL Server, Parquet, Delta Lake Deep understanding of: ETL/ELT, CDC, stream processing Lakehouse architecture and data warehousing Scalable pipeline design and database optimisation A proactive mindset, strong problem-solving skills, and clear communication If you're an experienced data engineer and interested in the opportunity, please More ❯

Data Engineer £70,000 - £110,000 GBP Onsite WORKING Location: Manchester, North West - United Kingdom Type: Permanent Role: Lead or Senior Data Engineer Salary: £70,000 - £110,000 per annum (multiple grades - depending on experience) + Benefits Location: Open to UK-wide candidates (Remote/Hybrid options available) Overview We are looking for a Data Engineer with a strong foundation in software engineering and experience working in consultancy environments. This role involves designing and developing large-scale data processing solutions within Agile teams, contributing to impactful digital transformation projects across sectors. You'll work across the full software lifecycle, from design and development to testing and deployment, while collaborating with colleagues … and stakeholders to ensure high-quality, maintainable, and scalable data solutions. Key Responsibilities Design and develop data processing software for deployment in Big Data technologies Build and maintain ETL/ELT pipelines using modern data platforms Collaborate with team members to resolve implementation challenges and ensure code quality Work with operations teams More ❯

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle and … are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer, you will take responsibility for the development of high-quality pipelines that process and manage large volumes of data from a range of external and internal sources. You'll play a key role in enhancing and maintaining their central data platform, ensuring the smooth delivery of information that supports investment decision-making. Working closely with stakeholders across the business, you'll help shape how data is accessed, tested, and leveraged to maximise value. More ❯

roles that best align with your skills, interests and university experience to strengthen your application. Roles Available in Location: Stevenage Education required: To apply for a placement in Data, Automation, & Predictive Sciences (DAPS), you must be studying for an Undergraduate Degree in a subject related to the role. Includes Life sciences, Biomedical Sciences, Engineering, Mathematics, Bioinformatics, Computer Science … Business Analysis, Information Sciences, Statistics, Data Sciences, Biology, Chemistry, Physics or related fields. Please read the degree requirements for each role carefully before applying. Other requirements: You will have completed a minimum of 2 years of your undergraduate degree but will not have graduated at the start of your placement. You must be enrolled at a UK or … groups and pre-joining webinars. 2 volunteering days per year. Typical skills you can expect to learn on this placement include teamwork, communication, time management, problem-solving, networking, data analysis and management, and role-specific technical skills. The Roles (6 available) This advert contains multiple roles. All roles are within the Data, Automation & Predictive Sciences Department. More ❯

to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on!?? The TeamWe're Intuita - a fast-growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … an interesting insight into projects spanning a variety of industries, which may include telecoms, insurance, healthcare, finance and mortgages across various sectors.?? The RoleWe are seeking a skilled Data Engineer, ideally Senior experience to join our Data Engineering team, ideally as a permanent consultant opportunity. We can move fast and adapt our selection period to our … permanent rights to work are essential, alongside other factors we'll consider. This is a hands-on Analytics Engineering role where you'll be at the heart of data-driven decisions. Day to day you will be transforming raw data in clean, reliable and performant data models using dbt within Google Cloud Platform (GCP More ❯

Data Integration Engineer £Up to £700 Inside IR35 GBP Onsite WORKING Location: Bristol, South West - United Kingdom Type: Permanent Software Engineer/Data Integration Engineer - National Security & Government Up to £700 Inside IR35 Location: London or Bristol Our client is a trusted digital consultancy working at the heart of national security, law enforcement, and defence. They … deliver secure, mission-critical software and data solutions that help protect the UK and its interests. With a strong focus on innovation, collaboration, and agility, they empower engineers to solve complex challenges in high-trust environments. As a Data Integration Engineer , you'll work across data pipelines, APIs, and backend services to ensure data … Strong understanding of API design and integration techniques (REST, Webhooks, GraphQL). Familiarity with authentication protocols (OAuth2, JWT). Experience with ETL/ELT frameworks and data pipeline tools. Solid understanding of relational and NoSQL databases. Hands-on experience with AWS cloud services and integration tools. Strong debugging, analytical, and communication skills. Comfortable working in agile development More ❯

Role Description: Senior Quantitative engineers in Global Risk are responsible for designing and overseeing the implementation of common, reusable, and scalable software components. These components enable GRM's data and analytical capabilities. These components can be domain independent (such as generic data quality tools over billions of rows of data) or domain specific (such … framework for Global Markets processes). Senior Quantitative engineers work with senior modelers, risk managers, and technologists to understand the current state and design the future state of data and analytics. Senior Quantitative engineers have a combination of software engineering, big data, modelling and management skills and the ability to work across the entire spectrum of … a big data stack - from data to logic to model to UI to UX. Responsibilities Seek opportunities for consistent improvement in quality, efficiency, and processes Partner effectively with senior stakeholders within GRA & EIT, Front Line Units, Technology, Audit and Compliance Provide leadership and oversight to less experienced team members Applying quantitative methods to develop capabilities that More ❯

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert … advertisements around the world. Job Summary As a Global Business Intelligence Data Engineer 3 on Freewheel’s System Administration and Automation Team, you will leverage a dynamic skill set as you help us create and implement standards and best practices in our rapidly growing Snowflake Environment. You will be an excellent communicator who is comfortable providing expert consultation … of significance. Our tech stack : • Bachelor's degree or equivalent in quantitative or similar field required. • 4+ years of experience in Data Analysis and Data Pipeline Engineering• Knowledge of Snowflake Architecture, Best Practices, and Implementation required• Strong knowledge of Snowflake SQL Development is required• Experience with Visualization BI tools (Looker is required. Tableau and/ More ❯

Location: Manchester Duration: 3 Days a Week Job Type: Permanent/FTE As a Snowflake Developer, you'll be a key player in designing, developing, and maintaining our data solutions. You'll work with cutting-edge technologies, leveraging your expertise in Snowflake to build robust and scalable data pipelines and architectures. This role is perfect for … SQL: Possess a deep understanding of Snowflake's architecture and internals, including roles, dynamic tables, streams, and tasks. You'll need excellent skills in writing complex SQL queries. Data Modeling: Extensive working knowledge of various data models, including Dimensional Data Model , ER Data Model , and Data Vault . Cloud Computing … Strong foundational knowledge of cloud computing principles. Data Expertise: Significant experience in data-related projects and applications, including a good understanding of data management and data governance . Programming & Tools: Good working knowledge of Python and GitLab . Stakeholder Management: Proven experience in managing product owners and stakeholders. Soft Skills: A great More ❯

Snowflake Developer Location: ManchesterDuration: 3 Days a WeekJob Type: Permanent/FTE As a Snowflake Developer, you'll be a key player in designing, developing, and maintaining our data solutions. You'll work with cutting-edge technologies, leveraging your expertise in Snowflake to build robust and scalable data pipelines and architectures. This role is perfect for … SQL: Possess a deep understanding of Snowflake's architecture and internals, including roles, dynamic tables, streams, and tasks. You'll need excellent skills in writing complex SQL queries. Data Modeling: Extensive working knowledge of various data models, including Dimensional Data Model , ER Data Model , and Data Vault . Cloud Computing … Strong foundational knowledge of cloud computing principles. Data Expertise: Significant experience in data-related projects and applications, including a good understanding of data management and data governance . Programming & Tools: Good working knowledge of Python and GitLab . Stakeholder Management: Proven experience in managing product owners and stakeholders. Soft Skills: A great More ❯

We are seeking a highly experienced SAP Data & Analytics Lead with 10–12+ years of expertise in SAP data solutions, particularly SAP Datasphere and SAP Analytics Cloud (SAC). The ideal candidate will have strong functional and technical experience in Finance data modeling and analytics, along with hands-on development skills. A proven ability … to lead design, implementation, and end-to-end delivery of SAP Data & Analytics solutions is essential. Responsibilities: Lead the design, architecture, and implementation of enterprise-level data models and analytics solutions using SAP Datasphere and SAC. Build, optimize, and maintain data pipelines, ODS models, and data integration(In/out) in Datasphere … for various Finance and cross-functional domains. Collaborate closely with Finance stakeholders to understand requirements and translate them into scalable, efficient data models and analytical reports. Provide hands-on development in Datasphere, data fabric, and SAC, including advanced calculations, KPIs, and dashboarding. Establish best practices for data governance, lineage, and security within Datasphere and More ❯

About the Role Reporting to the Head of Data, Insights & Analytics you will lead a team of Data Engineers in the design, development and maintenance of Travel Counsellors’ data infrastructure. This role will be a high impact, multi-faceted working on data pipelines, our new strategic Data Platform and operationalising … our analytical/data science solutions. Principal Accountabilities Support the design and implementation of data pipelines to ensure accurate, consistent and timely data across our analytical and reporting needs Work closely with Data Scientists, Analysts and business SMEs to automate and scale our machine learning and AI capabilities Support the development of … our new cloud-based Data Platform, transforming systematic data into a business view for reporting and analytics Take ownership of our existing Microsoft technology (SQL Server, SSIS, SSAS, SSRS) whilst delivering on our migration plans to cloud-based technology Create and maintain comprehensive documentation for data processes and architectures. Provide training and support to More ❯

Senior Data Engineer London | Permanent | Full-Time | Hybrid Working An excellent opportunity has arisen for a Senior Data Engineer to join a respected, international insurance and analytics organisation. In this role, you will design, develop, and maintain data solutions that enhance underwriting and claims decision-making, support operational improvements, and drive data-driven strategies across multiple specialty lines. This position is ideal for an experienced data engineering professional with strong insurance sector knowledge, looking to make a significant impact in a high-profile analytics function. About the Team The data and analytics team works across multiple international specialty lines, including cyber, energy, equine, marine, professional and … financial risks, trade credit, political risk and surety, and international casualty. Its remit covers: Data engineering and analytics Portfolio management Pricing model development The team is embedded within underwriting operations and plays a key role in achieving profitability and performance targets. What You'll Bring A collaborative, proactive, and solutions-focused mindset. Ability to influence and engage with More ❯

We're looking for a technical steward of enterprise metadata assets , ensuring governance, quality, and regulatory compliance across complex data landscapes. You will be the subject matter expert for data cataloguing, metadata synchronisation, and stewardship best practices. helping us build a trusted foundation for AI, analytics, and digital transformation. What You'll Do Metadata Curation & Governance … Define and implement enterprise metadata standards, business glossaries, and classification schemas. Establish data quality KPIs, SLAs, and governance metrics. Build automated discovery workflows to enable self-service analytics. Champion adoption of governed data assets across business and technical teams. Technical Stewardship Configure cross-platform metadata synchronisation between Alation, Databricks (Unity Catalog) , and downstream systems. Implement schema … BI spaces. Hands-on with data quality tools such as Great Expectations, Ataccama, Monte Carlo (or similar). Experience with metadata orchestration and modern data pipeline tools. More ❯

Lead Data Engineer - Overview: We're looking for a visionary data leader to shape the future of data for a leading bank. Join now if you want to spearhead the delivery of a next-generation data platform, built on a modern Azure-Databricks ecosystem, unlocking the full potential of advanced analytics, machine … learning and AI across the business. The Role: Are you a proven data engineer, looking to step into an exciting leadership position? Reporting directly into the head of data, this position will allow you to use your Azure experience throughout exciting transformation projects and to shape the journey of the bank. Your expertise will be used … learning & AI implementation - experience delivering machine learning and AI solutions, ideally within Databricks. Strong data governance knowledge- in-depth knowledge of data governance best practices. Pipeline engineering & monitoring expertise - skilled in building and orchestrating scalable data pipelines, with experience implementing using Azure-native tools. Exceptional stakeholder & communication skills - able to clearly articulate complex More ❯

Thames Water is seeking a Metering Data Scientist to join our Smart Metering Operations Centre (SMOC) in an exciting new role. You’ll have the opportunity to work with data from over a million smart meters monitoring, supporting and creating processes to ensure accuracy, integrity, security and accessibility of data in upstream and downstream … applications integrated to the Thames Water Meter data management system (MDMS). What you’ll be doing as a Metering Data Scientist As a Metering Data Scientist at Thames Water, you'll play a crucial role in the SMOC Meter Data Strategy and … Insights team. Ensuring that the smart metering programme data processes and pipelines are working efficiently and accurately. Providing support to the SMOC and Digital IT teams.Key Responsibilities Pipeline Management – Create and maintain robust data pipelines for reliable reporting. Data Analysis & Modelling – Identify trends, forecast water demand, and improve business processes. To align the More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Data Architect to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making … across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using DBT, Delta Live Tables, and dimensional modelling to deliver consistent More ❯

Our client is looking for an experienced and forward-thinking Data Engineer to join their Digital Services team. This is a key role in shaping and delivering the enterprise data engineering strategy, ensuring that our data infrastructure is robust, secure, and ready for the future. You will be responsible for designing, building, and optimising … data pipelines and database systems that support their administrative and research activities. Working collaboratively across the business you’ll ensure their data is high-quality, accessible, and compliant with governance and cybersecurity standards.Key Responsibilities • Design, build, and maintain efficient data pipelines and ETL workflows.• Develop and optimise relational and non-relational database systems.• Collaborate … with analysts, researchers, and IT teams to deliver tailored data solutions.• Implement and maintain data governance and metadata frameworks.• Ensure data security, integrity, and compliance with regulations such as GDPR.• Contribute to data architecture design and enterprise data strategy.• Lead technical data planning within change programmes.• Explore and More ❯