376 to 400 of 1,074 Data Pipeline Jobs in the UK excluding London

Data Engineer Bolton- Hybrid £45,000 - £55,000 (dependent on experience) We're looking for a Data Engineer experienced in Generative AI to join our growing international and cross functional client. In this role, you'll be responsible for evaluating, building, and maintaining high quality data sets that support their internal stakeholders across the … business. You'll play a key part in ensuring data pipelines are secure, reliable, and scalable. Data Engineer Duties: Design, develop, and maintain robust data pipelines and architectures. Evaluate, build, and optimise data sets for internal customers. Ensure data systems comply with governance and security standards. Collaborate with internal teams … to understand data needs and deliver effective solutions. Stay ahead of emerging data and AI technologies, contributing to our innovation roadmap. Support the integration of generative AI capabilities into existing systems. As a Data Engineer, you will have: Strong experience with SQL (e.g., MS SQL, Oracle). Knowledge of NoSQL technologies (e.g., MongoDB, InfluxDB More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

Analytics Engineer London (onsite) | Full-Time, Permanent We're on an exciting data transformation journey and are looking for a skilled Analytics Engineer to join our growing data team. In this role, you'll help design and implement scalable, high-performance data infrastructure using the modern data stack, including Azure Databricks , Azure … Data Factory , dbt , SQL , Python , and Power BI . You'll act as the bridge between data engineering and analytics-building robust data models, automated pipelines, and self-service tools that drive decision-making across the business. This is a hands-on technical role with real impact. You'll collaborate with engineers, analysts, and … stakeholders to deliver clean, trusted, and accessible data. Key Responsibilities: Develop and maintain data pipelines using Databricks and ADF Create dimensional models and transformation workflows using dbt Implement automated data quality checks and monitoring systems Empower business users through self-service analytics using Power BI Document technical processes and uphold coding standards Collaborate with cross-functional More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We are seeking a talented and motivated Data Engineer to join our IT department, focusing on Business Intelligence, you will play a crucial role in designing and building infrastructure to support the extraction, transformation, and loading (ETL) of data from various sources. This is an exciting opportunity to work with cutting-edge analytical tools and ensure … the stability and performance of our data pipelines. Candidates should have demonstratable experience in an IT role. Key Responsibilities Design, maintain, and configure data pipelines, platforms, and sources. Integrate and validate new software and technical solutions. Monitor and ensure the stability and performance of data pipelines. Provide technical leadership to deliver innovative solutions. Collaborate … with partners and business owners to address data quality issues. Support existing business systems and BI via the Service Desk as needed. About You You possess strong capabilities in data management and in delivering data solutions that meet business requirements. You are proactive, detail-oriented, and able to challenge preconceived solutions while maintaining awareness More ❯

BI Analyst Location: Bristol (Hybrid 2/3 days a week onsite) Salary: £35,000 - £45,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Executive Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk, Group Sales Director , providing strategic data and insight to support their decision … making. Design, build, and deliver group-wide reporting programmes , primarily using Tableau , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CPO Bespoke data More ❯

Data Analyst (BI & SQL) Up to £50K plus benefits Birmingham Role Summary We are seeking a skilled and motivated SQL Analyst. In this role, you will play a vital part in analysing, creating, implementing, and maintaining data infrastructure, ensuring the seamless operation of corporate IT systems. This is a unique opportunity to contribute to our journey … of innovation, efficiency, and customer excellence. Core Duties Design, implement, and maintain on-prem and cloud data infrastructure to support IT services. Administer corporate databases, including maintenance, upgrades, and monitoring for resilience and efficiency. Develop and implement data pipelines for data warehousing and analytics requirements. Perform database administration tasks such as user management, backups … APIs and web services. Experience Required In-depth knowledge of Microsoft SQL Server (2017 and above), including SSMS, SSRS, SSAS, SSIS, and SQL scripting. Expertise in database development, data cubes, and data marts. Proficiency with data visualisation tools like Power BI, Tableau, or SAP BusinessObjects. Familiarity with cloud data services such as More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to streamline … operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through … through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to streamline … operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through … through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of … years of experience in solution architecture and design governance, ideally in financial services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Data Analyst - Matillion £475 - 525 Inside IR via umbrella 6 months Gloucestershire - twice a week on site We're looking for a Data Analyst who can bridge the gap between technical detail and business insight. This role is perfect for someone who enjoys working with non-technical stakeholders, translating complex data requirements into clear … actionable outcomes that drive smarter decision-making. You'll play a hands on role in data analysis, transformation and root-cause investigation helping the business get to the "why" behind the numbers. We need someone who's confident navigating modern data stacks and comfortable turning raw data into meaningful intelligence. What you'll be … doing: Partnering closely with non-technical teams to understand and define data requirements Translating business questions into SQL queries, reports, and dashboards Performing root-cause analysis to identify data quality or process issues Working with Matillion ETL to design, optimise and maintain data pipelines Supporting the development and maintenance of Snowflake based data More ❯

What's the Opportunity Join our dynamic Digital Engineering team at Ridge as a Data Analyst/Engineer, where you'll play a pivotal role in transforming data into actionable insights that drive innovation across our projects. You'll work closely with multidisciplinary teams to develop and maintain robust data pipelines, implement advanced analytics … integration of digital tools that enhance design, delivery, and operational efficiency. This is a unique opportunity to contribute to cutting-edge engineering solutions while shaping the future of data-driven decision-making in the built environment. We operate an agile working policy, but please note this opportunity will require weekly attendance at a major project site on the … Bristol, Winchester, Reading, London, or Birmingham) subject to ability to travel to Oxford. What you need to do to be effective in this role Develop, maintain, and optimise data pipelines to support digital workflows across engineering and design projects. Collaborate with multidisciplinary teams to understand data requirements and deliver tailored analytical solutions. Clean, transform, and analyse More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯