176 to 200 of 2,477 Data Pipeline Jobs in the UK

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £72,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS … across financial, operational, and leasing functions, providing a single source of truth for asset, fund, and portfolio performance. Key Responsibilities Data Pipeline Development Data Platform Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some ...

Financial Crime Data Lead Hybrid: Central London 2 days a week in the office Permanent Paying up to £120k + Bonus We are currently working with a leading organisation undergoing a major transformation of its Financial Crime, Risk and Compliance technology landscape. As part of this journey, they … looking to hire a Financial Crime Data Lead to play a central role in designing and building a new enterprise-wide Financial Crime data platform that will underpin key capabilities including transaction monitoring, client screening, onboarding, risk assessment and future AI-driven decision making. The Role ...

considerable responsibility and ownership of your path. At the core, it involves: Data engineering and analysis – extending the data pipeline which feeds our carbon market dashboard and bespoke analytics platform Developing the back-end code and infrastructure for the API – providing access to our offsets … alternative finance to emerging markets Responsibilities You will be working on the following: Extending and maintaining the codebase for the data pipeline which feeds into our carbon offsets database Data gathering, processing and analysis; researching and implementing ways to unlock data from ...

Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery … understanding of Infrastructure as Code concepts (Demonstrable Terraform experience a plus) Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance Demonstrable experience of working within Agile Delivery projects An understanding of data formats for ingest, transformation and analytics ...

Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery … understanding of Infrastructure as Code concepts (Demonstrable Terraform experience a plus) Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance Demonstrable experience of working within Agile Delivery projects An understanding of data formats for ingest, transformation and analytics ...

organisations transform and deliver high-quality, scalable solutions that truly matter. Role Overview We are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft … Terraform and Infrastructure as Code (IaC). Experience using GitLab, including GitLab CI/CD. Strong data engineering and data pipeline development experience. Good understanding of cloud-based data architecture and integration. Strong troubleshooting and problem-solving skills. Proactive approach with the ability ...

seeking a results-oriented Senior Services Sales Executive to drive growth across our services business. This role is accountable for building and converting pipeline, increasing services attach rates, and accelerating top-line bookings in close partnership with our Go-to-Market (GTM) organization. This leader will operate … services are positioned early, effectively, and consistently across the customer lifecycle to maximize both customer value and revenue outcomes. What you will do: Pipeline & Bookings OwnershipProactively build, manage, and mature a robust Professional Services pipeline aligned to regional and vertical sales prioritiesDrive services bookings by actively engaging ...

Data Engineer Department: IT Employment Type: Full Time Location: GBR Manchester Hardman Boulevard Description Data and Reporting is an integral part to NCC Group to help deliver our data strategy and, as our Data Engineer, you’ll support the successful delivery … scalable data intelligence platform in Azure. This will provide the services and tools to extract deeper insights from big and complex data using predictive analytics and AI. This in turn will enable the uncovering of actionable insights previously hidden in data. You’ll support the roll ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

Data Architect Inside IR35 Rate: £660 per day Location: Telford (2 days per week onsite) Clearance Required: Active SC Clearance (must be valid prior to start) The Opportunity We're looking for an experienced Data Architect to join a major transformation programme, helping to design … deliver enterprise-scale data and analytics solutions. This is a hands-on architecture role where you'll shape modern data platforms, cloud migration initiatives, data management capabilities, and analytics solutions. You'll work across the full data lifecycle, providing technical leadership from ...

Data Architect Inside IR35 Rate: £660 per day Location: Telford (2 days per week onsite) Clearance Required: Active SC Clearance (must be valid prior to start) The Opportunity We're looking for an experienced Data Architect to join a major transformation programme, helping to design … deliver enterprise-scale data and analytics solutions. This is a hands-on architecture role where you'll shape modern data platforms, cloud migration initiatives, data management capabilities, and analytics solutions. You'll work across the full data lifecycle, providing technical leadership from ...

enshrine our Data as a Product policies as code . This role is evenly split between infrastructure automation and data pipeline development. You will write clean pipeline code to ingest data into BigQuery , while using Terraform to provision and scale our infrastructure. … secure service accounts using Terraform. Optimise Costs & Resources: Monitor GCP resource utilization and implement automation to optimise BigQuery compute (slots) and storage costs. Pipeline Coding & CI/CD (50%) Build Ingestion Pipelines: Code automated ETL/ELT pipelines to extract, transform, and load diverse data sources into ...

Description About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking … experienced Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands-on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability ...

PHMG is continuing to develop and mature its data capability, focusing onmodernisingour data platform and enhancing the way we work. As part of this continued development, we are looking to strengthen our Data Engineering team andmaximisethe valuefromthe wealth of data held across … theorganisation. We are looking for a Data Engineer to help design,buildandmaintainreliable, scalable data solutions. Working as part of an established Data Engineering team, you will contribute to the development of our data platform, strengthen engineeringpracticesand help improve the quality and reliability ...

tomorrow’s public sector skills demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span architecture, project management, data … powerful platform that empowers the public sector with the talent to navigate an evolving digital landscape. Role As part of this mission, the Data Analyst/Data Analytics Engineer will play a key role in driving data analytics, reporting, and insight generation using DOMO ...

Lead Data Engineer - 12 Month FTC Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should … couple of years. Join us - and help us fulfil our mission to close the world's digital skills gap. The Role The Lead Data Engineer will play a key role in shaping, building and evolving the data capabilities that underpin our clients Accounts platform. Working across ...

analysts, AI engineers, and platform leads to deliver production‐grade, business‐critical data products. Lead by example in data documentation, pipeline testing, and lineage tracking — ensuring transparency and reproducibility across all pipelines. Qualifications Hands‐on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert‐level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design, and schema normalization ...

tomorrow’s public sector skills demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span architecture, project management, data … powerful platform that empowers the public sector with the talent to navigate an evolving digital landscape. Role As part of this mission, the Data Analyst/Data Analytics Engineer will play a key role in driving data analytics, reporting, and insight generation using DOMO ...

Financial Crime Data Lead Hybrid: Central London 2 days a week in the office Permanent Salary £100,000 - £120,000 pa Paying up to £120k + Bonus Posted 1 Sep 2026 (Last week) We are currently working with a leading organisation undergoing a major transformation of its Financial … Crime, Risk and Compliance technology landscape. As part of this journey, they are looking to hire a Financial Crime Data Lead to play a central role in designing and building a new enterprise-wide Financial Crime data platform that will underpin key capabilities including transaction monitoring ...

flow across the organisation. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Work closely with cross-functional teams, including software engineers, data scientists, and business … similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written ...

ambition will find a home, where opportunities for growth and advancement abound. About TRG Screen TRG Screen is the leading provider of market data and subscription management technology and automation solutions, tailored to the unique needs of financial institutions and legal firms. Our integrated suite of solutions includes … data products that feed AI and agentic use cases, such as, vector stores, RAG, embeddings, tool surfaces. Python for data pipeline scripting and orchestration. Exposure to real‐time analytics use cases - dashboards, alerting, and anomaly detection. Join TRG Screen and unlock your potential ...

recruiting on behalf of our client for an experienced Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions. Our client works with organisations operating in complex, secure and highly regulated environments, with a significant focus … public sector and defence. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide other engineers and influence engineering practices. The Role As a Senior Data Engineer, you’ll take a leading role ...

UNITED is your playing field. Join us in shaping the future of gaming. Are you ready to LEVEL-UP THE GAME? Key Responsibilities Data Platform & ArchitectureDevelop and maintain robust and efficient data solutions and products including data transformation, data modelling, and reporting … Experience with ETL/ELT processes and data ingestion Proven expertise using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards ...

e.g. SSIS or equivalent tools and frameworks). Programming (e.g. Python) – Experience using Python or similar languages for data processing, automation, or pipeline development. Cloud & Platform Technologies – Familiarity with modern data platforms and cloud-based architectures (desirable). Performance & Scalability Optimisation – Ability to design … modelling, system design, and integration patterns. Strong experience with SQL and data processing at scale. Experience working with data pipeline and ETL tools (e.g. SSIS or equivalent). Experience with programming languages (e.g. Python) for data processing or automation. Experience defining ...

Data, AI, Solutions & Engineering (DAISE) practice is looking for an experienced Data Engineer to join the team. In DAISE, we are focused on delivering value‐adding, sustainable data capabilities, aligned to our client’s specific needs. This expertise is applied across clients … Understanding of key core concepts like distributed computing, batch & stream processing, functional and object‐orientated programming, how pipelines are built and deployed on cloud, pipeline schedules and SLAs Well‐versed with documentation and artefacts that need to go along with the solution design and delivery work #J-18808-Ljbffr ...