251 to 275 of 917 Data Pipeline Jobs in the UK

Data Engineer Location: Newcastle upon Tyne (Hybrid 3 days onsite) Salary: £40,000£65,000 + Benefits We're looking for an experienced Data Engineer to join a growing technology team delivering modern data platforms and AI-driven solutions. This is an excellent opportunity … work on large-scale data engineering and machine learning projects using the latest cloud technologies. The Role You'll design, build and optimise scalable data pipelines while developing and deploying machine learning solutions that solve complex business challenges. Working across cross-functional teams, you'll help ...

financial processes run in an efficient, scalable, and controlled manner. We are looking for a talented Senior Software Engineer II to join our Data Onboarding Team in London. In this role, you will be the driving force behind building, scaling, and optimizing the critical data pipelines … daily) to bridge the gap between immutable product events and audit-ready data structures. What will you be working on? Technical Leadership & Pipeline Engineering Lakehouse Architecture: Design, build, and optimize robust end-to-end data pipelines on top of our Trino + Iceberg Lakehouse stack. ...

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional consulting … enabling the AI-empowered workforce of tomorrow, you’ll be working at the cutting edge of what’s next. We DESIGN next-generation data, analytics and AI platforms – You will lead the architecture and development of scalable, secure and cost-efficient platforms that power both operational and analytical ...

Lead Data Engineer Up to £100,000 *Kafka or Kinesis required London (4 days onsite) This is a great opportunity to join a high-growth organisation where you can take ownership of building and architecting a greenfield data platform for an AI-driven product. THE COMPANY … EXPERIENCE: You will bring strong capability in: Python development and building scalable distributed data systems Data architecture design and pipeline development Batch and streaming data processing Relational databases (PostgreSQL or similar) NoSQL and modern vector databases (e.g., Qdrant, Milvus, pgvector) THE BENEFITS ...

better outcomes for our patients and communities, work to get the best possible value for taxpayers, and drive improvement across the NHS. The Data Services division of Data and Analytics sub directorate's vision is to be the leading data services provider for health … social care across England through creating innovative and high-quality data products and services that give our customers the knowledge and capabilities required to deliver the best outcomes for citizens. The Data Engineering team work with a number of key delivery programmes including but not limited ...

Lead Data Platform Engineer – DataOps Location: Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core financial data ecosystem. This senior, hands‐on engineering role … operations, ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong ...

Data Engineering Lead - Value & Analytics Location: London or Edinburgh Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking … Data Engineering Lead to join its Value Management function. You will build the technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard ...

world's money. For everyone, everywhere. More about our mission and what we offer . THE ROLE We’re looking for a Lead Data Analyst who is passionate about our mission of Money Without Borders to partner with our operational teams to help drive data-driven … refining analytical models for strategic capacity planning. Take ownership of forecasting efforts to align with business growth and operational demands. Data Pipeline Ownership. Take ownership of data pipelines to maintain and improve data flow, ensuring reliability and accuracy of data that ...

firm serving customers in the Blockchain space, where technology enables greater efficiency and delivers solutions that arent feasible otherwise. While our team builds data pipelines and reporting tools that enable accountancy teams to work efficiently, this role spans cloud infrastructure, data platform engineering, and AI tooling. … support Pragmatic approach to balancing technical delivery with business needs Desirable Python experience for infrastructure automation and tooling Familiarity with data pipeline infrastructure (supporting ETL workloads, data warehousing) and experience with Snowflake or a comparable cloud data warehouse Experience with data ...

Senior Data and AI Engineer An exciting opportunity has arisen for a Senior Data Engineer to join a fast-growing, venture-backed technology business operating at the forefront of AI, robotics, and intelligent automation. Joining at a key stage of the company's growth … play a central role in designing and developing scalable data infrastructure, building robust data pipelines, and helping shape the future of the organisation's data platform. This is an opportunity to take ownership, influence technical direction, and work on complex engineering challenges within ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Data Engineer (Databricks and AWS) Position Description At CGI, we're helping to transform the future of healthcare through the power of data. … Senior Data Engineer, you'll play a pivotal role in designing, building, and optimising data platforms that underpin critical national services. Working at the heart of our Healthcare team, you'll use your expertise in AWS, Databricks, and Python to deliver high-impact solutions that improve ...

Role Summary We are seeking a seasoned Voice AI Lead Architect with strong Data Architecture expertise to lead the design and implementation of next-generation Voice/Agentic AI solutions for a leading banking client on GCP . This role combines conversational AI, data strategy … customer engagement , acting as a trusted advisor to drive intelligent, data-driven IVR transformation . Key Responsibilities Act as the onsite Voice AI and Data Architecture lead , building strong relationships with banking stakeholders across business, data, and IT teams. Design and deliver Voice ...

Data Engineer Up to £70,000 + Benefits Central London (Hybrid Working) This is a fantastic opportunity to join a purpose-driven organisation where you can take ownership of building and developing a modern cloud-based analytics platform that supports data-driven decision-making across … music industry, you will be part of an ongoing digital transformation programme, the business is investing heavily in its cloud-based Analytic Data Platform, creating an opportunity to work with cutting-edge data technologies while contributing to a platform that delivers real-world impact. THE ROLE ...

Lead Data Engineer Are you an experienced Lead Data Engineer looking to shape the future of a modern cloud data platform? This is an exciting opportunity to join a growing technology business where you'll provide technical leadership, define engineering best practices, and help … build scalable, high-performing data solutions. As a senior individual contributor, you'll act as the technical authority within the Data Engineering team, working closely with senior leadership to define architecture, improve platform performance, and mentor engineers. This role focuses on technical excellence rather than people ...

About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core financial data ecosystem. This is a senior, hands‐on engineering role for a technical expert who thrives on the unique challenge of designing, building … ideally within a large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data ...

with clear KPI outcomes, strong governance, and senior stakeholder alignment. Key role highlights Commercial-impact role focused on measurable Sales outcomes (uplift, win-rate, pipeline velocity, wallet share, and coverage productivity). Hands-on expectation to code and prototype, contributing production-grade analytics/ML components (not only oversight … . Own use-case pipeline from idea to scaled adoption, with KPI definition, testing/experimentation, and benefits tracking. Build on modern data/ML platforms (e.g., Databricks/Spark and Snowflake) with CI/CD, monitoring, and operational controls. Operate in a controlled environment with strong ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Data Engineer II Are you passionate about building scalable, high-performance data-driven applications? Do you enjoy turning complex datasets into robust, reliable … Spark. Basic understanding of data engineering concepts including batch processing and relational databases. Some hands-on experience with data pipeline tools; exposure to Spark or Airflow is a plus. Familiarity with cloud platforms (preferably AWS); production experience is not required. A collaborative mindset and willingness ...

Data Engineer Telford/Hybrid - 2 days per week onsite £515 per day inside IR35 6 months Active SC clearance An exciting opportunity has arisen for an experienced Data Engineer to join a high-profile government programme focused on improving fraud prevention and risk assessment. … play a key role in delivering innovative data solutions that support critical public services, working as part of a newly formed Agile Scrum team responsible for developing data ingestion and risking capabilities within a modern SAS platform. This is an opportunity to work on a complex ...

Principal Data Engineer – Inside IR35 – Hybrid – SC Cleared An established Client is seeking anSC Cleared Principal Data Engineer on an initial contract. You’ll be responsible for designing, building, and maintaining secure, scalable data pipelines and platforms Working within a collaborative Agile team … scalable cloud-based data solutions that enable reporting, analytics, AI, and business intelligence capabilities. Design and maintain modern ETL/ELT pipelines, data integration frameworks, and reusable data products. Experience 7 years’ experience in Data Engineering, Data Platform Development ...

Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting high-profile government programmes, is hiring a DV Cleared Data Engineer … join a critical, secure environment. This role involves designing, building, and maintaining robust data pipelines and platforms to enable advanced analytics and intelligence operations. What you'll be doing: Develop, optimise, and support scalable data pipelines (batch and streaming) within secure environments. Manage ETL/ ...

description, but you are excited about the role, we would still like to hear from you. If you are passionate, curious, innovative and data driven, you could still be a good fit. **About the role:** **Reports to Associate Director – Markets Technology Services**With continued growth across the Aztec … across operational and client-facing teams.* Collaborate with stakeholders to identify, prioritise, and implement improvements or new features to meet evolving client needs.**Data Management and Integrations:*** Ensure effective data governance across all applications, promoting accuracy, security, and compliance with regulatory requirements.* Work with the data ...

model training to serving Feature stores and vector database consistency for retrieval and agentic systems Data quality, reliability and lineage across every pipeline you build Cloud data infrastructure and cost management on the platforms we run on Documentation that makes the data trustworthy … everyone downstream, including governance Who you are Strong in SQL and Python, with real pipeline experience, not just querying Comfortable with Spark or PySpark, dbt and Airflow for orchestration Experience with at least one major cloud platform (AWS, GCP or Azure) You've worked with vector databases or feature ...

seeking an experienced Data Tester with a strong banking and investment management background to validate reporting and analytics data solutions within a modern Microsoft Fabric data platform. Working alongside Data Engineers and Data Architects, you will validate source-to-target … data movement, verify business rules and transformations, perform reconciliations, and ensure the quality and integrity of reporting data. The initial focus will be on functional and data validation rather than test automation. Key Responsibilities Test end-to-end data pipelines. Validate source-to-target ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. About the Job you are considering: As data engineer Design build test data flows and data models in AWS Snowflake in line with business requirements. Responsible for designing, developing … deploying, and supporting scalable data pipelines and cloud-based data platforms using DevOps best practices. Automate CI/CD processes, implement Infrastructure as Code, monitor production environments, ensure data security and reliability, and collaborate with cross-functional teams to deliver robust analytics solutions. Hybrid ...

Data Engineering Manager - London London | Hybrid - Monday to Thursday in the office. Friday work from home Salary | £85,000-£95,000 dependent on experience Ref J13149 A fast-growing AI SaaS platform company is seeking a hands-on Data Engineering Manager to lead and grow … Data Engineering function. This is an opportunity to build and develop a high-performing team, shape technical direction and establish engineering best practice, while remaining closely involved in the design and delivery of the cloud-based data platform that powers innovative AI products. Working alongside Product ...