226 to 250 of 2,468 Data Pipeline Jobs in the UK

Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You’ll join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You’ll help implement efficient data pipelines and storage. Key Responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

Senior Data Engineer Microsoft Azure data This is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. Job details … Title: Senior Data Engineer Technical Stack: Microsoft Azure data Location: London or Glasgow with 1 day a week in the office Permanent role salary £80,000- £100,000 Requirements: Strong experience as a Senior Data Engineer in enterprise data environments. Technical stack ...

anodyne version. Bonus points if you can find the more analeptic version. And provide proof of your quest. Good luck! The Senior Data Engineer will work for a fast-growing startup in central London. The Senior Data Engineer will earn £130,000+ and equity. The Senior … Data Engineer will work 4+1. We're building a product and a culture. The Senior Data Engineer will have huge autonomy, ownership and accountability. The Senior Data Engineer will pair with BackEnd and AI Engineering teams to support the product roadmap. The Senior Data ...

future of gaming. Are you ready to LEVEL-UP THE GAME? Focusing on our Sportsbook product, we’re looking for a Senior Data Engineer to help build and evolve our next-generation data platform, powering trusted, scalable, and real-time data assets across multiple … brands and markets. You’ll primarily work on our Sportsbook Data Platform — a modern, event-driven lakehouse built on AWS and aligned to medallion architecture principles — delivering high-quality, well-governed data products that support analytics, trading insight, and machine learning use cases. This platform underpins ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … document, row‐based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event‐driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners ...

Newcastle, United Kingdom Role Overview We are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft Azure. You will work closely with engineering, data … Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering and data pipeline development experience. Good understanding of cloud-based data architecture and integration. Strong troubleshooting and problem-solving skills. Proactive approach with the ability ...

events that have a financial impact on Checkout.com and our merchants. Our team is responsible for maintaining an accurate record of all financial data, the data integrity of our systems and ensuring our infrastructure meets regulatory and compliance obligations in a scalable, reliable and fault-tolerant … pipelines to process data from our systems, services and applications. Implement monitoring and alerting frameworks to ensure data pipeline performance and reliability. Partner with other analytics engineers to design and implement scalable data models that support downstream business operations and analytical ...

Soho, London Hybrid working: 3 days in the office Tues - Thurs The Role We are seeking a Senior Data Engineer to join our Data Team, taking a leading role in building the complex, scalable systems that power our data strategy. You will lead architectural … technologies, setting technical direction where they can enhance data infrastructure or enable new data products. Lead the resolution of critical pipeline failures and data- quality incidents, performing fault analysis and ensuring that preventative improvements are implemented. Lead critical system- design and architectural decisions ...

OpportunityJoin a team building the data foundations that support the firm's AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data use across … including version control, testing, release discipline and CI/CD practices. Data Engineering CapabilityStronger ownership of technical design across multiple datasets or pipeline domains. Experience guiding implementation standards, code quality and engineering practices within a team. Ability to lead delivery for a workstream, manage dependencies and support ...

Type: Permanent Location: United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Data Engineer We have an exciting role for you Data Engineer ! Careers at TCS: It means more TCS is a purpose-led transformation company … make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership. The Role Design, develop, and maintain Azure-based data pipelines and ETL solutions. Work with Azure Data Factory, Databricks, Synapse, and Data Lake to support data integration ...

opportunity We are investing in the next generation of our data and technology capabilities to create more connected, intelligent experiences for customers. Data is central to this ambition. This is an opportunity to define the architecture, standards and delivery patterns for a modern data platform that will enable trusted data use across products and support advanced analytics and AI. The Principal Data Architect will be the senior technical authority for data architecture within this strategic transformation. The role is architecture-led while remaining practically engaged through ...

Project description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue — a foundational shift in how one of the world's largest financial market infrastructure companies … Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR) Implement data quality checks, validation, and reconciliation processes Optimize pipeline performance and manage compute/storage costs Ensure data security and access control (IAM, KMS, encryption) Monitor and troubleshoot pipeline failures (CloudWatch ...

Principal Data Architect will be the senior technical authority for data architecture within this strategic transformation. The role is architecture-led while remaining practically engaged through prototyping, proof-of-concepts, technical reviews and the resolution of complex engineering challenges. As the capability grows, the remit … expand to include leadership of a small team. Define and own the target data architecture, standards, reference patterns and technical roadmap for a strategic enterprise data capability. Design a modern Databricks lakehouse foundation that enables secure, scalable use of data across a complex product ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. The role will focus on designing and building robust data pipelines, migrating data from a wide range of legacy and enterprise … source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where applicable. Key Skills & Experience Azure Data Engineering Azure Data ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. The role will focus on designing and building robust data pipelines, migrating data from a wide range of legacy and enterprise … source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where applicable. Key Skills & Experience Azure Data Engineering Azure Data ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. The role will focus on designing and building robust data pipelines, migrating data from a wide range of legacy and enterprise … source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where applicable. Key Skills & Experience Azure Data Engineering Azure Data ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. The role will focus on designing and building robust data pipelines, migrating data from a wide range of legacy and enterprise … source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where applicable. Key Skills & Experience Azure Data Engineering Azure Data ...

Cloud Data Engineer (Python) Up to £54,150 per annum + excellent pension | Hybrid working | London, Manchester, Cardiff, Belfast, Edinburgh or Darlington Are you an experienced Data or Software Engineer with hands-on experience of: Python and end to end Cloud deployment, looking for a role … where your work can make a real difference? Our Government client is looking for a Data Engineer to join its Data, Technology and Insights (DTI) unit on a 12-month fixed-term contract . Youll join a multidisciplinary team of data engineers, data ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands-on exposure to: ☁️ AWS cloud & migration 🐍 Python development 🗄️ SQL, databases & data platforms 🔄 Data pipelines & ETL/ELT 🔌 APIs & backend engineering 🚀 CI/CD & production systems 📊 Analytics & modern data platforms 🤖 AI/ ...

mitigate risk, and scale with efficiency and confidence. To learn more about Comply, visit comply.com The Role We are looking for Senior AI Data Engineers to implement and operationalize Comply’s semantic layer — turning the ontological models defined by our ontologist and architects into working knowledge graphs, vector … data pipelines. Familiarity with semantic web standards — JSON‐LD, RDF, OWL, or SKOS. Strong Python skills and experience with data pipeline frameworks. Experience with cloud‐native data platforms (AWS, Azure, or GCP). Exposure to domain‐driven design (DDD) and bounded contexts ...

Senior Data Engineer Microsoft Fabric Azure data This is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. … details Title: Senior Data Engineer Technical Stack: Microsoft Azure data Location: London or Glasgow with 1 day a week in the office Industry: STEM Technology Permanent role salary £50- £70,000 dependant on skills and location Requirements: Strong experience as a Senior Data Engineer ...

Role Description The Technical Analyst – Data Lineage will support a Data Governance, Controls, and Reporting program for a top-tier banking client. Responsible for establishing and validating end-to-end lineage across critical datasets used in operational and regulatory reporting. Translate governance and reporting requirements into … Produce and maintain Source-to-Target Mapping (STTM) documentation and metadata standards. Validate lineage accuracy by tracing logic through SQL/Spark transformations and pipeline configurations. Support impact analysis for proposed changes (upstream/downstream dependencies, report impact, control impact). Partner with engineers and platform teams to improve ...

national security, Roke are a trusted partner delivering mission-critical solutions that protect the UK and its interests. Your Mission As our next Data Engineer, you’ll be managing and developing data pipelines that transform raw data into valuable insights for Roke’s National … sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets. What You’ll Do Data pipeline development - Data ingestion and pipeline orchestration design and tooling. Database schema design/database modelling Data integration - Integrating ...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Join Microlise as a Senior AWS Data Engineer … month fixed term contract and help build the data foundations behind the next generation of customer-facing analytics and AI products. This is a hands-on engineering role in a major cloud data platform programme, where youll help turn operational, telematics, customer and third-party data ...

Role: Data Engineer (Mid/Senior) - 12 Months Fixed Term Maternity Cover The Team: Data Hiring Manager: Director of Technology Operations Hours: Full Time Location: Hybrid* (Head office Nottingham) Salary: £56,000 - £68,000 per annum (depending on experience) At Medichecks, we’re on a mission … clinics, pharmacies, and healthcare practitioners, we’re expanding fast—and we need exceptional people to help us grow. If you're a data-driven problem solver with a passion for analytics, automation, and storytelling through data, this is your chance to make a real impact ...