551 to 575 of 1,617 Data Pipeline Jobs in the UK

plans to become The Best and Biggest in the UK market. Over the past few years, we've made significant investments in our data and tech capabilities, particularly within our CIO function. Our CIO team is at the forefront of driving innovation and ensuring our technology infrastructure supports … team is always looking for passionate individuals who are eager to make a difference and contribute to our success. Job DetailsAs a Data & AI Engineer you will design, build and support scalable data and AI solutions that enable analytics, automation, and AI-driven business outcomes. Develop ...

Data Engineer Contract Location: London – 4 days per week on-site, 1 day remote Rate: Up to £800 per day Inside IR35 Clearance: Active DV Clearance I'm currently recruiting for a Data Engineer to join a long-running programme within Central Government, supporting the development … maintenance of secure data platforms and pipelines across MoD-owned infrastructure. You'll work as part of a technical team building and supporting data pipelines using Python, Azure and Kubernetes, alongside technologies including Apache Airflow and Apache Spark. Key Responsibilities: Build and maintain new and existing ...

Barratt Developments plc is seeking an Azure Data Engineer to build and maintain our Azure Data Lake and data pipelines within the Group Data Office. You will collaborate with the Visualization team to support Power BI data model development … role emphasizes design and implementation of ADL/Synapse solutions, API integrations, and adherence to SOLID and TOGAF standards. A strong cloud and data engineering background is required. #J-18808-Ljbffr ...

plans to become The Best and Biggest in the UK market. Over the past few years, we've made significant investments in our data and tech capabilities, particularly within our CIO function. Our CIO team is at the forefront of driving innovation and ensuring our technology infrastructure supports … team is always looking for passionate individuals who are eager to make a difference and contribute to our success. Job Details As a Data & AI Engineer you will design, build and support scalable data and AI solutions that enable analytics, automation, and AI-driven business outcomes. ...

analytics engineering team operating within a highly regulated environment. Key Responsibilities Technical Leadership & Platform Ownership • Provide technical leadership for the organisation's strategic data and analytics products. • Define and drive the technical roadmap for the GCP Analytics platform from concept through to implementation. • Take ownership of engineering standards … with organisational governance standards, security policies and regulatory obligations. • Balance innovation and rapid delivery with appropriate risk management and control frameworks. • Design secure data integration patterns incorporating authentication, authorisation and access management technologies. • Support delivery of solutions that are suitable for audit scrutiny and regulatory reporting requirements. • Operate ...

Lead Data Engineer £73,000 - £83,000 per annum Folkestone Hybrid Initial 8-month FTC (potential to go perm) As Lead Data Engineer, youll play a pivotal role in shaping how Saga Travel uses data to make better decisions, understand our customers and deliver … promotion between development, test and production environments Working on with project team to build and then take ownership of the CI/CD pipeline so that every change is built and tested automatically before it reaches production Owning orchestration of the Travel transformation layer and the operational interface with ...

Lead Data Engineer £73,000 - £83,000 per annum Folkestone Hybrid Initial 8-month FTC (potential to go perm) As Lead Data Engineer, youll play a pivotal role in shaping how Saga Travel uses data to make better decisions, understand our customers and deliver … promotion between development, test and production environments Working on with project team to build and then take ownership of the CI/CD pipeline so that every change is built and tested automatically before it reaches production Owning orchestration of the Travel transformation layer and the operational interface with ...

Senior Data Engineer Manchester (3 Days per Week in the Office) £80,000 - £90,000 + Private Healthcare + Life Insurance Are you a Senior Data Engineer who prefers building the foundations that make reporting possible, rather than inheriting someone else's platform and maintaining … This role sits within a growing digital transformation and project controls consultancy delivering reporting and data solutions across major capital programmes. You'll work across two established client accounts from day one, building the data capability behind board-level reporting rather than simply producing dashboards. ...

Senior Data Engineer Manchester (3 Days per Week in the Office) £80,000 - £90,000 + Private Healthcare + Life Insurance Are you a Senior Data Engineer who prefers building the foundations that make reporting possible, rather than inheriting someone else's platform and maintaining … This role sits within a growing digital transformation and project controls consultancy delivering reporting and data solutions across major capital programmes. You'll work across two established client accounts from day one, building the data capability behind board-level reporting rather than simply producing dashboards. ...

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will … joining an established defence programme requiring additional engineering support across an existing data platform. You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment. Due to the nature of the work you will be required to work ...

maintenance of environments and services in cloud and/or on premisesArchitect, engineer and deploy low latency network infrastructure across multiple data centresWriting and maintaining cloud infrastructure scripts, buying into the infrastructure as code paradigmAssist in debugging and resolving production operational issuesEnsuring … proper monitoring and log collection/aggregation is in place and comfortable adding new instrumentation in code as necessaryCreating and maintaining data pipeline(s) and data projections for other departments to have self-service to data sets (ETL Pipelines)The DevOps Engineer Must ...

Python | SQL | BigQuery | Neo4j | Data Engineering | Knowledge Graphs The Role I'm working with a business investing heavily in enterprise AI, search and knowledge management capabilities. They're looking for a Data Engineer to help build the data foundations that sit behind large-scale … knowledge discovery platforms. This is a hands-on engineering role focused on designing and delivering data pipelines, search infrastructure and knowledge management solutions that turn complex enterprise information into trusted, searchable and AI-ready assets. What You Will Be Doing Designing and building scalable data ingestion ...

Through PJT Park Hill, it also provides private fund advisory and fundraising services for alternative investment managers. Задачи: Design and own the Snowflake data architecture, including data models, schemas, warehouses, RBAC, and performance; Write and optimize complex SQL for extraction, transformation, validation, and ad-hoc analysis … transformations; Design and maintain integrations with upstream and downstream systems via RESTful APIs and Core Connectors; Develop subject‐matter expertise on key data elements and ensure data lineage and accuracy; Implement data quality checks, automated validation, and testing; Build and automate departmental workflows, approvals ...

Data Engineer Newcastle (Hybrid) Permanent Competitive salary + package Im currently working with a global consultancy to hire Data Engineers to join a growing Advanced Technology team delivering large-scale data solutions across public and private sector clients. This is a hands-on role … where youll work with modern data technologies, building scalable pipelines and real-time data platforms that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that … support analytics and operational decision-making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that … support analytics and operational decision-making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable ...

client, an expanding data consultancy based in Hove, is seeking an enthusiastic Apprentice Data & AI Consultant to join its growing team. This is an exciting opportunity for someone looking to build a career in data analytics, business intelligence, data engineering, and artificial … intelligence. Role This is an exciting opportunity for someone looking to build a career in data analytics, business intelligence, data engineering, and artificial intelligence. You will work alongside experienced consultants on real client projects, supporting the design and delivery of data pipelines, dashboards, reports ...

Role: Cyber Data Engineer Location: Reading,Havant, Glasgow, Perth Duration: 6 months Office requirement: 2/3 day onsite in a week. Description: This role will support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated … repeatable reporting. The role will help ensure cyber metrics are based on trusted, accessible and well-managed data rather than manual collection and spreadsheet-based processes. Scope: Identify, onboard and integrate cyber security data sources. Design, build and maintain automated data pipelines and workflows. ...

Data Engineer - Newcastle-Upon-Tyne - Up to £64,000 - Permanent Be part of a growing technology consultancy delivering complex data and cloud solutions for major organisations. This opportunity offers the chance to work on large-scale transformation programmes, helping businesses unlock value from their data through modern cloud platforms, scalable engineering practices and emerging technologies. As a Data Engineer, you'll collaborate with architects, consultants and engineering teams to design, build and support robust data solutions across cloud environments. Working with technologies such as AWS, Python and modern data ...

LiveScore Group in London is seeking a Data Engineer to join the Data Team, building scalable data pipelines that power our data strategy and real-time AI/ML workloads. You will contribute to architectural discussions and deliver high-quality data solutions across the data platform. Join a team shaping data-driven decisions, optimise data storage, and collaborate with engineers, analysts and IT to deliver robust, secure data products. Hybrid work with in-office presence Tue-Thu. #J-18808-Ljbffr ...

proper monitoring and log collection/aggregation is in place and comfortable adding new instrumentation in code as necessaryCreating and maintaining data pipeline(s) and data projections for other departments to have self-service to data sets (ETL Pipelines)This is a greenfield ...

Hybrid Role Purpose We are seeking a highly experienced, hands-on Azure Databricks Platform Engineer/Architect to enhance and optimise an enterprise Data Platform. The role combines architecture with direct implementation: the successful candidate must be able to configure, develop, troubleshoot and optimise Azure Databricks rather than … compute based on duration, utilisation, SLA, concurrency, performance and cost. Enable and configure Serverless for appropriate jobs, SQL workloads, notebooks, analytical processing and data pipelines. Establish workload-placement guidance, including when Serverless is not economical for predictable, heavy or continuously running workloads. Implement compute policies, autoscaling, quotas, budget ...

seeking a Software Engineer to join the Commodities Data Team in London. You will help build data pipelines for ingestion and analysis of datasets, collaborating with senior data engineers and stakeholders on both greenfield and legacy projects. Initially you will focus on delivering data to analysts, with opportunities to design core data infrastructure as you grow. The role emphasizes reliable Python ETL development, strong communication, and a collaborative, high-performance #J-18808-Ljbffr ...

think big, act fearlessly, and create an inclusive environment that drives positive impact to join our team. What you'll do Corporate Data & Analytics designs, builds, and maintains the data platforms that keep our business running. We manage the reporting tools, data pipelines … analytics systems relied on across the company every day. Our work covers Google Cloud Platform (GCP), BI platforms, data engineering tooling, and reliability processes - all with a focus on stability, modernization, and continuous improvement. This role plays a key part in keeping these platforms healthy, reliable, and continuously ...

month contract £80,000 per annum Hybrid - 3 days per week in London We are hiring an AI-Enabled Data Analytics Engineer to join a global technology organisation, building scalable data, analytics and AI-assisted automation solutions that improve business decision‐making. This is a hands … improve them , ensuring solutions are technically accurate, reliable and relevant to the business. What you'll be doing Design, build and optimise data pipelines and analytics solutions using Databricks Develop SQL, Python and PySpark solutions for transformation, analytics and automation Build and improve AI agents, reusable workflows, prompt ...