251 to 275 of 1,750 Data Pipeline Jobs in the UK

quality, consistency, security, and lineage throughout all stages of data processing and transformation, implementing monitoring and alerting mechanisms to maintain pipeline reliability. Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses. Lead communities of practice across … pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands ...

technical problems. Our globally distributed team values technical excellence, ownership, proactive communication, and collaboration. About the Role We are looking for a Senior Data Platform Engineer to join a high-impact engagement with one of our partners, a global leader in wealth-management technology. This is a hybrid … this position to go to the office between 1 to 2 times per week. You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion, transformation, modeling, and delivery of complex financial data. ...

levels, FDJ UNITED is your playing field. Join us in shaping the future of gaming. What You’ll Do Build and run data pipelines that ingest data from sources like Oracle databases, APIs, and SFTP files into our Oracle data warehouse. Write and maintain …/SQL (Oracle 19c+) for data processing, reporting, and analytics. Help design and maintain data models (3NF, Star, Snowflake) that support reporting and downstream applications. Develop and maintain dashboards and reports using tools such as Power BI. Investigate data issues, perform root‐cause analysis ...

Role: Data Engineer Salary: up to £90k Location: City of London Flexible working: Hybrid My client is looking for a Data Engineer with strong Microsoft Fabric expertise to own and develop the data platform, pipelines and reporting that support the business. You'll work … closely with Engineering, Product and commercial teams to turn business requirements into scalable, secure and trusted data solutions. Key skills/Responsibilities Microsoft Fabric: Own and optimise the Fabric environment across OneLake, Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Spark notebooks, semantic models and DirectLake. Data ...

Data Engineer up to £55,000 + Benefits Remote (UK) This is a fantastic opportunity to join a high-growth technology business where you can take ownership of building and optimising modern data pipelines while developing into a key member of a growing data team. THE COMPANY Our client is an innovative technology business operating at the intersection of mobile applications, hardware products, and AI-powered data solutions. With a global, remote-first workforce and ambitious growth plans, they are investing heavily in their data platform to support ...

Data Engineer up to £55,000 + Benefits Remote (UK) This is a fantastic opportunity to join a high-growth technology business where you can take ownership of building and optimising modern data pipelines while developing into a key member of a growing data team. THE COMPANY Our client is an innovative technology business operating at the intersection of mobile applications, hardware products, and AI-powered data solutions. With a global, remote-first workforce and ambitious growth plans, they are investing heavily in their data platform to support ...

Data Engineer up to £55,000 + Benefits Remote (UK) This is a fantastic opportunity to join a high-growth technology business where you can take ownership of building and optimising modern data pipelines while developing into a key member of a growing data team. THE COMPANY Our client is an innovative technology business operating at the intersection of mobile applications, hardware products, and AI-powered data solutions. With a global, remote-first workforce and ambitious growth plans, they are investing heavily in their data platform to support ...

Data Engineer needed in Lincoln Paying £27.95 per hr ref 376144 Full time hours on a temporary basis Key Responsibilities Design, develop, and maintain scalable data pipelines and data integration solutions. Build and optimise ETL/ELT processes to extract data from … various source systems. Develop and maintain data warehouses, data lakes, and cloud-based data platforms. Ensure data quality, accuracy, integrity, and consistency across all data assets. Monitor and troubleshoot data pipelines, resolving performance and reliability issues. Collaborate with ...

looking for experienced Data Engineers to build and operate enterprise-scale data pipelines that transform disparate organisational knowledge into structured, searchable and AI-ready formats. You will work across ingestion, enrichment, indexing and storage, helping create the underlying data infrastructure required to support enterprise … search, knowledge graphs and AI systems. Key Responsibilities Build and operate large-scale data ingestion and transformation pipelines . Develop ETL/ELT processes for disparate enterprise data sources. Design data structures supporting enterprise knowledge and AI use cases. Develop and maintain knowledge graph ...

hackajob is partnering directly with Accenture to hire for this role. Job Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level of experience) Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout … Python Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/ ...

IR35, £800 - £950 per day)Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics … initiatives.**Key Responsibilities:*** **Cloud Architecture:** Design secure, scalable, cloud-native solutions on Microsoft Azure, spanning infrastructure, PaaS services, networking, identity, security and observability.* **Data Engineering:** Design solutions around our data lake platform, architecting performant pipelines, sound data models and strong governance for large volumes ...

ecosystem: AI-assisted development: High proficiency using Kiro/Claude as daily development tools not just prompting, but leveraging AI to accelerate pipeline development, data analysis, and automation Skills & agents: Hands-on experience building AI skills and agents within the Amazon internal ecosystem (AIM, MCP integrations …/BI space Preferred Qualifications Master's degree, or Advanced technical degree Knowledge of data modeling and data pipeline design Experience with statistical analysis, co-relation analysis Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central ...

Keka Technologies Private Limited is seeking an experienced Data Engineer to architect scalable data solutions and data pipelines is the focus. This role emphasizes data integrity, security, and performance across the data lifecycle. Location: Remote. The ideal candidate has 7+ … years in data engineering, strong SQL and Python/Java skills, and experience with data lakes, ETL, and Power BI to deliver insightful visualizations for stakeholders. #J-18808-Ljbffr ...

Data Engineering Lead - Databricks Bristol (Hybrid - 3 Days per Week Onsite) Up to £75,000 - £90,000 + Bonus + Excellent Benefits We're partnering with a well-established, highly successful UK organisation undergoing a significant data transformation programme. As part of their continued investment … data and technology, they're seeking aData Engineering Leadto drive technical excellence, mentor a talented team, and play a key role in the evolution of their cloud-based data landscape. Data Engineering Lead- The Opportunity This is an exciting leadership role where ...

Data Engineer Consultant — Billigence Location: London, UK Hybrid, Flexible 1-2 days per week on site Contract Type: Permanent | Full-time Start Date: ASAP About Billigence Billigence is a boutique data consultancy with global outreach & clientele, transforming the way organisations work with data. We leverage proven … cutting-edge technologies to design, tailor, and implement advanced Business Intelligence solutions across Cloud Data Warehousing, Visualisation, Data Science, Data Engineering, and Data Governance. Headquartered in Sydney, Australia with offices around the world, we help clients navigate difficult business conditions, remove inefficiencies ...

Azure Data Engineer Salary: £36,644 - £45,151 Glasgow Permanent I'm currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards … Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data ...

Azure Data Engineer Salary: £36,644 - £45,151 Glasgow Permanent I'm currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards … Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data ...

Azure Data Engineer Salary: £36,644 - £45,151 Glasgow Permanent I'm currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards … Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data ...

Reference: BBBH3776_1776778489GCP Data Engineer (BigQuery/Dataflow)Salary: Up to 85,000 + Bonus + Benefits Location: London - Hybrid (3 days per week onsite) Working Hours: 40 hours per week - Full time Job Type: Permanent A globally established organisation is seeking an experienced GCP Data Engineer to help build modern, scalable cloud data platforms within a complex enterprise environment. This GCP Data Engineer role will focus on designing data architectures on Google Cloud Platform, building high-performance pipelines, and enabling reliable, secure and governed data ...

they can take on the harder problem tomorrow. This isn't a feature of being early-stage. It's the model. Data Pipeline Architecture. Build the infrastructure that turns 100,000+ unstructured PDFs into constantly updating datasets. Own architecture decisions, pipeline reliability, data quality … also yours. You The builder-operator. You don't see a line between building the system and understanding the business. You can architect a pipeline and explain to a client why the methodology matters. 3–5 years building data pipelines or ML systems. You've shipped ...

Azure Data Engineer Salary: £44,000 - £54,000 Including London Weighting London Permanent I'm currently working with a well-known national charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation … moving towards a Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. ...

Data Engineer 6-months £400 - £450 per day (outside IR35) Remote This is an opportunity to join a leading organisation within the media sector, supporting a major data transformation programme across their cloud data platform. You'll play a key role in building … Experience working with AWS data services and cloud-based data platforms. Strong Python skills for data engineering and pipeline development. Ability to analyse, transform, and optimise complex datasets. Strong problem-solving skills and ability to work collaboratively with technical and business stakeholders. ...

BettingJobs is seeking a Data Engineer to join a small but growing quant team in the sports betting industry. Working alongside the modelling team, you will be responsible for ensuring they have access to reliable, well-structured and high-quality data for research, modelling and analysis. … From building robust Python-based workflows to investigating complex data issues and assessing new data sources, the Data Engineer will be responsible for extracting maximum value from the data. Responsibilities: Work day-to-day with quant modellers to prepare, refine and maintain datasets used ...

Описание The client is an innovative, fast-growing technology company operating across data, cloud, and machine learning. It builds scalable, data-driven platforms that support advanced analytics and AI-powered applications across fintech, healthcare, and digital services. Задачи Design and build SQL databases from scratch … reliability, and performance Optimise and maintain existing database systems to improve query performance and efficiency Architect, implement, and manage cloud-based databases and data solutions in Azure Develop and maintain data pipelines for analytics and machine learning workloads Collaborate with data scientists to prepare ...

Title: Snowflake Data Architect Salary: Paying between £85-£110,000 Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data Engineering … data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector databases, embedding stores, and RAG pipeline integration. Soft Skills: Strong interpersonal skills; ability to translate complex data architecture into clear language for Business Analysts and non-technical stakeholders. ...