51 to 75 of 180 Data Ingestion Jobs in the UK

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap to maximize long-term business … value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design … and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and third-party resources. Establish clear service definitions, SLAs, and performance More ❯

to power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications. Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from Deepmind … from world-class investors including General Catalyst, Bessemer, Khosla Ventures & YCombinator - and we're just getting started. Role Summary: We're looking for a Data Engineering Lead to architect and scale the data pipelines that power our next-generation generative video models. This role is central to our … mission of training models exclusively on clean, high-quality data . You will lead the design of data ingestion pipelines, data annotations, and high-throughput, distributed systems that support large-scale data processing and curation. You'll work closely with researchers, engineers, and infrastructure teams More ❯

We are seeking an experienced Informatica IDMC (Intelligent Data Management Cloud) Developer to join our team on a contract basis. This role involves hands-on development and implementation of Informatica cloud assets to support our ongoing data initiatives. You'll work closely with our internal teams to help … IDMC in a cloud environment - Design, build, and maintain workflows, pipelines, and assets across IDMC modules - Collaborate with internal stakeholders to define and implement data solutions - Ensure quality, performance, and governance across all developed assets - Provide documentation, best practices, and knowledge transfer to internal teams Essential Experience: - Candidates must … have strong hands-on experience in the following IDMC modules: - Platform Setup & Configuration - Data Governance & Catalog - Data Ingestion & Replication - Data Integration - Data Quality - Data Profiling - Data Validation - Metadata Command Center Ideal Candidate Profile: - Proven experience delivering Informatica IDMC projects in a contractor capacity More ❯

We are seeking an experienced Informatica IDMC (Intelligent Data Management Cloud) Developer to join our team on a contract basis. This role involves hands-on development and implementation of Informatica cloud assets to support our ongoing data initiatives. You'll work closely with our internal teams to help … IDMC in a cloud environment - Design, build, and maintain workflows, pipelines, and assets across IDMC modules - Collaborate with internal stakeholders to define and implement data solutions - Ensure quality, performance, and governance across all developed assets - Provide documentation, best practices, and knowledge transfer to internal teams Essential Experience: - Candidates must … have strong hands-on experience in the following IDMC modules: - Platform Setup & Configuration - Data Governance & Catalog - Data Ingestion & Replication - Data Integration - Data Quality - Data Profiling - Data Validation - Metadata Command Center Ideal Candidate Profile: - Proven experience delivering Informatica IDMC projects in a contractor capacity More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development and operational management of the … data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision-making. Key Responsibilities as Director of Data More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development and operational management of the … data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision-making. Key Responsibilities as Director of Data More ❯

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role As a Data & AI Operating Model Consultant, you will play a key role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage … data and AI to drive business outcomes: You will play a central role in the designing of effective data, analytics & AI operating models, covering all components required to deliver an effective data & AI capability. You will work with our clients to define their strategic objectives, and then … build a picture of the requisite data & analytical capabilities required to realise those strategic objectives. You will provide guidance and advisory services to clients on a wide range of data & analytics capabilities at all points of the data & analytics value chain. You will work with stakeholders at More ❯

Day Rate: £450 - £550 P/day Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Databricks Data Engineer - Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or … at least Banking experience is a MUST! Key expertise and experience we're looking for: Data Engineering in Databricks: Spark programming with Scala, Python, SQL Ideally experience with Delta Lake Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/… ELT frameworks Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data Governance Management component More ❯

Senior Data Scientist – AI/LLM Trading Platform Overview We are looking for an experienced Senior Data Scientist to design and implement a high-performance data pipeline for an AI/LLM-powered trading platform. This role involves handling large-scale, unstructured financial data—such as … articles, books, and research papers—by collecting, extracting, cleaning, and structuring it for machine learning and trading strategies. What You’ll Do Develop Scalable Data Pipelines – Design and maintain an efficient pipeline to process unstructured data for AI/LLM models. Process Unstructured Text Data – Extract and … prepare data from diverse sources, including financial literature and research. ETL & Data Engineering – Build ETL workflows that unify data from multiple sources into a structured format. Ensure Data Quality – Implement validation techniques and anomaly detection for data integrity. Collaborate Across Teams – Work closely with quant More ❯

Senior Data Scientist – AI/LLM Trading Platform Overview We are looking for an experienced Senior Data Scientist to design and implement a high-performance data pipeline for an AI/LLM-powered trading platform. This role involves handling large-scale, unstructured financial data—such as … articles, books, and research papers—by collecting, extracting, cleaning, and structuring it for machine learning and trading strategies. What You’ll Do Develop Scalable Data Pipelines – Design and maintain an efficient pipeline to process unstructured data for AI/LLM models. Process Unstructured Text Data – Extract and … prepare data from diverse sources, including financial literature and research. ETL & Data Engineering – Build ETL workflows that unify data from multiple sources into a structured format. Ensure Data Quality – Implement validation techniques and anomaly detection for data integrity. Collaborate Across Teams – Work closely with quant More ❯

Data Engineering Manager Location: London, UK Salary: Competitive Salary + Package (dependent on experience) Career Level: Manager Accenture is a leading global professional services company, offering services in strategy and consulting, interactive, technology, and operations, with digital capabilities across all these areas. We leverage industry expertise, diverse skills, and … what we do and the impact we have with our clients and communities." - Julie Sweet, CEO Team Overview: We have exciting opportunities for a Data Engineer to join our Data & AI practice, part of the larger Cloud First Group. We deliver scalable, business-critical, end-to-end solutions … for our clients, from data strategy and governance to core engineering, enabling transformation in cloud technologies. Join us to learn, grow, and advance in an innovative culture that values shared success, diverse thinking, and boundaryless opportunities for your career development. If you're seeking a challenging career in a More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL … someone that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL … someone that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL … someone that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python More ❯

part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Data Lake Engineer at JPMorgan Chase within the Corporate Technology, Chief Data and Analytics Office Development Team, you will play a pivotal role in … technologies (AWS or GCP) via hands on experience or certification Solid understanding of software applications and technical processes within a related technical discipline (e.g. data ingestion, data storage, data serving, APIs, etc.). Hands-on experience in data lake or data warehouse and related More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues … delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You will … work closely with data scientists, analysts, and software engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and unstructured More ❯

REQUIRED: DATA ENGINEER - SC CLEARED LOCATION: FULLY REMOTE WITH OCCASIONAL TRAVEL TO CENTRAL LONDON IR35 STATUS: INSIDE DURATION: 6 MONTH INITIAL CONTRACT Seeking a Data Engineer who has a strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management … etc - Strong understanding of complex JSON manipulation - Experience working with Data Pipelines using a custom Python/PySpark frameworks - Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. - Strong understanding of Data Security … principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets - Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve) - Experience working in a support role would More ❯

Job Title: Azure Data Engineer Lead - Outside IR35 Location: Remote Salary/Rate: £450 per day - Outside IR35 Start Date: 28/04/2025 Duration: 3 months We have an exciting opportunity with a major retail company. They are looking for a Lead Azure Data Engineer to … working outside IR35 and fully remote. Job Responsibilities/Objectives: Lead the design and execution of the end-to-end migration from on-premise data systems to Azure, ensuring scalability, reliability, and performance. Develop and optimise data pipelines using Azure Data Factory, Synapse Analytics, and related services … to support data ingestion, transformation, and integration. Architect and implement Azure-based data solutions, including Data Lake, SQL Database, and Databricks, aligning with business and technical requirements. Establish cloud data engineering best practices, including governance, security, monitoring, and cost optimisation. Collaborate cross-functionally with cloud More ❯

Data Engineer 4 months - with extensions Remote Active SC clearance required £640 per day inside ir35 REQUIRED Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc Strong understanding of complex JSON manipulation Experience working with Data Pipelines … using a custom Python/PySpark frameworks Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including … both CLI usage and scripting) Git Markdown Scala DESIRABLE Azure SQL Server as a HIVE Metastore DESIRABLE TECHNOLOGIES Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA If you meet the above requirements, please apply for the vacancy to be More ❯

Data Engineer - Insurance Company - Didcot (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re working in partnership with a forward-thinking insurance company based in Didcot that’s heavily investing in data and technology to drive smarter decisions and … better outcomes for their customers. As part of this growth, they are now seeking a Data Engineer to help shape their data infrastructure and analytics capabilities. The Role As a Data Engineer, you’ll play a crucial role in designing and maintaining data pipelines, ensuring data is clean, structured, and accessible for analysis. You'll work with modern data tools and cloud technologies to enable real-time insights and support strategic business decisions. Key Responsibilities Develop and maintain scalable data pipelines and solutions for data ingestion, transformation, and delivery. Use Python More ❯

Data Engineer - Insurance Company - Didcot (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re working in partnership with a forward-thinking insurance company based in Didcot that’s heavily investing in data and technology to drive smarter decisions and … better outcomes for their customers. As part of this growth, they are now seeking a Data Engineer to help shape their data infrastructure and analytics capabilities. The Role As a Data Engineer, you’ll play a crucial role in designing and maintaining data pipelines, ensuring data is clean, structured, and accessible for analysis. You'll work with modern data tools and cloud technologies to enable real-time insights and support strategic business decisions. Key Responsibilities Develop and maintain scalable data pipelines and solutions for data ingestion, transformation, and delivery. Use Python More ❯

Data Engineer - Insurance Company - Didcot (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re working in partnership with a forward-thinking insurance company based in Didcot that’s heavily investing in data and technology to drive smarter decisions and … better outcomes for their customers. As part of this growth, they are now seeking a Data Engineer to help shape their data infrastructure and analytics capabilities. The Role As a Data Engineer, you’ll play a crucial role in designing and maintaining data pipelines, ensuring data is clean, structured, and accessible for analysis. You'll work with modern data tools and cloud technologies to enable real-time insights and support strategic business decisions. Key Responsibilities Develop and maintain scalable data pipelines and solutions for data ingestion, transformation, and delivery. Use Python More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring control of their data and AI evolution. … This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities: Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and stakeholders to gather requirements and propose solutions. … Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinement and work estimation. Skills and Experiences More ❯

THE CANDIDATES MUST BE PORTUGAL, SPAIN or UK BASED) For more information visit us: www.marionete.co.uk SKILLS Must-Have Requirements Minimum of 5 years in Data Engineering. Speaks fluent English (written and verbal) for effective collaboration with stakeholders. Proven ability to communicate complex technical concepts to both technical and non … technical audiences. Capable of providing technical guidance and mentoring to junior team members. Experience working in cross-functional teams , including data scientists, analysts, and DevOps engineers. Ability to influence and establish best practices in data engineering processes. Self-motivated with a growth mindset and an eagerness to stay … updated on emerging technologies. Apache Kafka Expertise : Proven experience designing, developing, and managing Kafka-based data pipelines . Good understanding of Kafka Streams , Connect, or the Confluent Kafka platform. Data Engineering Skills : Hands-on experience with ETL tools and data ingestion processes . Strong SQL skills More ❯

The Role: Our objective is to reshape the value chain for our Members and Insurers using data driven insights. Our success will be based on the value data creates for our Members, our risk capital providers, other suppliers and ourselves. Your role will contribute to the overall success … of the Risk Exchange Data Operations team who are responsible for managing and delivering timely and accurate reporting to Insurers and partners of the Risk Exchange. You will establish relationships with Insurers, become a subject matter expert in their data and reporting requirements, and collaborate cross-functionally to … ensure the accuracy and reliability of the data provided to Insurers and partners. Responsibilities: Support the data onboarding process for Insurers and demonstrate a comprehensive understanding of their reporting requirements. Collaborate cross-functionally with Insurers, Data Acquisition Operations, Product and Development teams to ensure data requirements More ❯