76 to 100 of 180 Data Ingestion Jobs in the UK

We are currently looking for a Technical Data Analyst to join our team in the Cardiff office. You will be expected to attend the office 50% of the working week, to align with our hybrid working policy. WHO ARE WE? At Creditsafe, we weave our core values of customer … a part of a culture and a company where careers are made and where talent meet its true potential. THE TEAM The North American Data and Development Team plays a central role in Creditsafe’s US data strategy, with team members based across the United States, Hyderabad, and … Cardiff. The team is responsible for the end-to-end management of US data — from ingestion and validation to continuous improvement — ensuring we deliver accurate, high-quality information to power our products. With dedicated team leads and close oversight from senior leadership, the team supports Creditsafe’s ambition More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting … a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth … Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple data sources to ensure real-time availability Promote high data More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting … a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth … Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple data sources to ensure real-time availability Promote high data More ❯

foster continuous improvement, and ensure our moderation efforts align with broader business objectives. What You Will Do: Conduct in-depth analysis of UGC moderation data to identify trends, patterns, and optimization opportunities, translating complex insights into actionable recommendations. Collaborate with cross-functional teams like product, engineering and vendor management … as well as with external industry partners to stay current on emerging moderation practices and implement data-driven solutions. Champion a data-driven culture by fostering collaboration, knowledge sharing, and best practices that elevate moderation quality, efficiency, and scalability. Develop and implement new methodologies to measure the impact … of moderation decisions, using advanced analytics and big data techniques to inform strategic direction. Generate and maintain reports, dashboards, and data pipelines by consolidating multiple data sources, programming algorithms, and automating processes to produce actionable insights. Work on diverse-scope problems where analysis requires evaluating numerous factors More ❯

Data Engineer - SC Clearance Leeds (Hybrid and Flexible Working Available) 65K + Bonus **🔐 MUST HAVE ACTIVE SC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. 🔍 What You’ll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft’s data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You’ll More ❯

Data Engineer - SC Clearable Leeds (Hybrid and Flexible Working Available) 65K + Bonus **?? MUST BE ELIGIBLE FORSC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. ?? What You'll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft's data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You'll More ❯

JOB SUMMARY Senior Data Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data … This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality … and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting More ❯

Job Description: Engineering Lead - GCP Data Key Responsibilities: 12+ years of overall IT experience with 10+ years in building data warehouse/datamart solutions. Experience in implementing an end-to-end data platform for analytics on cloud from ingestion to datamart. 4+ years of experience in … Query, GCS. 4+ years of experience in Python; 2+ years of experience in PySpark. Knowledge of GCP Kubernetes would be an advantage. Knowledge of data warehousing concepts with a good understanding of dimensional models. Experience in implementing a metadata framework for data ingestion, data quality, and More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL … enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: You will be developing data pipelines, managing databases, Analysing and visualizing GIS data, Developing python scripting to automate data ingestion, Testing and validating, data manipulation … and cleansing, creating tiles from datasets. You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python SQL, PostgreSQL More ❯

What is Human Native? At Human Native, we're building an AI data marketplace that ensures creators and rights holders are fairly compensated for their work while providing AI developers with high-quality, responsibly licensed training data. We believe in building AI the right way - ensuring transparency, fairness, and … us solve it. The Opportunity As an ML Engineer, you'll help us index, benchmark, and evaluate training datasets at scale. Your expertise with data, AI and ML training methodologies and evaluation techniques will advance the state of the art for developing AI. You will work across: Designing and … developing benchmarks that allow our customers to understand their value of data for training ML (quantifying dataset quality and biases). Deploy these benchmarks by implementing end-to-end data evaluation pipelines to be run on different datasets and ML models. Tools to visualise, analyze, and understand the More ❯

Python - ETL - Systematic Trading - HFT - StatArb - SQL A $25BN AUM statarb/HFT equities focused hedge fund client are scaling their front office facing data team to support incoming portfolio manager/researcher hires. This Data/Software Engineer will be working on data ingestion, data management, application development and the extension of their state of the art research data platform. As well as working on ad hoc projects for the front office to help them use data correctly and augment their investment process. Ideally looking for 1-5 years experience, excellent STEM … degree and competency in both data engineering and software engineering. STRONG Python a MUST. Tech: Python, Pandas, ETL, SQL, Spark, AWS Please apply for more information More ❯

Python - ETL - Systematic Trading - HFT - StatArb - SQL A $25BN AUM statarb/HFT equities focused hedge fund client are scaling their front office facing data team to support incoming portfolio manager/researcher hires. This Data/Software Engineer will be working on data ingestion, data management, application development and the extension of their state of the art research data platform. As well as working on ad hoc projects for the front office to help them use data correctly and augment their investment process. Ideally looking for 1-5 years experience, excellent STEM … degree and competency in both data engineering and software engineering. STRONG Python a MUST. Tech: Python, Pandas, ETL, SQL, Spark, AWS Please apply for more information More ❯

World-leading, advanced data and analytics AI platform is searching for a Technical Adoption Engineer – EMEA —as part of the EMEA Advanced Customer Enablement (ACE) program—to join their growing team in London . In this role, you’ll collaborate closely with customer teams to drive the adoption and … through webinars, workshops, and training, while also mentoring customers to foster self-sufficiency. Technical expertise will be essential in guiding customers through system and data architecture, integrating with cloud data warehouses such as Snowflake and Databricks; supporting the integration of external data sources, developing data models … role. Responsibilities Customer Engagement and Enablement: Act as a trusted advisor for named customer accounts, ensuring they fully leverage the company’s AI and Data capabilities Collaborate with customer teams to enhance their implementation administration Conduct webinars, training sessions, and Art of the Possible workshops to showcase platform potential More ❯

Description This is an exciting opportunity to join a fast-growing Private Equity backed ICT Services business at a time when the Data and Analytics function is core to the next phase of growth. The Data and Analytics team are responsible for the continued growth of data … based in HQ offices in Shoreham by Sea, with the ability to work from home 2 days a week. Principal Responsibilities/Duties Support data-driven decision making across the Operations function of the business by providing insight and data analytics. Manipulate, analyse, and interpret complex data sets. Create data dashboards, graphs, and visualisations to support the business Work alongside data engineering to support data ingestion and modelling projects Provide business-critical analysis to the board of Directors. First line response to required reports and queries. Analysing statistical information and highlighting trends. More ❯

DATA ENGINERRING LEAD - WORLD LEADING BROKER - MUST BE UK BASED ** DVF Recruitment are currently supporting a global leading insurance broker, who are looking to hire a talented Lead Data Engineer (Hands On), to join their highly regarded and well respected team. This is to spearhead the design, implementation … and technical oversight of an internal data ingestion platform. My client are looking for an individual that has the following: Experience with Apache Spark, Kafka, and Airflow for data ingestion and orchestration. Experience in designing and deploying solutions on Azure Kubernetes Service (AKS). Knowledge of More ❯

Freelance Analytics Engineer Start date - ASAP Duration - TBC FULLY REMOTE £350/DAY MUST HAVE STRONG EXPERIENCE IN FUNNEL.IO MUST HAVE MARKETING DATA EXPERIENCE/DATA MANAGER MUST HAVE DASHBOARDING EXPERIENCE - Looker Dashboard ideally Zenith Media are looking for a highly skilled Analytics Engineer, with Looker Dashboard development … a high-profile fashion retail brand. In this role, you will be responsible for the collection, storage, transformation & dashboard visualisation of digital paid media data, working closely with our data engineers, analysts, and media planning teams to transform data into actionable insights. The ideal candidate will have … hands-on experience with Funnel.io & Looker, specifically in transforming data, parsing taxonomy values, building schemas & impactful dashboards. Key Responsibilities: • Design, develop, and maintain scalable data pipelines for digital paid media data. • Utilise Funnel.io to transform data, parse values, and structure schemas for analytics and reporting. • Work closely More ❯

We are currently recruiting for a Data Engineer with hands-on experience of Azure and Insurance experience to join one of our Global Insurance Clients on a 6-month contract. Please note, this role is Inside IR35 with travel to London 1 day a week (Mondays). Key Responsibilities … Design, build, and maintain robust data pipelines to curate and ingest data efficiently. Work with Azure cloud services to deploy and manage scalable data solutions. Implement and maintain CI/CD pipelines for seamless data workflows. Collaborate with cross-functional teams to ensure data integrity … security, and accessibility. Key Skills & Experience: Strong programming skills in Python (PySpark). Hands-on experience with Azure Data Services (Azure Data Factory, Databricks, Synapse, Data Lakes, etc.). Experience with CI/CD pipelines for release management. Knowledge of best practices in data ingestion More ❯

World-leading, advanced data and analytics AI platform is searching for a Senior Solutions Consultant to join their expanding team in London . As a Senior Solution Consultant, you’ll be a key player in shaping data-driven strategies partnering closely with the Sales team to design and … deliver impactful solutions with this AI and Data Products Platform. You’ll help prospects and clients understand how the platform can solve real-world business problems, eliminate technical roadblocks, and create measurable value. This role requires deep familiarity with modern data ecosystems. You’ll leverage cloud data … as a trusted advisor to core customers, delivering exceptional client satisfaction through successful engagements. Responsibilities Conduct insightful discovery sessions to deeply understand customer goals, data environments, and technical challenges, positioning the platform as a differentiated solution that integrates seamlessly with modern cloud data platforms Design and deliver tailored More ❯

Working under the direction of the Managers and/or senior managers to identify and understand client needs, will include being responsible for: Processing data (in Relativity and/or Nuix) Moving data into Relativity Running searches across Relativity Creating review batches and coding layouts in Relativity Preparing … Relativity Supporting legal review teams with their review workflows (including running threading, near de-duplication and CAL) Additional responsibilities include: Maintaining the integrity of data, including evidence handling, processing and data tracking. Liaising with other team members to ensure that correct solutions and processes are implemented at a … eDiscovery experience (law firm or service provider). Deep understanding and practical day-to-day use of eDiscovery technology, specifically Relativity and Nuix, including data processing, data ingestion, database setup, searching, production, threading, near de-duplication, clustering and active learning. Strong documentation and communication skills, including effective More ❯

specialist consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data & analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll … customer visits based on the needs. Handle customer escalations and facilitate any patches or fixes as needed to resolve any issues relating to their data platform. Investigate issues in and maintain data models to support analytics and reporting. Monitor and maintain data infrastructure to ensure availability, correctness … and performance. Perform regular checks to ensure data pipelines and ML models are working correctly. You'll collaborate with the customer on a quarterly basis to ensure all requirements continue to be met. Scope and plan implementation of any customer changes/requirements. Maintain automated data pipelines to More ❯

World-leading, advanced data and analytics AI platform is searching for a Technical Adoption Consultant – as part of the EMEA Advanced Customer Enablement (ACE) program – to join their growing team in London . In this role, you’ll collaborate closely with customer teams to drive the adoption and successful … through webinars, workshops, and training, while also mentoring customers to foster self-sufficiency. Technical expertise will be essential in guiding customers through system and data architecture, integrating with cloud data warehouses such as Snowflake and Databricks; supporting the integration of external data sources, developing data models … role. Responsibilities Customer Engagement and Enablement: Act as a trusted advisor for named customer accounts, ensuring they fully leverage the company’s AI and Data capabilities Collaborate with customer teams to enhance their implementation administration Conduct webinars, training sessions, and Art of the Possible workshops to showcase platform potential More ❯

World-leading, advanced data and analytics AI platform is searching for a Technical Adoption Consultant – as part of the EMEA Advanced Customer Enablement (ACE) program – to join their growing team in London . In this role, you’ll collaborate closely with customer teams to drive the adoption and successful … through webinars, workshops, and training, while also mentoring customers to foster self-sufficiency. Technical expertise will be essential in guiding customers through system and data architecture, integrating with cloud data warehouses such as Snowflake and Databricks; supporting the integration of external data sources, developing data models … role. Responsibilities Customer Engagement and Enablement: Act as a trusted advisor for named customer accounts, ensuring they fully leverage the company’s AI and Data capabilities Collaborate with customer teams to enhance their implementation administration Conduct webinars, training sessions, and Art of the Possible workshops to showcase platform potential More ❯

and ability to design, develop, and deploy cutting-edge artificial intelligence and machine learning solutions on cloud platforms. You will be familiar with big data tools and technologies for handling large datasets and have hands-on experience with cloud providers like Google Cloud Platform (GCP) . Responsibilities: Utilise cloud … solutions (e.g. ) to build and deploy scalable AI solutions. Process and analyse large datasets to train and evaluate AI/ML models. Collaborate with data scientists to optimise model performance and accuracy. Develop and maintain AI/ML pipelines for data ingestion, processing, and model training. Integrate … latest advancements in AI/ML and cloud technologies. Contribute to the development of AI/ML strategy and best practices. Requirements: Knowledge of data structures, algorithms, and software design principles. Experience with machine learning frameworks: Preferably hands-on experience with cloud platforms (GCP) and their AI/ML More ❯

Job Title: Data & Analytics Team Lead Company Overview: The Airedale Group is the market-leading design, installation, and maintenance provider for commercial kitchens in the UK hospitality and food service industry. We work alongside clients from the initial designs to bespoke fabrication and installation. Coupled with the country's … to our extensive client base. We have long-standing relationships with many of the biggest multi-site brands in the UK. Job Overview: The Data & Analytics Team Lead will oversee the delivery of business-critical dashboards and reports focused on field service operations. This includes driving the analysis of … key performance indicators (e.g first time fix metrics, engineer working time on site, etc) & supporting data-driven decision-making in field service operations. Overseeing a team of analysts, you will be responsible for ensuring the quality and accuracy of field service reporting, providing actionable insights to stakeholders, and fostering More ❯

a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: This is a great opportunity for a Junior Data Test Engineer to join a rapidly growing data team in Clarion. Reporting to the Senior Architect, you will be responsible for assisting with … designing and maintaining the testing and testing strategy across our customer data platform and BI solution. You will be working with a small team which consists of database architects, developers, testers, administrators and integration developers and can grow your development skills in Azure, Synapse, Python and SQL. Key Responsibilities … testing, integration testing, functional testing, and end to end testing throughout various project iterations/sprints. Learn to develop complex SQL queries for querying data against different databases or source systems for data verification. Prepare the test plan and testing strategies for data warehousing applications. Interact with More ❯