26 to 50 of 61 Data Ingestion Jobs in the UK excluding London

We are currently looking for a Technical Data Analyst to join our team in the Cardiff office. You will be expected to attend the office 50% of the working week, to align with our hybrid working policy. WHO ARE WE? At Creditsafe, we weave our core values of customer … a part of a culture and a company where careers are made and where talent meet its true potential. THE TEAM The North American Data and Development Team plays a central role in Creditsafe’s US data strategy, with team members based across the United States, Hyderabad, and … Cardiff. The team is responsible for the end-to-end management of US data — from ingestion and validation to continuous improvement — ensuring we deliver accurate, high-quality information to power our products. With dedicated team leads and close oversight from senior leadership, the team supports Creditsafe’s ambition More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting … a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth … Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple data sources to ensure real-time availability Promote high data More ❯

Data Engineer - SC Clearance Leeds (Hybrid and Flexible Working Available) 65K + Bonus **🔐 MUST HAVE ACTIVE SC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. 🔍 What You’ll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft’s data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You’ll More ❯

Data Engineer - SC Clearable Leeds (Hybrid and Flexible Working Available) 65K + Bonus **?? MUST BE ELIGIBLE FORSC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. ?? What You'll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft's data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You'll More ❯

JOB SUMMARY Senior Data Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data … This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality … and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting More ❯

BI Developer, an expert in Power BI and its related tools, to take ownership of our client's Power Reporting Platform during a significant data warehouse migration project. This role requires someone to leverage their hands-on Power BI experience to advise stakeholders on data ingestion and … advanced BI solutions tailored to stakeholder requirements is essential. Experience developing custom BI products using SQL, R, and Python is highly desirable. Knowledge of data integration, data warehousing, data modeling, and data presentation concepts is also important. Additional Skills Extensive report writing experience using Tableau or More ❯

World-leading, advanced data and analytics AI platform is searching for a Technical Adoption Engineer – EMEA —as part of the EMEA Advanced Customer Enablement (ACE) program—to join their growing team in London . In this role, you’ll collaborate closely with customer teams to drive the adoption and … through webinars, workshops, and training, while also mentoring customers to foster self-sufficiency. Technical expertise will be essential in guiding customers through system and data architecture, integrating with cloud data warehouses such as Snowflake and Databricks; supporting the integration of external data sources, developing data models … role. Responsibilities Customer Engagement and Enablement: Act as a trusted advisor for named customer accounts, ensuring they fully leverage the company’s AI and Data capabilities Collaborate with customer teams to enhance their implementation administration Conduct webinars, training sessions, and Art of the Possible workshops to showcase platform potential More ❯

Description This is an exciting opportunity to join a fast-growing Private Equity backed ICT Services business at a time when the Data and Analytics function is core to the next phase of growth. The Data and Analytics team are responsible for the continued growth of data … based in HQ offices in Shoreham by Sea, with the ability to work from home 2 days a week. Principal Responsibilities/Duties Support data-driven decision making across the Operations function of the business by providing insight and data analytics. Manipulate, analyse, and interpret complex data sets. Create data dashboards, graphs, and visualisations to support the business Work alongside data engineering to support data ingestion and modelling projects Provide business-critical analysis to the board of Directors. First line response to required reports and queries. Analysing statistical information and highlighting trends. More ❯

World-leading, advanced data and analytics AI platform is searching for a Senior Solutions Consultant to join their expanding team in London . As a Senior Solution Consultant, you’ll be a key player in shaping data-driven strategies partnering closely with the Sales team to design and … deliver impactful solutions with this AI and Data Products Platform. You’ll help prospects and clients understand how the platform can solve real-world business problems, eliminate technical roadblocks, and create measurable value. This role requires deep familiarity with modern data ecosystems. You’ll leverage cloud data … as a trusted advisor to core customers, delivering exceptional client satisfaction through successful engagements. Responsibilities Conduct insightful discovery sessions to deeply understand customer goals, data environments, and technical challenges, positioning the platform as a differentiated solution that integrates seamlessly with modern cloud data platforms Design and deliver tailored More ❯

World-leading, advanced data and analytics AI platform is searching for a Technical Adoption Consultant – as part of the EMEA Advanced Customer Enablement (ACE) program – to join their growing team in London . In this role, you’ll collaborate closely with customer teams to drive the adoption and successful … through webinars, workshops, and training, while also mentoring customers to foster self-sufficiency. Technical expertise will be essential in guiding customers through system and data architecture, integrating with cloud data warehouses such as Snowflake and Databricks; supporting the integration of external data sources, developing data models … role. Responsibilities Customer Engagement and Enablement: Act as a trusted advisor for named customer accounts, ensuring they fully leverage the company’s AI and Data capabilities Collaborate with customer teams to enhance their implementation administration Conduct webinars, training sessions, and Art of the Possible workshops to showcase platform potential More ❯

and ability to design, develop, and deploy cutting-edge artificial intelligence and machine learning solutions on cloud platforms. You will be familiar with big data tools and technologies for handling large datasets and have hands-on experience with cloud providers like Google Cloud Platform (GCP) . Responsibilities: Utilise cloud … solutions (e.g. ) to build and deploy scalable AI solutions. Process and analyse large datasets to train and evaluate AI/ML models. Collaborate with data scientists to optimise model performance and accuracy. Develop and maintain AI/ML pipelines for data ingestion, processing, and model training. Integrate … latest advancements in AI/ML and cloud technologies. Contribute to the development of AI/ML strategy and best practices. Requirements: Knowledge of data structures, algorithms, and software design principles. Experience with machine learning frameworks: Preferably hands-on experience with cloud platforms (GCP) and their AI/ML More ❯

Pro currently has an exciting opportunity for a motivated and detail-orientated individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data Architect in the Insurance … or Liverpool office. This vacancy however is suitable for an individual who is fully remote and we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing and preparing datasets for analysis. Creation and management of both Risk and Claims More ❯

World-leading, advanced data and analytics AI platform is searching for a Senior Solutions Consultant to join their expanding team in London . As a Senior Solution Consultant, you’ll be a key player in shaping data-driven strategies partnering closely with the Sales team to design and … deliver impactful solutions with this AI and Data Products Platform. You’ll help prospects and clients understand how the platform can solve real-world business problems, eliminate technical roadblocks, and create measurable value. This role requires deep familiarity with modern data ecosystems. You’ll leverage cloud data … as a trusted advisor to core customers, delivering exceptional client satisfaction through successful engagements. Responsibilities Conduct insightful discovery sessions to deeply understand customer goals, data environments, and technical challenges, positioning the platform as a differentiated solution that integrates seamlessly with modern cloud data platforms Design and deliver tailored More ❯

Senior Data Platform Engineer Location: Primarily Remote (1 day/month in-office) Salary: £70,000 – 85,000 Join a cutting-edge Data Platform Engineering team working on real-time analytics and microservices architecture to power one of the most sophisticated martech solutions in the industry. About the … Role: Reporting directly to the Platform Engineering Manager , you'll be a vital part of a team that enables real-time data processing and analytics. This role involves developing and maintaining microservices, capturing user events and feeding them into a Snowflake-powered analytics platform. What You’ll Be Doing … Developing microservices that handle real-time data ingestion from APIs into the data warehouse Working with live-streaming data Writing clean, efficient Java code (Python is a bonus!) Enhancing and scaling the experimentation framework to support data science and ML operations Ensuring high-quality, accurate More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely with Risk … Finance, Trading, and Business Solutions teams to build high-performance data models and pipelines that drive decision-making at scale. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven More ❯

Junior–Mid Software Engineer (Data Pipelines) 📍 Onsite – London | Full-time We’re helping one of our partner — a seriously exciting AI company started by a team of top scientists — find a Software Engineer to join their data team. They’re building powerful platforms that help organisations make smarter … decisions, and the data ingestion & pipelines team plays a huge part in that. You’d be working on real infrastructure, solving real problems, and making an actual impact from day one. What you’ll be up to: Building and optimising data pipelines (think ETL, scraping, ingestion) Keeping data accurate, clean, and flowing smoothly Collaborating with engineers, analysts, and data scientists Playing around with modern tools, cloud platforms, and a very smart team You might be a good fit if you: Have 1–3 years of experience writing software (Python, Java, Scala — whatever works More ❯

We are currently working with a leading, private equity-backed music rights investor that is seeking a Data Engineer to join their growing team. The data team builds, owns, and maintains proprietary data assets that support the full data lifecycle — from raw data ingestion … pipelines. The team plays a critical role across the business. Responsibilities: Develop, maintain, and optimise robust ETL/ELT pipelines in Python Collaborate with data teams to translate business requirements into scalable data solutions Work cross-functionally to support analytics, reporting, and product development Write clean, maintainable, and … testable code with a strong emphasis on clarity and structure Contribute ideas and insights to help evolve the client’s data platform for scale and efficiency To be successful in this role, you will have: A minimum of 2 years' of relevant experience Proficiency in Python Experience building ETL More ❯

We are looking for a Lead Data Engineer to take on a leadership role within our client's Data Engineering team, driving technical excellence and transforming their data ingestion processes. You will be responsible for implementing Data Engineering strategy, working closely with the Head of … Data Engineering to define best practices for the team whilst also working closely with the Project team to ensure technical specifications and tasks are clear for all team members. Responsibilities Lead data engineering projects, provide guidance & oversight to junior + mid-level data engineers, and establish best … practices to improve the software development life-cycle Work closely with the Head of Data Engineering to ensure the data engineering strategy is implemented by the team Help define clear testing frameworks for the team to follow for validating/transforming synthetic data Define best practices for More ❯

Job Title: Elastic Data Engineer Location: Birmingham 3 days per week. We are looking for a talented Elastic Data Engineer to help build and maintain scalable data solutions. Key Responsibilities: Design, develop, and maintain ElasticSearch clusters. Implement data ingestion pipelines using ETL tools. Optimise search … and indexing performance. Collaborate with seniors and analysts to support data-driven projects. Ensure data security and compliance. Qualifications: Proven experience with ElasticSearch and data engineering. Proficiency in programming languages. Strong understanding of ETL processes and data modelling. Excellent problem-solving skills and attention to detail. More ❯

Data Engineer (Python Spark SQL) *Newcastle Onsite* to £70k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive … growth potential. As a Data Engineer you'll be instrumental in transitioning the core data platform to Azure, managing 3rd party data ingestion and integration. You'll collaborate and be supported by a small team, seeking ways to improve the data quality and introduce event … top tier university, Computer Science or similar technical/scientific discipline, backed by minimum A A B grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data More ❯

for the role. Full Job Description About the role: The primary responsibility of this role is to integrate log sources into Sentinel, using standard data connectors, troubleshooting and enhancing data connectors, developing custom connectors where required and optimising log ingestion. The key responsibilities are: Responsible for end-to … test and advise clients on audit configuration settings for log sources, to ensure that the right logs flow into Sentinel for threat detection. Deploy data connectors and troubleshoot data ingestion, including deployment of Function Apps, customisation and enhancement of Function App code where required, and development of … custom log ingestion solutions. Validation of log parsing, fixing and enhancing existing parsers, and development of new parsers. Optimisation of collected logs to ensure the right events are collected and unnecessary events are filtered out to manage consumption and cost. Documentation of solution design, and development of technical processes More ❯

and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality … cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software … monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure , latency optimization , execution systems , and market data feeds . Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a More ❯

Econometrician/Data Scientist London (Hybrid working 3 office days per week) Salary DOE £40,000-£45,000 Additional Benefits: Gym Membership, Pension and yearly bonus Job Reference: J12950 We’re excited to be hiring for a unique opportunity to join a fast-growing, independent marketing effectiveness agency that … part of a team where your ideas are heard and your impact is recognised. We’re looking for a motivated and capable Econometrician/Data Scientist with 2–3 years of hands-on experience in Marketing Mix Modelling (MMM). Experience within the FMCG sector would be a bonus … essential. Roles and Responsibilities This role is well-suited for candidates who have a strong analytical mindset and prefer working behind the scenes with data Leading the modelling process from briefing, data exploration, and variable selection through to model building, interpretation, and being involved in the presentation of More ❯

GBP/Day (Inside IR35) Role Description: A Security Solutions Architect + GenAI would design and implement secure AI/ML solutions, ensuring data protection and compliance while leveraging AI's capabilities. This role combines expertise in cybersecurity, AI/ML, and cloud technologies to architect secure and scalable … AI solutions. Responsibilities : Security Architecture: Design and implement security solutions for AI/ML applications, focusing on data privacy, confidentiality, and integrity. GenAI Solution Design: Develop and deploy AI-powered solutions, integrating security measures throughout the life cycle, from data ingestion to model deployment. Skills and Qualifications … understanding of cybersecurity principles, threat modelling, vulnerability assessment, and penetration testing. Cloud Computing: Familiarity with cloud platforms (AWS, Azure, GCP) and their security features. Data Privacy and Compliance: Knowledge of data privacy regulations (GDPR, CCPA) and industry standards. Problem-solving and Analytical Skills: Ability to identify, analyze, and More ❯

The Role We are seeking an experienced Software Development Manager with extensive expertise in AI, Data Engineering, and Architecture. You will lead the development of scalable, AI-driven solutions, combining deep technical knowledge of AWS Cloud Services, MLOps, and core Data Science concepts with proven leadership and strong … up for quality for our customers then we want to talk to you. Key responsibilities Lead engineering teams to deliver high-quality AI and Data solutions. Define and oversee solution and technical architecture decisions. Drive the technical vision, including the selection of appropriate technologies, frameworks, and architectural patterns. Review … designs, providing feedback to Product Management and Architects. Oversee the end-to-end lifecycle of AI projects including data ingestion, ML model development, deployment, and monitoring. Implement and refine MLOps processes, ensuring robust and scalable delivery of models into production. Plan, initiate, manage, and monitor technical projects from More ❯