101 to 125 of 167 Data Ingestion Jobs in England

Senior Data Platform Engineer Location: Primarily Remote (1 day/month in-office) Salary: £70,000 – 85,000 Join a cutting-edge Data Platform Engineering team working on real-time analytics and microservices architecture to power one of the most sophisticated martech solutions in the industry. About the … Role: Reporting directly to the Platform Engineering Manager , you'll be a vital part of a team that enables real-time data processing and analytics. This role involves developing and maintaining microservices, capturing user events and feeding them into a Snowflake-powered analytics platform. What You’ll Be Doing … Developing microservices that handle real-time data ingestion from APIs into the data warehouse Working with live-streaming data Writing clean, efficient Java code (Python is a bonus!) Enhancing and scaling the experimentation framework to support data science and ML operations Ensuring high-quality, accurate More ❯

the promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims … financial professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science teams … processes, building integrations, and analytics. Desired skills: A university degree in Mathematics, Computer Science, Engineering, Physics or similar. 5+ years of relevant experience in Data Engineering, warehousing, ETL, automation, cloud technologies, or Software Engineering in data related areas. Ability to write clean, scalable, maintainable code in Python with More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition to bringing all … its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities: Design, develop, and optimise … real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition to bringing all … its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities: Design, develop, and optimise … real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely with Risk … Finance, Trading, and Business Solutions teams to build high-performance data models and pipelines that drive decision-making at scale. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely with Risk … Finance, Trading, and Business Solutions teams to build high-performance data models and pipelines that drive decision-making at scale. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven More ❯

the direction of the senior stakeholders. Identify and understand client needs, which will include being responsible for: Strong understanding of projects using Relativity Moving data into Relativity Running searches across Relativity Creating review batches and coding layouts in Relativity Preparing productions and exports from Relativity Supporting legal review teams … z2bz0 years' eDiscovery experience (law firm or service provider, understanding full EDRM) Use of eDiscovery technology, specifically Relativity and Nuix, with experience in data processing, data ingestion, database setup, searching, production, threading, near de-duplication, clustering, and active learning Strong documentation and communication skills, including effective collaboration … Brimstone Consulting: We specialise in finding highly qualified staff in E-Discovery and Digital Forensics, Payments, Fraud, Risk, Compliance/Corporate Governance, IT, Big Data and Data Analytics, InfoSec and Cyber Crime, Audit, Accountancy and Finance. Brimstone Consulting acts as an employment agency (permanent) and as an employment More ❯

Junior–Mid Software Engineer (Data Pipelines) 📍 Onsite – London | Full-time We’re helping one of our partner — a seriously exciting AI company started by a team of top scientists — find a Software Engineer to join their data team. They’re building powerful platforms that help organisations make smarter … decisions, and the data ingestion & pipelines team plays a huge part in that. You’d be working on real infrastructure, solving real problems, and making an actual impact from day one. What you’ll be up to: Building and optimising data pipelines (think ETL, scraping, ingestion) Keeping data accurate, clean, and flowing smoothly Collaborating with engineers, analysts, and data scientists Playing around with modern tools, cloud platforms, and a very smart team You might be a good fit if you: Have 1–3 years of experience writing software (Python, Java, Scala — whatever works More ❯

Junior–Mid Software Engineer (Data Pipelines) 📍 Onsite – London | Full-time We’re helping one of our partner — a seriously exciting AI company started by a team of top scientists — find a Software Engineer to join their data team. They’re building powerful platforms that help organisations make smarter … decisions, and the data ingestion & pipelines team plays a huge part in that. You’d be working on real infrastructure, solving real problems, and making an actual impact from day one. What you’ll be up to: Building and optimising data pipelines (think ETL, scraping, ingestion) Keeping data accurate, clean, and flowing smoothly Collaborating with engineers, analysts, and data scientists Playing around with modern tools, cloud platforms, and a very smart team You might be a good fit if you: Have 1–3 years of experience writing software (Python, Java, Scala — whatever works More ❯

Senior Manager - Enterprise Data & Analytics At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. … lead enterprise transformation, and execute innovative solutions to address the complex challenges of our clients. You will be responsible for: Shaping and executing enterprise data transformation: Driving enterprise-level transformation projects, including designing data platforms, establishing robust governance frameworks, and embedding scalable AI and analytics solutions. Leading innovation … in AI and analytics: Spearheading the development of generative AI solutions, statistical models, and data visualisations that deliver actionable insights across various industries. Delivering strategic advisory: Acting as a trusted advisor to C-level stakeholders, providing insights that bridge the gap between technical capabilities and business goals. Portfolio and More ❯

We are currently working with a leading, private equity-backed music rights investor that is seeking a Data Engineer to join their growing team. The data team builds, owns, and maintains proprietary data assets that support the full data lifecycle — from raw data ingestion … pipelines. The team plays a critical role across the business. Responsibilities: Develop, maintain, and optimise robust ETL/ELT pipelines in Python Collaborate with data teams to translate business requirements into scalable data solutions Work cross-functionally to support analytics, reporting, and product development Write clean, maintainable, and … testable code with a strong emphasis on clarity and structure Contribute ideas and insights to help evolve the client’s data platform for scale and efficiency To be successful in this role, you will have: A minimum of 2 years' of relevant experience Proficiency in Python Experience building ETL More ❯

We are currently working with a leading, private equity-backed music rights investor that is seeking a Data Engineer to join their growing team. The data team builds, owns, and maintains proprietary data assets that support the full data lifecycle — from raw data ingestion … pipelines. The team plays a critical role across the business. Responsibilities: Develop, maintain, and optimise robust ETL/ELT pipelines in Python Collaborate with data teams to translate business requirements into scalable data solutions Work cross-functionally to support analytics, reporting, and product development Write clean, maintainable, and … testable code with a strong emphasis on clarity and structure Contribute ideas and insights to help evolve the client’s data platform for scale and efficiency To be successful in this role, you will have: A minimum of 2 years' of relevant experience Proficiency in Python Experience building ETL More ❯

We are looking for a Lead Data Engineer to take on a leadership role within our client's Data Engineering team, driving technical excellence and transforming their data ingestion processes. You will be responsible for implementing Data Engineering strategy, working closely with the Head of … Data Engineering to define best practices for the team whilst also working closely with the Project team to ensure technical specifications and tasks are clear for all team members. Responsibilities Lead data engineering projects, provide guidance & oversight to junior + mid-level data engineers, and establish best … practices to improve the software development life-cycle Work closely with the Head of Data Engineering to ensure the data engineering strategy is implemented by the team Help define clear testing frameworks for the team to follow for validating/transforming synthetic data Define best practices for More ❯

Job Title: Elastic Data Engineer Location: Birmingham 3 days per week. We are looking for a talented Elastic Data Engineer to help build and maintain scalable data solutions. Key Responsibilities: Design, develop, and maintain ElasticSearch clusters. Implement data ingestion pipelines using ETL tools. Optimise search … and indexing performance. Collaborate with seniors and analysts to support data-driven projects. Ensure data security and compliance. Qualifications: Proven experience with ElasticSearch and data engineering. Proficiency in programming languages. Strong understanding of ETL processes and data modelling. Excellent problem-solving skills and attention to detail. More ❯

coupled with at least 2 years experience of Nice Actimize. - Analyzing current installation of Actimize WLF solution at a client side - Recommend improvements on data ingestion and batch process performance - Recommend optimal Threshold setting and Scoring configuration which adhere to the client requirements - Improve detection and alert generation … especially face-to-face with clients. - Must be willing to travel to client site. Nice to have - Experience in DowJones Sanctioned List and Profile data ingestion to WLF The position will be based in Canary Wharf London. Rate will be in the range £275 to £375 per day More ❯

Data Engineer (Python Spark SQL) *Newcastle Onsite* to £70k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive … growth potential. As a Data Engineer you'll be instrumental in transitioning the core data platform to Azure, managing 3rd party data ingestion and integration. You'll collaborate and be supported by a small team, seeking ways to improve the data quality and introduce event … top tier university, Computer Science or similar technical/scientific discipline, backed by minimum A A B grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data More ❯

closer look at the role: About the role: We are seeking a skilled Database Administrator to manage and optimise our cloud databases, ensuring seamless data flow and robust performance. Your work will directly impact the team's race performance by guaranteeing clean data flow and minimising system downtimes … ultimately giving our drivers and strategists the data they need to succeed. As part of the Cadillac Formula 1 Team, we aspire to be the absolute best in every aspect of our team. Team members are encouraged to challenge established thinking and share their ideas to create an environment … where everyone can contribute to our shared success. What you'll be doing: · Cloud Database Management: Oversee cloud database systems and data ingestion processes, particularly the use of DataBricks. · Kafka Streaming and Replication: Implement and manage Kafka streaming and replication solutions. · Django Administration: Administer Django applications with SQL More ❯

closer look at the role: About the role: We are seeking a skilled Database Administrator to manage and optimise our cloud databases, ensuring seamless data flow and robust performance. Your work will directly impact the team's race performance by guaranteeing clean data flow and minimising system downtimes … ultimately giving our drivers and strategists the data they need to succeed. As part of the Cadillac Formula 1 Team, we aspire to be the absolute best in every aspect of our team. Team members are encouraged to challenge established thinking and share their ideas to create an environment … where everyone can contribute to our shared success. What you'll be doing: · Cloud Database Management: Oversee cloud database systems and data ingestion processes, particularly the use of DataBricks. · Kafka Streaming and Replication: Implement and manage Kafka streaming and replication solutions. · Django Administration: Administer Django applications with SQL More ❯

e.g., Apollo) to their distribution partners (e.g., Banks, Financial Advisors, Investment Consultants). Daphne gives asset managers the tools to get their fund product data in a standardized format and easily manage the transmission of the data to their distribution partners. Daphne is headquartered in London and New … to join our team as a Business Analyst in London. The primary responsibility of this business analyst will be the rapid onboarding of fund data into Daphne's product master from various data sources across PDFs, excel files and other client databases. This role has a customer facing … element and we need someone who is comfortable working with data but also being able to spend time with non-technical people from the customer side, understand their requirements and turn it into product improvements. We expect this person to drive process improvement and bring innovation to the data More ❯

teams to achieve their strategic business goals. It also involves evangelizing effective and consistent use of marketing technology platforms and promoting better understanding of data-driven marketing practices among the Marketing teams. A key focus of this role will be supporting the implementation of a new Customer Data … with key business partners : Function as a liaison among CIX and Marketing teams to assist in documenting business use cases, identifying gaps in customer data management, and enhancement opportunities within the new CDP. Work with the business teams to identify projects and enhancements that align with Ralph Lauren's … strategic objectives. CDP Implementation : Work closely with business and IT teams to ensure the smooth integration of the CDP with existing technology solutions and data sources. Assist in mapping data flows, defining data models, and establishing processes for data ingestion. Encourage Data Confidence : Partner with More ❯

to make a difference apply now! What youll be doing Working within a small, collaborative team, youll play a key role in creating geospatial data solutions that help other businesses to understand and improve their impact around sustaibility and more. In this role, youll be working on building and … maintaining data pipelines to load and transform geospatial datasets using PostgreSQL/PostGIS. Youll also manage databases and queries to keep everything running smoothly and efficiently. Youll also be responsible for sourcing and cleaning new datasets, ensuring theyre accurate and ready to use. Day to day, youll be using … various tools to carry out geospatial analysis and create useful data visualisations. Youll also write Python scripts to automate data processing, quality checks, and data ingestion, making things faster and more efficient! Youll collaborate closely with your team and work closely with developers, analysts, and other More ❯

for the role. Full Job Description About the role: The primary responsibility of this role is to integrate log sources into Sentinel, using standard data connectors, troubleshooting and enhancing data connectors, developing custom connectors where required and optimising log ingestion. The key responsibilities are: Responsible for end-to … test and advise clients on audit configuration settings for log sources, to ensure that the right logs flow into Sentinel for threat detection. Deploy data connectors and troubleshoot data ingestion, including deployment of Function Apps, customisation and enhancement of Function App code where required, and development of … custom log ingestion solutions. Validation of log parsing, fixing and enhancing existing parsers, and development of new parsers. Optimisation of collected logs to ensure the right events are collected and unnecessary events are filtered out to manage consumption and cost. Documentation of solution design, and development of technical processes More ❯

and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality … cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software … monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure , latency optimization , execution systems , and market data feeds . Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a More ❯

and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality … cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software … monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure , latency optimization , execution systems , and market data feeds . Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a More ❯

Econometrician/Data Scientist London (Hybrid working 3 office days per week) Salary DOE £40,000-£45,000 Additional Benefits: Gym Membership, Pension and yearly bonus Job Reference: J12950 We’re excited to be hiring for a unique opportunity to join a fast-growing, independent marketing effectiveness agency that … part of a team where your ideas are heard and your impact is recognised. We’re looking for a motivated and capable Econometrician/Data Scientist with 2–3 years of hands-on experience in Marketing Mix Modelling (MMM). Experience within the FMCG sector would be a bonus … essential. Roles and Responsibilities This role is well-suited for candidates who have a strong analytical mindset and prefer working behind the scenes with data Leading the modelling process from briefing, data exploration, and variable selection through to model building, interpretation, and being involved in the presentation of More ❯