101 to 125 of 128 Data Ingestion Jobs in the UK

growing technology-focused cyber security organisation is seeking a motivated Software Engineer with strong Python skills to contribute to the development of internal data-driven platforms. This role involves building and improving systems that gather, process, and analyse large datasets to support research and operational decision-making. Key Responsibilities … Develop and enhance a Python-based Cyber Security platform, ensuring it remains scalable, stable, and capable of handling high data volumes Build and maintain automated cyber event data pipelines to ingest and process information from multiple internal and external sources Refine existing systems and workflows to improve performance ...

arisen for an experienced KDB Developer to work alongside their Quants and Traders. This is an exciting opportunity to take ownership of critical data and analytics capabilities in a business where your work will directly support front-office decision-making, research, and platform performance. In addition to the base … every 6 months. THE ROLE: KDB Developer This position sits within a small, highly capable team focused on building, improving and supporting the firms data environment. The successful candidate will play a key role in designing and developing scalable data collection and analytics solutions, while helping ensure ...

C++ Engineer - Market Data London | Onsite (4 days per week) | Contract I’m working with a leading quantitative research and trading firm looking to expand their Market Data Engineering team in London. This team sits at the core of a high-performance trading environment, building and optimising … systems that connect their platform to ~50 global exchanges. The focus is on low-latency data ingestion, exchange connectivity and reliable delivery of real-time market data into trading and research workflows. The role • Build and maintain high-performance market data feed handlers in modern C++ ...

security monitoring remains effective, scalable and reliable. Key responsibilities include: Acting SME on Elastic Security and Splunk Enterprise Security platforms Designing and maintaining log ingestion pipelines and data enrichment processes Developing and tuning detection rules aligned to MITRE ATT&CK techniques Managing the full lifecycle of detection content … Hands on experience with Elastic Security and Splunk Enterprise Security Strong background in detection engineering and SIEM operations Experience designing and managing large scale data ingestion pipelines Advanced knowledge of SPL, KQL or EQL for detection engineering Experience with automation, scripting or Infrastructure as Code in SIEM environments ...

+ Bonus + Benefits Do you want to be at the heart of some of the biggest and most ambitious AI & Data programmes in the market? We’re hiring experienced Lead GenAI System Architects to join a world-class AI Institute – a centre of excellence driving cutting-edge Engineering … Data innovation. You’ll work with senior leaders, global clients, and multidisciplinary teams on transformative Generative AI initiatives that redefine how organisations operate. This is a senior, hands-on role for someone who blends deep technical expertise with the ability to influence at board and C-suite level. Shape ...

helping maintain momentum across several active research initiatives. You will take ownership of day‐to‐day technical work spanning research platform development, model evaluation, data management, and research operations. The role plays an important part in supporting human studies, community deployments, and evaluation workflows—ensuring that community input … experimentation while maintaining good engineering practices. Key Responsibilities: Develop and maintain a research platform supporting human‐in‐the‐loop evaluation, feedback tasks, and synthetic data workflows, including new experimental API and UI features (e.g. using FastAPI and React). Extend model evaluation pipelines, including quantitative metrics, qualitative review workflows ...

systems. The Role You’ll take ownership of designing and delivering an end-to-end AI-driven reporting and automation platform, working closely with Data Science and operational stakeholders. This is a build-from-scratch opportunity — ideal for someone who enjoys solving real-world complexity and turning manual processes … into robust, automated systems. What You’ll Be Doing Designing and building an automated reporting platform from the ground up Creating intelligent workflows across data ingestion, validation, and reconciliation Implementing AI-driven and agent-based automation to streamline operations Introducing exception handling and human-in-the-loop systems ...

enterprise AI solutions that align with business objectives while ensuring scalability, security, and efficiency. This role translates business needs into AI-driven architectures (across data ingestion, models and operational workflows), ensuring feasibility, cost-effectiveness, and adherence to industry best practices and firmwide standards. The AI Solution Architect works … have: Proven experience architecting AI-driven solutions for enterprise customers, collaborating with sales and engineering teams. Ability to assess data dependencies, business constraints, and success criteria to deliver AI solutions that meet user and business needs. Expertise in AI Solution Architecture, including LLM/SLM (Large Language Models/ ...

alpha research platform . This is not just another quant dev role youll be working on the core infrastructure that powers alpha generation , from data ingestion and processing through to model evaluation, reporting, and deployment . The team is focused on solving complex problems around execution quality, market … impact, and data-driven decision-making , using cutting-edge tools and large-scale datasets. Youll work closely with quants and researchers, influence architecture decisions, and play a key role in shaping how strategies are built and tested across the business. Required Skills: Strong experience with Python (5+ years ...

partitioned, attributes) Functional programming constructs and adverbs (each, over, etc.) Parallel processing (peach, secondary processes) Interprocess communication (hopen, synchronous vs asynchronous messaging) High-volume data ingestion techniques (0:, read0/read1, named pipes, .Q.fs, .Q.fps) Experience with established KDB+ frameworks (eg TorQ or equivalent) Systems & Engineering Fundamentals Strong … grounding in concurrency, algorithms, and data structures Experience working with distributed, low-latency data systems Solid Linux/Unix and Shell Scripting capability Exposure to Java and/or Python is advantageous Domain Expertise Experience with electronic trading platforms or market data systems Understanding of cross-asset ...

strong track record of innovation, operational excellence, and a culture that values collaboration, flexibility, and diversity. This opportunity sits within a modern Data Science team and will play a pivotal role in designing and building an AI-enabled reporting and reconciliation platform that will transform the client's Fund … Administration processes. Role Overview The successful candidate will report into the Head of Data Science and work closely with a dedicated Product Manager in the Fund Administration team. This is a hands-on engineering role where you will architect, build, and deliver production-grade automation solutions in a real ...

modern cloud-native platforms. You'll be working closely with the Lead Engineers/Senior Engineers, helping drive innovation across backend, frontend, DevOps, and data engineering initiatives. The role is fully remote, with the odd meet up in London Key Skills Required Python (Flask) React/TypeScript Comfort working … expand the TypeScript/React frontend Build and maintain Dockerised microservices deployed to AWS (EKS) Troubleshoot and optimise performance across the stack Support data ingestion and transformation pipelines (Spark-based) Work cross-functionally with product and data specialists Help shape new features and influence engineering standards This ...

modern cloud-native platforms. You'll be working closely with the Lead Engineers/Senior Engineers, helping drive innovation across backend, frontend, DevOps, and data engineering initiatives. The role is fully remote, with the odd meet up in London Key Skills Required Strong experience in Full-Stack Engineering Python … expand the TypeScript/React frontend Build and maintain Dockerised microservices deployed to AWS (EKS) Troubleshoot and optimise performance across the stack Support data ingestion and transformation pipelines (Spark-based) Work cross-functionally with product and data specialists Help shape new features and influence engineering standards This ...

. Python is a plus, but insufficient alone. What? Build critical trading infrastructure in Rust (no prior exp needed). You'll own the data layer between core systems and digital PM teams (real-time market data ingestion, position consolidation, and exchange connectivity). Front-to-back … quant analysis. Why? Portfolio Managers, Risk, and Treasury rely daily on the production-critical infrastructure that you'll be building. Ingest real-time market data via exchange APIs, consolidate positions and pricing across multiple sources, and deliver clean data pipelines to the business. The kind of work where ...

Services), Kafka, TypeScript, Mongo DB About the Company Our client is a fast-growing, well-funded technology start up who are developing advanced data platforms for large, global organisations. They focus on solving complex data challenges at scale, using modern technologies to drive meaningful business outcomes. The Role … experienced Backend Engineer to help design, build, and scale core backend systems. This role involves working on high-performance APIs and distributed data processing systems that support critical business operations. Key Responsibilities Design and build scalable data ingestion and processing services Develop and maintain high-performance ...

critical decisions about their packaging - increasing its sustainability and reducing costs. At the centre of this is our platform that brings together fragmented packaging data, applies complex regulatory applies complex regulatory logic making reporting accurate and simple, and enables customers to model packaging decisions that reduce cost and increase … What’s missing is the engineering leadership to define how we build, scale, and deliver it. About Us We’re an industry-leading packaging data company on a mission to rid the world of unnecessary packaging, and we’re scaling fast. More than 500 brands and retailers, including some ...

partnering with a top-tier quantitative trading firm to hire an experienced C++ Software Engineer to work on performance-critical trading and market data systems. This is a role for engineers who care deeply about latency, determinism, and correctness, and who want to build systems where microseconds and design … core engineering team responsible for low-latency, high-throughput systems that sit directly on the trading path. The work spans strategy execution, market data processing, and core infrastructure, with a strong focus on performance and reliability. You’ll collaborate closely with quants, traders, and other systems engineers, taking research ...

reclamation workflows across major publishers (Microsoft, Oracle, IBM, Adobe, SAP, and others). Implement scalable normalisation and reconciliation strategies to handle high-volume data ingestion and multi-publisher ELP reporting. Architect integrations with multiple discovery sources and ERP systems to support large publisher catalogues, ensuring data quality ...

Birmingham. Job description: Role Title: Elastic Engineer 1. Elastic engineer - Strong understanding of elastic - elastic search, Kibana, logstash, Fleet and other integrations 2. Data Engineering skill set to design and develop pipelines to ingest data into Elastic. 3. Logstash pipeline Scripting knowledge. 4. Cloud & Kafka aware 5. Kubernetes … Candidate will be responsible for: -Building all the required pipeline for data ingestion -Setting up ELK stack -Analyzing and sharing insight to stakeholders -Marinating the ELK stack ...

Contract duration: 6 months Location: Birmingham, UK 1. Elastic engineer - Strong understanding of elastic - elastic search, Kibana, logstash, Fleet and other integrations 2. Data Engineering skill set to design and develop pipelines to ingest data into Elastic. 3. Logstash pipeline Scripting knowledge. 4. Cloud & Kafka aware 5. Kubernetes … Candidate will be responsible for: -Building all the required pipeline for data ingestion -Setting up ELK stack -Analyzing and sharing insight to stakeholders -Marinating the ELK stack If you are interested in this position and would like to learn more, please send through your CV and we will ...

Elastic Stack/Elastic Security Deep knowledge of detection engineering, threat intelligence frameworks (MITRE ATT&CK), and noise reduction techniques Hands-on experience with data ingestion tools such as Elastic Agent, Beats, Splunk UF/HF, Syslog, Kafka Advanced proficiency in querying languages including … Strong understanding of ECS and CIM log normalization, enrichment, and large-scale data architectures Expertise in detection rule design, tuning, and lifecycle management Proficiency with automation and orchestration tools, CI/CD pipelines, and Infrastructure as Code (Terraform, Ansible) Excellent stakeholder communication and client management skills Ability to assess ...

role centres on Java API development, identity orchestration, and event-driven architectures, working closely with security and engineering teams to deliver robust IAM and data-driven solutions. Key Responsibilities Design and develop secure, scalable RESTful APIs (Java) supporting identity and access workflows Build and enhance identity lifecycle orchestration (provisioning … understanding of IAM/Identity concepts (OAuth2, OIDC, SAML, federation) Experience with event-driven architectures (Pub/Sub or similar messaging systems) Knowledge of data ingestion, transformation, and API-driven workflows Familiarity with Terraform and cloud platforms (ideally GCP) Desirable Experience with identity platforms (eg Auth0, Okta) Exposure ...

Platform Engineer, Observability Join a high-performance trading platform and take ownership of their Observability and SRE evolution. You’ll work at scale, shaping data ingestion and monitoring pipelines that handle huge real-time trading flows. What you’ll work with Python or Go in a DevOps/ ...

+ bonus Join a high-performance trading platform and take ownership of their Observability and SRE evolution. You’ll work at scale, shaping data ingestion and monitoring pipelines that handle huge real-time trading flows. What you’ll work with Python or Go in a DevOps/ ...

live and beyond • Lead Proof of Value Programmes (typically 4–6 weeks) and transition into full production rollouts • Configure and deploy the platform including data ingestion, workflow design and AI calibration • Work closely with compliance teams to map regulatory frameworks and control environments • Coordinate across internal engineering ...