76 to 92 of 92 Data Ingestion Jobs in England

massive (GB-scale) datasets. Focusing on performance bottlenecks via vectorisation, parallelism, chunking, or memory optimization. Analytical Pipelines: Experience building end-to-end analytical pipelines (data ingestion → computational transformation → modelling → output) rather than one-off analyses. Cloud Environments: Hands-on exposure to deploying and managing applications within a cloud ...

Routes, ConfigMaps, and Secrets). Database Management: Architect and optimize complex schemas, stored procedures, and queries in Microsoft SQL Server to handle high-frequency data ingestion and reporting. Performance Optimization: Implement and manage Redis for distributed caching to reduce database latency and improve system throughput. DevOps Integration: Collaborate … .NET 8+ and Entity Framework Core. Cloud & Containers: Hands-on experience with OpenShift or Kubernetes; ability to write Docker files and manage container lifecycles. Data Tier: Advanced knowledge of MS SQL Server (T-SQL, indexing strategies, and execution plan analysis). Caching: Experience integrating Redis for session management ...

software for automating bioanalysis workflows. Our platform helps scientists and bioanalysis teams turn complex analytical processes into reliable, repeatable, AI-assisted workflows across data ingestion, analysis, reporting, review, and compliance. The Research Engineer executes our research projects. The work spans agent systems, how we quantify their performance … comes from product feedback; you turn it into shipped results. You will work close to the science: formulating problems, designing experiments, shipping implementations, curating data, and interpreting results. You will work with biologists, scientific contractors, and the rest of the team, and act as a technical sparring partner ...

software for automating bioanalysis workflows. Our platform helps scientists and bioanalysis teams turn complex analytical processes into reliable, repeatable, AI-assisted workflows across data ingestion, analysis, reporting, review, and compliance. We are looking for a Senior Full Stack Engineer to take ownership of both product and infrastructure development. … Build product features across React, Next.js, and TypeScript. - Design, build, and maintain backend Python backend services and APIs. - Own PostgreSQL database design, data modelling, schema migrations, and query performance. - Build and maintain infrastructure using Terraform, Docker and Kubernetes, on GCP. - Improve the reliability, scalability, and maintainability of production systems. ...

front-end and back-end systems. Support and mentor junior developers, fostering a collaborative learning environment. Design and maintain scalable infrastructure and frameworks for data ingestion, processing, and analysis. Skills & Experience Required Minimum 3 years' commercial experience in a Full Stack Developer role. Strong proficiency in JavaScript/ ...

architecture, reference designs, and governance for Generative AI solutions across voice and chat channels. This role partners with product owners, security, data, and engineering teams to translate business outcomes into scalable, secure, and cost-optimised architectures on AWS, accelerating delivery of conversational AI products using Amazon Bedrock, agentic frameworks …/function calling, and agentic workflows (e.g., LangChain/LangGraph/CrewAI/Strands-style patterns) with clear guardrails. Design enterprise-grade knowledge architectures: ingestion pipelines, chunking strategies, embedding/model choices, vector stores, metadata/ACL strategy, and evaluation loops to improve retrieval quality. Architect APIs and integration ...

that let filmmakers edit, localise, and refine performances without reshoots. About the Role The Senior ML Systems Engineer will own the full stack from data ingestion through to distributed training and production inference . Responsibilities Importantly a track record of building ML infrastructure or data platform Strong … #Python backend expertise (e.g. FastAPI or similar) and this hire will have significant ownership Data platform: #LanceDB, #DataFusion, #Arrow, Parquet, Iceberg Training infra: #PyTorch, Ray, multi-node distributed setups Inference: Triton, model ensembles, production reliability Multimodal pipelines: TB-scale video, embedding, and #metadata #datasets Qualifications It's a hybrid ...

brokers, and risk teams use Parsewise to read full submission and claims files end-to-end, turn them into structured, source-linked, decision-ready data, and surface the key risk signals in a dedicated UI that fits their workflow. We are growing a team of driven, high-ownership people … wave and deliver on its promise for regulated buyers. We’re building the most reliable and scalable pipelines for unstructured data. Beyond the document ingestion and understanding that out-of-the-box LLMs can solve, we give business users a level of AI support that no chatbot can provide ...

highly skilled Automation Test engineer with expertise in Identity and Access management (IAM) back-end validation. Skilled in identity orchestration, API testing, data ingestion and transformation, and event-driven (Pub/Sub) architectures. This role focuses on testing secure, scalable identity and access workflows across Google Cloud Platform … automated test framework and suites for API, event, and graph-based services (Python/PyTest). Define and execute test plans/cases/data aligned to requirements and technical specs; maintain FR/NFR traceability. Validate IAM concepts and access models (RBAC/ABAC/ReBAC/PBAC ...

core cyber security platforms and services. You will maintain and tune security tooling across identity, access, network and XDR technologies, ensuring system health, data integrity and effective alerting. You will support multi-tenant platforms such as XDR, SIEM, monitoring analytics, queries and dashboards, and identify opportunities to improve performance. … will contribute to onboarding by supporting ingestion pipelines, enrichment processes and integrations that enable CSOC operations. You will also support planning and implementation of system changes through formal change management, considering risk, impact and service continuity. Working with senior engineers, you will help improve service reliability, resilience and scalability ...

robust coverage against evolving threat landscapes. Key Responsibilities Design and implement detection use cases across SIEM and SOAR platforms using threat intelligence and incident data Develop, map, and maintain detection logic aligned to MITRE ATT&CK frameworks Continuously tune and optimise correlation rules to improve signal-to-noise ratio … Validate detection logic through simulations, threat emulation, and red team collaboration Work closely with SOC tooling and engineering teams to ensure efficient data ingestion and parsing Document detection logic, methodologies, and expected outputs for audit and operational use Contribute to post-incident reviews, enhancing detection coverage and response ...

intelligent software systems that sit underneath large scale operational workflows and real time decision making processes. The platform processes very high volumes of live data, powers complex orchestration pipelines, and delivers AI driven functionality directly into customer environments at enterprise scale. The engineering challenges are genuinely difficult. … Kubernetes so we're scaling" difficult. More the kind of problems involving distributed systems, real time data ingestion, AI orchestration pipelines, and building software that customers rely on day to day inside production environments. The team is still small enough that every engineer materially changes the trajectory ...

make critical decisions about their packaging - improving sustainability while reducing costs. At the centre of this is a platform that brings together fragmented packaging data, applies complex regulatory logic, and enables customers to model packaging decisions across multiple markets. Technology is a critical, funded investment area for the business … looking for now is the engineering leadership to define how this is built, scaled, and delivered. About Ecosurety Ecosurety is an industry-leading packaging data company on a mission to rid the world of unnecessary packaging, and we’re scaling fast. More than 500 brands and retailers, including some ...

enhancements Support detection engineering, tuning, and platform optimisation Lead automation and SOAR initiatives to improve efficiency Collaborate with SOC providers on SIEM governance and data ingestion Ensure platforms meet regulatory and compliance requirements Maintain engineering documentation, standards, and governance Represent engineering in client governance and audit activities Coordinate ...

leader in consumer electronics and tech innovation to find an Enterprise Adobe Specialist for their London hub. You will lead the orchestration of complex, data-driven marketing campaigns, leveraging enterprise tools to connect with millions of users. Note: This is a deeply technical role requiring expertise in Adobe … execute cross-channel campaigns using Adobe Campaign (Classic/V8) and Adobe Real-Time CDP/AEP . Build unified customer profiles, manage data schemas (XDM), and orchestrate real-time journeys. Troubleshoot complex workflows and optimize data ingestion APIs. Requirements Proven track record as an Adobe Campaign ...

within complex distributed systems. The environment is heavily focused on: Real-time event-driven processing High-throughput backend services Distributed microservice architectures Low-latency data ingestion pipelines Operational resilience and observability Production-scale concurrency and asynchronous processing Youll be joining a team working on systems that continuously ingest … process large volumes of operational and telemetry-style data from connected platforms and devices. Tech environment: Python FastAPI Azure Functions Azure Service Bus/Event Hub Kubernetes/AKS Docker Cosmos DB Distributed messaging systems Event-driven microservices Real-time processing pipelines What theyre looking for: Strong hands ...

Remote-first UK role, with regular time near Tetbury- UK Huru is building brain-monitoring technology for a future where brain-health data is easier to collect, understand, and use. Our Clic EEG platform is a miniaturised, self-applied wearable designed to make long-duration brain monitoring possible beyond … leadership. What you’ll be doing You will help build, operate, and improve the backend and cloud systems that support Huru’s devices, apps, data pipelines, internal tools, and customer-facing services. Your responsibilities will include: Building and maintaining backend services, primarily using Node.js, with some use of Python. ...