226 to 250 of 277 Data Ingestion Jobs in England

defining, refining, and delivering enterprise products that help manufacturers connect Redzone with third‐party systems (ERP, MES, and OT/IoT platforms), optimizing data flow, system connectivity and frontline execution across the plant floor. This is a high-impact, high-visibility role at the center of Redzone’s growth … strategy. You will define how Redzone connects seamlessly into the broader manufacturing tech ecosystem—unlocking data from ERP, MES, HRIS, and OT systems to deliver seamless workflows and real-time connectivity for the frontline. You will own the vision and execution for integrating with enterprise systems like SAP, Oracle ...

About the job you’re consideringThe continued digitisation of our clients' businesses and the growing complexity of modern technology estates generate vast volumes of data and telemetry. The real value lies in making sense of those signals, building a coherent view of service health and business impact, and turning … complex challenges into clear architectural decisions.Lead the end-to-end architecture of the Splunk platform, including scalability, resilience, security, performance, and lifecycle management.Define telemetry, data-ingestion and integration patterns across applications, infrastructure, cloud, networks and service management.Own architecture governance for the observability domain, including HLDs, reference architectures, standards ...

maintainable, and built to scale, adhering to secure development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies … vector databases: context windows, temperature and sampling parameters, system prompts, tool/function calling. Experience of implementing RAG pipelines end-to-end, including data ingestion, chunking strategies, embedding model selection, and retrieval tuning. Experience of implementing parsing pipelines for tasks such as document processing/ingestion, including ...

backend services that power the platform, from ingesting MQTT traffic from thousands of deployed devices through to APIs and internal services that ensure data remains reliable and consistent. This is an opportunity for someone who enjoys genuine ownership. You'll deploy the services you build, take responsibility for them … production operations. Your responsibilities will include: Designing, building and maintaining production-grade Python services supporting thousands of deployed smart meters. Developing and supporting data ingestion services handling MQTT traffic from connected devices. Building APIs and internal backend services that provide reliable access to platform data. Designing resilient services ...

security automation role. Strong hands‐on experience developing and managing Splunk SOAR playbooks. Solid understanding of Splunk platform architecture, including: Search heads, indexers, forwarders Data ingestion and performance considerations Strong experience using Splunk SPL (Search Processing Language). Experience integrating Splunk SOAR with security tools such as SIEM ...

build, train, and deploy models that solve real problems: predicting solar generation, optimising energy storage, forecasting demand, and keeping the grid balanced. The data is rich — weather, sensors, market prices, consumption patterns — and the problems are genuinely hard. This isn't big tech ML for ads or engagement metrics. … that sounds like you, keep reading. Responsibilities Build and deploy ML models for solar forecasting, demand prediction, and energy optimisation Work with time series data from weather systems, sensors, and smart meters across Europe Design and maintain ML pipelines — from data ingestion to training to production inference ...

Description Factor is an API driven, AI powered retail data platform for global energy utilities. We use deep machine learning to help energy retailers accurately value the energy they sell: improving margins, unlocking more competitive customer products, and driving lower carbon emissions. We believe that great environmental outcomes come … Responsibilities Build and ship backend features and services with a focus on elegance, scalability, performance, and resilience. Design and evolve Factor’s core data and application architecture (Typescript rust, AWS, etc). Solve complex, end to end problems across the stack, from data ingestion and transformation, complex ...

government/publications/united-kingdom-security-vetting-clearance-levels Key areas of responsibility Support the design of end-to-end AI pipelines, from data ingestion and feature engineering through to model training, evaluation, deployment, and monitoring, contributing technical input and developing architectural judgement under senior guidance. Assist … assess tooling, platform, and hosting options, summarising trade-offs clearly to inform architectural decisions. Support the identification of technical risks in AI solutions, including data quality issues, model drift, integration failure modes, and AI security and safety considerations. Work with ML engineers, data engineers, and domain SMEs ...

custom automations) on our internal Kubernetes platform. Develop pipelines and self-service automations that allow the CyberSec/SOC team and developers to onboard data and deploy detection use cases autonomously. Ensure robust integration across hybrid infrastructure, log pipelines, and network telemetry. Who are we looking for? Self-Starter … champions automation-first, CI/CD pipelines, code reviews, and self-service enablement. Modern Observability & Telemetry: Strong background in Splunk (SPL, dashboards, alerts, data ingestion, forwarders) and also configuring OpenTelemetry collectors and pipelines; knowledge of Prometheus and Grafana or similar tools. Kubernetes (Power User): Strong, hands-on experience ...

environments. At the core of everything we build is AVISTM (A Very Intelligent System), our orchestration platform: the intelligence layer that fuses multi-modal data, including text, imagery, telemetry and sensor feeds, so operators can interrogate complex information at speed and make better decisions under pressure. AVISTM powers … into the environments where it matters most, whether that is protecting nations, infrastructure and lives, or transforming how commercial organisations reason over their data and make high-stakes decisions. As a Senior Applied AI Engineer at Oxford Dynamics, you will build and ship agentic AI systems in production: designing ...

technology consulting firm in Birmingham is seeking an Elastic Engineer for a hybrid role focused on building and maintaining data ingestion pipelines and the ELK stack. Candidates should have strong experience with Elastic search, Kibana, and Logstash, along with data engineering skills and cloud awareness. This role … involves analyzing data insights and collaborating with stakeholders. The contract is for 6 months with a daily rate of £300 - £350. #J-18808-Ljbffr ...

long-term software strategy and engineering function. The Company They are an innovative technology business developing connected products that combine hardware, software, and data to deliver meaningful real-world impact. Their product is already in market with a growing user base and a clear roadmap for future growth. … Developing and optimising Bluetooth Low Energy (BLE) connectivity between devices and applications. Designing and managing AWS-based cloud infrastructure and backend services. Creating scalable data ingestion and processing pipelines. Supporting the integration of AI-driven functionality into customer-facing products. Owning software quality, observability, deployment, and release processes. ...

Adarga is seeking an experienced generalist engineer to advance the design and implementation of our multimodal data fusion platform. You will take components from design to production, contribute to architectural decisions, and ship, working with our Chief Architect and a growing team across data ingestion, transformation pipelines … semantic data representation, and deployment from cloud to edge to airgap. #J-18808-Ljbffr ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

environments. At the core of everything we build is AVISTM (A Very Intelligent System), our orchestration platform: the intelligence layer that fuses multi-modal data, including text, imagery, telemetry and sensor feeds, so operators can interrogate complex information at speed and make better decisions under pressure. AVISTM powers … into the environments where it matters most, whether that is protecting nations, infrastructure and lives, or transforming how commercial organisations reason over their data and make high-stakes decisions. As a Senior Applied AI Engineer at Oxford Dynamics, you will build and ship agentic AI systems in production: designing ...

Software Developer Apprentice, you will support the development of an innovative AI-powered platform, gaining experience across software development, data engineering, testing and user experience design. This role is ideal for someone with a passion for technology who wants to build a career in software development. Role Key Responsibilities … Support the development of web-based applications and digital platforms Assist with building and maintaining data ingestion pipelines and API integrations Develop and maintain dashboards and reporting tools Support full-stack software development activities across the platform Write and maintain automated tests to ensure software quality Assist with ...

modeling and design workflows. Your primary responsibility will be to design, implement, and maintain reliable, scalable backend and infrastructure components that support ML inference, data pipelines, and product features. You will work closely with ML researchers, product engineers, and scientists to turn cutting‐edge models into dependable, production‐grade … services. This includes building APIs, scaling inference workloads, evolving data ingestion and storage pipelines, and ensuring the platform meets real-world requirements around performance, reliability, and cost. This role is ideal for someone who enjoys owning foundational systems end‐to‐end, thrives on ambiguity, and is motivated ...

modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video, unstructured documents) with bothbatch … real-time. Develop full‐stack applications and internalengineering tools using Python, shell scripting, and modern web frameworks(e.g., Flask, React). Collaborate closely with data scientists tooperationalize machine learning models using Cloudera Machine Learning(CML). Perform performance tuning and optimization of dataapplications on Hadoop to ensure optimal resource ...

Elasticsearch SIEM Engineer. You will be responsible for designing, developing and supporting scalable Elastic Stack solutions, with a particular focus on security monitoring, log ingestion and SIEM capabilities. Key responsibilities Design, deploy and maintain Elasticsearch, Logstash and Kibana environments Develop and optimise Logstash pipelines for security and operational data … logs from cloud, infrastructure, network and security sources Create and tune Elastic SIEM detection rules, dashboards and alerts Improve cluster performance, resilience, scalability and data retention Automate deployments and configuration through Ansible and scripting Support containerised Elastic environments running on Kubernetes Manage streaming and ingestion workflows using Kafka ...

Stack AI Engineer who can build across the entire product — from the security analyst dashboards to the ML models that power detection, to the data ingestion pipelines that process billions of events daily. Security is a domain where AI genuinely matters. The attackers are using … anomaly detection, behavioural analysis, natural language processing for threat intelligence, and building interfaces that help analysts respond faster. The problems are adversarial, the data is noisy, and the stakes are real. Responsibilities Build analyst-facing interfaces for investigating and responding to security threats Design and implement ML models ...

Research in London seeks a Security Data and Platform Engineer to own the onboarding, tuning and evolution of security telemetry across cloud, hybrid and corporate environments. You will design scalable data ingestion into Elastic SIEM and apply software engineering to automate workflows. You will collaborate with … CSIRT, Detection Engineering, Platform Engineering and Cloud teams to ensure high‐quality, cost‐effective security data for monitoring, investigation, threat hunting and #J-18808-Ljbffr ...

Refractal in London, United Kingdom, is hiring a software engineer to connect our security platform to customer systems, building integrations and data pipelines. You will work with security engineers and customers to translate requirements into reliable software. You will design robust data ingestion, transformation and interface patterns ...

Senior AI Infrastructure Engineer focused on model training and inference, you will: Implement and scale training pipelines for large transformer and LLM models, from data ingestion and preprocessing through distributed training and evaluation. Build and optimize inference services that deliver low‐latency, high‐reliability experiences for our customers … transformers and LLMs). Low‐level GPU work , such as writing CUDA or Triton kernels. Comfortable working in production environments at meaningful scale (traffic, data, or organizational). You communicate clearly, can explain complex technical topics to different audiences, and enjoy close collaboration with both engineers and non‐engineers. ...

LOCATION Remote | London ROLE Role Purpose You design the AI platform as a system, ensuring that models, data, reasoning, and humans work together coherently over time. Your role is to maintain architectural integrity as capabilities scale, complexity increases, and use cases expand. What You’ll Build … architecture of the AI platform, from data foundations to intelligence layers and interfaces. Key Responsibilities Design and evolve architecture for: Data ingestion, storage, and access Model training, deployment, and orchestration AI-driven services and decision-support systems Define how multiple model types interact in a single system ...