251 to 275 of 315 Data Ingestion Jobs in the UK

credit, collections, and financial health infrastructure across Europe. Our mission is to build fairer, smarter, and more empathetic financial systems through modern software engineering, data science, and thoughtful product design. As we expand into new markets across Europe, we face a core challenge: adapting to complex local banking standards … counterparts to prioritize client deployments, integrations, and go‐live schedules. What You'll Do Edge & Integration Engineering: Build, scale, and optimize per‐market client data ingestion and egestion integrations, including APIs, file formats, validation, reconciliation, and replay mechanisms. Payment & Comms Integration: Connect market‐specific payment providers, SMS, email ...

About Us: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial … Essential Experience Demonstrable success designing and delivering enterprise‐scale ML platforms and products (ideally using AWS SageMaker). Proven experience delivering ML solutions from data ingestion and feature engineering through to production deployment, monitoring, and continuous improvement. Experience building reliable, low‐latency inference services and operating ML workloads ...

# Data Engineer at N Consulting LtdJob Title: Data Engineer Location: Glasgow, UK. Job Type: Contract -2 Days onsite. Required Skills & Experience 5+ years of experience as a Data Engineer. Strong expertise in SQL and Python/Scala. Hands-on experience with ETL tools and frameworks. Experience … with data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with big data technologies (Spark, Hadoop, Kafka). Knowledge of API integrations and microservices-based data ingestion. Experience working in Agile/Scrum environments. Banking Domain Experience ...

defining, refining, and delivering enterprise products that help manufacturers connect Redzone with third‐party systems (ERP, MES, and OT/IoT platforms), optimizing data flow, system connectivity and frontline execution across the plant floor. This is a high‐impact, high‐visibility role at the center of Redzone’s growth … strategy. You will define how Redzone connects seamlessly into the broader manufacturing tech ecosystem—unlocking data from ERP, MES, HRIS, and OT systems to deliver seamless workflows and real‐time connectivity for the frontline. You will own the vision and execution for integrating with enterprise systems like SAP, Oracle ...

United Kingdom: Full time: Posted Today: R0123436**About Us:**LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience … Essential Experience* Demonstrable success designing and delivering enterprise-scale ML platforms and products (ideally using AWS SageMaker).* Proven experience delivering ML solutions from data ingestion and feature engineering through to production deployment, monitoring, and continuous improvement.* Experience building reliable, low-latency inference services and operating ML workloads ...

advancing OpenAI’s goal of developing AI that benefits everyone. About the Role As a Fullstack Engineer focused on child safety, you’ll build data-intensive, AI-powered applications and infrastructure that enable operators and investigators to work effectively and responsibly. You’ll adapt quickly in ambiguous, fast-moving … Safety Systems, and Research Contribute to the team’s technical strategy, especially for child safety related tools and systems Report on impact in a data-driven fashion You might thrive in this role if you: Have a strong software engineering foundation and enjoy owning systems end-to-end—from ...

defining, refining, and delivering enterprise products that help manufacturers connect Redzone with third‐party systems (ERP, MES, and OT/IoT platforms), optimizing data flow, system connectivity and frontline execution across the plant floor. This is a high-impact, high-visibility role at the center of Redzone’s growth … strategy. You will define how Redzone connects seamlessly into the broader manufacturing tech ecosystem—unlocking data from ERP, MES, HRIS, and OT systems to deliver seamless workflows and real-time connectivity for the frontline. You will own the vision and execution for integrating with enterprise systems like SAP, Oracle ...

About the job you’re consideringThe continued digitisation of our clients' businesses and the growing complexity of modern technology estates generate vast volumes of data and telemetry. The real value lies in making sense of those signals, building a coherent view of service health and business impact, and turning … complex challenges into clear architectural decisions.Lead the end-to-end architecture of the Splunk platform, including scalability, resilience, security, performance, and lifecycle management.Define telemetry, data-ingestion and integration patterns across applications, infrastructure, cloud, networks and service management.Own architecture governance for the observability domain, including HLDs, reference architectures, standards ...

maintainable, and built to scale, adhering to secure development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies … vector databases: context windows, temperature and sampling parameters, system prompts, tool/function calling. Experience of implementing RAG pipelines end-to-end, including data ingestion, chunking strategies, embedding model selection, and retrieval tuning. Experience of implementing parsing pipelines for tasks such as document processing/ingestion, including ...

backend services that power the platform, from ingesting MQTT traffic from thousands of deployed devices through to APIs and internal services that ensure data remains reliable and consistent. This is an opportunity for someone who enjoys genuine ownership. You'll deploy the services you build, take responsibility for them … production operations. Your responsibilities will include: Designing, building and maintaining production-grade Python services supporting thousands of deployed smart meters. Developing and supporting data ingestion services handling MQTT traffic from connected devices. Building APIs and internal backend services that provide reliable access to platform data. Designing resilient services ...

security automation role. Strong hands‐on experience developing and managing Splunk SOAR playbooks. Solid understanding of Splunk platform architecture, including: Search heads, indexers, forwarders Data ingestion and performance considerations Strong experience using Splunk SPL (Search Processing Language). Experience integrating Splunk SOAR with security tools such as SIEM ...

build, train, and deploy models that solve real problems: predicting solar generation, optimising energy storage, forecasting demand, and keeping the grid balanced. The data is rich — weather, sensors, market prices, consumption patterns — and the problems are genuinely hard. This isn't big tech ML for ads or engagement metrics. … that sounds like you, keep reading. Responsibilities Build and deploy ML models for solar forecasting, demand prediction, and energy optimisation Work with time series data from weather systems, sensors, and smart meters across Europe Design and maintain ML pipelines — from data ingestion to training to production inference ...

Description Factor is an API driven, AI powered retail data platform for global energy utilities. We use deep machine learning to help energy retailers accurately value the energy they sell: improving margins, unlocking more competitive customer products, and driving lower carbon emissions. We believe that great environmental outcomes come … Responsibilities Build and ship backend features and services with a focus on elegance, scalability, performance, and resilience. Design and evolve Factor’s core data and application architecture (Typescript rust, AWS, etc). Solve complex, end to end problems across the stack, from data ingestion and transformation, complex ...

government/publications/united-kingdom-security-vetting-clearance-levels Key areas of responsibility Support the design of end-to-end AI pipelines, from data ingestion and feature engineering through to model training, evaluation, deployment, and monitoring, contributing technical input and developing architectural judgement under senior guidance. Assist … assess tooling, platform, and hosting options, summarising trade-offs clearly to inform architectural decisions. Support the identification of technical risks in AI solutions, including data quality issues, model drift, integration failure modes, and AI security and safety considerations. Work with ML engineers, data engineers, and domain SMEs ...

custom automations) on our internal Kubernetes platform. Develop pipelines and self-service automations that allow the CyberSec/SOC team and developers to onboard data and deploy detection use cases autonomously. Ensure robust integration across hybrid infrastructure, log pipelines, and network telemetry. Who are we looking for? Self-Starter … champions automation-first, CI/CD pipelines, code reviews, and self-service enablement. Modern Observability & Telemetry: Strong background in Splunk (SPL, dashboards, alerts, data ingestion, forwarders) and also configuring OpenTelemetry collectors and pipelines; knowledge of Prometheus and Grafana or similar tools. Kubernetes (Power User): Strong, hands-on experience ...

environments. At the core of everything we build is AVISTM (A Very Intelligent System), our orchestration platform: the intelligence layer that fuses multi-modal data, including text, imagery, telemetry and sensor feeds, so operators can interrogate complex information at speed and make better decisions under pressure. AVISTM powers … into the environments where it matters most, whether that is protecting nations, infrastructure and lives, or transforming how commercial organisations reason over their data and make high-stakes decisions. As a Senior Applied AI Engineer at Oxford Dynamics, you will build and ship agentic AI systems in production: designing ...

environments. At the core of everything we build is AVISTM (A Very Intelligent System), our orchestration platform: the intelligence layer that fuses multi-modal data, including text, imagery, telemetry and sensor feeds, so operators can interrogate complex information at speed and make better decisions under pressure. AVISTM powers … into the environments where it matters most, whether that is protecting nations, infrastructure and lives, or transforming how commercial organisations reason over their data and make high-stakes decisions. As a Senior Applied AI Engineer at Oxford Dynamics, you will build and ship agentic AI systems in production: designing ...

technology consulting firm in Birmingham is seeking an Elastic Engineer for a hybrid role focused on building and maintaining data ingestion pipelines and the ELK stack. Candidates should have strong experience with Elastic search, Kibana, and Logstash, along with data engineering skills and cloud awareness. This role … involves analyzing data insights and collaborating with stakeholders. The contract is for 6 months with a daily rate of £300 - £350. #J-18808-Ljbffr ...

long-term software strategy and engineering function. The Company They are an innovative technology business developing connected products that combine hardware, software, and data to deliver meaningful real-world impact. Their product is already in market with a growing user base and a clear roadmap for future growth. … Developing and optimising Bluetooth Low Energy (BLE) connectivity between devices and applications. Designing and managing AWS-based cloud infrastructure and backend services. Creating scalable data ingestion and processing pipelines. Supporting the integration of AI-driven functionality into customer-facing products. Owning software quality, observability, deployment, and release processes. ...

Adarga is seeking an experienced generalist engineer to advance the design and implementation of our multimodal data fusion platform. You will take components from design to production, contribute to architectural decisions, and ship, working with our Chief Architect and a growing team across data ingestion, transformation pipelines … semantic data representation, and deployment from cloud to edge to airgap. #J-18808-Ljbffr ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

environments. At the core of everything we build is AVISTM (A Very Intelligent System), our orchestration platform: the intelligence layer that fuses multi-modal data, including text, imagery, telemetry and sensor feeds, so operators can interrogate complex information at speed and make better decisions under pressure. AVISTM powers … into the environments where it matters most, whether that is protecting nations, infrastructure and lives, or transforming how commercial organisations reason over their data and make high-stakes decisions. As a Senior Applied AI Engineer at Oxford Dynamics, you will build and ship agentic AI systems in production: designing ...

Software Developer Apprentice, you will support the development of an innovative AI-powered platform, gaining experience across software development, data engineering, testing and user experience design. This role is ideal for someone with a passion for technology who wants to build a career in software development. Role Key Responsibilities … Support the development of web-based applications and digital platforms Assist with building and maintaining data ingestion pipelines and API integrations Develop and maintain dashboards and reporting tools Support full-stack software development activities across the platform Write and maintain automated tests to ensure software quality Assist with ...