76 to 100 of 101 Data Ingestion Jobs in the UK excluding London

choices while delivering high-quality work within deadlines Leading architecture and software design discussions Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Generating new potential solutions to challenges (technical and non-technical) in partnership with … encourage applicants with experience in the following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such ...

secure access controls. Develop and maintain CI/CD pipelines, Infrastructure-as-Code, container orchestration, and monitoring solutions. Integrate third-party systems, APIs, and data feeds while ensuring reliability and scalability. Design and support data ingestion and processing pipelines. Collaborate with front-end developers, data scientists … Linux, and collaborative development experience. Preferred Skills Experience designing large-scale microservice and distributed system architectures. Advanced Python development, asynchronous programming, and high-volume data processing. Knowledge of SQLAlchemy, Django ORM, Pydantic, or related data-access frameworks. Experience with Go, Node.js, or Java environments. Familiarity with API gateways ...

infrastructure across the energy, transportation, security, and industrial sectors. Our Edge Platform team develops software systems that transform vast volumes of real-time sensor data into actionable intelligence. Deployed globally in demanding customer environments, our platform processes and analyses data from Distributed Acoustic Sensing (DAS) and Distributed Temperature … Developer, you will play a key role in building and enhancing the backend services that power these solutions. Working with modern C++, distributed systems, data processing pipelines, containerised applications, and cloud-connected technologies, you will help solve complex technical challenges while contributing to products used by some ...

designing, building, and operating production-grade ML systems from the ground up. Responsibilities include: Building and owning end-to-end machine learning solutions, from data ingestion through to deployment and monitoring Developing scalable data pipelines that process large volumes of real-time and batch data Training … production environments Working with Databricks, AWS, Python, Kafka, and modern MLOps tooling Leveraging machine learning, LLMs, and multimodal AI techniques across structured and unstructured data sources Collaborating with engineering, product, and business stakeholders to deliver impactful solutions Contributing to system architecture, platform design, and technical best practices Driving measurable ...

expansion into European markets, there's plenty to get involved in. You'll work closely with engineers and traders, building reliable backend services and data pipelines that support forecasting, trading and day to day business operations. You don't need previous energy or trading experience: curiosity, sound engineering judgement … willingness to take ownership matter most. The role Sitting between backend software engineering and data engineering, this position gives you the chance to understand how your work connects to the wider business, including cash management and financial workflows. You'll: Build and maintain data ingestion services connecting ...

latency of AI applications and retrieval workflows. - Manage infrastructure-as-code using Terraform and support containerised deployments. - Build CI/CD pipelines and automate data ingestion, embedding generation and vector indexing. - Implement monitoring, logging, tracing and performance optimisation across AI workloads. - Apply security, access controls, versioning and governance … DevOps and security teams to deliver production-ready solutions. Skills & Experience - Strong Python development skills. - Commercial experience delivering solutions using Microsoft Azure. - Experience with data integration and ETL pipelines, such as Azure Data Factory. - Familiarity with vector databases or search technologies, such as OpenSearch. - Experience with Terraform, infrastructure ...

components, and create reusable patterns that accelerate delivery of high-value use cases. Your work will directly influence how AI is embedded into the data, knowledge and process layers of the enterprise, ensuring solutions are robust, compliant and commercially viable. Key Responsibilities: Architect end-to-end AI solutions across … data, knowledge and process layers, covering internal business processes, reporting, frontline operations and customer experience. Design and deliver proof-of-concept AI solutions that validate target architectures, use cases and reusable patterns at enterprise scale. Define and document AI solution blueprints, including integration patterns for APIs, microservices, orchestration ...

about unlocking the potential of AI to transform the world. By combining advanced technology with a global network of talented people, we make unusable data usable, driving real-world impact at scale. More than just a workplace, we’re a global community founded on strong relationships and the belief … board! Role Summary: Cloudfactory is an AI enablement company where our software platform enables trusted AI at scale. Services of the platform include data preprocessing, AI model fine-tuning, inference oversight and MLOps for AI solutions in production. For traditional enterprises that have an aspiration to leverage ...

About Us: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial … Essential Experience Demonstrable success designing and delivering enterprise‐scale ML platforms and products (ideally using AWS SageMaker). Proven experience delivering ML solutions from data ingestion and feature engineering through to production deployment, monitoring, and continuous improvement. Experience building reliable, low‐latency inference services and operating ML workloads ...

# Data Engineer at N Consulting LtdJob Title: Data Engineer Location: Glasgow, UK. Job Type: Contract -2 Days onsite. Required Skills & Experience 5+ years of experience as a Data Engineer. Strong expertise in SQL and Python/Scala. Hands-on experience with ETL tools and frameworks. Experience … with data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with big data technologies (Spark, Hadoop, Kafka). Knowledge of API integrations and microservices-based data ingestion. Experience working in Agile/Scrum environments. Banking Domain Experience ...

defining, refining, and delivering enterprise products that help manufacturers connect Redzone with third‐party systems (ERP, MES, and OT/IoT platforms), optimizing data flow, system connectivity and frontline execution across the plant floor. This is a high‐impact, high‐visibility role at the center of Redzone’s growth … strategy. You will define how Redzone connects seamlessly into the broader manufacturing tech ecosystem—unlocking data from ERP, MES, HRIS, and OT systems to deliver seamless workflows and real‐time connectivity for the frontline. You will own the vision and execution for integrating with enterprise systems like SAP, Oracle ...

defining, refining, and delivering enterprise products that help manufacturers connect Redzone with third‐party systems (ERP, MES, and OT/IoT platforms), optimizing data flow, system connectivity and frontline execution across the plant floor. This is a high-impact, high-visibility role at the center of Redzone’s growth … strategy. You will define how Redzone connects seamlessly into the broader manufacturing tech ecosystem—unlocking data from ERP, MES, HRIS, and OT systems to deliver seamless workflows and real-time connectivity for the frontline. You will own the vision and execution for integrating with enterprise systems like SAP, Oracle ...

maintainable, and built to scale, adhering to secure development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies … vector databases: context windows, temperature and sampling parameters, system prompts, tool/function calling. Experience of implementing RAG pipelines end-to-end, including data ingestion, chunking strategies, embedding model selection, and retrieval tuning. Experience of implementing parsing pipelines for tasks such as document processing/ingestion, including ...

technology consulting firm in Birmingham is seeking an Elastic Engineer for a hybrid role focused on building and maintaining data ingestion pipelines and the ELK stack. Candidates should have strong experience with Elastic search, Kibana, and Logstash, along with data engineering skills and cloud awareness. This role … involves analyzing data insights and collaborating with stakeholders. The contract is for 6 months with a daily rate of £300 - £350. #J-18808-Ljbffr ...

long-term software strategy and engineering function. The Company They are an innovative technology business developing connected products that combine hardware, software, and data to deliver meaningful real-world impact. Their product is already in market with a growing user base and a clear roadmap for future growth. … Developing and optimising Bluetooth Low Energy (BLE) connectivity between devices and applications. Designing and managing AWS-based cloud infrastructure and backend services. Creating scalable data ingestion and processing pipelines. Supporting the integration of AI-driven functionality into customer-facing products. Owning software quality, observability, deployment, and release processes. ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Software Developer Apprentice, you will support the development of an innovative AI-powered platform, gaining experience across software development, data engineering, testing and user experience design. This role is ideal for someone with a passion for technology who wants to build a career in software development. Role Key Responsibilities … Support the development of web-based applications and digital platforms Assist with building and maintaining data ingestion pipelines and API integrations Develop and maintain dashboards and reporting tools Support full-stack software development activities across the platform Write and maintain automated tests to ensure software quality Assist with ...

modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video, unstructured documents) with bothbatch … real-time. Develop full‐stack applications and internalengineering tools using Python, shell scripting, and modern web frameworks(e.g., Flask, React). Collaborate closely with data scientists tooperationalize machine learning models using Cloudera Machine Learning(CML). Perform performance tuning and optimization of dataapplications on Hadoop to ensure optimal resource ...

months Location: Birmingham, UK Role Title: Elastic Engineer 1. Elastic engineer - Strong understanding of elastic - elastic search , Kibana , logstash , Fleet and other integrations 2. Data Engineering skill set to design and develop pipelines to ingest data into Elastic . 3. Logstash pipeline scripting knowledge. 4. Cloud & Kafka aware … 5. Kubernetes Candidate will be responsible for: -Building all the required pipeline for data ingestion -Setting up ELK stack -Analyzing and sharing insight to stakeholders -Marinating the ELK stack# Elastic Engineer at N Consulting LtdLocationBirmingham, United KingdomSalary£300 - £350/dayJob TypeContractDate PostedApril 7th, 2026Apply Now #J ...

hiring for a permanent full-time position in Manchester to strengthen our on-site technical team. You will work across real-time forecasting problems, data ingestion, and model development within a fast-growing energy tech scale-up. The role emphasizes fast, accurate software development using Python, Node.js/ ...

solutions and RAG techniques for information storage and retrieval. Develop agentic reasoning workflows using frameworks like LangChain or LlamaIndex. Lead the full AI lifecycle: data ingestion, embedding, extraction, synthesis, prompt engineering, and workflow orchestration. Deploy, monitor, and maintain models in Docker-based, containerized environments. Collaborate with cross-functional ...

London Stock Exchange Group is seeking a Senior Lead ML Engineer to provide technical leadership across the ML lifecycle, from data ingestion and feature engineering to production deployment and monitoring. The role focuses on building scalable, low-latency ML systems and establishing robust governance and MLOps practices. ...

Exabeam is a global cybersecurity leader that delivers AI-driven security operations. High-integrity data ingestion, powerful analytics, and workflow automation power the industry's most advanced self-managed and cloud-native security operations platform for threat detection, investigation, and response (TDIR). With a history of leadership ...