76 to 100 of 107 Data Ingestion Jobs in the UK

Responsibilities (High-Level) Design, implement, and maintain scalable ML model deployment pipelines (CI/CD for ML). Build infrastructure to monitor model performance, data drift, and other key metrics in production. Develop and maintain tools for model versioning, reproducibility, and experiment tracking. The Role As an MLOps Engineer … will support these products from inception. This requires working across the full data ecosystem: developing application-specific data pipelines (features), building CICD pipelines that automate the training and deployment of machine learning models, publishing the model results for downstream consumption, and/or building out the APIs that ...

Summary: We are partnering with a leading global consultancy who are looking to hire a highly skilled Databricks Engineer to deliver modern, scalable data platforms for enterprise clients. This is a hands-on engineering role, focused on building, optimising, and operating Databricks-based Lakehouse solutions across cloud environments. Responsibilities … Design, build, and maintain data pipelines using Databricks (Spark, Delta Lake). Develop batch and streaming workloads using PySpark/Spark SQL. Implement data ingestion, transformation, and orchestration pipelines. Optimise Databricks workloads for performance, reliability, and cost. Integrate Databricks with cloud-native services across Azure ...

requirements into real-world outcomes. The Opportunity Own the technical delivery and architecture of Onsera's core product platforms, from wearables integration and health data pipelines to member payments and AI workflows. As a player-coach, you'll design and implement full-stack solutions while setting engineering standards … strategies and quality-driven development Experience acting as a technical leader or player-coach with demonstrated ability to mentor engineers Comfortable collaborating with product, data, clinical, and non-technical stakeholders Preferred Qualifications Strong written and verbal communication skills for technical and cross-functional collaboration Experience working with Python Experience ...

quality, correctness, and long term system design genuinely matter. Responsibilities Design and build backend systems that power a complex, evolving platform using Python Own data models, schemas and database design with a strong focus on correctness and scale Build ingestion pipelines and integrations with production customer systems Develop … skills and experience designing schemas Experience building complex backend systems that evolve over time Comfort working in ambiguous, early stage product environments Experience with data ingestion pipelines or internal tooling for AI or data teams The engineering team is currently small and senior, with a strong academic ...

core systems that power trading and research across the firm — from corporate actions and fundamentals to index data. This is not about hoarding alternative data; it’s about creating clean, reliable, business-critical datasets that the entire firm depends on. What you’ll do Build and optimise automated data ingestion pipelines Own and improve distributed systems used firm-wide Apply statistical and algorithmic techniques to improve data quality Work closely with internal users to ship impactful improvements Operate with real ownership and autonomy in a high-stakes environment What we’re looking for 2–5 years ...

Responsibilities - Act as a hands-on platform specialist across a secure, cloud-based data and analytics platform.- Contribute directly to build, configuration, and implementation activity alongside developers and data engineers. Support definition of the POC scope, success criteria, and value proposition. Shape the technical path from … considering scalability, security, governance, and reuse. Contribute to analytics and insight generation over identity, access, and entitlement-related datasets. Provide pragmatic technical input across data ingestion, analytics, visualization, access control, and environments. Work closely with delivery leadership to surface risks and maintain delivery momentum. Ensure decisions, progress ...

performance improvements. The Role You’ll work on a modern, cloud-based platform supporting live operational environments. The role spans API development, Azure services, data layers and portal functionality, with a strong focus on quality, scalability and long-term maintainability.Working closely with technical leadership and operational stakeholders … pipelines and DevOps practices Blazor (WASM and/or SSR) and modern frontend integration Strong database design and optimisation skills (T-SQL and analytical data stores) Experience with API security and documentation (e.g. OAuth, OpenAPI/Swagger) Comfortable working in Agile teams and collaborative engineering environments Desirable Experience Terraform ...

TimeXtender delivers secure, trusted, AI-ready data for every decision. Our metadata-first platform enables mid-sized enterprises to build future-proof data infrastructure 10x faster than traditional methods. By automating the complex layers of data ingestion, preparation, and delivery, TimeXtender provides a secure foundation … analytics and AI across cloud, hybrid, or on-prem environments. We give data teams the agility they need and the governance compliance demands. The Role Join a fast-growing cloud innovator at the forefront of Data Management and AI as a Senior Business Development Representative, helping power ...

Robotics Software Design Engineer - C++/PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation … Robotics Software Design Engineer - C++/Postgres, based in Cambridge, will be responsible for: Developing and optimising C++ code to acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining ...

complex AI workflows. Implement and manage vector databases (e.g., FAISS, Pinecone, Weaviate, Milvus) for fast similarity search and retrieval. Develop embedding pipelines for unstructured data using models like Sentence Transformers, OpenAI, or Hugging Face. Collaborate with data scientists and software engineers to create scalable AI-powered applications. Fine … . Familiarity with LangChain for building LLM-powered applications. Ability to create chains, prompts, and agents. Desirable Skills/Knowledge/Experience Experience with data ingestion, indexing, and querying. Working with unstructured data (text, documents, images). ...

retail expert— we will teach you the intricacies of the supply chain. What we need from you is the technical intuition to navigate data challenges and the confidence to guide customers through critical Pilots and Proofs of Concept (PoCs). Tightly sits as the intelligence layer … merchant's ERP and sales channels. Your job is to ensure that the data translation is flawless. You will work with prospective customers to validate their inputs, using your technical toolkit (SQL, Python, AI) to troubleshoot anomalies and ensure that the purchasing plans Tightly generates are based on accurate ...

recruiting on behalf a large healthcare consultancy, partnering with some of the worlds most ambitious life sciences, biotech, and healthcare organisations to solve complex, data-driven challenges at scale. Our work directly contributes to improving patient outcomes, accelerating research, and enabling smarter, more efficient healthcare systems. We are proud … Pinecone and Weaviate . Build multi-modal workflows spanning text, voice, and video, with a strong focus on accuracy, explainability, and performance. Design data ingestion and enrichment pipelines that meet healthcare-grade quality and compliance expectations. Drive Engineering Excellence Build scalable microservices and platforms using Python and/ ...

pipelines, database schema design, and API orchestration. MVP Development: Build and ship the core web application (frontend and backend) to support multi-tenant data ingestion, state management, and visualisation. Agent Integration: Implement deterministic orchestration logic for LLM-based agents, including execution flows, state handling, prompt management, and observability. ...

successful product launch and strong global demand, they are now looking to appoint an IoT DevOps Engineer to take ownership of device connectivity, data flow and system integration. This IoT DevOps Engineer role sits at the intersection of hardware, software and cloud. You will work hands-on with real … code. IoT DevOps Engineer – Role & Responsibilities Own end-to-end connectivity from device to cloud dashboard Configure Bluetooth connectivity between devices and tablets Manage data ingestion and visualisation using cloud platforms such as ThingsBoard Build and maintain Node-RED flows to route and transform data Troubleshoot devices ...

this, the team are also responsible for the development of core products that can be utilised across the business, such as a standardised data ingestion and distribution exchange for engaging with 3rd party data providers. Finally, you will also be a proponent of agile practises and clean ...

required to broaden their existing product line. What do they do?:- The existing product offers compliance solutions enabling the capturing and archiving of data - this is across multiple median such as WhatsApp/WeChat. etc. AI tooling has recently been implemented and used in production. The product largely supports … encompass the Azure ecosystem. Tech:- C#/.Net Expert Azure - Platform and Software Architecture Design Patterns - HLD and LLD Messaging/Queueing - Service Bus Data Ingestion - NoSQL/Postgres API Design and Development - RESTFul Cloud agnostic mindset a nice to have - AWS/GCP. Medium Term Aspirations ...

fire prototypes that become mission-critical apps. What you’ll tackle Spot the pain-points across Equities, Credit, Rates and central Risk teams; translate data-flow headaches into buildable tech projects. Prototype at pace in Python—leveraging LLM co-pilots—to stand-up analytics services, REST APIs and lightweight … Dash/React front-ends. Own the full stack: data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. Codify best practice for safe, auditable LLM-assisted development; lead code reviews and knowledge-share sessions. Stay user-facing —white-board with quants ...

between business leaders, functional teams, and technical delivery, you will ensure that transformation is guided by a process-first approach, supported by real process data, AI-driven insights, and industry best practices. This role brings together expertise in process architecture, process mining, value management, and continuous improvement to deliver … Strong understanding of S/4HANA best practices across finance, supply chain, procurement, or manufacturing. Experience integrating Signavio with SAP Datasphere for real-time data ingestion and analytics. Strong grasp of SAP Activate methodology and how Signavio accelerates the Discover and Prepare phases. Excellent facilitation, communication, and stakeholder ...

market‐leading technology provider that’s transforming how large enterprises, financial institutions, and multinational groups manage regulatory, tax, and financial reporting. Their innovative, data‐agnostic automation platform helps clients simplify complex processes and gain full control over their reporting workflows. Why This Is a Great Opportunity Work … aligned to client needs and implementation best practice. Act as the bridge between sales and delivery teams to enable seamless handover. Provide expertise in data ingestion, automation, workflow configuration, and structured reporting. Why You Should Apply Join a company at the forefront of reporting automation and regulatory innovation. ...

projects. Azure AI/ML Engineer, key responsibilities: Build, develop and deploy AI applications using Python Design and Develop AI services Setup and develop data ingestion pipelines and components Develop search related components using Azure AI Search Developing and deploying AI/ML models Built and maintain scalable ...

SecOps operations in support of live security services. You will take ownership of administering and managing the Elastic Stack, including agent deployment and data onboarding. You will tune detection rules, build and maintain dashboards, and improve alert fidelity across the SOC. You will work closely with internal SOC teams … Skills - SOC Analyst/SecOps Consultant Proven experience working in SOC or SecOps environments. Strong hands on expertise with Elastic Stack (ELK) , including data ingestion and rule tuning. Experience integrating and managing security data sources. Ability to collaborate effectively across multi SOC environments. Strong written and verbal ...

applications directly to our Student Record System (SRS) and to each other. By developing a modern Central Integration Hubleveraging cloud-based technologies for standardised data ingestion, transformation, orchestration, unified API exposure, and robust monitoringwe will deliver substantial benefits for our university. We are seeking a talented Software Developer ...

Systems Architect - Cheshire My Client is a privately owned technology company operating in a specialist, data-driven domain, currently scaling a complex software platform built around edge computing, distributed systems, and AI workloads. They are seeking an experienced AI Systems Architect to take technical ownership of the core system … evolve end-to-end system architecture across edge and backend environments Design and build backend services and APIs using Go and Python Develop scalable data ingestion, messaging, and telemetry pipelines Support containerised deployments and system reliability Work closely with senior engineers to align architecture with delivery Identify ...

creation of high-level and low-level solution designs, ensuring alignment with enterprise architecture standards, secure by design principles, and regulatory requirements. - development of data ingestion, telemetry, and integration patterns between Darktrace, Defender, SIEM/SOAR tools, and existing security stacks. - production of architecture decision records, design patterns … Leading technical delivery workstreams, providing direction and assurance across engineering teams. - Oversee deployment and configuration of Darktrace sensors, appliances, and monitoring coverage across networks, data centres, and cloud estates. - Guide onboarding, configuration, and tuning of Microsoft Defender XDR (Endpoint, Identity, Email, Cloud Apps, Server, and Threat Intelligence modules). ...

observability roles and responsibilities and recommend improvements aligned to Operational Resilience standards Champion automation and API-driven approaches for dashboard provisioning, alert management, and data ingestion Ensure clear documentation of standards, configurations, and improvements delivered TECHNICAL SKILLS/REQUIREMENTS Strong hands-on and leadership experience with: Prometheus - instrumentation ...