76 to 100 of 111 Data Ingestion Jobs in the UK

Backed by experienced founders and investors, we're building toward a clear goal: the defining AI platform in our category As the first senior data hire, you'll architect and scale the systems powering our client's AI products: from real-time pipelines and analytics infrastructure to vector databases … data workflows. You'll define data architecture, tooling, and engineering standards, working closely with AI and backend engineers, and lay the foundations for the future data te Duties Architect and build scalable data pipelines and infrastructure for AI and product systems Design data ingestion ...

possible to track and then present KPIs effectively across the Group. Main responsibilities Support the implementation and development of the Group Microsoft Fabric data environment Design and maintain data ingestion pipelines from multiple source systems Develop and maintain data models to support reporting and analytics Working … interactive dashboards. Ensuring the dashboard, reporting and design process uses the most appropriate formats to gain maximum user engagement and insight. Ensuring the data integrity of all reports, dashboards, and analysis. Assist in the governance and documentation of BI solutions, including data dictionaries and report inventories. Actively seeking ...

believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … during the action. As a Principal Machine Learning Engineer , youll shape the technical strategy and delivery of production ML systems that transform raw sports data and live video into real-time insights and personalised experiences for millions of fans. For this role we offer the hybrid working approach with ...

believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … during the action. As a Principal Machine Learning Engineer , youll shape the technical strategy and delivery of production ML systems that transform raw sports data and live video into real-time insights and personalised experiences for millions of fans. For this role we offer the hybrid working approach with ...

least-privilege access models for multiple teams. Support security and TDA assurance with architecture diagrams, control mappings, and risk mitigations. Define reference patterns for data ingestion, transformation, and data product creation. Support use cases across analytics, data engineering, and machine learning. Establish standards for data … NSGs, UDRs), ADLS Gen2 integration and access control, Entra ID/Azure AD integration. Experience supporting security assurance and architecture governance. Strong understanding of data platform operating models and data product concepts. Key Deliverables Secure Databricks platform implemented in Azure. Reference architecture and design documentation. Governance and RBAC ...

Senior Product Manager to take the lead on our Customer, Access and Identity roadmap, owning a portfolio of initiatives that bring together our customer data and modernise how customers access our products. This is a pivotal role in shaping how we identify, authenticate, and understand our customers across … central access management platform and driving the roll‐out of single sign‐on (SSO) and SAML across our estate. Working closely with Engineering Leads, Data teams, Commercial and Operations stakeholders, and third‐party vendors, you will translate a complex, cross‐system landscape into a clear, prioritised delivery plan ...

524.40 per day - Umbrella onlyDuration: 4 monthsLocation: London - 3 days a week in the officePlatform Architect to lead the evolution of our Enterprise Data Platform (EDP), driving platform engineering, FinOps, DevOps automation, and data engineering capabilities across the organization.This role is ideal for an architect who can combine … strategic architecture leadership with DevOps, FinOps, and Data Engineering expertise to deliver measurable business value, modernize the EDP landscape, and drive significant operational and cost efficiencies.Key ResponsibilitiesLead platform modernization initiatives aligned with enterprise technology and data strategies.Databricks Serverless EnablementLead the design and implementation of Databricks Serverless capabilities across ...

working with a London-based investment bank who are actively seeking a Senior Software Engineer to assist in the development of a business-critical data ingestion and search interface to simplify the onboarding of future applications. What you'll need to succeed : Proficiency in UI development with React. … Extensive Python and PowerShell scripting experience. Strong experience building data pipelines, architectures, and datasets. Strong experience building processes to support data transformation, data structures and metadata Extensive big-data experience. Good experience with at least one object-orientated programming language. What you'll get in return ...

people platforms Handle and partner with external vendors/configuration centres to deliver scalable, compliant solutions globally Act as a link between engineering, product, data science ensuring solutions move beyond prototypes into sustainable production AI & Engineering Leadership Design, develop and maintain production-grade AI applications and services using modern … practices (cloud-native design, CI/CD, testing, observability). Define and implement reusable AI platforms and capabilities (e.g. conversational assistants, AI search, unstructured data processing, GenAI solutions). Lead architectural decisions , ensuring responsible AI, explain ability, security, and operational robustness are embedded by design. Evaluate and integrate LLMs ...

Umbrella only Duration: 4 months Location: London - 3 days a week in the office Platform Architect to lead the evolution of our Enterprise Data Platform (EDP), driving platform engineering, FinOps, DevOps automation, and data engineering capabilities across the organization. This role is ideal for an architect … combine strategic architecture leadership with DevOps, FinOps, and Data Engineering expertise to deliver measurable business value, modernize the EDP landscape, and drive significant operational and cost efficiencies. Key Responsibilities Lead platform modernization initiatives aligned with enterprise technology and data strategies. Databricks Serverless Enablement Lead the design and implementation ...

applications and third‐party tools. Work with message brokers (RabbitMQ) to design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services across the engineering team. Evaluate and recommend ...

hands-on technical role, suited to someone with strong Splunk Enterprise and Splunk Enterprise Security experience, who can take ownership of platform engineering, data ingestion, detection content and performance tuning across complex client environments. This is a key technical leadership role, responsible for ensuring the right tooling, controls … will be doing: Lead the deployment, management and optimisation of Splunk Enterprise and Splunk ES platforms in large, complex environments. Design, implement and maintain data pipelines, including log ingestion, enrichment and schema standardisation. Develop and tune security detection content, translating threat intelligence and TTPs aligned to MITRE ...

choices while delivering high-quality work within deadlines Leading architecture and software design discussions Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Generating new potential solutions to challenges (technical and non-technical) in partnership with … particularly like to encourage applicants with experience in the following areas: MLOps: including tools like LangChain for application development and managing the ML lifecycle Data Engineering: including platforms like Databricks for data processing and analytics DevSecOps & DevOps Infrastructure as Code Data Engineering: including platforms like Databricks ...

ground-up rebuild of a core Claims and Policy Record system, working within a small, focused team alongside a Senior Software Engineer, BA, Data Engineer and Infrastructure Engineer. The role is explicitly positioned as the internal successor to the Enterprise Architect seat, with the rebuild providing the platform … ShareDo. Own the claims import pipeline end-to-end. Build the notes and flags features within the new system. Work with the Senior Data Engineer on mapping specifications so integration inputs align with pipeline requirements. Write clean, maintainable, well-documented code and contribute to technical standards in code review. ...

Software Developer Industrial Data & IIoT Location: Sheffield, South Yorkshire (1 day per week on site) Salary: Up to £50,000 per annum Job Type: Permanent, Full-Time Recruiter: Renzo Talent recruiting on behalf of a confidential client About the Role Renzo Talent are recruiting on behalf of a growing … technology business based in Sheffield. Our client is a small, cross-functional engineering team building applications and data pipelines for manufacturing customers on an Industrial Data-Ops platform. They are looking for a Software Developer who writes Python and React and is keen to work hands-on with ...

architecture, technical leadership and hands-on delivery to ensure our Adobe Experience Cloud solutions enable personalised customer experiences at scale. Working closely with Marketing, Data, Engineering and Product teams, you'll define customer journeys, architect integrations and help drive adoption of Adobe's digital experience technologies. Key Responsibilities … personalised customer experiences throughout the customer life cycle. Manage customer profiles, identity stitching and Identity Graph capabilities to maintain accurate, unified customer views. Oversee data ingestion across Edge, Streaming and Batch pipelines, ensuring high-quality, timely and reliable customer data. Work closely with Engineering teams to optimise ...

Kaluza in the United Kingdom is seeking a Senior Engineering Manager (Data Platform & Analytics Engineering) to lead the Data Platform and Analytics Engineering teams across data ingestion, modeling, and governance. You will partner with Head of Data Science & Products to shape the data architecture ...

vision, strategy, and execution of Greyparrot’s dual-pronged product ecosystem. Your work will bridge the gap between sophisticated hardware deployment and deep, data-driven AI software platforms. This is a pivotal executive role for a platform thinker. Greyparrot operates across two distinct buyer markets - recycling facility operators … brands and regulators who depend on packaging performance data - served through a single underlying AI intelligence platform. The VP of Product owns the roadmap and architecture logic that connects these two surfaces, ensuring the right sequencing of investment so that growth in one directly compounds the value delivered ...

architecture vision, principles, standards, and roadmaps. Ensure security architecture aligns with business objectives, regulatory expectations, and risk appetite. Design secure, scalable patterns for APIs, data platforms, AI workloads, and cloud‐native services. Provide authoritative security architecture guidance across engineering, platform, and data teams. Identity & Access Management … prioritized by adopting a risk‐based approach. AI & Emerging Technology Security Design and review security controls for AI/ML systems, including training data protection, model integrity, access control, and inference security working in conjunction with compliance, security and data privacy teams to ensure controls are appropriate ...

training of Machine Learning models. Experience in industry or a research lab working on machine learning problems and engineering workflows. Preferred Qualifications Experience with data analysis at scale, data visualization and data ingestion pipelines for training models. Experience with Large Language Models and notably Agents … institutes all over the world. From creating experiments and prototyping implementations to designing new architectures, engineers work on real-world problems including artificial intelligence, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more. ...

Network Device Telemetry & Analysis Engineer is responsible for onboarding, processing, and analyzing network infrastructure and device telemetry. This role focuses on bringing telemetry data into Splunk and related platforms, developing dashboards and alerts, and enabling Operations teams with data-driven insights for troubleshooting, availability decisions, and performance monitoring. … hands-on and closely aligned with Network Operations, Automation, and Monitoring teams. Key Responsibilities Collect, normalize, and onboard network device telemetry and instrumentation data (metrics, logs, events, streams) into Splunk and approved analytics platforms. Work with Network Engineering teams to understand device behaviors, health indicators, and performance signals across ...

investigating anomalies, resolving technical issues, and helping ensure deployments continue to deliver measurable value. The role would suit someone who enjoys working across software, data, integrations, telemetry and customer-facing technical support. The Role You will work closely with Customer Success, Engineering and Data teams to monitor active … performance. Responsibilities will include: Monitoring live customer deployments, including uptime, system behaviour, performance and SLA compliance Investigating anomalies using logs, metrics, telemetry and operational data Diagnosing issues across data ingestion, integrations, connectivity, software deployments and system outputs Acting as a technical point of contact for deployment-related ...

architecture, scalability and platform evolution, connecting technical decisions to product and business outcomes Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Driving innovation by proactively surfacing new technical approaches and product solutions Leading or initiating … encourage applicants with experience in the following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such ...

school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. ...

support machine learning models, large language models (LLMs), and emerging AI capabilities in production. The successful candidate will work closely with AI Engineers, Data Scientists, Platform Engineers, Security, and Product partners to deliver resilient, cloud native AI platforms in a highly regulated environment. Key Responsibilities Design, build, and operate … inference. Engineer scalable, reliable, and secure cloud native services to support AI workloads across AWS, Azure, and hybrid environments. Partner with AI Engineering and Data Science teams to improve developer experience, performance, and operational stability of AI systems. Enable production deployment of ML models and LLMs within governed enterprise ...