151 to 175 of 178 Data Ingestion Jobs in England

Power BI Developer Up to £45,000 I am seeking an Power BI Developer to support the development, optimisation and governance of modern data and analytics solutions within a growing UK analytics consultancy. Sitting within an expanding analytics practice, this role is central to delivering trusted, scalable and high … quality insight products that enable organisations to make faster, data-driven decisions. This role is ideal for someone with strong hands-on experience with Power BI as well as a strong background in data modelling. You will be comfortable building advanced reports and collaborating with cross-functional teams ...

Senior Software Engineer | Sports Data London, UK | Remote Working Up to £80,000 + Company-wide benefits We’re partnered with a high-growth sports media network that operates a portfolio of market-leading brands and partnerships across the sports betting and tech space. Their mission is to empower … cutting-edge tools, all powered by modern, cloud-native technology. They are looking for an established Senior Software Engineer to join their expanding data team, where you will be working directly on key services that power a core part of the company's platform. While having essential responsibility ...

solutions and strengthening client security posture. Key Responsibilities Lead design and deployment of security monitoring tools (Elastic & Splunk) Build and optimise large-scale log ingestion pipelines and data models (ECS/CIM) Develop and tune detection rules using KQL, EQL, and SPL Drive detection engineering lifecycle aligned … hands-on expertise with Elastic Stack and Splunk (Enterprise/ES) Advanced knowledge of SIEM operations, detection engineering, and RBA Experience with large-scale data ingestion, enrichment, and pipeline design Familiarity with automation tools, SOAR, Terraform/Ansible, and CI/CD Excellent communication, stakeholder management, and problem ...

solutions and strengthening client security posture. Key Responsibilities Lead design and deployment of security monitoring tools (Elastic & Splunk) Build and optimise large-scale log ingestion pipelines and data models (ECS/CIM) Develop and tune detection rules using KQL, EQL, and SPL Drive detection engineering lifecycle aligned … hands-on expertise with Elastic Stack and Splunk (Enterprise/ES) Advanced knowledge of SIEM operations, detection engineering, and RBA Experience with large-scale data ingestion, enrichment, and pipeline design Familiarity with automation tools, SOAR, Terraform/Ansible, and CI/CD Excellent communication, stakeholder management, and problem ...

arisen for an experienced KDB Developer to work alongside their Quants and Traders. This is an exciting opportunity to take ownership of critical data and analytics capabilities in a business where your work will directly support front-office decision-making, research, and platform performance. In addition to the base … every 6 months. THE ROLE: KDB Developer This position sits within a small, highly capable team focused on building, improving and supporting the firms data environment. The successful candidate will play a key role in designing and developing scalable data collection and analytics solutions, while helping ensure ...

engineering practices (CI/CD, testing, observability, cloud-native design). Developing reusable AI platforms and tools (e.g. conversational bots, AI-powered search, unstructured data processing, GenAI solutions). Working in cross-functional, embedded teams with business stakeholders to rapidly deliver AI solutions to high-priority problems. Evaluating … integrating AI tools and frameworks (LLMs, vector databases, RAG, AI agents) into robust, scalable systems. Championing automation across the full AI lifecycle —from data ingestion and preprocessing to deployment and monitoring. Collaborating closely with data scientists, product managers, and engineers to ensure reliable end-to-end delivery. ...

maintain SOAR playbooks to automate investigation and response workflows Support onboarding of log sources into SIEM, ensuring accurate parsing and normalisation Optimise search performance, data pipelines, and platform efficiency Troubleshoot issues across SIEM/SOAR environments (data ingestion, alerting, integrations, automation workflows) Collaborate with Detection Engineers … operationalise detection use cases Implement enrichment workflows incorporating threat intelligence, asset context, and identity data Support incident response through effective automation and data availability Maintain clear and comprehensive documentation for configurations, integrations, and playbooks Required Skills & Experience Minimum 3+ years of commercial experience in SOC, SIEM, SOAR ...

detection content, ensuring security monitoring remains effective, scalable and reliable. Key responsibilities include: Acting SME on Splunk Enterprise Security platforms Designing and maintaining log ingestion pipelines and data enrichment processes Developing and tuning detection rules aligned to MITRE ATT&CK techniques Managing the full lifecycle of detection content … ENGINEER ESSENTIAL SKILLS Hands on experience with Splunk Enterprise Security Strong background in detection engineering and SIEM operations Experience designing and managing large scale data ingestion pipelines Advanced knowledge of SPL, KQL or EQL for detection engineering Experience with automation, scripting or Infrastructure as Code in SIEM environments ...

bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Principal Product Data Scientist You’ll be part of the Operations Delivery Intelligence (ODI) directorate, working within integrated operations product squads to build and embed industrialised decision‐support … real‐world decision‐making challenges across the airline. What you’ll do: Act as the technical owner of one or more production‐grade data science product codebases Lead the end‐to‐end delivery of decision‐support software across the full product lifecycle Understand complex operational business problems ...

systems. The Role You’ll take ownership of designing and delivering an end-to-end AI-driven reporting and automation platform, working closely with Data Science and operational stakeholders. This is a build-from-scratch opportunity — ideal for someone who enjoys solving real-world complexity and turning manual processes … into robust, automated systems. What You’ll Be Doing Designing and building an automated reporting platform from the ground up Creating intelligent workflows across data ingestion, validation, and reconciliation Implementing AI-driven and agent-based automation to streamline operations Introducing exception handling and human-in-the-loop systems ...

Design, develop, and deploy end-to-end AI/ML systems—from ML to generative AI Create robust, production-ready pipelines (data ingestion, modelling, deployment, monitoring) Implement MLOps best practices including CI/CD, versioning, automated retraining, and rollback Ensure solutions are scalable, secure, and high-performing … technologies (LLMs, GenAI, vector databases) where they add real value Act as a trusted advisor, guiding trade-offs and implementation strategies Mentor engineers and data scientists through hands-on guidance and reviews What You Bring Strong software engineering foundation (Python essential) Proven track record delivering production AI/ ...

Business Operations/Product Operations Manager — UK Insurance Role purpose UK Insurance is scaling a portfolio of recurring, monthly-cadence data products,. These products now represent a material share of ARR, margin contribution and growth, but the operating model supporting them has not yet been industrialised to match … more productised, platform-enabled operating model. That means recurring products need to be run with clearer process ownership, better workflow discipline, stronger operational data, and more consistent handoffs between commercial, analytical, product and technical teams. This role will support that transition by: creating operational visibility across monthly product workflows ...

role based in London (2 days per week in office) You will work in a team of 15, collaborating with C# developers and actuarial data scientists to deliver scalable features. The role Technical Challenge: Take ownership of performance bottlenecks involving 4GB+ datasets. Cloud Infrastructure: Utilize Azure PaaS tools including …/CD. To be successful in this role, you must demonstrate specific experience in: Large Dataset Management: A track record of handling GB-scale data (4GB+) and addressing performance via vectorisation , parallelism , or memory optimisation . Advanced Python Logic: Writing modular, production-quality code using classes/functions ...

core insight: truly consequential AI requires context no outside vendor can access. Real decisions need CRM records, support tickets, customer communications, contracts, finance data, product telemetry, market signals, audit logs – dozens of dimensions, deeply connected. They’ve solved that structurally. Instead of selling software from the outside, they acquire … software companies and embed the system directly inside them. That gives the AI full access to live data, real feedback loops, and the organisational depth needed to encode business intuition over time. Every acquisition deepens the intelligence. Every agent compounds it. The work spans enterprise data ingestion ...

workflows for reasoning, search, summarisation, and task execution Deploy AI systems into cloud, on-premises, and air-gapped environments Build production-ready pipelines from data ingestion through to inference Experience with observability for AI systems, including agent behaviour, model performance, and failure modes Collaborate with engineers, product leads ...

position focused on experimenting in isolation. The company is looking for someone who can take ownership of the entire AI production lifecycle - from raw data collection and training pipelines through to robust, production-ready models operating in demanding environments. The role is ideal for someone who combines deep technical … hands-on approach to engineering and leadership. The Opportunity You will lead the design and evolution of the company’s AI production pipeline, covering data ingestion, organisation, annotation strategy, model training, validation, optimisation, deployment, and monitoring. The focus is on building industrial-grade Computer Vision systems that perform ...

helping clients build and enhance their security monitoring capabilities. You will lead the full project lifecycle, from requirements gathering and stakeholder engagement through to data onboarding, alert development, and dashboard creation, ensuring solutions are aligned to both business and security objectives. You will bring strong hands-on experience with … automation and orchestration initiatives (including exposure to SOAR where applicable) Leverage scripting languages such as Python and PowerShell to automate detection logic, enrich data, and integrate with security workflows Provide mentorship and technical guidance to junior engineers, particularly on Splunk backend activities such as data ingestion, parsing ...

robust coverage against evolving threat landscapes. Key Responsibilities Design and implement detection use cases across SIEM and SOAR platforms using threat intelligence and incident data Develop, map, and maintain detection logic aligned to MITRE ATT&CK frameworks Continuously tune and optimise correlation rules to improve signal-to-noise ratio … Validate detection logic through simulations, threat emulation, and red team collaboration Work closely with SOC tooling and engineering teams to ensure efficient data ingestion and parsing Document detection logic, methodologies, and expected outputs for audit and operational use Contribute to post-incident reviews, enhancing detection coverage and response ...

robust coverage against evolving threat landscapes. Key Responsibilities Design and implement detection use cases across SIEM and SOAR platforms using threat intelligence and incident data Develop, map, and maintain detection logic aligned to MITRE ATT&CK frameworks Continuously tune and optimise correlation rules to improve signal-to-noise ratio … Validate detection logic through simulations, threat emulation, and red team collaboration Work closely with SOC tooling and engineering teams to ensure efficient data ingestion and parsing Document detection logic, methodologies, and expected outputs for audit and operational use Contribute to post-incident reviews, enhancing detection coverage and response ...

robust coverage against evolving threat landscapes. Key Responsibilities Design and implement detection use cases across SIEM and SOAR platforms using threat intelligence and incident data Develop, map, and maintain detection logic aligned to MITRE ATT&CK frameworks Continuously tune and optimise correlation rules to improve signal-to-noise ratio … Validate detection logic through simulations, threat emulation, and red team collaboration Work closely with SOC tooling and engineering teams to ensure efficient data ingestion and parsing Document detection logic, methodologies, and expected outputs for audit and operational use Contribute to post-incident reviews, enhancing detection coverage and response ...

space. We've built out our own internal 'agency brain,' a self-hosted AI system running on Mac Minis via OpenClaw, pulling together data from across the entire business: Notion playbooks, Xero invoicing, Fireflies call recordings, Slack communications, and more. They're not just an agency that talks about … Ensure integrations with Notion, Xero, Fireflies, Slack, and other platforms remain stable • Diagnose and fix workflow breakages before they impact the team • Continuously improve data ingestion, retrieval, and output quality AI Workflow & Agent Building • Design and build new AI-driven workflows based on internal briefs from leadership ...

Elastic Stack/Elastic Security Deep knowledge of detection engineering, threat intelligence frameworks (MITRE ATT&CK), and noise reduction techniques Hands-on experience with data ingestion tools such as Elastic Agent, Beats, Splunk UF/HF, Syslog, Kafka Advanced proficiency in querying languages including … Strong understanding of ECS and CIM log normalization, enrichment, and large-scale data architectures Expertise in detection rule design, tuning, and lifecycle management Proficiency with automation and orchestration tools, CI/CD pipelines, and Infrastructure as Code (Terraform, Ansible) Excellent stakeholder communication and client management skills Ability to assess ...

make critical decisions about their packaging - improving sustainability while reducing costs. At the centre of this is a platform that brings together fragmented packaging data, applies complex regulatory logic, and enables customers to model packaging decisions across multiple markets. Technology is a critical, funded investment area for the business … What’s missing is the engineering leadership to define how this is built, scaled, and delivered. About Ecosurety Ecosurety is an industry-leading packaging data company on a mission to rid the world of unnecessary packaging, and they’re scaling fast. More than 500 brands and retailers, including some ...

escalation rules. Integration & Automation Integrate ServiceNow SIR with security tools such as SIEM, SOAR, EDR, vulnerability scanners, and threat intelligence platforms. Enable automated ingestion of security alerts and events from multiple sources into ServiceNow. Develop workflow automations, Flow Designer flows, and business rules to reduce manual effort and speed … SOAR, or EDR platforms. Solid ServiceNow development skills, including Flow Designer, business rules, UI policies, client scripts, and integrations. Experience with REST APIs and data ingestion pipelines. Security & Operational Knowledge Good understanding of cyber threats, vulnerabilities, and incident response processes. Familiarity with SOC operations and security monitoring workflows. ...

escalation rules. Integration & Automation Integrate ServiceNow SIR with security tools such as SIEM, SOAR, EDR, vulnerability scanners, and threat intelligence platforms. Enable automated ingestion of security alerts and events from multiple sources into ServiceNow. Develop workflow automations, Flow Designer flows, and business rules to reduce manual effort and speed … SOAR, or EDR platforms. Solid ServiceNow development skills, including Flow Designer, business rules, UI policies, client scripts, and integrations. Experience with REST APIs and data ingestion pipelines. Security & Operational Knowledge Good understanding of cyber threats, vulnerabilities, and incident response processes. Familiarity with SOC operations and security monitoring workflows. ...