26 to 50 of 51 Data Ingestion Jobs in the North of England

Microsoft Fabric Data Engineer SQL, Python, PySpark Microsoft Fabric pipelines, Lakehouses, Warehouses and semantic models Microsoft Fabric Data Engineer – Contract (Hybrid 2-3 days/wk) Greater Manchester Our Financial Services client has a contract vacancy for an experienced Microsoft Fabric Data Engineer to join their Data & Business Architecture team. This is a hands-on role supporting the operation, development and continuous improvement of a Microsoft Fabric data platform. You’ll work across data engineering, platform development, DevOps, CI/CD and data operations, helping to improve the performance, resilience and automation ...

DATA ENGINEER - GCP/PYTHON/SQL/KAFKA/AI £750-£800 per day | Inside IR35 | 3-month initial contract | Manchester or Leeds | Hybrid THE DETAILS £750-£800 per day Inside IR35 Initial 3 months with likely extensions Manchester or Leeds 2 days per week on-site … looking for an experienced Data Engineer to join a major enterprise data and AI transformation programme, working through a leading Managed Service Provider. This is an initial 3-month contract with likely extensions, offering £750-£800 per day Inside IR35 and requiring 2 days per week on-site ...

PermanentManchester, United KingdomSenior Data Engineer Manchester | Hybrid, ideally 2 days per weekWe’re working with a truly disruptive FinTech that is continuing to invest heavily in its data and technology capability.With a growing Data Science function and around 3–5TB of new data being processed each … week, they’re looking for a Senior Data Engineer to help build and evolve the platform behind it.This isn’t necessarily a traditional Data Engineering profile. They’re open to people from Data Engineering, Platform, DevOps or Systems Engineering backgrounds, but strong data foundations and hands ...

# 23615 Job description Connect to your IndustryDeloitte’s AI for Sustainability and Infrastructure team sits within our Engineering, AI & Data practice and is purpose built to help our clients lead and win through the transition to a low‐carbon, digitally enabled, prosperous, equitable and resilient economy.We work across … Sustainability related problems. Working within our business allows you to empower clients with cutting edge technology assets and alliances including AI and Data foundations, Geospatial Analytics and Digital Twin Modelling, Sustainability infused ERP, Supply Chain Traceability and AI enabled reporting and performance management.Connect to your career at Deloitte Deloitte ...

Principal AI Data Engineer Certain Advantage is hiring for a Principal AI Data Engineer based in London. This role is an initial contract until the end of the year and is hybrid, requiring 3 days per week onsite in London. You'll be responsible for: Developing AI, GenAI …/or Scala. Experience with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ...

faster than the last. What you'll do Google SecOps (SIEM/SOAR) Lead end‐to‐end SecOps deployments — tenant setup, multi‐tenant architecture, data ingestion, retention design, RBAC, and feed onboarding. Build and maintain parsers, UDM mappings, and data models for Google Cloud, AWS, Azure, endpoint …/SOC delivery experience (any major platform; Google SecOps/Chronicle preferred). Hands‐on with Google SecOps: UDM, YARA‐L, parsers, SOAR playbooks, data ingestion patterns. Solid grounding in Google Cloud security primitives: IAM, Organization Policies, VPC Service Controls, Cloud Logging, Cloud KMS. Comfortable with Terraform ...

Lead the architecture behind Bank of England's flagship programme modernising how regulatory data is collected and managed. The Bank of England, in partnership with Inspire People, is seeking a Lead Solution Architect with strong Azure expertise, knowledge of data-collection platforms and the ability to produce clear … with a view to becoming permanent. About the Lead Solution Architect role You will help shape the design and delivery of a new regulatory data collection platform, handling large volumes of data submitted by banks, insurers and other financial firms. Working across the full architecture lifecycle, you will ...

build, and operate the cloud-native backend services that connect the platform to third-party attraction providers. You will focus on scaling partner integrations, data ingestion, and building highly resilient distributed systems. Key Responsibilities Design, build, and maintain cloud-native backend services, utilizing event-driven patterns where appropriate. … delivery lifecycle: clarify requirements, implement and test solutions, deploy safely, and monitor in production. Develop robust capabilities for partner integrations, data ingestion, and reliable communication. Ensure system resilience, scalability, security, and observability using logs, metrics, and tracing. Collaborate with product managers, data specialists, and engineering teams ...

build, and operate the cloud-native backend services that connect the platform to third-party attraction providers. You will focus on scaling partner integrations, data ingestion, and building highly resilient distributed systems. Key Responsibilities Design, build, and maintain cloud-native backend services, utilizing event-driven patterns where appropriate. … delivery lifecycle: clarify requirements, implement and test solutions, deploy safely, and monitor in production. Develop robust capabilities for partner integrations, data ingestion, and reliable communication. Ensure system resilience, scalability, security, and observability using logs, metrics, and tracing. Collaborate with product managers, data specialists, and engineering teams ...

Automation Engineer QA Automation Engineer - End to End Hybrid - 3 Days on-site | 400-500 per day (outside of IR35) | Technology & Data Shape the future of AI-powered quality engineering. We're working with an organisation that's embracing AI to transform the way software is tested and delivered. … This is more than a traditional QA role. You'll be responsible for building robust, end-to-end automated test coverage across complex applications, data pipelines and reporting layers, while using the latest AI-assisted development tools to improve quality, speed and efficiency. Working closely with software engineers, data ...

Contract/Fixed-Term EmploymentStart: ASAPWe’re seeking a Full Stack Engineer with a strong backend focus to help build and modernise the Global Data Network (GDN), a high-impact platform enabling the secure sharing and analysis of fraud intelligence across systems.This is a hands-on engineering role where … work across backend services, data platforms, cloud infrastructure, and UI, contributing to the evolution of a cloud-native, API-driven architecture.You’ll play a critical role in transforming legacy data-sharing approaches into a scalable, real-time, graph-powered platform that enhances fraud detection and intelligence capabilities.What ...

shaping our technology and AI strategy. This is a senior, high-visibility role where you'll act as the technical authority across AI, cloud, data and SaaS , helping turn business strategy into secure, scalable and practical technology solutions. Key Responsibilities Lead the architecture of AI and data initiatives … from data ingestion through to deployment and monitoring. Shape our technology roadmap across AWS, Azure, Snowflake, Databricks and SaaS platforms. Set architecture standards, principles and guardrails, while supporting engineering teams to apply them effectively. Provide technical leadership on complex, multi-platform solutions, APIs and integrations. Work closely with ...

Director/Associate Director, you’ll build trusted relationships with business stakeholders – and use the most exciting new AWS technologies available – to create data-driven programmes that transform their organisations. Your advice will help clients position their organisations to succeed in an ever-evolving marketplace.· Lead the architectural design … significant focus on designing and implementing solutions on AWS.· Proven track record of successfully delivering large-scale, complex AWS projects across various domains (e.g., data analytics, application modernisation, infrastructure, security).· Experience working in a technical pre-sales capacity, producing bid documentation, RFIs, RFPs and participating in technical ...

Incident Response: React effectively to production failures, managing triage efforts, engaging appropriate teams, and communicating with management and technical escalation. Documentation and Reporting: Maintain data quality and completeness of incident tickets, ensuring all impacts are accurately recorded in the system of record. Prepare professional documents and ad-hoc reports … processes. Ideal Candidate Profile: Technical Expertise: Familiarity with enterprise network infrastructure, including routing, switching, wireless, and SD-WAN. Hands-on experience with Splunk for data ingestion, searches, and dashboard creation would be a big plus. Analytical Skills: Strong analytical skills with an attention to data quality, capable ...

Responsibilities Design, build, and maintain Splunk dashboards, searches, reports, and visualisations that support operational monitoring and troubleshooting. Collect, ingest, normalise, and manage network telemetry data, including logs, metrics, events, and streaming data. Develop and optimise alerting capabilities to proactively identify performance degradation, service disruption, and availability risks. Partner with … behaviour, performance indicators, and operational requirements. Support incident management, root cause analysis, and proactive problem identification through effective telemetry and monitoring solutions. Validate telemetry data quality, ensuring information is accurate, complete, and available when required. Identify gaps in monitoring coverage and implement improvements to strengthen observability across the network ...

Responsibilities Design, build, and maintain Splunk dashboards, searches, reports, and visualisations that support operational monitoring and troubleshooting. Collect, ingest, normalise, and manage network telemetry data, including logs, metrics, events, and streaming data. Develop and optimise alerting capabilities to proactively identify performance degradation, service disruption, and availability risks. Partner with … behaviour, performance indicators, and operational requirements. Support incident management, root cause analysis, and proactive problem identification through effective telemetry and monitoring solutions. Validate telemetry data quality, ensuring information is accurate, complete, and available when required. Identify gaps in monitoring coverage and implement improvements to strengthen observability across the network ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 46 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Develop alerting strategies to identify network degradation, anomalies and availability risks. Support incident triage, root-cause analysis and proactive network monitoring . Validate telemetry data quality, identify gaps and work with stakeholders to resolve issues. Support onboarding of new network platforms and device types. Document telemetry sources, dashboards, alert … logic and operational processes. Provide support during major network rollouts and changes. Essential Experience 4–6 years' experience in network operations, telemetry, monitoring or data analysis. Strong understanding of enterprise networking , including routing, switching, wireless and SD-WAN. Hands-on Splunk experience covering data ingestion, searches, dashboards ...

Power Platform capabilities, supporting consistency, interoperability, and best practice adoption across USS. * Support end-to-end solutions for Copilot and Copilot Studio, encompassing data ingestion, development, deployment, and seamless integration with existing Power App architecture and SharePoint. * Review and validate Copilot solution designs against enterprise technology architecture, providing … designing and delivering solutions using Power Apps, Automate, Power Bi to support Copilot customisation, automation, and governance. * Proven experience implementing Copilot ready solutions, including data readiness, permissions alignment, content lifecycle management, including Dataverse, SharePoint, OneDrive & Teams. * Deep familiarity with Power Platform, Microsoft Fabric, Entra ID, and M365 data ...

Splunk Enterprise and/or Splunk Cloud and certified to architect or consultant level Experience with monitoring, logging, and observability solutions Strong experience with data onboarding, parsing, and transformation Good understanding of Linux platform and infrastructure Experience in incident, problem, and change management processes Ability to troubleshoot complex issues … platform (Cloud/ITSI) to meet business and operational requirements Provide support for production issues, including incident, problem, and change management Optimise platform performance, data ingestion, and search efficiency Support platform upgrades, migrations, and onboarding activities Collaborate with engineering, DevOps, and application teams to onboard workloads and improve ...

beqom is building the future of AI-driven data platforms in Manchester, empowering multi-tenant data ingestion, schema management and analytics through agentic pipelines. This Senior Agentic Backend Engineer role focuses on guiding agents with precise specifications, governance, and robust verification to reach fully AI-embedded development. … collaborate with Data Platform, Analytics, Support and Product teams to translate needs into agent-executable specs, owning the pipeline, governance, #J-18808-Ljbffr ...

endpoint platforms, macOS, and Linux.Strong knowledge of information security frameworks, including NIST and relevant NIST 800-series publications.Hands-on experience with SIEM technologies, including data ingestion, monitoring, alerting, and integration with security operations processes.Proficiency in Terraform and infrastructure-as-code (IaC) best practices.Excellent written and verbal communication skills ...

macOS, and Linux. Strong knowledge of information security frameworks, including NIST and relevant NIST 800-series publications. Hands-on experience with SIEM technologies, including data ingestion, monitoring, alerting, and integration with security operations processes. Proficiency in Terraform and infrastructure-as-code (IaC) best practices. Excellent written and verbal ...

industry is currently seeking for a Networks support engineer to join the team. Key Responsibilities Collect, normalize, and onboard network device telemetry and instrumentation data (metrics, logs, events, streams) into Splunk and approved analytics platforms. Work with Network Engineering teams to understand device behaviors, health indicators, and performance signals … wireless, and SD-WAN platforms. Requirements Strong understanding of enterprise network infrastructure (routing, switching, wireless, SD-WAN). Hands-on experience with Splunk for data ingestion, searches, dashboards, and alerts. Experience working with network telemetry sources such as SNMP, syslog, telemetry streams, APIs, and device metrics. Please note ...

platform processing billions of cloud telemetry and log events every day. You’ll be hands-on with the design and engineering of event-driven data ingestion and streaming capabilities, helping shape the architecture, engineering standards and testing strategy across the platform. We endeavour to process your personal data ...