51 to 75 of 79 Data Pipeline Jobs in the North of England

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … mission-critical programmes within the National Security sector, delivering innovative solutions across AI, machine learning, cyber security and geospatial intelligence. As a Senior Data Engineer, you will join a collaborative Agile environment, playing a key role in designing, building and maintaining scalable data platforms and processing ...

Data Engineer/BI Engineer Salary: Up to £50,000 Location: Hybrid (3 days per week in the office) Type: Permanent We're looking for a Data Engineer/BI Engineer to join a growing team and play a key role in developing and enhancing data and reporting solutions across the business. This is an excellent opportunity for someone with strong data engineering and BI experience who wants to be involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) – Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access Soft Skills Strong problem-solving and troubleshooting capabilities. Ability to work collaboratively across security, engineering, and operations teams. Excellent communication ...

This role requires eligibility for BPSS and SC Security Clearance, including 5 years' continuous UK residency. The Role We're looking for a Data Engineer to join a growing technology team delivering cloud and data solutions across a range of complex projects. You'll design … build scalable data pipelines, work with modern cloud technologies, and collaborate with engineers, analysts and product teams to deliver high-quality data solutions that support analytics and AI. Key Responsibilities * Design, build and maintain scalable data pipelines * Develop real-time and batch data ...

Senior Data Engineer (Knowledge Systems) This organisation is building a modern, cloud-native platform and evolving towards an AI-first engineering model , where intelligent systems rely on high-quality, well-structured knowledge to power automation, decision-making and software delivery. They are looking for a Senior Data … multiple sources. Choose the most appropriate storage and retrieval approach for different use cases, including document stores, graph databases, vector databases and traditional data platforms. Model complex business domains to improve retrieval quality and contextual understanding. Design and optimise hybrid retrieval strategies using semantic search, keyword search, embeddings ...

Principal Data Engineer (Contract) Outside IR35 Principal Data Engineer £650 per day | Outside IR35 | 3 Month Contract | Remote UK (Very occasional travel to Leeds if you can) Brio Digital are working with a major UK organisation embarking on a strategic data transformation project … into a much larger programme of work. You'll join a cross-functional delivery team alongside Solution Architects, Technical Analysts, Project Managers, and Data specialists, taking ownership of the platform's technical design and engineering. Principal Data Engineer Responsibilities: * Design and build a cloud-native ...

Commerce Data Analyst £35,000 - £45,000 Merseyside (3 days a week on-site) Are you passionate about turning digital data into meaningful business outcomes? This is an excellent opportunity for an E-Commerce Data Analyst to join a growing analytics function where your … influence online performance, customer experience, and commercial decision-making. You'll work closely with E-Commerce and Analytics teams, helping shape strategy through data-driven recommendations. THE COMPANY They are a well-established consumer-focused organisation with a strong digital presence and a commitment to using data ...

risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence. Skills and Competencies 3+ years of experience within a data engineering or software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources … applying AI‐assisted development tools (e.g., GitHub Copilot, generative AI coding assistants) to improve engineering productivity, code quality, and delivery efficiency Understanding of data engineering considerations for AI and machine learning workloads, including data quality, governance, lineage, and scalability requirements Education Bachelor’s degree or equivalent ...

Lead Data Scientist | Fully Remote | £90,000–£100,000 + Benefits Build the models behind real-time decision making at scale. Why this role stands out This isn’t just another senior data science position. It’s a chance to shape the future of analytics … most successful privately owned technology businesses, a market leader trusted by millions and driven by data at its core. You’ll join a high-performing team working with real-time data, advanced machine learning, and large-scale analytical systems, with the freedom to influence both technical ...

place where people stay because they feel valued, and find room to grow because theyre challenged. About the role Working closely with the Data Analytics Manager and wider Marketing Team, this role will be responsible for turning audience data and customer intelligence into real-world outcome … marketing activations across paid media, CRM, and emerging channels across the DFS Group. This role sits at the heart of our Group Customer Data Strategy so the successful candidate will be responsible for the deployment and activation of our First Party Data (1PD) audiences, enriching audience ...

helping organisations transform and deliver high-quality, scalable solutions that truly matter. Overview: We are looking for a highly skilled AWS DevOps/Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps … expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks. Key Responsibilities: Translate technical requirements into effective DevOps toolchains to enable product delivery Design and implement resilient, scalable, and highly available services Automate infrastructure, deployments, and testing using Infrastructure as Code (IaC) Ensure deployment ...

Staff Data Engineer/Leeds or London 1x a month/£120k - £140k Shape the Future of Data Engineering Within a Leading SaaS Product Business This is an opportunity to step into one of the most influential technical roles within a high-growth SaaS organisation where … engineering plays a central role in shaping the future of the product. Rather than focusing solely on building data pipelines, you'll provide technical leadership across the engineering function, helping define the architectural direction of the company's data platform while influencing how engineering teams solve ...

Data Software Engineer - Azure Databricks London, United Kingdom Contract 6 to 8 years of experience in data software engineering with a strong focus on Azure technologies Expertise in Azure Databricks development, including efficient handling of large datasets Strong working knowledge of Azure Data Factory … building complex ETL workflows Experience with performance optimization of data pipelines and distributed processing setups Proficiency in Scala development (hands-on experience highly desirable) Solid understanding of Azure services relevant to data engineering and cloud architecture Strong problem-solving ability with effective communication skills for team ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

real difference. Whether you are coming from insurance pricing, actuarial, financial services, consulting, retail pricing, or another analytical environment, if you enjoy turning data into commercial decisions, we would love to hear from you. Why join us? Make an impact: help determine how we price, grow, and optimise … products used by millions of customers across the UK. Work on innovative data science problems: use the right tools for the job, including Python, SQL, Power BI, and advanced analytical techniques, to solve real commercial pricing challenges. Develop your actuarial career: if you are on the actuarial path ...

have a bachelor’s degree and proven multi-platform SIEM expertise including Splunk Enterprise Security and Microsoft Sentinel, plus automation and data pipeline experience. #J-18808-Ljbffr ...

hands-on delivery and cross-functional collaboration to deliver measurable ROI. You will partner with an AI Business Analyst, applying best practices in data pipelines, AI governance, and security while guiding rapid time-to-value projects #J-18808-Ljbffr ...

nationwide site visits Rate: £500/day Outside IR35 Roc Search is recruiting for an experienced Scrum Master to join a large-scale data and analytics transformation programme. This is a fantastic opportunity to work with a highly technical team delivering modern cloud-based data solutions … fast-paced Agile environment. This is a technically-focused Scrum Master role. You'll be working closely with Data Engineers, BI Developers and technical stakeholders to drive delivery, remove blockers and ensure Agile best practices are embedded across the programme. Key Responsibilities Lead Scrum ceremonies and manage sprint ...

with: Plant managers Maintenance and engineering teams Procurement and asset owners CRM & Reporting Maintain accurate records of: Opportunities, Contracts & Installed Base Data Pipeline, forecast & performance reporting Candidate Profile Experience Previous or related experience in aftermarket/service sales within: Combustion systems Boilers, burners, or thermal plant Industrial ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

Moody’s is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines powering Moody’s next-generation digital content platform. You will work with DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS, driving platform optimizations and cross-functional collaboration. … this role, you’ll collaborate with product owners and engineering teams, ensure data quality and governance, and mentor colleagues through code reviews and workshops. #J-18808-Ljbffr ...

Data Software Engineer - Azure Databricks London, United Kingdom Contract 6 to 8 years of experience in data software engineering with a strong focus on Azure technologies Expertise in Azure Databricks development, including efficient handling of large datasets Strong working knowledge of Azure Data Factory … building complex ETL workflows Experience with performance optimization of data pipelines an click apply for full job details ...

Bank of England’s Financial Stability Strategy and Risk (FSSR) is seeking a Lead Data Scientist to drive data science and AI capabilities across the directorate. The role focuses on cloud‐based analytical solutions and AI tools, delivering dashboards and scalable data pipelines … financial stability analysis. You will lead cross‐directorate projects, mentor staff, and embed responsible AI practices while aligning with Bank-wide cloud and data governance. #J-18808-Ljbffr ...

clean, efficient code, and can work both independently and collaboratively. Role Purpose:- The DevOps Engineer is responsible for owning and operating the enterprise data platforms built across on-premise RedHat & Microsoft platforms Microsoft Azure and Microsoft Fabric. This includes delivering secure, automated, and reliable platform services using GitHub … ensuring all changes are delivered in a controlled, auditable, and repeatable manner Provide proactive monitoring and operational management of the platform, including Fabric pipelines, data refresh cycles, Azure dependencies, and capacity utilization Drive continuous service improvement using metrics and operational insight Embed a culture of ownership, accountability ...