51 to 75 of 81 Data Pipeline Jobs in the North of England

Data Engineer Newcastle (Hybrid) Permanent Competitive salary + package Im currently working with a global consultancy to hire Data Engineers to join a growing Advanced Technology team delivering large-scale data solutions across public and private sector clients. This is a hands-on role … where youll work with modern data technologies, building scalable pipelines and real-time data platforms that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing ...

part of the development of our Digital Services function, we are strengthening internal digital capability within the Data Team. These roles are central to building sustainable in-house expertise that supports the design, development, and delivery of digital solutions across the transport network. A key focus of this … campaign is creating new opportunities, and as a result, we are recruiting a Principal Data Engineer. This is a pivotal role within the organisation. In this role, you will work closely with business stakeholders to design, build, test, and maintain data management systems that meet user ...

empowered workforce of tomorrow, you’ll be working at the cutting edge of what’s next. We DESIGN autonomous, AI-powered data platforms– You will lead the design and evolution of next-generation, self-optimising data and AI platforms that power both operational and analytical data … that can reason, adapt, and act with minimal human intervention. We ENABLE intelligent cloud transformation– You will architect intelligent, hybrid and multi-cloud data ecosystems, driving the transition from legacy platforms to AI-centric, adaptive architectures that enhance scalability, performance, and resilience. We INNOVATE with agentic and generative ...

Data Engineer/BI Engineer Salary: Up to £50,000 Location: Hybrid (3 days per week in the office) Type: Permanent We're looking for a Data Engineer/BI Engineer to join a growing team and play a key role in developing and enhancing data and reporting solutions across the business. This is an excellent opportunity for someone with strong data engineering and BI experience who wants to be involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) – Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access Soft Skills Strong problem-solving and troubleshooting capabilities. Ability to work collaboratively across security, engineering, and operations teams. Excellent communication ...

technology estate, join the client's Cybersecurity Science & Analytics (CSA) team. You'll be part of a multi-skilled group of cybersecurity scientists, data and analytics professionals, and engineers-using advanced analytics and cloud-based data platforms to build next-generation cybersecurity capabilities. What … doing: . Ingest, provision and enhance raw datasets, enriched tables and curated data assets for cybersecurity use cases . Improve reliability and frequency of data ingestion, expanding Real Time coverage . Design and build data pipelines that collect, transport and deliver data ...

This role requires eligibility for BPSS and SC Security Clearance, including 5 years' continuous UK residency. The Role We're looking for a Data Engineer to join a growing technology team delivering cloud and data solutions across a range of complex projects. You'll design … build scalable data pipelines, work with modern cloud technologies, and collaborate with engineers, analysts and product teams to deliver high-quality data solutions that support analytics and AI. Key Responsibilities * Design, build and maintain scalable data pipelines * Develop real-time and batch data ...

Senior Data Engineer (Knowledge Systems) This organisation is building a modern, cloud-native platform and evolving towards an AI-first engineering model , where intelligent systems rely on high-quality, well-structured knowledge to power automation, decision-making and software delivery. They are looking for a Senior Data … multiple sources. Choose the most appropriate storage and retrieval approach for different use cases, including document stores, graph databases, vector databases and traditional data platforms. Model complex business domains to improve retrieval quality and contextual understanding. Design and optimise hybrid retrieval strategies using semantic search, keyword search, embeddings ...

Principal Data Engineer (Contract) Outside IR35 Principal Data Engineer £650 per day | Outside IR35 | 3 Month Contract | Remote UK (Very occasional travel to Leeds if you can) Brio Digital are working with a major UK organisation embarking on a strategic data transformation project … into a much larger programme of work. You'll join a cross-functional delivery team alongside Solution Architects, Technical Analysts, Project Managers, and Data specialists, taking ownership of the platform's technical design and engineering. Principal Data Engineer Responsibilities: * Design and build a cloud-native ...

travel. At least 10 years of IT experience, practical solution planning and technical architecture design (SaaS, IAM). Deep knowledge of emerging technologies, data management governance, and technology road‐mapping. Experience with Microsoft Office 365, Dynamics 365, SAP SuccessFactors, Azure AD, Power BI, etc. Strong stakeholder engagement, conflict … resolution, and vendor management skills. Salary range: £90,000–£110,000 + benefits. Location: Central London (Hybrid). Enterprise Data Architect Own the data architecture strategy, develop dashboards, and orchestrate data pipelines supporting event operations across channels. 5+ years in data architecture ...

Commerce Data Analyst £35,000 - £45,000 Merseyside (3 days a week on-site) Are you passionate about turning digital data into meaningful business outcomes? This is an excellent opportunity for an E-Commerce Data Analyst to join a growing analytics function where your … influence online performance, customer experience, and commercial decision-making. You'll work closely with E-Commerce and Analytics teams, helping shape strategy through data-driven recommendations. THE COMPANY They are a well-established consumer-focused organisation with a strong digital presence and a commitment to using data ...

risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence. Skills and Competencies 3+ years of experience within a data engineering or software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources … applying AI‐assisted development tools (e.g., GitHub Copilot, generative AI coding assistants) to improve engineering productivity, code quality, and delivery efficiency Understanding of data engineering considerations for AI and machine learning workloads, including data quality, governance, lineage, and scalability requirements Education Bachelor’s degree or equivalent ...

Lead Data Scientist | Fully Remote | £90,000–£100,000 + Benefits Build the models behind real-time decision making at scale. Why this role stands out This isn’t just another senior data science position. It’s a chance to shape the future of analytics … most successful privately owned technology businesses, a market leader trusted by millions and driven by data at its core. You’ll join a high-performing team working with real-time data, advanced machine learning, and large-scale analytical systems, with the freedom to influence both technical ...

place where people stay because they feel valued, and find room to grow because theyre challenged. About the role Working closely with the Data Analytics Manager and wider Marketing Team, this role will be responsible for turning audience data and customer intelligence into real-world outcome … marketing activations across paid media, CRM, and emerging channels across the DFS Group. This role sits at the heart of our Group Customer Data Strategy so the successful candidate will be responsible for the deployment and activation of our First Party Data (1PD) audiences, enriching audience ...

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional consulting … operate at the cutting edge of intelligent enterprise evolution. We DESIGN intelligent, agent-ready platforms – Architect and deliver scalable, secure, and cost-efficient data, analytics, and AI ecosystems that support both human and autonomous agent workloads, leveraging leading cloud platforms (AWS, Azure, GCP). We ENABLE agentic ...

Staff Data Engineer/Leeds or London 1x a month/£120k - £140k Shape the Future of Data Engineering Within a Leading SaaS Product Business This is an opportunity to step into one of the most influential technical roles within a high-growth SaaS organisation where … engineering plays a central role in shaping the future of the product. Rather than focusing solely on building data pipelines, you'll provide technical leadership across the engineering function, helping define the architectural direction of the company's data platform while influencing how engineering teams solve ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

have a bachelor’s degree and proven multi-platform SIEM expertise including Splunk Enterprise Security and Microsoft Sentinel, plus automation and data pipeline experience. #J-18808-Ljbffr ...

hands-on delivery and cross-functional collaboration to deliver measurable ROI. You will partner with an AI Business Analyst, applying best practices in data pipelines, AI governance, and security while guiding rapid time-to-value projects #J-18808-Ljbffr ...

with: Plant managers Maintenance and engineering teams Procurement and asset owners CRM & Reporting Maintain accurate records of: Opportunities, Contracts & Installed Base Data Pipeline, forecast & performance reporting Candidate Profile Experience Previous or related experience in aftermarket/service sales within: Combustion systems Boilers, burners, or thermal plant Industrial ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

Moody’s is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines powering Moody’s next-generation digital content platform. You will work with DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS, driving platform optimizations and cross-functional collaboration. … this role, you’ll collaborate with product owners and engineering teams, ensure data quality and governance, and mentor colleagues through code reviews and workshops. #J-18808-Ljbffr ...

Bank of England’s Financial Stability Strategy and Risk (FSSR) is seeking a Lead Data Scientist to drive data science and AI capabilities across the directorate. The role focuses on cloud‐based analytical solutions and AI tools, delivering dashboards and scalable data pipelines … financial stability analysis. You will lead cross‐directorate projects, mentor staff, and embed responsible AI practices while aligning with Bank-wide cloud and data governance. #J-18808-Ljbffr ...

clean, efficient code, and can work both independently and collaboratively. Role Purpose:- The DevOps Engineer is responsible for owning and operating the enterprise data platforms built across on-premise RedHat & Microsoft platforms Microsoft Azure and Microsoft Fabric. This includes delivering secure, automated, and reliable platform services using GitHub … ensuring all changes are delivered in a controlled, auditable, and repeatable manner Provide proactive monitoring and operational management of the platform, including Fabric pipelines, data refresh cycles, Azure dependencies, and capacity utilization Drive continuous service improvement using metrics and operational insight Embed a culture of ownership, accountability ...