101 to 120 of 120 Data Pipeline Jobs in the North of England

We are seeking an experienced Kafka Real-Time Architect to design and implement scalable, high-performance real-time data processing systems leveraging Apache Kafka. In this role, you will be responsible for architecting and managing Kafka clusters, ensuring system scalability and availability, and integrating Kafka with various data processing platforms. This position requires a deep understanding of Kafka and related technologies, along with a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are … robust, highly available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster Management: Configure, deploy, and maintain highly available Kafka clusters, ensuring scalability and fault tolerance across distributed environments. Manage configurations, optimize cluster performance, and troubleshoot issues to maintain smooth operations. Integration & Data More ❯

Snowflake Data Engineer - £60,000-£80,000 My client is looking for a skilled Data Engineer with expertise in Snowflake to join their team. You will build and manage data pipelines, ensure integration of data into Snowflake and implement data … a fast-paced, technology driven business and work alongside experienced colleagues at all different levels. Requirements: -Snowflake -Cloud-based platform experience -Experience building data pipelines in Snowflake -Stakeholder management Please Note: This is role for UK residents only. This role does not offer Sponsorship. You must have the More ❯

Snowflake Data Engineer - £60,000-£80,000 My client is looking for a skilled Data Engineer with expertise in Snowflake to join their team. You will build and manage data pipelines, ensure integration of data into Snowflake and implement data … a fast-paced, technology driven business and work alongside experienced colleagues at all different levels. Requirements: -Snowflake -Cloud-based platform experience -Experience building data pipelines in Snowflake -Stakeholder management Please Note: This is role for UK residents only. This role does not offer Sponsorship. You must have the More ❯

Snowflake Data Engineer - £60,000-£80,000 My client is looking for a skilled Data Engineer with expertise in Snowflake to join their team. You will build and manage data pipelines, ensure integration of data into Snowflake and implement data … a fast-paced, technology driven business and work alongside experienced colleagues at all different levels. Requirements: -Snowflake -Cloud-based platform experience -Experience building data pipelines in Snowflake -Stakeholder management Please Note: This is role for UK residents only. This role does not offer Sponsorship. You must have the More ❯

Snowflake Data Engineer - £60,000-£80,000 My client is looking for a skilled Data Engineer with expertise in Snowflake to join their team. You will build and manage data pipelines, ensure integration of data into Snowflake and implement data … a fast-paced, technology driven business and work alongside experienced colleagues at all different levels. Requirements: -Snowflake -Cloud-based platform experience -Experience building data pipelines in Snowflake -Stakeholder management Please Note: This is role for UK residents only. This role does not offer Sponsorship. You must have the More ❯

in the office/Home working] 💷 Salary: £75,000 - £100,000 base (dependent on experience) Senior AI/ML Engineer – Behavioural Biometrics/Data Science – Early Equity Opportunity Our client uses behavioural biometric interactions and advanced AI to create unique digital user identities, enabling seamless, intelligent security systems … the ideal time to get in early and make a defining impact. We’re seeking a Senior AI/ML Engineer with a data science foundation , strong academic background (MSc/PhD preferred), and a proven track record of building and deploying real-world AI systems from research …/ML Engineer: As a senior member of this growing team, you’ll help architect and scale intelligent systems that analyse complex behavioural data (e.g. sensor, motion, touch, or biometric patterns). You'll work across the full lifecycle, from R&D and prototyping to robust deployment, and More ❯

growing as engineers, and having fun in a collaborative environment. Yelp's mission to connect people with great local businesses relies on powerful data infrastructure and backend systems that can scale across millions of users and businesses. As a Senior Data Backend Engineer on the Content … and Contributor Intelligence team, you will play a key role in building the data platforms and services that power some of Yelp's most innovative GenAI-driven features, from review insights and business summaries to conversational search experiences. You will work closely with machine learning engineers to design … and implement robust, scalable systems that process and serve data at scale. Whether it's streaming real-time content signals, building APIs for ML models, or managing large-scale distributed data stores, your work will directly impact the consumer experience on Yelp This opportunity requires you More ❯

rapidly growing company that specialises in delivering high-intent, high-quality leads while maintaining strict compliance with Financial Conduct Authority (FCA) and General Data Protection Regulation (GDPR) standards. Leveraging advanced APIs, their platform focuses on enhancing eligibility criteria and creating frictionless customer journeys to maximise conversion rates and … generation platforms. The successful candidate will be passionate about automation, API integrations, and building conversion-focused user experiences, with a strong awareness of data privacy, security, and compliance. Responsibilities: Develop and maintain full-stack web applications focused on lead generation workflows. Optimise and scale platform performance to manage … of full-stack development experience, ideally within a lead generation or regulated (fintech, insurance) environment. Clear understanding of GDPR, FCA regulations, and secure data management. Strong collaboration, problem-solving, and communication skills. Desirable Skills: Experience with AI/ML integration for lead scoring or segmentation. Knowledge of Google More ❯

with a leading airline and holiday who are looking for a Tech Specialist to modernise and optime test processes within their well-established Data Engineering & Analytics function. What will you be doing? Develop and implement testing frameworks for data pipelines and analytical models. Conduct technical testing … mentor and upskill teams to enhance test automation adoption What you'll bring to the team? Exposure and experience in technical testing for data analytics/engineering Hands-on experience with GCP or AWS and data warehousing such as Snowflake or Databricks Experience of working with More ❯

Snowflake Data Engineer -£60,000 - £80,000 - Leeds Overview: We are seeking a Snowflake Data Engineer to help drive forward a fascinating greenfield project aiming to reinvent and build out a data platform from scratch. This is a demanding but rewarding project to be … part of a team of data experts in order to develop the capabilities of a global organisation and drive their continued growth. Working on this project will give you experience and expertise that will present limitless opportunities. You will develop and oversee Snowflake-based data pipelines … and implement effective solutions. You will optimise performance to ensure scalability and reliability and contribute to the establishment, growth and efficiency of the data platform. Requirements: Proven Snowflake experience Strong experience working within a cloud-based environment Ability to take initiative Strong stakeholder skills More ❯

D365 modules including finance, trade and logistics, stock, warehousing, procurement and sourcing etc. An understanding of the wider Microsoft stack including Azure functionality, Data pipelines and integrations is also desirable. Travel to customer sites to support optimizations or consultancy requirements will be required on occasion. Key Responsibilities: Liaise … role of Senior Consultant. Worked in a solution delivery capacity in the past. Understanding of the wider Microsoft Stack, e.g. Azure functionality, CE, Data pipelines. Willing to expand and train in other areas to cover demand as required. Salary: We offer a competitive, market-aligned salary, that reflects More ❯

balance. DWP. Digital with Purpose. We are looking for a talented and highly skilled Infrastructure Engineer with experience of Infrastructure Monitoring, Application Monitoring, Data Analytics Platforms and Data Pipelines to join our community of tech experts. We're using fresh ideas and leading-edge tech to More ❯

balance. DWP. Digital with Purpose. We are looking for a talented and highly skilled Infrastructure Engineer with experience of Infrastructure Monitoring, Application Monitoring, Data Analytics Platforms and Data Pipelines to join our community of tech experts. We're using fresh ideas and leading-edge tech to More ❯

balance. DWP. Digital with Purpose. We are looking for a talented and highly skilled Infrastructure Engineer with experience of Infrastructure Monitoring, Application Monitoring, Data Analytics Platforms and Data Pipelines to join our community of tech experts. We're using fresh ideas and leading-edge tech to More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯

next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … re Looking For: Strong Python programming skills (5+ years preferred). Deep experience with distributed systems Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in an autonomous environment. Unfortunately, visa sponsorship is not available for this position. More ❯