1 to 25 of 30 Data Pipeline Jobs in the North West

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Overview This is an exciting opportunity for a technically minded Data Engineer to join a growing and innovative organisation working at the forefront of data-driven solutions. Youll play a key role in building, maintaining, and optimising data systems that support operational performance … reporting. This role offers exposure to modern data tools, cloud technologies, and large-scale datasets, making it ideal for someone looking to develop a career in data engineering. Data Engineer Key Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

part of our continued growth and investment in our data and analytics capabilities, were recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data is leveraged … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. Youll work closely with stakeholders to define requirements, develop best-in-class data ...

data stack, connect APIs and pipelines into coherent systems, and take ownership of the full journey from initial brief through to a pipeline running reliably in production. If you are the kind of engineer who takes pride in clean pipelines, fast queries, and infrastructure that just works … it. What you will be doing Owning BI infrastructure end-to-end, from initial brief and requirement gathering through to data pipeline development across APIs, ETL, ELT and SQL Working alongside Data Analyst colleagues to help them generate impactful business insights and analysis Taking ...

Title: Data Engineer Location: Greater Manchester (Hybrid - 3 days per week onsite) Salary: £60,000 - £70,000 + Bonus + Excellent Benefits We're working with a well-established, market-leading organisation that is investing heavily in its data and technology capabilities. They are looking … appoint an experienced Data Engineer to lead the development of a modern cloud-based data platform that will support reporting, analytics and business decision-making across the organisation. This is an exciting opportunity to join a growing business undergoing digital transformation, where you'll have ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Manchester Manchester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing … Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data ...

Data Platform & Analytics Lead (Microsoft Fabric/AI Enablement) Manchester or Leeds (hybrid working available) The role: The Data & Analytics Lead owns my clients' enterprise data platform and is responsible for ensuring it supports analytics, AI, and machine learning use cases in a structured … governed, and scalable way. This includes end-to-end accountability for data ingestion, transformation, lakehouse design, semantic modelling, and the development of reliable data products. The role ensures business data is accessible, consistent, and trusted, with clearly defined metrics that enable high-quality analysis ...

Data Engineer Join a growing data engineering function and help build scalable, cloud-based data products that support data-driven decision making across the organisation. The Opportunity This is an exciting opportunity for a Data Engineer to work with modern … cloud technologies while contributing to the design, development, and delivery of enterprise data products. Working alongside Product Managers, Architects, Principal Engineers, and fellow Data Engineers, you will help create robust, high-performing data solutions that transform raw data into valuable business insights. ...

Data Engineer Manchester £45,000 About the Company A fast-growing, family-oriented organisation operating across multiple locations in the UK with a strong focus on people, development and long-term career growth are looking for a Data Engineer to join their growing team. As their … business continues to expand, they are investing heavily in data and technology to support smarter decision-making and innovation across the organisation. This is an excellent opportunity for someone with some hands-on experience who is eager to further develop their career in data engineering, with ...

Were looking for a Head of Integration, Data & GenAI Engineering to lead a critical engineering capability within Technology Services at AJ Bell. This role brings together leadership across three important parts of our technology landscape: integration engineering, data engineering and Generative AI engineering. Reporting … Director of IT Strategy & Architecture, you will lead through three senior technical leaders: Senior Engineering Manager (EA), Senior Data Engineering Manager, and Software Engineering Team Lead (GenAI). You will help shape the platforms, capabilities and engineering practices that support AJ Bells long-term strategy. This ...

Data Engineer - Preston - £60,000 About the Opportunity A large and respected organisation is seeking an experienced Data Engineer to lead the evolution of its data engineering capability and help deliver a modern, data-driven future. This is a senior technical leadership … position offering the opportunity to shape enterprise-wide data strategy, architecture, platforms, and standards. Working within a highly collaborative technology team, you will drive the design, implementation and optimisation of scalable data platforms and pipelines that enable informed decision-making across the organisation. The Role: Lead ...

Senior Data Engineer Location: UK Remote Salary: £60,000 to £70,000 Dependent on Experience Ref: J13159 Are you a Senior Data Engineer who enjoys building reliable data solutions and isn't afraid to get stuck into an established SQL environment? We're looking … solutions. Driving engineering best practice, including version control, CI/CD, automated testing and documentation. Monitoring data quality, performance and pipeline health, resolving issues proactively. Supporting the ongoing evolution of the data platform and cloud environment. What we're looking for Strong ...

Data Lead - GCP We are looking for an experienced Data Manager to lead a high-performing Data Engineering team building scalable data and reporting platforms used by global stakeholders. In this role, you will guide the development of high-throughput, database-centric … applications that process and deliver critical operational data at scale. Working within a cloud-first architecture on Google Cloud Platform (GCP), you will play a key role in designing and delivering modern data solutions using BigQuery and distributed systems. You will lead a geographically distributed team ...

Role Summary We are seeking a seasoned Voice AI Lead Architect with strong Data Architecture expertise to lead the design and implementation of next-generation Voice/Agentic AI solutions for a leading banking client on GCP . This role combines conversational AI, data strategy … customer engagement , acting as a trusted advisor to drive intelligent, data-driven IVR transformation . Key Responsibilities Act as the onsite Voice AI and Data Architecture lead , building strong relationships with banking stakeholders across business, data, and IT teams. Design and deliver Voice ...

Sparta Global are hiring a Senior Data Engineer - this is a role that combines hands-on engineering with technical leadership, including mentoring junior engineers and driving best practice across an organisation's data engineering function. This is a 12-Month Fixed Term Contract , requiring 3 days … week on-site in Blackpool. Role Summary: Designing, building, and optimising scalable data pipelines that support analytics, reporting, and operational use cases. You will play a key role in shaping the organisations data architecture, ensuring data is reliable, accessible, and performant across multiple systems ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that … support analytics and operational decision-making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable ...

experience with: Minimum Qualification - bachelor's degree Multi-Platform SIEM Expertise: Proven experience with Splunk Enterprise Security, Microsoft Sentinel, and SIEM architecture including data models, correlation rules, and administrative functions. Security Operations: Strong … analytical skills in threat detection, incident response, and security event analysis with experience in large enterprise environments (10,000+ endpoints). Data Pipeline Management: Hands-on experience with log ingestion, data routing, and transformation using tools like Cribl, plus understanding of data normalisation ...

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … mission-critical programmes within the National Security sector, delivering innovative solutions across AI, machine learning, cyber security and geospatial intelligence. As a Senior Data Engineer, you will join a collaborative Agile environment, playing a key role in designing, building and maintaining scalable data platforms and processing ...

Senior Data Engineer (Knowledge Systems) This organisation is building a modern, cloud-native platform and evolving towards an AI-first engineering model , where intelligent systems rely on high-quality, well-structured knowledge to power automation, decision-making and software delivery. They are looking for a Senior Data … multiple sources. Choose the most appropriate storage and retrieval approach for different use cases, including document stores, graph databases, vector databases and traditional data platforms. Model complex business domains to improve retrieval quality and contextual understanding. Design and optimise hybrid retrieval strategies using semantic search, keyword search, embeddings ...

Commerce Data Analyst £35,000 - £45,000 Merseyside (3 days a week on-site) Are you passionate about turning digital data into meaningful business outcomes? This is an excellent opportunity for an E-Commerce Data Analyst to join a growing analytics function where your … influence online performance, customer experience, and commercial decision-making. You'll work closely with E-Commerce and Analytics teams, helping shape strategy through data-driven recommendations. THE COMPANY They are a well-established consumer-focused organisation with a strong digital presence and a commitment to using data ...

risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence. Skills and Competencies 3+ years of experience within a data engineering or software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources … applying AI‐assisted development tools (e.g., GitHub Copilot, generative AI coding assistants) to improve engineering productivity, code quality, and delivery efficiency Understanding of data engineering considerations for AI and machine learning workloads, including data quality, governance, lineage, and scalability requirements Education Bachelor’s degree or equivalent ...

Lead Data Scientist | Fully Remote | £90,000–£100,000 + Benefits Build the models behind real-time decision making at scale. Why this role stands out This isn’t just another senior data science position. It’s a chance to shape the future of analytics … most successful privately owned technology businesses, a market leader trusted by millions and driven by data at its core. You’ll join a high-performing team working with real-time data, advanced machine learning, and large-scale analytical systems, with the freedom to influence both technical ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...