1 to 25 of 63 Data Pipeline Jobs in the North West

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Senior Data Engineer Remote UK | Occasional Travel Senior Data Engineer | Azure | Microsoft Fabric | Data Platform | Python | SQL | Power BI | AI & Analytics 167 Solutions are partnering with a global organisation embarking on a significant data transformation programme. As investment in analytics … business intelligence continues to grow, we are seeking a Senior Data Engineer to play a key role in shaping and delivering a modern enterprise data platform. This opportunity offers the chance to work on large-scale data initiatives, modern cloud technologies and next-generation ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Description As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. You’ll work closely with stakeholders to define requirements, develop best-in-class data ...

Data Engineer - Databricks Salary: £50K - £60K Location: Manchester (3 days per week) Role Overview: Our client is looking for a Data Engineer to take ownership of a Databricks platform and help push it into its next stage of maturity. This is a great opportunity for someone … Role? This is a strong opportunity for a Data Engineer who wants more ownership, more influence and more impact than a standard pipeline-focused role. You'll be working on a business-critical Databricks platform where data quality, structure and reliability genuinely matter. The business ...

Data Engineer £60,000-£65,000 Manchester City Centre- Hybrid We are looking for highly skilled and experienced Azure Data Engineer to join a newly established team with a strong focus on data. In this role, you will play a key part in delivering a complex … pipelines and integration processes Work closely with Data Stewards and Business Analysts to understand data requirements and design optimal pipeline solutions Ensure all solutions align with the target-state data architecture About You Degree in Computer Science, Information Systems, Data ...

Pipelines & Project Delivery Own It End-to-End: Manage and deliver BI infrastructure from initial brief and requirement gathering through to data pipeline development (APIs/ETL/ELT/SQL). Enable the Analysts: Work alongside your Data Analyst colleagues to help them generate … tools such as Cloud Build and GitHub, raising the standard of how code is tested, deployed and version-controlled. Manage Performance & Cost: Proactively monitor pipeline health, optimise performance, and manage infrastructure costs to ensure efficient scaling. AI Enablement Make Data AI-Ready: Apply strong data ...

Databricks Data Engineer Salary: £40K - £50K Location: Manchester Role Overview: Our client is seeking a Data Engineer to support the development, optimisation and ongoing improvement of a modern cloud-based data platform. This role would suit someone with strong hands-on Databricks experience … enjoys building reliable data pipelines, improving how data flows through the business, and creating trusted datasets for reporting and analytics. You will work across technical and non-technical teams, helping turn data requirements into scalable solutions that are accurate, maintainable and easy ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. ...

currently seeking a Data Warehouse Architect who will be responsible for establishing, optimising, and governing a unified enterprise data platform that enables data‐driven decision‐making. Acting as a bridge between complex raw data and meaningful business insight, the role involves designing … Microsoft Fabric (OneLake) and Databricks (Unity Catalog) architecture. Experience building scalable lakehouse and warehouse solutions (Databricks SQL, Fabric SQL). Strong data pipeline development using Databricks Workflows, DLT, and Fabric Data Factory. Knowledge of Delta Lake and cross‐platform data strategies to reduce ...

Title: Data Analyst Ir35: Outside Rate: £450 Location: Manchester (onsite 3 days pw) Contract: 6 month Overview We are looking for a Data Analyst to support delivery of data-driven insights and reporting. This role will focus on analysing large datasets, building data models, and developing dashboards to support decision-making. Key Responsibilities Analyse and interpret complex data sets to identify trends and insights Design and develop data models to support reporting and analytics Build and maintain Power BI dashboards and reports for business users Work with ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Manchester Manchester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing … Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data ...

Data Engineer - Defence ££60,000 - £90,000 GBP Hybrid WORKING Location: Manchester;Bristol;London;Newcaslte , Manchester, North West - United Kingdom Type: Permanent Data Engineer Newcastle | Manchester | Bristol | London | Hybrid | Permanent Our client is a specialist technology consultancy delivering high-impact engineering across defence and complex environments … engineering within defence and secure environments Modern cloud-based data platforms and distributed systems End-to-end data pipeline design and optimisation High-assurance, real-world engineering challenges Embedded delivery within client environments Why Join: Work on mission-critical data systems ...

Data Engineer 12 Month Fixed Term Contract Manchester - 1 day per week About Salix At Salix, we enable and inspire organisations to achieve net zero and create better places. We deliver and administer government funding schemes that improve energy efficiency, support clean power and help create warmer, healthier … with: Advanced SQL and database administration Microsoft Azure Data Services and cloud-based data engineering best practices ETL/ELT pipeline development and orchestration Data modelling for analytics and reporting Query optimisation and performance tuning Testing and automation of data processes ...

Engineer - Job Description Position SummaryOur client's AI & Data function focuses on helping organisations solve complex business challenges through the effective use of data, artificial intelligence, and modern technology platforms.The team delivers end-to-end, business-driven solutions that integrate data, technology, and processes … solutions that enable better decision-making, operational efficiency, and digital transformation. The OpportunityAs an AI Engineer, you will work at the intersection of data, engineering, and artificial intelligence to build practical, scalable solutions that deliver real business value.You'll collaborate with cross-functional teams to design, develop ...

Data Engineer - Manchester (Hybrid) - Python, Cloud, AI & Generative AI - up to £55,000 This is a great opportunity to join a well-established, global consulting organisation that's working on interesting, meaningful projects. The focus is on large-scale technology and transformation programmes, with plenty of opportunity … build practical AI and data solutions that are used in the real world. You'd be part of a team operating right at the heart of data and AI, tackling real problems for major public and private sector organisations. There's a clear commitment to investing ...

India. Based out of our Manchester HQ on a hybrid basis, you will lead a team of 14 across two distinct sales motions: pipeline generation through a blended SDR function, and direct revenue through a team of Commercial Account Managers. This is not a role for someone stepping into … develop that manager to lead independently and with confidence Directly manage 3 Commercial Account Managers responsible for driving direct sales revenue — coach them on pipeline management, deal progression, and closing Build and maintain a high‐performance culture where expectations are clear, coaching is consistent, and accountability is non‐negotiable ...

strong data governance, including lineage, cataloguing, and eliminating shadow IT Set engineering standards across CI/CD, version control, and documentation Oversee pipeline orchestration (ETL/ELT) to ensure reliable, high-performing data flows Work cross-functionally with Finance, Data Science, and Architecture … programming skills in Python and SQL, with experience building scalable, reusable frameworks Deep understanding of lakehouse and medallion architectures Experience with data pipeline tools (e.g. DataFactory, Dataflow/Apache Beam) and workflow orchestration A track record of delivering cloud cost optimisation (FinOps) and managing large-scale data ...

healthtech scale-up is transforming how organisations understand and act on real-world feedback data. Their platform aggregates and processes millions of unstructured data points from external sources, turning them into meaningful insights that drive decision-making across large enterprise clients. Following recent investment and a strategic shift … growth, the business is entering an exciting new phase of development. As part of this journey, they are looking to appoint a Senior Data Engineer to play a key role in evolving their core data platform. This is a rare opportunity to join a small, high ...

Senior Data Engineer Manchester, 2 days per week Millions of customers. One proprietary platform. Infinite possibilities. This global technology business has just completed a massive migration to their own platform, and now, the stage is set for scale, innovation, and speed. Products are being built at pace, technology … data pipelines and ETL solutions. Strong understanding of data warehousing principles and modern data architecture patterns. Experience with pipeline orchestration and workflow management tools. Excellent communication skills and the ability to engage effectively with both technical and non-technical audiences. Experience supporting ...

focused environment. Since its early beginnings, the business has experienced significant expansion and now operates at scale across the UK. As growth continues, data is playing an increasingly important role in driving decision-making, improving operational performance, and supporting long-term strategy. With a large volume of data across multiple systems and applications, the organisation is now looking to appoint a Data Engineer to help develop its data platform and strengthen its data-driven capabilities. This represents an excellent opportunity to join a values-led business at an exciting stage ...

Head of Integration, Data & GenAI Engineering We’re looking for a Head of Integration, Data & GenAI Engineering to lead a critical engineering capability within Technology Services at AJ Bell. This role brings together leadership across three important parts of our technology landscape: integration engineering, data … engineering. Reporting to the Director of IT Strategy & Architecture, you will lead through three senior technical leaders: Senior Engineering Manager (EA), Senior Data Engineering Manager, and Software Engineering Team Lead (GenAI). You will help shape the platforms, capabilities and engineering practices that support AJ Bell’s long ...

Data Engineer; Python, PySpark - Salford, Onsite. Be part of a retail phenomenon! This is a brand new role at a company experiencing huge growth, offering a lot of autonomy and the opportunity to grow as the company grows. My client is seeking an experienced Data Engineer … join a growing Data Team within a fast-paced, e-commerce-led business that is growing at an astonishing rate. The company operates in the direct-to-consumer retail space, and the role will require you to work on-site, 5 days a week. As an experienced Data ...

advertisers while meeting the operational and analytical needs of internal business teams. We work closely with Product Managers, Ad Sales, Ad Operations, Data Science, and multiple other software teams within the Advertising Engineering organization to deliver high‐impact solutions. Looking ahead, we are exploring AI‐driven measurement capabilities … seeking a highly skilled Senior Software Engineer with deep expertise in API Development using Spring Boot and knowledge of Apache Spark‐based Big Data pipelines using Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems ...

DATA ENGINEER up to £38,000 + benefits Liverpool (Hybrid) This is a great opportunity to join a purpose-driven organisation where you can take ownership of data development and help modernise a traditional data estate as part of a growing Data & Insight function. THE COMPANY: This organisation is forward-thinking and technology-driven, with a strong focus on using data to improve people's lives. They are investing in a new data strategy and modern Microsoft stack, creating an excellent environment for someone early ...