1 to 25 of 75 Data Pipeline Jobs in the North of England

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Senior Data Engineer Remote UK | Occasional Travel Senior Data Engineer | Azure | Microsoft Fabric | Data Platform | Python | SQL | Power BI | AI & Analytics 167 Solutions are partnering with a global organisation embarking on a significant data transformation programme. As investment in analytics … business intelligence continues to grow, we are seeking a Senior Data Engineer to play a key role in shaping and delivering a modern enterprise data platform. This opportunity offers the chance to work on large-scale data initiatives, modern cloud technologies and next-generation ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Lead Data Engineer/Data Tech Lead Permanent, Leeds/Hybrid Who are we? Enablis is a technology delivery consultancy who partner with clients to accelerate digital roadmaps. By combining our deep knowledge and best practice experience with the client’s domain expertise, we are able … open the door to incredible opportunities and introduce you to a network of equally driven, like-minded professionals. Job Brief The Lead Data Engineer role is responsible for owning the technical direction, design and delivery of data platforms and data engineering solutions ...

Azure Data Technical Specialist: For one of our globally leading tech clients we are urgently looking for an experienced Azure Data Technical Specialist for a long contract based in Gateshead, England, United Kingdom. Its paying well and my client can interview asap! Key Responsibilities Design … processing. Collaborate with business and technical stakeholders to gather and implement data requirements. Monitor, troubleshoot, and optimize data pipeline performance. Ensure data quality, accuracy, and reliability. Stay current with Azure data platform innovations and best practices. Required Skills Strong ...

Christmas shut down) Position Overvie w My client are looking for an experienced Microsoft Fabric & Azure Engineer with hands-on experience in data ingestion, Microsoft Fabric, and Azure data services. This role is focused on building and supporting data pipelines that move data from on-premise systems into Microsoft Fabric and Azure, helping to improve reporting, analytics, and overall data visibility across the business. You will be responsible for designing and maintaining data ingestion processes, supporting Lakehouse architecture, and ensuring data is secure, reliable ...

Description As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. You’ll work closely with stakeholders to define requirements, develop best-in-class data ...

Data Engineer - Databricks Salary: £50K - £60K Location: Manchester (3 days per week) Role Overview: Our client is looking for a Data Engineer to take ownership of a Databricks platform and help push it into its next stage of maturity. This is a great opportunity for someone … Role? This is a strong opportunity for a Data Engineer who wants more ownership, more influence and more impact than a standard pipeline-focused role. You'll be working on a business-critical Databricks platform where data quality, structure and reliability genuinely matter. The business ...

Data Engineer £60,000-£65,000 Manchester City Centre- Hybrid We are looking for highly skilled and experienced Azure Data Engineer to join a newly established team with a strong focus on data. In this role, you will play a key part in delivering a complex … pipelines and integration processes Work closely with Data Stewards and Business Analysts to understand data requirements and design optimal pipeline solutions Ensure all solutions align with the target-state data architecture About You Degree in Computer Science, Information Systems, Data ...

better outcomes for our patients and communities, work to get the best possible value for taxpayers, and drive improvement across the NHS. The Data Services division of Data and Analytics sub directorate's vision is to be the leading data services provider for health … social care across England through creating innovative and high-quality data products and services that give our customers the knowledge and capabilities required to deliver the best outcomes for citizens. The Data Engineering team work with a number of key delivery programmes including but not limited ...

Pipelines & Project Delivery Own It End-to-End: Manage and deliver BI infrastructure from initial brief and requirement gathering through to data pipeline development (APIs/ETL/ELT/SQL). Enable the Analysts: Work alongside your Data Analyst colleagues to help them generate … tools such as Cloud Build and GitHub, raising the standard of how code is tested, deployed and version-controlled. Manage Performance & Cost: Proactively monitor pipeline health, optimise performance, and manage infrastructure costs to ensure efficient scaling. AI Enablement Make Data AI-Ready: Apply strong data ...

Databricks Data Engineer Salary: £40K - £50K Location: Manchester Role Overview: Our client is seeking a Data Engineer to support the development, optimisation and ongoing improvement of a modern cloud-based data platform. This role would suit someone with strong hands-on Databricks experience … enjoys building reliable data pipelines, improving how data flows through the business, and creating trusted datasets for reporting and analytics. You will work across technical and non-technical teams, helping turn data requirements into scalable solutions that are accurate, maintainable and easy ...

better outcomes for our patients and communities, work to get the best possible value for taxpayers, and drive improvement across the NHS. The Data Services division of Data and Analytics sub directorate's vision is to be the leading data services provider for health … desirable Skills and Experience Essential Can deliver well-scoped work independently Applies standard design patterns and engineering practices Debugs and resolves data pipeline issues Communicates effectively with technical and semi-technical stakeholders. Values Essential Proactive, team-oriented, willing to learn Open to feedback and continuous improvement. Disclosure ...

Data & AI Engineer - Up to £50,000 Location: Newcastle - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver technology-enabled transformations. This team specialises in building modern, data-driven solutions … that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

Title: Data Analyst Ir35: Outside Rate: £450 Location: Manchester (onsite 3 days pw) Contract: 6 month Overview We are looking for a Data Analyst to support delivery of data-driven insights and reporting. This role will focus on analysing large datasets, building data models, and developing dashboards to support decision-making. Key Responsibilities Analyse and interpret complex data sets to identify trends and insights Design and develop data models to support reporting and analytics Build and maintain Power BI dashboards and reports for business users Work with ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Manchester Manchester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing … Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data ...

Data Engineer - Defence ££60,000 - £90,000 GBP Hybrid WORKING Location: Manchester;Bristol;London;Newcaslte , Manchester, North West - United Kingdom Type: Permanent Data Engineer Newcastle | Manchester | Bristol | London | Hybrid | Permanent Our client is a specialist technology consultancy delivering high-impact engineering across defence and complex environments … engineering within defence and secure environments Modern cloud-based data platforms and distributed systems End-to-end data pipeline design and optimisation High-assurance, real-world engineering challenges Embedded delivery within client environments Why Join: Work on mission-critical data systems ...

Data Engineer 12 Month Fixed Term Contract Manchester - 1 day per week About Salix At Salix, we enable and inspire organisations to achieve net zero and create better places. We deliver and administer government funding schemes that improve energy efficiency, support clean power and help create warmer, healthier … with: Advanced SQL and database administration Microsoft Azure Data Services and cloud-based data engineering best practices ETL/ELT pipeline development and orchestration Data modelling for analytics and reporting Query optimisation and performance tuning Testing and automation of data processes ...

better outcomes for our patients and communities, work to get the best possible value for taxpayers, and drive improvement across the NHS. The Data Services division of Data and Analytics sub directorate's vision is to be the leading data services provider for health … social care across England through creating innovative and high-quality data products and services that give our customers the knowledge and capabilities required to deliver the best outcomes for citizens. The Data Engineering team work with a number of key delivery programmes including but not limited ...

Engineer - Job Description Position SummaryOur client's AI & Data function focuses on helping organisations solve complex business challenges through the effective use of data, artificial intelligence, and modern technology platforms.The team delivers end-to-end, business-driven solutions that integrate data, technology, and processes … solutions that enable better decision-making, operational efficiency, and digital transformation. The OpportunityAs an AI Engineer, you will work at the intersection of data, engineering, and artificial intelligence to build practical, scalable solutions that deliver real business value.You'll collaborate with cross-functional teams to design, develop ...

Data Engineer - Manchester (Hybrid) - Python, Cloud, AI & Generative AI - up to £55,000 This is a great opportunity to join a well-established, global consulting organisation that's working on interesting, meaningful projects. The focus is on large-scale technology and transformation programmes, with plenty of opportunity … build practical AI and data solutions that are used in the real world. You'd be part of a team operating right at the heart of data and AI, tackling real problems for major public and private sector organisations. There's a clear commitment to investing ...

strong data governance, including lineage, cataloguing, and eliminating shadow IT Set engineering standards across CI/CD, version control, and documentation Oversee pipeline orchestration (ETL/ELT) to ensure reliable, high-performing data flows Work cross-functionally with Finance, Data Science, and Architecture … programming skills in Python and SQL, with experience building scalable, reusable frameworks Deep understanding of lakehouse and medallion architectures Experience with data pipeline tools (e.g. DataFactory, Dataflow/Apache Beam) and workflow orchestration A track record of delivering cloud cost optimisation (FinOps) and managing large-scale data ...

Senior Data Engineer Manchester, 2 days per week Millions of customers. One proprietary platform. Infinite possibilities. This global technology business has just completed a massive migration to their own platform, and now, the stage is set for scale, innovation, and speed. Products are being built at pace, technology … data pipelines and ETL solutions. Strong understanding of data warehousing principles and modern data architecture patterns. Experience with pipeline orchestration and workflow management tools. Excellent communication skills and the ability to engage effectively with both technical and non-technical audiences. Experience supporting ...