1 to 25 of 250 Permanent Data Pipeline Jobs in the North of England

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

NEXT CHAPTER STARTS WITH YOU. Data Engineer Build trusted data products that turn complexity into confident decisions Vanquis is strengthening how it uses data to improve customer outcomes, insight and competitive advantage. This is an opportunity to help shape a modern, cloud-first data … tools that improve time to market. Learning together. We document well, share experience and help the wider engineering community grow. Technology stack Snowflake – ELT pipeline development – Agile and DevOps Coalesce – Data modelling and data marts – CI/CD and test automation SQL – Metadata-driven pipelines ...

competitive salary, and opportunities for professional development. Apply now to make a difference in our community! We are seeking a dedicated and experienced Data Engineer to join our Insights team. At North East and North Cumbria Integrated Care Board, we are committed to providing high-quality care … modifying and supporting data pipelines or data processing solutions in production or operational environments. Diagnosing and resolving data pipeline, data quality or processing issues, identifying root causes and taking corrective action within agreed parameters. Supporting the deployment of data ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

Data Engineer Department: [SBSS] Enterprise Data Management Employment Type: Permanent - Full Time Location: Newcastle Compensation: £53,000 - £67,000/year Description At Somerset Bridge Group, we're transforming our data platform to create a modern, cloud-based data ecosystem that powers … smarter decision-making across the business. As part of this journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise ...

More about the role Our Data & Analytics team creates value for Morrisons by making sure we have the right data in the right place, transformed into clean, accessible structures ready for reporting, data product creation and enabling advanced decision-making. Utilising our Google Cloud … data platform, the Analytics Engineer transforms raw data from across our operations from field to fork into optimised, reliable, and well-documented data models and data products. You will bridge the gap between technical data pipelines and business insight, enabling ...

work depends on, including taking our golden dataset of completed matters from a manual exercise to a versioned, access-controlled, anonymised and repeatable pipeline, along with the evaluation data that tells us whether our AI is getting better. Replace a legacy management information warehouse built on stored … tuning, data modelling and stored procedures, with the judgement to understand the impact of querying production systems. Python for data pipeline and automation work. Experience owning production data pipelines end-to-end: built them, monitored them, fixed them when they broke. Experience working ...

small team with a large remit, and we expect AI-assisted development to be embedded in how we work Apply AI tools to accelerate pipeline development, automated testing, anomaly detection and data quality monitoring Stay current with AI developments in the data engineering space … this is non‐negotiable; you must have built and operated production data pipelines on this stack Strong Python skills – used daily for pipeline development, data transformation and automation Experience across at least two of the three core data domains: Customer, Commercial and Operations ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

client is a specialist technical consultancy delivering bespoke technology and data solutions to solve complex operational challenges. Due to continued growth, they are looking for an experienced Data Engineer to join their growing engineering team. This is an exciting opportunity to work on high-priority projects … data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data ...

Senior Data/AI Engineer - Manager £60,000 to 77,000 GBP Bonus Hybrid WORKING Location: Manchester, North West - United Kingdom Type: Permanent Senior Data/AI Engineer - Manager Location: Manchester Salary: Up to £77,000 + Bonus Employment Type: Permanent Security Clearance: Must be eligible … performance and solution reliability. Optimise data processing, storage and AI workloads for performance, scalability and efficiency. Produce clear technical documentation covering pipelines, data models, solution logic and technical assumptions. Ensure solutions adhere to appropriate data governance, security and privacy standards. Work as part ...

Senior Data Engineer - Remote We are looking for a Senior Data Engineer to take a key role in developing, modernising and improving the organisations data platform and data warehouse capability. This is a hands-on senior engineering position with genuine ownership. Youll … developing data warehouses, analytical platforms and data pipelines. Strong understanding of ETL/ELT, data transformation and pipeline architecture. Solid knowledge of data modelling, including dimensional modelling, Kimball, star schemas and/or medallion architecture. Hands-on experience with Microsoft Fabric ...

days per week on site) | Competitive + Bonus + Benefits Gravitas are partnering with a global organisation to recruit an experienced Lead Data Engineer. This is an exciting opportunity for a hands‐on technical leader to take ownership of enterprise‐scale data platforms, shape data strategy, and drive the design and delivery of modern data solutions across a complex international business. The successful candidate will combine deep technical expertise with strong leadership capability, playing a pivotal role in developing scalable data architecture, mentoring engineers, and enabling data ...

with our head office based in Liverpool city centre this is an exciting opportunity to come and join us as our Head Of Data as we embark on a data transformation journey. This is a hands on role supporting the migration of our legacy data across to our new cloud platform. This role would be ideal for a Head of Data, or a Lead Data & Analytics Engineer looking for that next step in their career. Client Details We are a 4th generation family owned business that was established ...

monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models … Work within IAM policies and data governance standards appropriate to a regulated government environment. Technical skills requiredLanguages & analytics Python - primary language for pipeline development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data ...

Data Engineer £30,000 - £45,000 Liverpool (1-2 days a week in office) If you enjoy building scalable data solutions and turning complex datasets into trusted business intelligence, this is an excellent opportunity to join a growing data function with strong visibility across … organisation. You will play a key role in shaping data infrastructure, supporting analytics, and driving better decision-making through high-quality data engineering practices THE COMPANY They are a well-established organisation delivering services across a large and diverse operational environment. Data is central ...

weeks. Please note that all applicants must be eligible to work full-time in the UK.About the RoleWe're looking for a Data Engineering Manager to help lead and grow our data engineering capability, shaping the platforms and practices that power analytics, insight and AI-driven … enjoys developing people as much as solving complex technical and platform challenges. You'll play a key role in helping us modernise how data moves through the business, from event-driven cloud data through to more traditional operational data sources, while supporting a talented ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … Lead or Senior Data Engineer, with experience leading engineering projects or mentoring technical teams. Strong experience designing, building and maintaining ETL pipelines, data warehouses and scalable data platforms. Expert Python and SQL skills, with experience working with large datasets and distributed systems. Hands ...

designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 54,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core … with delivery teams. Support the development of High-Level Designs (HLDs), Low-Level Designs (LLDs), technical documentation, and knowledge articles. Assure data pipeline integrity throughout migration, testing, validation, and dual-running activities. Mentor and guide Informatica engineers and project teams throughout the delivery lifecycle. Skills ...

organisations transform and deliver high-quality, scalable solutions that truly matter. Role Overview We are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft … Terraform and Infrastructure as Code (IaC). Experience using GitLab, including GitLab CI/CD. Strong data engineering and data pipeline development experience. Good understanding of cloud-based data architecture and integration. Strong troubleshooting and problem-solving skills. Proactive approach with the ability ...

Data Engineer Department: IT Employment Type: Full Time Location: GBR Manchester Hardman Boulevard Description Data and Reporting is an integral part to NCC Group to help deliver our data strategy and, as our Data Engineer, you’ll support the successful delivery … scalable data intelligence platform in Azure. This will provide the services and tools to extract deeper insights from big and complex data using predictive analytics and AI. This in turn will enable the uncovering of actionable insights previously hidden in data. You’ll support the roll ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

enshrine our Data as a Product policies as code . This role is evenly split between infrastructure automation and data pipeline development. You will write clean pipeline code to ingest data into BigQuery , while using Terraform to provision and scale our infrastructure. … secure service accounts using Terraform. Optimise Costs & Resources: Monitor GCP resource utilization and implement automation to optimise BigQuery compute (slots) and storage costs. Pipeline Coding & CI/CD (50%) Build Ingestion Pipelines: Code automated ETL/ELT pipelines to extract, transform, and load diverse data sources into ...