26 to 50 of 51 Data Pipeline Jobs in the North of England

extend) Location: Hybrid working IR35 Status: Outside Start Date: ASAP About the Role This is an opportunity to lead the delivery of a data transformation, helping an organisation establish its first centralised data warehouse and modern reporting capability.This is a hands-on contract role where … through to implementation, documentation and knowledge transfer. What You'll Do Lead the end-to-end design and delivery of a Microsoft Fabric data platform. Design and implement scalable data warehouse/lakehouse architecture. Build and optimise automated data pipelines from APIs, databases, SaaS ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop and maintain data pipelines using Azure services. - Ingest, transform, and model data from diverse sources. - Optimise data flows ...

Data Engineer £55,000 - £65,000 GBP Hybrid WORKING Location: Leeds, Central London, Greater London - United Kingdom Type: Permanent Are you a Data Engineer looking to work on high-impact projects that support UK national security? We're looking for engineers who enjoy building scalable data platforms and solving complex technical challenges within secure environments. You'll design, develop and maintain data pipelines, enabling organisations to collect, transform and deliver data that drives critical decision-making. Working alongside architects, analysts and software engineers, you'll help deliver modern cloud-based ...

Please note you will need to hold a British nationality or Indefinite Leave to Remain in the UK before application. BI Developer/Data Engineer We're seeking an experienced BI Developer/Data Engineer to join a growing data and analytics team. This … role is ideal for someone who enjoys transforming complex business data into meaningful insights through reporting, dashboards, and data visualisation. You'll work closely with business stakeholders to understand reporting requirements, build data solutions, and deliver high-quality analytics that support business decision-making. ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … away from engineering. A UK Wealth Management business is modernising its enterprise data platform and moving from Azure Synapse to Microsoft Fabric. Theyre looking for a Senior Data Engineer who has genuine production experience with Fabric: not simply implementing something and moving on, but supporting ...

Senior Data Engineer Microsoft Fabric Location: West Yorkshire Working pattern: Hybrid, 2 days per week onsite Salary: £70-80k We are looking for a Senior Data Engineer with strong hands on Microsoft Fabric experience to help design and build a modern data platform … Fabric Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

Reporting in to the Head of IT, the successful Data Engineer will work on building and maintaining data pipelines to support analytics and decision-making processes. This role is all about ensuring data flows smoothly and efficiently, helping the business make informed choices. Client … mission is to "enrich the lives of pets and their owners through visibly better pet food." We are currently looking to grow our Data Engineering & Analytics team Description The successful Data Engineer will be responsible for but not limited to: Design, build and maintain efficient ...

Title Data Scientist Job Description Job purpose: Our IT mission is to transform how data and AI are delivered to customers and colleagues around the world, with a focus on simplicity, trust, and measurable value. AI is central to this mission, providing tools and platforms … creating and operating secure, scalable data and AI solutions. Reporting to the BI and Analytics Manager, the Data Scientist is a valued member of the Enterprise Analytics & AI Hub. This role develops and evaluates advanced analytics, machine learning, and generative AI solutions that help us understand ...

Data Scientist in Leeds, you'll focus on analysing data and creating models to support business decisions within the financial services industry. Your work will help uncover insights and drive strategies that provide actionable insight and deliver value. Client Details Our client, is a market leading … financial services business, based in Leeds. Due to continued growth they are looking for a Data Scientist to support the strategic use of data within the business. Description Duties of the Data Scientist: Analyse large datasets to identify trends and actionable insights. Develop predictive ...

Security and Accessibility. Responsibilities: Plan and lead testing activities across sets of related user stories Design, implement and maintain automated test frameworks for data pipelines and applications Identify and escalate risks and quality issues identified through automated testing Analyse and report on test activity, results, issues and risks … Support live services through production data analysis and root cause investigation Operate and support ingest and publishing pipelines and services, identifying opportunities to improve resilience and stability Work closely with Product Owners, Business Analysts, developers and data users to understand requirements Take ownership of understanding ...

Data Engineer (Databricks/AWS) Leeds (Hybrid) Permanent £60,000 - £65,000 + Benefits Data Engineer needed for a permanent full-time position based in Leeds (Hybrid). Must have strong Databricks and AWS experience. Hybrid Working Model - primarily working from home with travel … Start ASAP in October/November 2026. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark and SQL skills. Hands-on Data Engineer to run + maintain production data ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Regulatory Data Developer, you will shape the reporting systems that keep our regulatory data accurate, timely and ready for change. The Regulatory Data … Server solutions to GCP, while helping to design and deliver new cloud-native reporting systems in BigQuery. The work spans data modelling, pipeline development, validation and automation, with AI-assisted development also playing a part in improving consistency and reducing manual effort. Qualifications Strong Google BigQuery experience. ...

expressions of interest from experienced analysts/developers who are currently employed within South Yorkshire & Bassetlaw (SYB) ICS, who can turn complex cancer data into practical operational intelligence. Working closely with the STH Cancer Turnaround Director, SYB Cancer Alliance and clinical and operational colleagues at Sheffield Teaching Hospitals … demonstrate advanced analytical and development skills; experience using SQL and Power BI or comparable business intelligence tools; confidence in interpreting complex operational data; and the ability to work independently with clinicians, managers and senior leaders. Knowledge of NHS cancer pathways and performance standards would be advantageous. Main duties ...

Data Engineer (Databricks) Leeds (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience. 6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026. Hybrid Working Model - primarily … Leeds office 1-2 days per month. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark + SQL skills. Hands-on Data Engineer to run + maintain production data ...

required in Python, SQL, Spark, Databricks and Customer Consultancy We're working with a fast-growing, high-performing technical consultancy seeking an experienced Data Engineer to join a team specialising in data, AI and software solutions across Defence and financial services. Headquartered in Newcastle, the business … working on cutting-edge technology for Defence and National Security. The Role You'll play a key role in you'll building the data foundations that Defence programmes depend on, working across projects ranging from production data pipelines and applications to POCs and making sensitive ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full job details ...

infrastructure across cloud and on-premise environments. Develop scalable architectures for AI workloads, including model hosting, vector databases, orchestration layers, APIs, and data pipelines. Integrate AI platforms with business-critical systems, data platforms, collaboration tools, and operational applications. Produce and maintain architecture documentation, operational procedures … optimise AI solution performance, reliability, security, and cost efficiency. Governance & Compliance Ensure AI solutions align with security, governance, and compliance requirements. Support data governance, privacy, risk management, and lifecycle policies for AI-enabled systems. Maintain standards and documentation relating to AI usage, access control, and governance frameworks. Contribute ...

Engineer, you'll work across the full solution lifecycle, helping to design, build and deploy AI-powered applications whilst ensuring the underlying integrations, data and processes are robust and scalable. You'll be involved in: Building AI-enabled solutions such as conversational assistants, workflow automation and intelligent document … Generation (RAG) and agent-based approaches Taking solutions from prototype through to deployment, monitoring and continuous improvement Building and maintaining APIs, integrations and data pipelines that support AI applications Working closely with business stakeholders to understand operational challenges and translate them into practical technical solutions Supporting user testing ...

combine structured study from Sheffield Hallam University with practical consulting experience, working alongside Capgemini Invent colleagues to help our clients address real business, data, AI and technology challenges. Role As a Digital & Technology Solutions Degree Apprentice, you’ll work as part of a team delivering and improving digital … help organisations run more effectively. When you join, you’ll start on one of the below pathways, depending on your skills and interests: Data Analyst In this pathway, you’ll learn how to use data to help organisations understand performance and make informed decisions. ...

real impact from day one, taking ownership of solutions from initial concept through to deployment. The Role Working closely with the Director of Data and Business Optimisation, you will design, build and deploy AI-powered applications, agents and integrations to improve efficiency across finance, billing, field operations … using modern programming languages and large language models. Integrating AI solutions with Microsoft 365, finance, CRM, workforce management and other business systems. Building data pipelines and reporting services to provide reliable, consistent business information. Implementing effective AI governance, security, testing and monitoring to ensure solutions are reliable, compliant ...

Cheshire - Hybrid - 12mth contract - Up to £400/day - Want to build better data solutions and see the impact they have on business decisions? We're looking for a Data Engineer to join an established organisation undergoing a significant transformation programme. This is an opportunity … work with modern Azure data technologies, develop reliable data pipelines and help turn complex data into click apply for full job details ...