251 to 275 of 432 Data Pipeline Jobs in the UK excluding London

client is a warehouse robotics and data company. Forward Deployed Engineer We believe that real-time data will revolutionise the logistics industry. We are building the ultimate data insights platform that provides companies with unprecedented access to their operations through autonomous data … scripting, log analysis, and networking fundamentals. Experience with cloud infrastructure (AWS or equivalent), containerised deployments with Docker and Kubernetes, and modern data pipeline tooling. Proficiency in Python or an equivalent scripting language for investigation tooling, automation, and data analysis. Hands-on experience with AI-assisted ...

basis. This is a key role in the Business responsible for the delivery and development of the organisation wide BI infrastructure, bringing together data from our core systems to provide a single view of the business and its strategic partners. Experience required: Strong experience in data … data manipulation and automation Experience integrating data from APIs, databases, files and other sources Experience with data quality, pipeline monitoring and troubleshooting Experience working with CI/CD, source control and DevOps practices Experience developing and maintaining semantic models using Power BI, SSAS ...

Senior Data Engineer £650 - £750 per day including agency fees London | Hybrid This is an opportunity to work on a high-impact data engineering project at the intersection of AI, machine learning, and large-scale data platforms. You will help build and enhance critical … data products that support advanced analytics and scientific innovation, using modern cloud technologies and engineering best practices. The Company They are a global organisation investing heavily in data, AI, and machine learning to drive innovation across complex scientific and business challenges. Their teams combine strong engineering ...

quickly we can deliver change, how reliably our systems operate, and how effectively our platforms - from SAP to e-commerce to our data estate - work together to serve the business and our customers. Getting this right is a key enabler for delivery and operational performance. The Integration Architect … Produce detailed, technically credible integration architectures across all integration domains - SAP and ERP connectivity, e-commerce and digital channels, mobile platforms, data pipeline and analytics integrations, and third-party SaaS and partner systems. Lead technical spikes and proof-of-concept work to validate architectural approaches, evaluate tooling ...

optimize the branch, improve operational efficiency and maximize self-service availability for financial institutions and retailers across the globe. Title: SW Engineer III - Data Analytics & Insights Location: Dundee (Hybrid) Grade: 11 Salary: £48,000 p/a (DOE) Job description Design, develop, and maintain enterprise reporting and analytics … solutions using Microsoft Power BI and Microsoft Fabric. Build scalable data models, semantic models, dashboards, and self-service reporting capabilities. Develop Python-based data processing and automation solutions to ingest, transform, validate, and analyze large datasets. Collaborate with engineering and business stakeholders to identify performance trends ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop and maintain data pipelines using Azure services. - Ingest, transform, and model data from diverse sources. - Optimise data flows ...

CLEARANCE IS REQUIRED. APPLICATIONS WITHOUT THIS WILL NOT BE CONSIDERED. Develop and optimise SQL queries to retrieve, manipulate and analyse complex datasets. Build data solutions using Python, including working within notebook-based environments. Integrate data from APIs and investigate issues within API responses and associated datasets. … Work confidently with a variety of data formats, including JSON, CSV and Excel. Build, manage and improve automated data pipelines supporting both ETL and ELT approaches. Carry out data validation and quality checks to identify inconsistencies, errors and processing issues. Diagnose and resolve problems ...

seeking someone to join our Data Obfuscation team as a Full Stack Developer – Data Engineering to design and deliver scalable, secure, and reusable data platforms and services that support enterprise data protection and obfuscation initiatives. In the Technology division, we leverage innovation … which is part of the job family responsible for monitoring, detecting, and responding to security incidents to ensure the organization's systems and data are protected from actual and potential threats or breaches. Since 1935, Morgan Stanley is known as a global leader in financial services, always evolving ...

LONDON/HYBRID UP TO £60,000 This is an excellent opportunity for a BI Developer to join a growing consultancy that delivers data and analytics solutions to leading investment and financial services organisations. You'll work on a variety of complex data projects, gain exposure … will have the following skills and experience: Strong commercial experience with SQL Server and T-SQL development. Proven ETL development and data pipeline experience. Solid understanding of data warehousing principles and best practices. Experience with dimensional modelling, including concepts such as star schema, semantic models ...

London (Hybrid - 3 days in office) | £50,000 - £60,000 An exciting opportunity has arisen for a BI Developer to join a growing data consultancy on a fixed-term contract. This role offers the chance to work on complex data integration and business intelligence projects … variety of technology environments and the opportunity to take ownership of delivery, this is an excellent role for someone who enjoys solving data challenges in a fast-paced, client-focused environment. The Company Our client is a specialist data and technology consultancy that helps organisations improve ...

client is a warehouse robotics and data company. You could be just the right applicant for this job Read all associated information and make sure to apply. Forward Deployed Engineer We believe that real-time data will revolutionise the logistics industry. We are building the ultimate … scripting, log analysis, and networking fundamentals. Experience with cloud infrastructure (AWS or equivalent), containerised deployments with Docker and Kubernetes, and modern data pipeline tooling. Proficiency in Python or an equivalent scripting language for investigation tooling, automation, and data analysis. Hands-on experience with AI-assisted ...

everyone, everywhere. More about our mission and what we offer . Job Description About the role Were looking for a seasoned, senior Data Engineer with a strong software engineering background to join our Scalable Growth team within the Global Product Tribe . In this role, youll report directly … Scalable Growth Engineering Lead while embedding day-to-day with the Marketing Platform team. You will serve as the technical authority on data architecture, bridging the gap between platform engineering and analytics engineering. Youll bring maturity, resilience, and scalability to our data infrastructurebuilding and shaping systems ...

Location: Hybrid - London Salary: Up to £60,000 We're working with a growing technology consultancy looking for an experienced Data Engineer to design and deliver modern Azure-based data solutions for a range of enterprise clients. This is a customer-facing role where … work closely with clients to build scalable, secure data platforms while collaborating with a talented engineering team. You'll also have the opportunity to mentor junior engineers and progress into technical architecture or leadership roles. Key Responsibilities Design, develop and maintain data pipelines using Azure Data ...

Data Engineer £55,000 - £65,000 GBP Hybrid WORKING Location: Leeds, Central London, Greater London - United Kingdom Type: Permanent Are you a Data Engineer looking to work on high-impact projects that support UK national security? We're looking for engineers who enjoy building scalable data platforms and solving complex technical challenges within secure environments. You'll design, develop and maintain data pipelines, enabling organisations to collect, transform and deliver data that drives critical decision-making. Working alongside architects, analysts and software engineers, you'll help deliver modern cloud-based ...

Technical Project Manager, Data & Integration Edinburgh, hybrid, 2 days onsite per week £450 - £525 per day, Inside IR35 Initial 6-month contract, expected extension Bright Purple is recruiting an experienced Technical Project Manager to join our client on a major ERP transformation programme, implementing COINS across the business. … discovery, cleansing, mapping, migration and reconciliation Coordinating integration delivery through design, build, testing and deployment Managing Microsoft Fabric, reporting and data pipeline dependencies Managing suppliers, risks, issues, dependencies and change control Supporting testing, cutover, go-live and hypercare What we’re looking for: Strong Technical Project ...

Permutable, we're building real-time AI systems that transform large volumes of global news, market and proprietary data into market intelligence and systematic signals for financial institutions. We're evolving our technology towards a more real-time, event-driven and agent-driven architecture and are looking … where data is the product. The engineering has a clear purpose: helping investment teams investigate changing market conditions using structured, traceable information. Pipeline reliability, data quality and safe releases directly affect the intelligence they can use. Youll have scope across the path from data ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have a strong ...

Title Data Engineer Job Description Join Sage's Routes to Revenue team and help build the data foundations that will power Sage's In-Life customer growth strategy. You will take hands-on ownership of data pipelines, analytical products, and automation workflows that turn … fragmented data into meaningful commercial outcomes. This is a great opportunity for someone who wants genuine ownership, real variety, and the chance to work at the intersection of data engineering, AI, and commercial strategy. What You'll Be Doing • Build and maintain data pipelines ...

Cleared Data Engineer Location: West Midlands - Hybrid working Rate: Up to £600 per day Inside IR35 Contract: Until 31 March 2027, with extensions expected Clearance: Active DV Clearance essential The Role We are seeking a DV Cleared Data Engineer to support a long-term defence programme. … will develop and maintain data solutions within Azure, supporting enterprise service integration, operational reporting, service performance monitoring and data-driven decision-making. Working alongside service architects, service management teams and technical stakeholders, you will help ensure data is accurate, secure and aligned with enterprise ...

Please note you will need to hold a British nationality or Indefinite Leave to Remain in the UK before application. BI Developer/Data Engineer We're seeking an experienced BI Developer/Data Engineer to join a growing data and analytics team. This … role is ideal for someone who enjoys transforming complex business data into meaningful insights through reporting, dashboards, and data visualisation. You'll work closely with business stakeholders to understand reporting requirements, build data solutions, and deliver high-quality analytics that support business decision-making. ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … away from engineering. A UK Wealth Management business is modernising its enterprise data platform and moving from Azure Synapse to Microsoft Fabric. Theyre looking for a Senior Data Engineer who has genuine production experience with Fabric: not simply implementing something and moving on, but supporting ...

explore, build, test, and responsibly scale AI-enabled solutions. In this role, you may support work across machine learning, generative AI, intelligent automation, data pipelines, retrieval patterns, model evaluation, LLM integrations, AI agents, agentic workflows, and AI-enabled software features. You'll collaborate with engineering, product, data … interactions, retrieval patterns, AI powered tools, or generative AI applications. Ability to support AI/ML development, testing, documentation, integration, or data pipeline activities under guidance. Awareness of responsible AI expectations, including reliability, safety, governance, security, privacy, compliance, and appropriate escalation when work is unclear or outside ...

explore, build, test, and responsibly scale AI-enabled solutions. In this role, you may support work across machine learning, generative AI, intelligent automation, data pipelines, retrieval patterns, model evaluation, LLM integrations, AI agents, agentic workflows, and AI-enabled software features. You'll collaborate with engineering, product, data … interactions, retrieval patterns, AI powered tools, or generative AI applications. Ability to support AI/ML development, testing, documentation, integration, or data pipeline activities under guidance. Awareness of responsible AI expectations, including reliability, safety, governance, security, privacy, compliance, and appropriate escalation when work is unclear or outside ...

Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required Strong hands-on experience with Python, PySpark , and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark , including DataFrames, joins ...

Data Engineer Nottingham (hybrid) £50,000 to £60,000 per annum Permanent Data Engineer - What will you be doing? * Developing data pipelines that ingest, process, and transform information from multiple sources. * Implementing seamless integration processes to ensure continuous flow of accurate information. * Designing, optimising … managing databases to facilitate efficient data retrieval and storage. * Creating efficient ETL processes that transform raw data into usable formats. * Building and maintaining structured data warehouses that support easy retrieval, reporting, and analysis. * Ensuring strict data quality checks and validation procedures ...