201 to 225 of 305 Data Pipeline Jobs in the UK excluding London

Design scalable, secure, and high-performance AI/ML solutions Translate business requirements into end-to-end AI architectures Lead the design of data pipelines, model training environments, and deployment frameworks Implement best practices for MLOps, CI/CD, and model life cycle management Evaluate and recommend … tools, platforms, and frameworks Ensure alignment with data governance, security, and regulatory requirements (e.g. GDPR) Collaborate with key stakeholders across data, engineering, and business teams Provide technical leadership and architectural oversight across AI initiatives Experience Required Extensive experience (typically 8-12+ years) in technology, with ...

Role: Senior Azure DevOps Engineer (Kafka) Location: Remote (UK) Salary: £75k + 10% Bonus Key Skills: Azure Terraform Kubernetes Kafka Data platforms Overview We're partnering with a fast-growing SaaS organisation building a modern, data-driven platform that powers better insight into behaviour, performance … They're scaling their platform capability and are now looking for a Platform Engineer to help design, build, and evolve their cloud and data infrastructure. This is a hands-on role spanning cloud infrastructure, DevOps, and data platform engineering. The Role You'll work across Azure ...

deployment environments. Experience with frontend technologies such as React, Next.js, TypeScript, or similar frameworks. Familiarity with vector databases, graph databases, semantic search, structured data pipelines, or knowledge graph tooling. Someone who thinks beyond prompt engineering. Should be experienced in the architecture of reasoning systems: how agents decide what ...

Senior Data Engineer - Contract (Hybrid) Seeking an experienced Senior Data Engineer with (strong communcation & stakeholder management experience) expertise in SQL , Infor LN , and Microsoft Fabric to optimise production analytics, purchase orders, cash flow forecasts, and profit margins. Immediate availability required for this hyrbid contract role. Semior … Data Engineer, key Responsibilities Strong communcation & stakeholder management experience Design scalable data pipelines for operational finance functions. Develop dashboards and reports using Microsoft Fabric . Extract, transform, and load data from systems like Infor LN using advanced SQL . Ensure data integrity ...

This is a hands-on technical and analytical role where your work will directly support commercial pricing decisions through the development of robust data pipelines, workflow automation and production-ready model deployment. You'll work closely with pricing analysts and stakeholders across the business to ensure pricing models … data processes are scalable, accurate and operationally effective. We're looking for someone who enjoys solving complex technical challenges, working with data and building automated solutions that drive real commercial value within a fast-paced pricing environment. Responsibilities include: Support the successful delivery of Consumer pricing ...

Senior Data Engineer | £650 - £700 Inside IR35 | Hybrid | London We are looking for an experienced Senior Data Engineer to join a high-profile project delivering modern data solutions within a secure environment. This is a hybrid role which will require … London. Active SC Clearance is mandatory for this role – candidates without current SC clearance cannot be considered Key Responsibilities Design and build scalable data pipelines Work across large-scale data platforms and cloud environments Collaborate with engineering and architecture teams to deliver high-quality solutions ...

opportunity This is not a standard reporting role. Our client is looking for a commercially minded analyst who is genuinely passionate about data - someone who sees insight as a tool for making better business decisions, not just producing charts for a weekly report. You'll be embedded … Projects team that delivers complex, bespoke, multi-million-pound solutions to international clients. You'll own the data and analytics function for that team - building dashboards, interrogating cost data and helping project managers and commercial leads make smarter decisions throughout the project lifecycle. Longer term, there ...

Head of Data Engineering | Permanent | £100,000-£125,000 | Manchester (Hybrid) A major UK retailer is transforming how it uses data and they need an experienced Head of Data Engineering to lead the charge. This is a senior, hands-on leadership role … heart of a cloud-native data platform build. You'll be setting the technical direction for data engineering, leading a growing team, and owning the modernised platform long after the initial build is complete. What you'll be doing Leading and growing a data ...

days onsite, London) Position Type: Permanent Salary: £50,000 - £60,000 per annum + Benefits Experience Required: 6-8 years in Data Integration/ETL About the Role Are you a seasoned Data Integration specialist with deep expertise in cloud ecosystems? We are seeking a Senior … modern data warehouses like Snowflake or Databricks . Performance Tuning: Act as the senior technical lead for debugging, advanced error handling, and pipeline optimization to ensure high scalability and performance. Collaboration: Partner closely with Solution Architects and Business Analysts to translate complex requirements into technical realities, ensuring ...

Voila, Power BI, GitHub, Vue, Nuxt AEC Platforms & Standards: Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and it’s Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the roleIn addition … plugins that integrate with AEC platforms (e.g. Revit, Rhino, IES). To support the Director responsible in developing the technical strategy for data and software initiatives aligned with the practice’s digital transformation goals. Designing and implementing data pipelines and analytics dashboards to support project performance ...

Mackie Myers are Partnering with London based Transport organisation, seeking a Senior Data Analyst. The role requires a highly capable Senior Data and Business Intelligence Analyst to join a growing, complex, Group Finance team.Location: London (Hybrid, 3 days in the office per week) This … scalable, enterprise-grade Power BI reporting solutions that support strategic decision-making across the business. This position is ideal for someone a strong Data Analyst back ground, confident with Power Automate, Python, or VBA, who enjoys solving complex problems, building robust data solutions from the ground ...

able to work closely with others to shape solutions Beneficial - exposure to ERP, B2B SaaS, or financial software Beneficial - experience with vector search, data pipelines, AI monitoring, and security For more information, please contact Katie at Matched Group. AI Software Engineer/AI Software Developer/AI/ ...

Azure AI Foundry, Azure OpenAI, AI Search, agents and RAG patterns. Strong practical knowledge of databases, including SQL and NoSQL platforms, schema design, data access patterns, query performance and secure data handling. Ability to design, build and review maintainable code while following agreed coding standards, architectural …/CD workflows, branching strategies, pull requests and automated testing using tools such as Playwright. Experience with Microsoft Fabric, Lakehouse architecture, data pipelines or analytics engineering would be beneficial, especially where data needs to be prepared for reporting, automation or AI use cases. Role Build ...

helping organisations transform and deliver high-quality, scalable solutions that truly matter. Overview: We are looking for a highly skilled AWS DevOps/Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps … expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks. Key Responsibilities: Translate technical requirements into effective DevOps toolchains to enable product delivery Design and implement resilient, scalable, and highly available services Automate infrastructure, deployments, and testing using Infrastructure as Code (IaC) Ensure deployment ...

Data Engineer Snowflake SQL Python Dynamics CRM We're looking for an experienced Data Engineer to play a key role in a high-profile data transformation programme. You'll lead the modelling of CRM data into Snowflake, develop scalable data ...

leadership teams on future platform improvements. What you will do Build and improve backend services running in Azure Develop APIs, integrations, and data pipelines Work across 60 percent greenfield development and 40 percent core system improvement Contribute to architecture and technical discussions Support code reviews, testing, and engineering ...

Splunk (Enterprise and ES), including tuning and optimisation Expertise in detection engineering, including MITRE ATT and risk-based alerting Experience building and maintaining data pipelines, log ingestion and schema standardisation Advanced knowledge of SPL, KQL or EQL Experience with SIEM operations, including scalability, high availability and performance Automation ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

Experience with RAG and LLM-based solutions, and with workflow design (e.g. N8N, Power Automate, LangChain, etc.) Solid understanding of AI architectures and data pipelines Knowledge of security, compliance, and governance principles from a development perspective Proven mentoring and team development capabilities Excellent communication and stakeholder management skills ...

committed to doing it well. We are looking to engage an Interim Business Analyst to support the discovery, definition, and shaping of data and analytics initiatives, ensuring clear requirements and actionable outputs to enable delivery, test and benefits realisation for a period of 12-months. Our key focus … implementation of Databricks to replace Synapse and Informatica pipelines and notebooks Carbon reporting tool for customer use Discovery and shaping of additional data initiatives (may include automated quotations, dynamic pricing, product enrichment) You will be responsible for: - Discovery & Requirements Gathering Conduct stakeholder interviews and workshops Capture and document ...

helping organisations transform and deliver high-quality, scalable solutions that truly matter. Overview :We are looking for a highly skilled AWS DevOps/Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps … expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks . Key Responsibilitie s:Translate technical requirements into effective DevOps toolchains to enable product delive ryDesign and implement resilient, scalable, and highly available servic esAutomate infrastructure, deployments, and testing using Infrastructure as Code ...

Data Analyst | Renewable Energy | Bristol (hybrid) | £40k-£45k 🌍 Join a fast-growing renewable-energy company in Bristol that’s using data and technology to power the UK’s clean-energy transition. With strong investment and a forward-thinking culture, it’s a place where engineers … shape new tools, influence real change, and make a meaningful impact from day one. We are now looking for a talented Data Analyst, you’ll deliver accurate, timely insights and own the full reporting process - from validating data to presenting clear, actionable findings that support decision ...

leading Professional Services firm is looking to hire a Finance Data Engineering & Analytics Lead to join their team. You will develop Python/PySpark-based data pipelines, build data models and datasets for finance, actuarial and risk reporting. You will also develop analytics, dashboards … data validation tooling. You will also support data quality monitoring and apply AI in delivery. KEY REQUIREMENTS: Strong Python capabilities Experience with Cloud Data Platforms is vital Exposure to Finance/Actuarial is essential Understanding of AI-enabled tooling is a necessity London Market ...

Data Engineer - Contract Rate: £500 per day (inside IR35) Location: Remote with 1 day per month in Leeds Duration: Until March 2027 with the possibility of extension Availability: 2 weeks' notice or less required Clearance: BPSS check required The Role We are working with a leading healthtech consultancy … joined-up system, underpinning services including the Electronic Prescription Service, GP Connect, and the national roll-out of Electronic Patient Records. As the Data Engineer, you will play a hands-on role in designing, building, and maintaining the data pipelines and platform infrastructure that underpin these ...

Data Engineer (Streaming) – Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems … with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3+ years in data engineering Agile experience and strong communication skills Nice to Have Consulting/client-facing experience Real-time/low-latency systems Certifications or mentoring ...