19 of 19 Permanent Data Pipeline Jobs in Milton Keynes

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

Description We are seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve … communicate the existing enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

Data Engineer - Outside IR35 Contract - AWS, Python, Terraform, Spark Initial contract until the end of March 2026 Remote based + with ad hoc client workshops Must be able to start at short notice Outside IR35 Must have strong AWS, Terraform, Python, Spark, SQL Data Engineer role … Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Title: Data Engineer Location: Hybrid/Manchester Rate: £400/day Inside Ir35 Duration: until 31/03/26 to begin with About Us: Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with … experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely with data scientists, analysts, and engineering teams to support ...

client is looking for a Salesforce-centric Data & Integration Technical Engineer to own and evolve the entire Sales & Marketing tech stack for a fast-growing group of Salesforce-based SaaS companies. You will operate at the intersection of data engineering, Salesforce development, and go-to-market … single, intelligent ecosystem. We are looking for a technical engineer, deeply fluent in Salesforce architecture & development, and capable of administering and extending Salesforce Data Cloud to unify data across multiple orgs. You will design and maintain the backbone that connects Data Cloud, 5+ Salesforce ...

building management systems (BMS). This role is responsible for creating robust server-side solutions within the Niagara Framework (N4) that enable efficient data exchange, automation workflows, and system interoperability. The specialist will work across a range of building systems and assets including HVAC, lighting, energy metering, environmental … Framework Development Design, develop, and maintain server-side components and logic within the Niagara N4 platform. Build and deploy custom services, APIs, and data flows to support complex multi-system integration requirements. Configure and optimize Niagara stations, drivers, network settings, and performance for large-scale environments. MQTT ...

Senior Data Engineer Contract Role Outside IR35 | £500-525/day | Milton Keynes or Manchester | Hybrid | Initial 7 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in both Manchester and Milton Keynes. You’ll join a high … impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 7-month contract with ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

Engineer bring? Strong backend development expertise with Go and additional bonus points for Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration … layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part ...

Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Cloud Engineer. The programme focuses on migrating data from legacy platforms into modern, cloud-based data environments, with an emphasis on automation, scalability and secure delivery. Key Responsibilities Design, develop … support data pipelines as part of a cloud migration initiative Build and maintain data processing and transformation workflows using Databricks Support the migration of data from legacy systems into cloud-based platforms Configure and maintain CI/CD pipelines using Azure DevOps to support ...

with prompt engineering, tool calling, retrieval-augmented generation (RAG), and multi-agent workflows Experience integrating AI into real systems, APIs, event-driven architectures, data pipelines, and automation platforms (e.g. UiPath, Blue Prism) Comfortable experimenting with new models, SDKs, and platforms, and evaluating what's production-ready vs hype ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

awareness: you understand value propositions, return on investment, trade-offs (cost vs speed vs write-down risk), and you factor in risk, compliance, data governance when designing solutions. Key Responsibilities Lead technical discovery and scoping phases with prospective clients: understand their business, compliance, risk, operational, regulatory and data environment. Design solution architectures leveraging Aveni's products (Detect, Assist, Agents, FinLLM) plus integrations with client systems (e.g. CRM, communication tools, data pipelines). Develop, deliver, and customise demos, POCs, workshops to illustrate value, ROI, regulatory compliance, risk mitigation, etc. Collaborate with sales teams to respond ...

rehabilitation progress. -Behavioural analytics (e.g., detecting self-harm risk via AIM). -Intelligent workflow automation for case management systems. Develop and optimize robust data pipelines, ensuring privacy and compliance with strict security standards. Continuously improve model accuracy, fairness, interpretability, and scalability. Stay up to date with research … recommend innovations that align with Unlinks vision and the sensitive nature of justice services. Person Specification Must-Have: Degree in Computer Science, AI, Data Science, or equivalent experience. Strong Python skills, with experience in ML libraries like TensorFlow, PyTorch, scikit-learn. Solid understanding of ML principles, algorithms ...

whose platform shows large enterprises how they could be compromised in real time, before attackers succeed. They blend attacker behavior, large-scale data pipelines and automated offensive security to give security teams true, live exposure visibility. The Role for Engineering Manager, Cybersecurity Applications You'll be the global … account lifecycle, auth/SSO, granular access control, notifications, logging and multi-tenancy • Partner tightly with Product and Design to turn complex security data into simple, powerful workflows that customers love • Shape engineering practices across teams, embedding quality, security and agility into how software is built and shipped ...