1 to 25 of 30 Data Pipeline Jobs in Warrington

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

Hiring Data Analyst, Data Engineer and Data Scientists Must have Security Clearance Warrington If you have 4–5 years of experience in data roles and a passion for Generative AI, ChatGPT, machine learning, and Azure’s modern data stack … want to hear from you. What We’re Hiring For We have multiple opportunities available across our growing capability: 📊 Data Analyst You’ll transform raw data into compelling insights, build enterprise-grade Power BI solutions, and work with Azure technologies such as Data Factory ...

Databricks Data Engineer - Manchester £100,000 | 2 days in office My client, a leading technology consultancy, is seeking an experienced Databricks Data Engineer to join their team on a high-profile engagement with a major insurance client. This is a hands-on technical role focused … designing, building, and optimising cloud-based data integration and analytics solutions in the insurance domain. This is an opportunity to work on complex, enterprise-scale data transformation programmes using cutting-edge Azure and Databricks technologies. Salary and Benefits Highly competitive salary ...

Hiring: Data Consultant – HealthTech We're supporting a leading healthtech provider in their search for a Data Consultant to help implement, configure, support, and maintain complex data pipelines that make a real impact in healthcare. What You'll Be Doing Translating business requirements into … clear technical specifications Ensuring the data warehouse aligns with stakeholder needs Creating, enhancing, and documenting data specifications, including mapping data from NHS source systems into a dimensional data warehouse Developing and delivering solutions for data extraction, integration, and transformation What ...

Data Production & Analysis Manager (Remote – UK Based) Full-time | Competitive salary: up to £80,000 DOE 100% Remote (UK-based only) Growing data & technology organisation Contract type : Permanent We are recruiting a Data Production & Analysis Manager for a rapidly expanding data solutions … undergone significant growth through multiple acquisitions and offers a stable, long-term environment where individuals can take real ownership of complex, high-impact data operations. About 60% of the job is hands-on data processing, 25% analysis, and a smaller share of client-facing work This ...

Position Overview We are seeking a highly skilled Machine Learning Engineer to design, build, deploy, and optimise machine learning models that power data-driven products and business solutions. This role bridges data science and software engineering, focusing on production-ready ML systems, scalability, and performance. … ideal candidate has strong experience in Python, ML frameworks, data pipelines, and cloud platforms, and is comfortable working in a fully remote, collaborative environment within the UK. Key Responsibilities 1. Machine Learning Model Development Design, develop, train, and evaluate machine learning models for prediction, classification, recommendation, or automation ...

with a well‐established, values‐led organisation operating at scale across the travel and leisure sector. They are investing heavily in AI and data, and are now looking to hire a Senior AI/ML Engineer to play a key role in building and productionising machine learning solutions … impact. This is a hands‐on senior engineering role with strong ownership across end‐to‐end AI/ML delivery, working closely with data science, product and engineering teams. The Role: Design, build and maintain scalable, end‐to‐end AI/ML pipelines using Microsoft Fabric Develop, train ...

seeking an experienced Senior AI/ML Engineer to join a high-performing, multi-disciplinary technology team building cutting-edge intelligence and data products. You'll work with complex datasets, modern cloud technologies, and advanced data processing approaches to create scalable, high-impact systems that transform …/graph technologies (e.g., GraphDB) AI/ML platforms (e.g., SageMaker, Bedrock) Search technologies (e.g., Solr, OpenSearch, Elasticsearch) Cloud-based data pipeline engineering (AWS) Produce clean, testable, maintainable code that supports incremental innovation. Build and maintain robust data pipelines, ensuring quality, accuracy, security, and strong ...

Senior Data Engineer Salary £72,000 - £77,500 UK Remote or Hybrid 10% Bonus + Benefits Our UK based client are hiring a hands-on Senior Data Engineer to design and build end-to-end data solutions across projects and long-term data products. You'll play a key role in shaping complex data pipelines, databases, and platform-aligned solutions while mentoring junior engineers and leading by example (no direct line management). Role Designing and building scalable, secure data pipelines from source to consumption Translating high ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern's Digital team, you'll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that's curious, collaborative and ready to learn in a fast-moving digital ...

building management systems (BMS). This role is responsible for creating robust server-side solutions within the Niagara Framework (N4) that enable efficient data exchange, automation workflows, and system interoperability. The specialist will work across a range of building systems and assets including HVAC, lighting, energy metering, environmental … Framework Development Design, develop, and maintain server-side components and logic within the Niagara N4 platform. Build and deploy custom services, APIs, and data flows to support complex multi-system integration requirements. Configure and optimize Niagara stations, drivers, network settings, and performance for large-scale environments. MQTT ...

Senior Data Engineer Contract Role Outside IR35 | £500-525/day | Milton Keynes or Manchester | Hybrid | Initial 7 Months We have a new Senior Data Engineer contract opportunity with a global leading client with offices in both Manchester and Milton Keynes. You'll join a high … impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site, and offers an initial 7-month contract with ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

Data & AI Senior Consultants Location - We are flexible: onsite, hybrid or fully remote, depending on what works for you and the client, UK or Netherlands based. What you will actually be doing This is not a role where you build clever models that never get used. Your focus … creating measurable value for clients using data science, machine learning and GenAI, in a consulting and advisory context. You will own work from the very beginning, asking questions like \"What value are we trying to create here?\" and \"Is this the right problem to solve?\" through ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

Engineer bring? Strong backend development expertise with Go and additional bonus points for Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration … layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part ...

Title: SC Cleared - Data Engineer (Databricks/Azure) Location: Fully Remote (UK-based) Day rate: Up to £400 a day Inside IR35 Clearance: SC Clearance required Contract Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Data Engineer … required to support a large-scale public sector digital transformation programme currently underway. The programme focuses on migrating data from legacy platforms into modern, cloud-based data environments. Key Responsibilities Design, develop and support data pipelines as part of a cloud migration initiative Build ...

Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Cloud Engineer. The programme focuses on migrating data from legacy platforms into modern, cloud-based data environments, with an emphasis on automation, scalability and secure delivery. Key Responsibilities Design, develop … support data pipelines as part of a cloud migration initiative Build and maintain data processing and transformation workflows using Databricks Support the migration of data from legacy systems into cloud-based platforms Configure and maintain CI/CD pipelines using Azure DevOps to support ...

Senior Software Engineer (Data-Centric) Manchester (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud … core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We're Looking ...

awareness: you understand value propositions, return on investment, trade-offs (cost vs speed vs write-down risk), and you factor in risk, compliance, data governance when designing solutions. Key Responsibilities Lead technical discovery and scoping phases with prospective clients: understand their business, compliance, risk, operational, regulatory and data environment. Design solution architectures leveraging Aveni's products (Detect, Assist, Agents, FinLLM) plus integrations with client systems (e.g. CRM, communication tools, data pipelines). Develop, deliver, and customise demos, POCs, workshops to illustrate value, ROI, regulatory compliance, risk mitigation, etc. Collaborate with sales teams to respond ...