1 to 25 of 34 Permanent Data Pipeline Jobs in Bath

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

description S.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers. Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored … clients' needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer, you may play one or more roles according to their clients' needs. The role ...

Contract Type: 5 months (Outside IR35) Location: Remote, United Kingdom Daily Rate: £350 per day We are currently recruiting for an experienced Data Engineer to join a leading consulting firm on a 5-month contract basis. This is a fully remote role, based in the United Kingdom. … with cloud platforms – AWS or GCP is essential, both would be highly beneficial Deep understanding of ETL/ELT processes and data pipeline development Strong problem-solving skills and the ability to work independently in remote settings Excellent communication skills and a consultative mindset This ...

Senior Data Engineer - 100% Remote £70,000 - £80,000 per annum Private Healthcare and Bonus We're hiring a Senior Data Engineer for a UK-based technology company operating at the intersection of healthcare and legal technology. This role exists to build the core data platform that underpins AI and machine learning work. The business is moving beyond fragmented data and needs someone who can design and deliver a structured, secure and compliant data foundation that AI teams can rely on. This is a greenfield role with real ownership. ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Data Architect – Utilities Industry Location: Bath Hybrid (2 days in the office) Salary - £71k to £85k+ 10% Bonus, combined contribution of 20% pension, Health care, Life Insurance Azure | CI/CD | AI/ML Are you a Data Architect passionate about designing modern data … enable AI and advanced analytics? Do you thrive in enterprise environments where you can lead from the front and shape the future of data architecture? If so, we have an exciting opportunity in the utilities sector. What you’ll do As a Data Architect ...

Title: Data Engineer Location: Hybrid/Manchester Rate: £400/day Inside Ir35 Duration: until 31/03/26 to begin with About Us: Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with … experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely with data scientists, analysts, and engineering teams to support ...

Senior Data Engineer – Remote (UK) - £70K-£80K Are you passionate about building robust data solutions that power analytics and business intelligence? We're working with a global organisation seeking a talented Senior Data Engineer to join their IT team and play a key role … shaping their centralised data platform. About the Role As a Data Engineer, you'll design, develop, and maintain scalable data pipelines and integration solutions that enable secure, efficient data flows across the business. You'll collaborate with internal stakeholders and external partners ...

Senior Data Engineer Bristol 12-Month Contract Paying up to £79p/h (Outside IR35) Role Overview: Our client, a large Aerospace company, is looking for an experienced Senior Data Engineer to assist with building and managing data pipelines using the Elastic Stack (Elasticsearch … Logstash, Kibana) and Apache NiFi Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects ...

Data Production & Analysis Manager (Remote – UK Based) Full-time | Competitive salary: up to £80,000 DOE 100% Remote (UK-based only) Growing data & technology organisation Contract type : Permanent We are recruiting a Data Production & Analysis Manager for a rapidly expanding data solutions … undergone significant growth through multiple acquisitions and offers a stable, long-term environment where individuals can take real ownership of complex, high-impact data operations. About 60% of the job is hands-on data processing, 25% analysis, and a smaller share of client-facing work This ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

Position Overview We are seeking a highly skilled Machine Learning Engineer to design, build, deploy, and optimise machine learning models that power data-driven products and business solutions. This role bridges data science and software engineering, focusing on production-ready ML systems, scalability, and performance. … ideal candidate has strong experience in Python, ML frameworks, data pipelines, and cloud platforms, and is comfortable working in a fully remote, collaborative environment within the UK. Key Responsibilities 1. Machine Learning Model Development Design, develop, train, and evaluate machine learning models for prediction, classification, recommendation, or automation ...

MUST HOLD DV CLEARANCE OUTSIDE IR35 This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards … based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern's Digital team, you'll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that's curious, collaborative and ready to learn in a fast-moving digital ...

challenge. We believe we're on the brink of creating something truly awesome. What will you do? We're looking for a Lead Data Engineer to drive the next phase of our data strategy at Midnite. This is a hands-on leadership role where … technical direction, own the design and scalability of our data infrastructure, and ensure the team delivers high-quality, impactful solutions. You'll work across the full data lifecycle from ingestion and modelling to orchestration, monitoring, and analytics enablement, while also mentoring engineers and shaping engineering best ...

DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This … based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. ...

senior Business Intelligence contractor to play a pivotal role in a greenfield Microsoft Fabric implementation, replacing a legacy on-premise SQL data warehouse across a multi-country European organisation. This is a high-impact, advisory-led role for someone who understands Azure and Fabric deeply, can confidently challenge … Doing Provide technical direction and oversight for the migration to Microsoft Fabric Act as the technical conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets ...

building management systems (BMS). This role is responsible for creating robust server-side solutions within the Niagara Framework (N4) that enable efficient data exchange, automation workflows, and system interoperability. The specialist will work across a range of building systems and assets including HVAC, lighting, energy metering, environmental … Framework Development Design, develop, and maintain server-side components and logic within the Niagara N4 platform. Build and deploy custom services, APIs, and data flows to support complex multi-system integration requirements. Configure and optimize Niagara stations, drivers, network settings, and performance for large-scale environments. MQTT ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

Data & AI Senior Consultants Location - We are flexible: onsite, hybrid or fully remote, depending on what works for you and the client, UK or Netherlands based. What you will actually be doing This is not a role where you build clever models that never get used. Your focus … creating measurable value for clients using data science, machine learning and GenAI, in a consulting and advisory context. You will own work from the very beginning, asking questions like \"What value are we trying to create here?\" and \"Is this the right problem to solve?\" through ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration … layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part ...

Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Cloud Engineer. The programme focuses on migrating data from legacy platforms into modern, cloud-based data environments, with an emphasis on automation, scalability and secure delivery. Key Responsibilities Design, develop … support data pipelines as part of a cloud migration initiative Build and maintain data processing and transformation workflows using Databricks Support the migration of data from legacy systems into cloud-based platforms Configure and maintain CI/CD pipelines using Azure DevOps to support ...

with prompt engineering, tool calling, retrieval-augmented generation (RAG), and multi-agent workflows Experience integrating AI into real systems, APIs, event-driven architectures, data pipelines, and automation platforms (e.g. UiPath, Blue Prism) Comfortable experimenting with new models, SDKs, and platforms, and evaluating what's production-ready vs hype ...