1 to 25 of 47 Data Pipeline Jobs in Somerset

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your … to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet business and technical requirements. Process Improvement … years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data More ❯

Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of … systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform. System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness. Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business … needs and analytic strategies. Scalability & Security: Implement and enforce best practices for data security, quality, and scalability across our data infrastructure. Essential Skills: Healthcare Data Expertise: Proven experience in designing and managing data solutions within healthcare environments. Demonstrated ability to work with More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Benefits Annual Leave More ❯

Data Engineer/Data Scientist (Imaging & Data Labelling) Location: Southwest UK (On-site/Hybrid) Clearance: Sole British National with active SC Clearance Engagement: Contract – Outside IR35 Overview: We are seeking a skilled Data Engineer/Data Scientist with strong … experience in data labelling and imaging datasets to support a critical defence-related project in the Southwest UK. The ideal candidate will have a solid background in building and managing data pipelines, annotating and labelling image-based data for machine learning workflows, and working … contributor in preparing high-quality datasets to support AI and ML initiatives in a mission-critical context. Key Responsibilities: Develop and maintain robust data pipelines to ingest, clean, transform, and store large volumes of imaging data. Lead and support the data labelling process—developing tools and More ❯

Azure Data Engineer/Consultant – Up to £75K + Bonus Location: Remote (UK-based, with very occasional travel) Salary: Up to £75,000 + bonus Company & role Join one of the UK’s most advanced Microsoft partners, specialising in Azure-led Data & AI solutions. This consultancy … is known for transforming data into tangible value through innovative platforms and strategic data services. With a collaborative team of experts, they deliver impactful solutions across enterprise clients, leveraging the very latest in Microsoft technology. Why This Role Stands Out Play a key role in shaping … across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion Architecture (Bronze, Silver, Gold layers) in lakehouse or Databricks environments Familiarity More ❯

Azure Data Engineer Remote (UK-based) Up to £60,000 per annum About the Company We are a leader in the insurance sector, committed to data-driven decision making and modernising our technology landscape. As part of our continued growth, we’re seeking a skilled Azure … Data Engineer to support our data platform and engineering initiatives. Role Overview As an Azure Data Engineer, you will be instrumental in designing, building, and optimising data pipelines and architecture in our Azure environment. This role is ideal for someone with strong … SQL skills and a background in Azure data services, looking to play a key role in transforming and scaling our data operations. Key Responsibilities Develop and maintain scalable data pipelines in Azure. Build and optimise data integration workflows using Azure Data More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that … for their very first Data Engineer. You’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. You’ll be leading on the design and implementation of scalable, secure data pipelines - getting … experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to More ❯

collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and … C#. This role would suit an experienced Data platform engineer or Data Solutions Architect who thrives in working across multiple projects with a diverse range of clients, and who places the importance of bridging the gap between complex data problems and real life product More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

Job Title: Data Operations Engineer Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 8am to 16:30pm The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic … opportunity has arisen for a strong data engineer to work in the data engineering team to maintain robust data pipelines. We’re looking for a business focussed individual, who can work independently in time sensitive situations to ensure the reliability of data … on issues impacting them managing Data Warehouse small change overseeing deployments maintaining documentation on team processes designing and maintaining data pipeline performance reporting The Person We are looking for someone who can roll their sleeves up and ‘dig in’ with the rest of the team. More ❯

Data Engineer We’re working with a forward-thinking Microsoft partnered consultancy who are looking for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. … You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights creation. … This is a fantastic opportunity for someone who is passionate about building scalable, high-performance data solutions utilising the latest cutting-edge cloud technologies. As part of this role, you will be responsible for some of the following areas • Design and develop scalable data pipelines to More ❯

a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable … Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data More ❯

Job Title: Data Analyst Location: LS12, On-site Reports To: Marketing Director/Operations Manager Job Type: Full-Time Salary: £40- £45k DOE About Yorkshire Dental Suite Yorkshire Dental Suite is a leading private dental practice, known for its innovative approach to patient care, advanced cosmetic treatments, and … a commitment to excellence. As we continue to grow, we’re looking for a data-driven professional to help us make smarter business decisions through insightful analysis and strategic guidance. Role Overview We're looking for a proactive Data Scientist/Analyst to join our growing … performance across all areas of the business, with a strong focus on marketing campaigns, lead generation, and conversion rates. Using HubSpot and other data sources, you’ll be responsible for turning data into actionable insights that drive growth and optimise performance. Key Responsibilities Analyse data More ❯

Integration · Design, build and maintain AI-driven information retrieval and generation workflows · Securely integrate and manage external and internal AI services · Develop advanced data matching and search solutions · Architect effective interaction frameworks and context-management strategies · Collaborate on extending core model capabilities and protocols Data Engineering … Design and maintain data pipelines for efficient data processing · Ensure efficient data flow between systems and LLM components · Implement data validation, transformation, and enrichment processes · Optimise data storage and retrieval for AI/ML workloads Security & Compliance · Implement security best … understanding of software design principles and coding standards Preferred Skills and Capabilities · Experience with vector databases and embedding models · Knowledge of data pipeline tools and ETL processes · Familiarity with React or other frontend technologies for better cross-team collaboration · Experience implementing LLM integration frameworks · Background in pharmaceutical More ❯

leading-edge finance solutions through a unique combination of teamwork and technology. From this continued success we are now looking to recruit a Data Analyst to allow us to continue our exciting growth plans. Our aim is to take the service we offer to the next level, to … d like to be part of? As a key member of our team, you’ll be responsible for translating business requirements into practical data models, reports, and dashboards that deliver real insights Role responsibilities; Stakeholder Engagement: Collaborate with key stakeholders across the business to understand their data needs, gather requirements, and provide clear insights that drive decision-making. Data Modelling & Analysis : Design, develop, and maintain scalable data models to ensure data quality and accuracy, utilising SQL and Azure Synapse where necessary. Dashboard Development: Build and maintain visually compelling and More ❯

Are you ready to join us and shape the future of data? As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data solutions using Microsoft Azure’s ecosystem—including Azure Synapse Analytics, Databricks, and Microsoft Fabric … to deliver innovative solutions across various projects. You will empower our clients to harness their data, drive decision-making, and achieve their business goals. What You’ll Do: Solution Design & Development : Architect and implement scalable, high-performance data solutions using Microsoft Azure technologies, adhering to best … practices for robust delivery. Design and maintain ETL/ELT pipelines, optimize storage solutions, and document technical workflows Data Management & Integration: Integrate structured and unstructured data, develop efficient data models for analytics and reporting, and ensure security, compliance, and data quality. Collaboration More ❯

Are you ready to join us and shape the future of data? As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data solutions using Microsoft Azure’s ecosystem—including Azure Synapse Analytics, Databricks, and Microsoft Fabric … to deliver innovative solutions across various projects. You will empower our clients to harness their data, drive decision-making, and achieve their business goals. What You’ll Do: Solution Design & Development : Architect and implement scalable, high-performance data solutions using Microsoft Azure technologies, adhering to best … practices for robust delivery. Design and maintain ETL/ELT pipelines, optimize storage solutions, and document technical workflows Data Management & Integration: Integrate structured and unstructured data, develop efficient data models for analytics and reporting, and ensure security, compliance, and data quality. Collaboration More ❯

Recruitment Company is working with an Environmental and Sustainability Business that supports and empower their customers journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting … and data requirements. About the role: The Data Engineer will be working with the latest innovative technologies, to design, build and maintain data solutions, constructing process to surface data both internally for reporting purposes and externally through the customer portal. The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources whilst ensuring data quality under the framework of a new Data Platform for real time application integration and reporting, and will work closely with business stakeholders More ❯

Senior Backend Engineer (Platform Experience & Data Warehousing teams) 👩🏽‍💻 Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland 🌍 numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space … We are looking for experienced Senior Backend Engineers (PHP) to join either our Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualization tool (dashboards) and … build features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) 👩🏽‍💻 Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland 🌍 numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space … We are looking for experienced Lead Backend Engineers (PHP) to join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build … features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer More ❯

and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work. Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back … in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains. We hold top-level partnership statuses with all … and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such More ❯

Data Engineer (Azure, SQL, ETL, Databricks, Data Factory) South Manchester – Remote (On-site just once a month MAX) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly … across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the … company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the More ❯

Data Engineer | Bristol | Up to 70,000 depending on experience We are partnering with a growing energy company in their search for a Data Engineer to join their team. They are a leading energy trading company with a global presence, and they are making waves across … the market, so you won't want to miss out! Responsibilities: Acquire and store UK and EU energy market data efficiently. Develop and enhance batch and real-time data pipelines. Collaborate with frontend and data science teams to optimize data processes. Audit … databases and enhance data querying efficiency. Prepare datasets for modelling and analysis. Experience required: Proficiency in Python and SQL. Degree in a quantitative/computational discipline. 2+ years of relevant experience in data engineering. Experience in data modelling and end-to-end data More ❯

Engineer will be doing . You will be leading on the design, implementation and maintenance of core data modelling, storage and pipeline solutions; using stakeholder requirements to guide your decisions. Building effective and scalable data pipelines, models and storage - driving the team forward and … bring to the team You will have a solid coding skills, ideally in Python - with the ability to work in a multicloud environment - demonstrating pipeline tracking, usage monitoring and cost management. Demonstrable skills with Python coding and SQL Awareness of how to work within Azure/AWS/GCP … Experience of pipeline building, data modelling, and analytical models/machine learning. Experience of leading a team and projects, with ability to support workload prioritisation and personal development Here's What You'll Get in Return Salary of up to 72,000 Pension scheme with employer contributions More ❯