1 to 25 of 35 Data Pipeline Jobs in the South West

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your … to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet business and technical requirements. Process Improvement … years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of … their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

Data Engineer (Security Clearance) Position Description The Space, Defence and Intelligence business unit in CGI is a true IT Systems Integrator. We work, build, and operate bespoke, technically complex, mission-critical systems which help our clients keep us all safe and secure. We bring innovation to our clients … collaboratively with global technology companies, cutting edge SMEs and academia to deliver the optimal solution for each client. We're seeking a Senior Data Engineer to design and lead the implementation of data flows between operational systems and BI/analytics platforms. Our Data Services team manages the ingestion, storage, and availability of diverse datasets, enabling analysts and data scientists to generate insights that support operational and tactical decisions. We're expanding our team of Data Engineers to ingest new datasets and maintain existing ones ensuring data More ❯

to your opportunity As a practitioner, you will bridge the gap between client needs and technical solutions. Your main responsibility is to make data valuable by developing pipelines that ingest, transform, and enrich high-volume, diverse data into accessible, trusted information assets for actionable insights. You … will manage deliverables and client relationships, delivering solutions using agile methodologies across multidisciplinary teams and industries. Your responsibilities may include: Applying data engineering tools and frameworks to create standardized data for AI and reporting. Designing and implementing high-quality data pipelines and stores. Introducing … candidates with both technical and business skills who can articulate the value of their work, with experience in: End-to-end data pipeline development. Working with diverse data types and sources. Architectural design for scalable data solutions. Data modeling, warehouse design More ❯

you ready to make a significant impact in the UK's leading investment services company? We are on a mission to revolutionize our data strategy by building core data hubs that serve as a single source of truth for our business. Our evolving data estate on AWS and Snowflake is at the heart of this transformation, consolidating key data areas such as client, account, and market reference data hubs. As a Senior Data Engineer, you will lead the engineering efforts for these data hubs … are a highly skilled data engineer with experience in working with high volume data/low latency data pipeline with the following skills. Data Engineering Skills Modelling Orchestration using Apache Airflow Cloud native streaming pipelines using Flink, Beam etc. DBT Snowflake More ❯

Data Engineer/Data Scientist (Imaging & Data Labelling) Location: Southwest UK (On-site/Hybrid) Clearance: Sole British National with active SC Clearance Engagement: Contract – Outside IR35 Overview: We are seeking a skilled Data Engineer/Data Scientist with strong … experience in data labelling and imaging datasets to support a critical defence-related project in the Southwest UK. The ideal candidate will have a solid background in building and managing data pipelines, annotating and labelling image-based data for machine learning workflows, and working … contributor in preparing high-quality datasets to support AI and ML initiatives in a mission-critical context. Key Responsibilities: Develop and maintain robust data pipelines to ingest, clean, transform, and store large volumes of imaging data. Lead and support the data labelling process—developing tools and More ❯

Senior Data Engineer Bristol 6-month contract Paying up to 80p/h (Outside IR35) Please note that due to the nature of the work you must be hold or be eligible to obtain DV level security clearance Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

Group Enterprise Data Architect Location: Cheltenham, UK (Hybrid working) Benefits: 27 days holiday plus Wellbeing day, Private Medical Insurance, Bonus scheme, Sharescheme, Enhanced pension plan, Life assurance, Discount scheme. Role Overview: Join Spirax Group as a Group Enterprise Data Architect , reporting directly to the Group Head … of Data and Analytics. This hybrid role requires a minimum of four days per month in Cheltenham and occasional travel. You will shape our global data strategy, influence business unit architects, and promote consistency in enterprise data architecture. Your objectives and responsibilities will focus … on Leading the strategic direction for data solutions across the Spirax Group. Collaborating with stakeholders and IS/IT teams to understand needs and deliver tailored data solutions. Mentoring Data/IT colleagues via a Community of Excellence. Building relationships with technology partners, evaluating More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

J Job Advertisement: Mid-Level Data Scientist/Data Analyst Location: Hybrid in Bristol (2-3 days a week) Contract Type: Permanent Salary: £50,000 - £60,000 depending on experience Are you passionate about data and excited to make a real impact in the … the next level, we want to hear from you! Position Overview: We are on the lookout for a talented and experienced Mid-Level Data Scientist/Data Analyst to spearhead the development and operation of our cutting-edge automated ingestion system. If you thrive in a … dynamic, agile environment and have a knack for designing sophisticated data ingestion pipelines with advanced ML components, this role is made for you! Key Responsibilities: Automated Ingestion System Development: Lead the design, development, and maintenance of advanced data ingestion pipelines, ensuring they are efficient, scalable, and More ❯

/non-tariff Department Insights It's an exciting time to join us! RWE Supply & Trading has recently introduced a new cloud-based data analytics platform. We are expanding our team and looking for an experienced Software Engineer to play a key role in enhancing our platform capabilities. … The Lead in Data (LiD) platform has revolutionized data searching, sharing, transforming, and onboarding within our organization. Data is central to our trading and analysis activities and will continue to be a vital asset across the group. You will apply your expertise in C# … and .NET to develop robust data services within the Mix system and help future-proof our architecture from security and technological perspectives. Experience with AWS environments is highly desirable. If this sounds appealing, then apply now! Your future responsibilities Design and develop scalable back-end services and APIs More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

Are you ready to join us and shape the future of data? As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data solutions using Microsoft Azure’s ecosystem—including Azure Synapse Analytics, Databricks, and Microsoft Fabric … to deliver innovative solutions across various projects. You will empower our clients to harness their data, drive decision-making, and achieve their business goals. What You’ll Do: Solution Design & Development : Architect and implement scalable, high-performance data solutions using Microsoft Azure technologies, adhering to best … practices for robust delivery. Design and maintain ETL/ELT pipelines, optimize storage solutions, and document technical workflows Data Management & Integration: Integrate structured and unstructured data, develop efficient data models for analytics and reporting, and ensure security, compliance, and data quality. Collaboration More ❯

If you're a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation, and you're excited about shaping the future of data in a cloud-first environment, we want to hear from you! This is a fantastic opportunity to join … our client at the start of its major data transformation journey. Their move to the cloud with Microsoft Azure, Fabric, and Synapse technologies will see you work with cutting-edge Cloud and AI-driven analytics, making this an exciting time to be part of its data science team. The role. We are looking for a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation. You will Lead and optimize automated reporting pipelines, ensuring high performance and quality assurance. Build and deploy predictive models, enhancing customer behaviour forecasting More ❯

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment; as such, those with only theoretical viewpoints will not be considered. The ideal candidate will be able … maintain an end-to-end advanced analytics solution on cloud. You will have exposure to cloud, preferably in Microsoft Azure, build and maintain data pipelines, understand CI/CD for end-to-end cloud solutions, be able to manage and maintain pre-existing ecosystems, and be competent in … Build and maintain data pipelines (including those from 3rd party sources and APIs) Identifying and patching issues and bugs identified in the pipeline/architecture Working as part of a data specialist team to deliver quality service to engagement clients Providing access and identity management More ❯

What you'll be doing Are you ready to contribute to the evolution of our data pipelines for our B2C division? At Future, we are transforming our data-driven decision-making processes and we are looking for a passionate and experienced Data Engineer to … join us. This is an exciting opportunity for someone who excels in a creative environment, enjoys solving complex data challenges, and is eager to build impactful business insights, for this role you will directly report into the Head of Data Engineering The Data & Business … Intelligence team guides our organisation to become more data-driven. By ensuring visibility of objective performance data, we empower our teams to make rapid, informed decisions that enhance overall performance. Important Responsibilities include and not limited to; Develop and maintain new/current features of the More ❯

Engineer will be doing . You will be leading on the design, implementation and maintenance of core data modelling, storage and pipeline solutions; using stakeholder requirements to guide your decisions. Building effective and scalable data pipelines, models and storage - driving the team forward and … bring to the team You will have a solid coding skills, ideally in Python - with the ability to work in a multicloud environment - demonstrating pipeline tracking, usage monitoring and cost management. Demonstrable skills with Python coding and SQL Awareness of how to work within Azure/AWS/GCP … Experience of pipeline building, data modelling, and analytical models/machine learning. Experience of leading a team and projects, with ability to support workload prioritisation and personal development Here's What You'll Get in Return Salary of up to 72,000 Pension scheme with employer contributions More ❯

Engineer will be doing . You will be leading on the design, implementation and maintenance of core data modelling, storage and pipeline solutions; using stakeholder requirements to guide your decisions. Building effective and scalable data pipelines, models and storage - driving the team forward and … bring to the team You will have a solid coding skills, ideally in Python - with the ability to work in a multicloud environment - demonstrating pipeline tracking, usage monitoring and cost management. Demonstrable skills with Python coding and SQL Awareness of how to work within Azure/AWS/GCP … Experience of pipeline building, data modelling, and analytical models/machine learning. Experience of leading a team and projects, with ability to support workload prioritisation and personal development Here's What You'll Get in Return Salary of up to £72,000 Pension scheme with employer contributions More ❯

Principal Data Consultant (Snowflake/Matillion) Application Deadline: 18 June 2025 Department: Data Engineering Employment Type: Full Time Location: Bristol, UK Compensation: £85,000 - £100,000/year Description As a Principal Data Consultant, at Snap, you'll be at the forefront of our … most strategic initiatives. Your role will involve leading client engagements, managing large-scale projects, and shaping Snap's approach to modern cloud data platforms. You'll also contribute as a thought leader, developing insights and sharing expertise internally and externally while mentoring others and driving innovation across the … leader by authoring blogs, presenting at webinars, and engaging in external speaking opportunities. Technical Delivery Excellence You'll design and optimise cloud-based data architectures (e.g. Snowflake, Databricks, Redshift, Google BigQuery, Azure Synapse) to support advanced analytics. You'll build and automate scalable, secure, and high-performance data More ❯

the clean-energy revolution - starting withsmarter, safer, and more efficient homes.We're focused on improving experiences for people through the application of technology, data, and a deep understanding of human behaviour. Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing … core, then we'd love to hear from you! The Role We're looking to grow our quality and test coverage in our data space. In this Intermediate-Senior role,you'll be helping us to implement processes, architectures and test coverage for validating our data backend with your excellent software skills and guidance. We have an existing small team working and building the data backend and we need a QA engineer to work with the team to verify and validate this part of our product. Some of the things that you More ❯

About The Role We are seeking a Lead Fabric Engineer to drive the design, development, and delivery of modern data solutions, using Microsoft Fabric. This is a hands-on, technical leadership role requiring deep expertise in data engineering, Azure, and lakehouse architectures. The successful candidate will … play a critical role in shaping and implementing enterprise-scale data platforms that support advanced analytics, reporting, and data governance. Leading a team of talented engineers, you'll ensure that best practices, performance, and scalability are at the heart of everything we deliver. Key Responsibilities Leading … the end-to-end implementation of data solutions, using Microsoft Fabric (OneLake, Lakehouse, Dataflows, Pipelines, Notebooks, Semantic Models). Building and maintaining data pipelines using medallion architecture (bronze/silver/gold layers). Collaborating with stakeholders, architects, and analysts to understand data needs More ❯