1 to 25 of 30 Data Pipeline Jobs in the South West

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

New Contract Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – full time on site when required Must hold active Enhanced DV Clearance (West) Circa £600 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

New Contract Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – full time on site when required Must hold active Enhanced DV Clearance (West) Circa £600 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission … critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client's National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and More ❯

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team … in London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across MUFG's EMEA banking and securities entities. This is a hands-on leadership role, combining technical expertise with mentoring and team leadership. Key Responsibilities Architect, design and deliver enterprise-wide EDM … and data solutions. Lead and mentor EDM developers, ensuring high-quality, cost-effective delivery. Drive data innovation, automation and best practices across EMEA. Translate business requirements into functional and technical designs. Ensure compliance with SDLC, governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … of the company's data and drive data-led decision-making. As part of this role, you will be responsible for some of the following areas Architect and build a scalable data platform integrating diverse data sources Develop and maintain robust, efficient data pipelines Write clean, reliable code to transform More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … of the company's data and drive data-led decision-making. As part of this role, you will be responsible for some of the following areas Architect and build a scalable data platform integrating diverse data sources Develop and maintain robust, efficient data pipelines Write clean, reliable code to transform More ❯

Data & Analytics Engineer 12 Month FTC Liberty Wines is modernising its data estate: migrating from on-prem Analysis Services to the cloud, moving our WMS, ERP and bespoke apps to scalable platforms, and expanding AI/ML initiatives. We are evaluating both Fabric and Databricks as a potential strategic fit. As our hands-on Data … needs based on your experience and contributing to successful delivery on either. You will work end-to-end, from schema design to dashboard storytelling, and be the pivotal data voice in the Technology team. This role offers broad ownership across tooling, standards, engineering and enablement rather than being confined to a narrow BI silo. Key Responsibilities Data … tools such as Data Factory, Dataflow Gen2, Databricks Workflows, or similar orchestration frameworks Experience with Python and/or PySpark for data transformation, automation, or pipeline development Familiarity with cloud services and deployment automation (e.g., Azure, AWS, Terraform, CI/CD, Git) Ability to deliver clear, insightful, and performant data visualisations and dashboards More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

Reports to: Data Director/Executive Sponsor Location: Remote with occasional travel to London (2 times a month) Contract: Full-time, permanent Base Salary: £60,000 £75,000 dependent on location and experience + 10% bonus scheme Why This Role Exists Serve Legal is forging new ground: transforming operational data into market-ready products, algorithms, and … insights that redefine client value. As a driver of our Innovation Labs, you will experiment, prototype, and build compelling data solutions in a startup-within-a-business environmentboldly iterating and owning proofs-of-concept that scale. This is a position with a balance between data science and engineering. Besides exploring and analysing datasets, you will help … to establish a cloud native data foundations, with a data warehouse and supporting data pipelines. You will be expected to use AI tools where possible to help explore, analyse and transform data. What Youll Do Build Data Products & Algorithms: Prototype and refine predictive models (e.g., compliance forecasting, anomaly detection, NLP-based feedback More ❯

Principal Data Engineer - Azure Databricks (Unity Catalog) - Contract Location: Bristol - Hybrid - 2 days a week in the office Contract Length: 12 Months Day Rate: Negotiable Job Ref: J12998 A data for good organisation that is in the early stages of building a modern Analytics and Data Engineering function, are looking to bring in a … Principal Data Engineer to support and lead key elements of this transformation. This is a fantastic opportunity for someone who enjoys building data platforms from the ground up, mentoring teams, and deploying cutting edge solutions in a collaborative environment. In this role, the successful candidate will be responsible for designing and implementing scalable, reusable data … team upskill, and embed best practices across the function. They will also lead on bringing AI models into production, ensuring robust monitoring, alerting, and data pipeline reliability are in place to support long-term success. Key Responsibilities: Build and maintain scalable data pipelines for analytics and AI use cases. Lead the deployment of More ❯

every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity We're looking for a skilled Data Lake Reporting Assistant Manager to join our team and play a key role in developing and maintaining our data lake reporting environment. You'll work closely with … experienced data analysts and engineers to deliver impactful reports that help us understand our business better. Key responsibilities include: Collaborate closely with senior data analysts and engineers, contributing to the development and implementation of our reporting strategy. Learn and apply industry best practices for data warehousing, reporting, and visualization. Data Lake Reporting … Environment: Become proficient in navigating and understanding data lake architecture. Assist in implementing data quality checks and validation processes to ensure accurate and reliable reporting. Work alongside data engineers to understand and optimize data pipelines for reporting needs. Translate business requirements into technical specifications for reports and dashboards, working with senior team More ❯

Contract Data Engineer – Up to £500 per day (Outside IR35) 6 months | 3 days per week on-site in Gloucester We’re supporting a leading organisation through a period of growth and transformation, seeking an experienced Data Engineer to join on a contract basis. This role sits within a global data team and will … focus on designing, developing, and maintaining data architecture and pipelines. You’ll be working with stakeholders across the business to ensure data is accessible, reliable, and driving actionable insight. The role: Design, build, and maintain data pipelines and warehouse solutions Administer and optimise Snowflake in line with best practice Build data models … using Kimball Dimensional Modelling Leverage dbt, Fivetran, and Power BI for data transformation and reporting Deliver dashboards and reports up to executive level Support data governance, quality, and compliance across multiple environments Collaborate with a global team and business stakeholders to ensure data strategy aligns with wider objectives Skills & experience required: Strong Data More ❯

Cyber Insights Analyst City of London (Hybrid) Up to £55,000 + 20% Bonus Are you passionate about using data to solve complex problems and deliver real business impact? A global leader within Insurtech are looking for a Cyber Insights Analyst to join their global Cyber Insights & Analytics team. This is a hands-on role where you’ll … transform diverse data sources. Ranging from policy and claims to cyber threat intelligence and incident response, into actionable insights that strengthen our underwriting decisions and frameworks. With their data strategy making strong progress, this is an exciting opportunity for someone with a few years’ experience in analytics or data science to take the next … manage reporting for underwriting class and product leaders. • Investigate underwriting performance queries and provide actionable insights. • Design, develop, and validate predictive models to inform underwriting decisions. • Work with data engineering teams to design and maintain Azure Databricks pipelines. • Support the automation of data-driven deliverables for proactive services. • Identify and resolve data issues, recommending More ❯

are to drive a modern digital government, by: joining up public sector services harnessing the power of AI for the public good strengthening and extending our digital and data public infrastructure elevating leadership and investing in talent funding for outcomes and procuring for growth and innovation committing to transparency and driving accountability We are home to the Incubator … for Artificial Intelligence (I.AI), the world-leading GOV.UK and at the forefront of coordinating the UK's geospatial strategy and activity. We lead the Government Digital and Data function and champion the work of digital teams across government. We're part of the Department for Science, Innovation and Technology (DSIT) and employ more than 1,000 people all … difference across the UK. You'll solve some of the nation's highest-priority digital challenges, helping millions of people access services they need. The GDS IDEA (Insight, Data Science, Economics, and Analysis) Unit is looking for talented data scientists to join our dynamic, high-impact, multidisciplinary team. We combine cutting-edge AI, advanced data More ❯

codebase. Key Responsibilities Lead the design, development, and testing of secure, scalable systems using Python or Java with modern front-end frameworks (e.g., React) Architect and maintain APIs, data pipelines, and cloud-native solutions (AWS, Azure, private cloud) Drive adoption of DevOps practices CI/CD, containers, infrastructure-as-code Guide and mentor engineers, promoting best practice, clean More ❯

We are searching for a Data Analyst/GIS Analyst for an extremely exciting technology and data focused business. The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore need to live within a commutable distance of … that underpin various digital products and services. You will ensure the quality of these datasets and provide support to the wider business. You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success! Working as a Data Analyst/GIS … with the ability to plan, allocate and manage workloads for yourself and other team members. You will also have the following: - A qualification in either a GIS or Data related discipline or equivalent professional experience. Practical experience of working in a data analysis role, a data curation role or a data focused More ❯

Data Engineer - PySpark - Palantir - London - £75K Join a dynamic team dedicated to innovative data solutions in Soho! We are seeking a Data Engineer with expertise in PySpark to play a pivotal role as the team and business grow. This permanent, hybrid position offers a unique opportunity to contribute to impactful projects while enjoying a … supportive and collaborative work environment.Key Responsibilities:- Develop and optimise data pipelines using PySpark to ensure efficient data processing- Collaborate with cross-functional teams to deliver high-quality, data-driven insights- Engage in continuous learning and implement best practices in data management- Participate in the deployment and maintenance of data solutions … within the Microsoft ecosystemThe ideal candidate will have strong analytical skills and a passion for data engineering. You will thrive in a setting that values innovation and teamwork. Salary is up to £75,000 plus share options.If you are ready to make a meaningful impact and grow your career, we encourage you to apply for this exciting opportunity More ❯

About The Role We are looking for an experienced Test Manager with a strong background in data platform testing, particularly across Microsoft Fabric, Azure services, PySpark notebooks, and automated testing frameworks. You will play a pivotal role in ensuring quality and governance across data pipelines, lakehouses, and reporting layers. This role requires a hands-on leader … . Lead and manage the QA effort across multiple agile teams. Drive the development and maintenance of automated testing for: 1-PySpark notebooks in Fabric/Databricks 2-Data pipelines and transformations 3-Delta tables and lakehouse validation Embed testing into CI/CD pipelines (Azure DevOps or GitHub Actions). Ensure quality gates are enforced through all … stages of the medallion architecture (bronze, silver, gold). Define test approaches for schema validation, data reconciliation, and business rule testing. Collaborate with data engineers, architects, product owners, and DevOps to deliver high-quality, scalable solutions. Establish reusable patterns for parameterized notebook testing and data-driven assertions. Own test planning, execution, environment readiness, and More ❯

scheme Internal coaching/mentoring system throughout your time here Focus on training and career progression Family friendly policies Happy to talk about flexible working The Opportunity The Data Analyst is the subject matter expert for a set of datasets that underpin Landmark’s many products and services. You will be responsible for ensuring the quality and currency … migration. In addition, the team also gets involved in project work where you may be asked to contribute based on your technical or domain expertise. About You The Data Analyst will be inquisitive with a desire to understand and resolve problems. You will also be an effective communicator, with the ability to plan, allocate and manage work for … yourself and junior team members. You will also have/be: A qualification in GIS or Data related discipline or equivalent professional experience Practical experience of working in a data analysis or data curation role Practical experience of authoring ETL/ELT processes following current best data governance practises, of problem-solving More ❯

Geospatial Specialist/Developer will support project delivery and tendering operations by providing reliable, efficient, and insightful geospatial services. This role involves developing tools, automating processes, and creating data-driven applications to enhance geospatial workflows across the business. The successful candidate will play a key role in promoting geospatial thinking across disciplines, with a focus on data … Prepare and manage project mapping deliverables, datasets, and spatial databases. Provide geospatial input for tendering activities, including baseline mapping, statistics, and spatial analysis. Maintain the company's geospatial data infrastructure to ensure consistency across projects. Contribute geospatial insights to reports, charts, and presentations. Integrate and manage spatial data from multiple sources. Support spatial QA/QC … and the standardisation of geospatial outputs. Geospatial Development Design, develop, and maintain geospatial tools to automate workflows supporting offshore surveys, 3D modelling, and spatial data analysis. Build and maintain reusable scripts and ETL pipelines (e.g., QGIS, Python, JavaScript). Develop and support web-based and/or script-driven geospatial applications. Explore advanced methods for spatial data More ❯

The Role Unite Students have an exciting opportunity for a Business Intelligence Developer to join our Data & Insight team in Bristol on a six month fixed-term contract. As we upgrade our data platform to modernise our analytics and AI capabilities, you will play a pivotal role in our enterprise-wide transformation programme, rebuilding our most … business-critical Tableau dashboards using data from our new platforms. Reporting to the Senior Analytics Manager, you will work at pace to deliver high-quality, user-friendly dashboards that enable commercial teams to make confident, data-driven decisions. Alongside this, you may also contribute to smaller projects across the business, supporting the team`s wider objectives. … Recreate and enhance business-critical sales dashboards in Tableau, ensuring accuracy and usability. Partner with stakeholders to understand requirements and translate them into clear, actionable dashboards. Collaborate with data engineers to ensure data pipelines and models align with reporting needs. Work within a multi-capability project team, contributing to the successful delivery of the wider transformation More ❯

doing? Are you an analyst who loves to see your insights make an impact? We're looking for a curious and driven Business Intelligence Analyst to join our Data & Business Intelligence team and support our B2B division. You'll be the go-to data expert for our B2B Audience, Sales, and Product teams, transforming complex data … drive growth for the division. You'll report to the Business Intelligence Manager for B2B and be a true partner to the business, solving challenging questions, building innovative data solutions, and directly influencing key decisions. If you thrive on solving puzzles and want to see your work shape business strategy, we'd love to hear from you. Key … provide analytical recommendations that guide strategic initiatives. Design, build, and maintain intuitive reports and dashboards in Looker that empower teams with self-serve insights. Develop and optimise robust data pipelines using tools like Dataform in Google BigQuery to ensure our data is reliable and efficient. Dive deep into our data to uncover trends, identify More ❯

PLEASE NOTE: We will consider graduates who have a degree inEngineering, Software, IT or a closely related discipline along with data skills. Quest Global is an organisation at the forefront of innovation and one of the worlds fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are … peer review project and technical reports. Work Experience Required Qualifications & Experience: Bachelors degree (minimum) in Engineering , Software, IT or a closely related discipline. Knowledge and awareness of assessing data and producing summary reports. Able to develop a project specification with colleagues, often including those from other engineering disciplines. Able to produce details of specifications, outline designs and recommend … to changing requirements and customer needs. Solution orientated mindset and the ability to consider the bigger picture. Experience with the Microsoft Office Suite (Intermediate+) Comfortable working with unstructured data and building data pipelines . A good awareness of data quality and structure. An eye for detail. More ❯