1 to 25 of 44 Data Pipeline Jobs in the South West

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your … to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet business and technical requirements. Process Improvement … years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of … their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and … secure data capabilities. This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the … team's growth, and help shape our overall data strategy. On a typical day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product More ❯

you ready to make a significant impact in the UK's leading investment services company? We are on a mission to revolutionize our data strategy by building core data hubs that serve as a single source of truth for our business. Our evolving data estate on AWS and Snowflake is at the heart of this transformation, consolidating key data areas such as client, account, and market reference data hubs. As a Senior Data Engineer, you will lead the engineering efforts for these data hubs … are a highly skilled data engineer with experience in working with high volume data/low latency data pipeline with the following skills. Data Engineering Skills Modelling Orchestration using Apache Airflow Cloud native streaming pipelines using Flink, Beam etc. DBT Snowflake More ❯

Data Engineer - Salisbury - £55,000-£65,000 - Hybrid My client is looking for a highly skilled Data Engineer to join our growing data team. This role is ideal for someone with strong experience in Azure data services and a passion for building … scalable, secure, and cost-effective data pipelines that support analytics and BI initiatives. You’ll work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure is reliable, performant, and compliant. Key Responsibilities Design, build, and maintain robust ETL/ELT … architecture and processes meet security, privacy, and compliance standards (e.g., GDPR, encryption, access controls). Support CI/CD and data pipeline automation best practices. Must-Have Skills Strong hands-on experience with Azure Synapse Analytics, Data Factory, and Data Lake Storage. More ❯

Senior Data Engineer Bristol 6-month contract Paying up to 80p/h (Outside IR35) Please note that due to the nature of the work you must be hold or be eligible to obtain DV level security clearance Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

Post Processing and Analysis (PP&A) products and developments .These products and developments are a critical part of the Met Office data pipeline, delivering essential weather forecast data to a range of end users including Operational Meteorologists, key customers and end users including Defence and … Data Provisioning customers. The products and services enable our users to consume and interrogate supercomputer data in a way which meets their needs and enables them to exploit ever growing datasets to ultimately help them make better decisions so that citizens stay safe and thrive.Our Senior … Product Manager role is within the Government Digital and Data (GDaD) profession, adopted by the Met Office as guidance to ways of working to ensure our public digital services meet government standards. • Manage and lifecycle Met Office data products, such as PP&A products, maximising the More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

J Job Advertisement: Mid-Level Data Scientist/Data Analyst Location: Hybrid in Bristol (2-3 days a week) Contract Type: Permanent Salary: £50,000 - £60,000 depending on experience Are you passionate about data and excited to make a real impact in the … the next level, we want to hear from you! Position Overview: We are on the lookout for a talented and experienced Mid-Level Data Scientist/Data Analyst to spearhead the development and operation of our cutting-edge automated ingestion system. If you thrive in a … dynamic, agile environment and have a knack for designing sophisticated data ingestion pipelines with advanced ML components, this role is made for you! Key Responsibilities: Automated Ingestion System Development: Lead the design, development, and maintenance of advanced data ingestion pipelines, ensuring they are efficient, scalable, and More ❯

/non-tariff Department Insights It's an exciting time to join us! RWE Supply & Trading has recently introduced a new cloud-based data analytics platform. We are expanding our team and looking for an experienced Software Engineer to play a key role in enhancing our platform capabilities. … The Lead in Data (LiD) platform has revolutionized data searching, sharing, transforming, and onboarding within our organization. Data is central to our trading and analysis activities and will continue to be a vital asset across the group. You will apply your expertise in C# … and .NET to develop robust data services within the Mix system and help future-proof our architecture from security and technological perspectives. Experience with AWS environments is highly desirable. If this sounds appealing, then apply now! Your future responsibilities Design and develop scalable back-end services and APIs More ❯

Data Engineer Hybrid: Remote/Bristol Salary: £70,000 - £75,000 About Us Duel is a SaaS company on a mission to make Brand Advocacy the industry standard playbook for building brilliant retail brands. It was founded by world record breaking adventurer and former brand ambassador Paul Archer … psychologists, brand experts, and community builders, combining cutting edge brand expertise with seasoned SaaS experience. The Role We are implementing a full-scale data warehouse using Snowflake and Kafka. To ensure long-term success, we're hiring a dedicated Data Engineer to own and maintain this … system. As our first dedicated Data Engineer, you will help shape how data is structured, accessed, and used at Duel. You'll work across multiple functions, ensuring that data is not only available but also meaningful and usable to engineers, product managers, and customer More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

If you're a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation, and you're excited about shaping the future of data in a cloud-first environment, we want to hear from you! This is a fantastic opportunity to join … our client at the start of its major data transformation journey. Their move to the cloud with Microsoft Azure, Fabric, and Synapse technologies will see you work with cutting-edge Cloud and AI-driven analytics, making this an exciting time to be part of its data science team. The role. We are looking for a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation. You will Lead and optimize automated reporting pipelines, ensuring high performance and quality assurance. Build and deploy predictive models, enhancing customer behaviour forecasting More ❯

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment; as such, those with only theoretical viewpoints will not be considered. The ideal candidate will be able … maintain an end-to-end advanced analytics solution on cloud. You will have exposure to cloud, preferably in Microsoft Azure, build and maintain data pipelines, understand CI/CD for end-to-end cloud solutions, be able to manage and maintain pre-existing ecosystems, and be competent in … Build and maintain data pipelines (including those from 3rd party sources and APIs) Identifying and patching issues and bugs identified in the pipeline/architecture Working as part of a data specialist team to deliver quality service to engagement clients Providing access and identity management More ❯

Are you looking for a role where you can implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that values collaboration … and flexibility? If you’re a Data Engineer with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to £100K, alongside benefits including … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As a Senior Data Engineer, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Contract- outside IR35 Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key … role in the technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality … Snowflake environment to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Contract- outside IR35 Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key … role in the technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality … Snowflake environment to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical More ❯

Data Engineer | Bristol | Up to 70,000 depending on experience We are partnering with a growing energy company in their search for a Data Engineer to join their team. They are a leading energy trading company with a global presence, and they are making waves across … the market, so you won't want to miss out! Responsibilities: Acquire and store UK and EU energy market data efficiently. Develop and enhance batch and real-time data pipelines. Collaborate with frontend and data science teams to optimize data processes. Audit … databases and enhance data querying efficiency. Prepare datasets for modelling and analysis. Experience required: Proficiency in Python and SQL. Degree in a quantitative/computational discipline. 2+ years of relevant experience in data engineering. Experience in data modelling and end-to-end data More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key role in the … technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality Snowflake environment to … support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical solutions with strategic More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key role in the … technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality Snowflake environment to … support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical solutions with strategic More ❯