1 to 25 of 54 Data Pipeline Jobs in the South West

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your … to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet business and technical requirements. Process Improvement … years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

Application and Reporting Lead required for my client based near Swindon. A Data Lead is sought by a forward-thinking company near Swindon for a hybrid permanent role, offering a salary of £50,000 to £65,000. Role Overview: You will oversee data-driven decision-making … tools such as MI, BI, and data input solutions. You'll collaborate with Data Engineers, Data Architects, and business stakeholders, leading a team to ensure data integrity and actionable insights. This role requires strong technical acumen, leadership, and a strategic approach to … align data solutions with business objectives. Key Responsibilities: Application, MI, and BI Leadership : Oversee the development and implementation of robust data products for MI and BI systems. Continuously drive innovation by enhancing data tools and improving accessibility. Provide expertise in data input More ❯

resetting the technology requirements to ensure my client is well-placed to deliver maximum value on the new contract term. By leveraging advanced data and reporting tools, the programme aims to enhance performance and efficiency across all departments, digitising operations to streamline processes and reduce manual workloads, complemented … engineering team, you will ensure our ELT processes adhere to best practices, lead the team, and ensure data availability and pipeline orchestration. You will also play a key role in a data platform cloud migration, upskilling and developing rapidly while maintaining our legacy … optimising data pipelines. Strong knowledge of data engineering techniques, ELT processes, data quality frameworks, and data pipeline orchestration. Extensive experience with cloud-based data platforms (e.g., Databricks, Snowflake, FiveTran, Microsoft Fabric). Advanced SQL skills and experience with Microsoft More ❯

An exciting opportunity has arisen with our client a leading defence prime, they are now looking to recruit systems engineer/data engineer, to work out of their Bristol site. This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch … Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and … with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Please send your CV in the first instance More ❯

we value so you may need to travel on occasion to any of our hub offices. About Jisc: Jisc is the UK digital, data and technology agency focused on tertiary education, research, and innovation. We are a not-for-profit organisation with a big ambition to improve lives … sectors. About the role: In this role, you will play a vital part in contributing to the design, implementation and improvement of the data pipelines for complex datasets, with a particular focus on census and international data. This role requires a strong foundation in both data engineering and platform development, with a focus on delivering innovative and scalable solutions. Responsibilities will include: Data Create and maintain robust and scalable data pipelines to ingest, process, and transform data from various sources, ensuring data and metadata quality, accuracy More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company are based in Hampshire and the role is remote with occasional trips to the office when required. As a Principal Data Engineer this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. As a Principal Data Engineer, you will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall … data infrastructure and strategy alignment with business goals. Main Responsibilities include: ' • Develop, design, and test data deliveries throughout the development lifecycle.' • Train and coach developers.' • Manage day-to-day data delivery tasks.' • Collaborate with stakeholders to align data solutions with organizational objectives. More ❯

Data Engineer Hybrid: Remote/Bristol Salary: £70,000 - £75,000 About Us Duel is a SaaS company on a mission to make Brand Advocacy the industry standard playbook for building brilliant retail brands. It was founded by world record breaking adventurer and former brand ambassador Paul Archer … psychologists, brand experts, and community builders, combining cutting edge brand expertise with seasoned SaaS experience. The Role We are implementing a full-scale data warehouse using Snowflake and Kafka. To ensure long-term success, we're hiring a dedicated Data Engineer to own and maintain this … system. As our first dedicated Data Engineer, you will help shape how data is structured, accessed, and used at Duel. You'll work across multiple functions, ensuring that data is not only available but also meaningful and usable to engineers, product managers, and customer More ❯

skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. Job title: Lead Data Engineer at JPMorgan Chase within Corporate Technology As a core technical contributor, you will be responsible for maintaining critical data pipelines and … architectures across multiple technical areas within various business functions to support the firm's business objectives. Job responsibilities Generate data models using firmwide tooling, statistics, and algorithms. Develop data extraction and transformation pipelines in collaboration with other Data Engineers and stakeholders. Deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable manner. Understand key data requirements by working closely with stakeholders. Design and implement secure and effective data solutions with appropriate access control. Create data visualization solutions focusing on User Experience. More ❯

the forefront of industry advancements. My client pride themselves on fostering a collaborative and inclusive work environment where creativity and excellence thrive. The data team is dedicated to pushing boundaries and achieving remarkable results. Your new role As a Principal Data Engineer, you will play a … pivotal role in designing, building, and managing the data infrastructure and systems, supporting the organisation's data strategy. You will be responsible for developing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. Additionally, you … will mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure and strategic alignment with business goals. You will be the 'what does good look like' person, you will always be horizon scanning, you will be the ideas' person, and you will More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

If you're a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation, and you're excited about shaping the future of data in a cloud-first environment, we want to hear from you! This is a fantastic opportunity to join … our client at the start of its major data transformation journey. Their move to the cloud with Microsoft Azure, Fabric, and Synapse technologies will see you work with cutting-edge Cloud and AI-driven analytics, making this an exciting time to be part of its data science team. The role. We are looking for a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation. You will Lead and optimize automated reporting pipelines, ensuring high performance and quality assurance. Build and deploy predictive models, enhancing customer behaviour forecasting More ❯