1 to 25 of 302 Data Pipeline Jobs in the South West

on financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Summary The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will … be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organisation, ensuring data availability, quality … guiding and upskilling more junior data engineers and setting data standards and guidelines. What you'll do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy, and More ❯

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Make your mark at the world's largest HVAC company Daikin Applied is seeking a talented Data Modeling Lead . The Data Modeling Lead will fulfill a critical function in driving data consistency and adoption as they curate Daikin's Medallion architecture, combining disparate … datasets into cohesive, user-friendly data domains to be explored and visualized by business users. You will lead internal and external data engineers in creating data schemas that represent data domains for each of our key business functions. You will leverage Daikin … s enterprise data platform and work with our digital team to ingest, curate, and serve the necessary solutions. Come be a part of an exciting journey at Daikin Applied, where innovation and excellence drive our every endeavor! Location: Plymouth, MN - Hybrid or Remote What you will do: * Data More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

Are you an experienced Data Engineer with in depth knowledge of both on-premises SQL data warehouses and modern Lakehouse architectures hosted on Azure? Do you enjoy bringing ideas to the table and sharing knowledge with stakeholders? If so, the Data Engineer role here … Microsoft Fabric, including hands-on development and implementation of a robust strategy for transitioning datasets, ETL pipelines, and reporting solutions to the cloud. ETL & Pipeline Development: Build scalable ETL processes using Azure Data Factory, Azure Synapse, and other Fabric-native tools, ensuring a smooth integration between the … migration strategies and ETL development Advanced SQL & Python: Proficiency in writing advanced SQL queries, stored procedures, and Python scripts for data manipulation, pipeline development, and automation ETL & Data Pipelines: Experience with ETL tools (both on-prem like SSIS, and cloud-based like Azure Data More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

Employment Type: Full Time CGI UK Careers - Your mission found here By playing this video you consent to Google/YouTube processing your data and using cookies - Learn more. Position Description: The Space, Defence and Intelligence business unit in CGI is a true IT Systems Integrator. We work … collaboratively with global technology companies, cutting edge SMEs and academia to deliver the optimal solution for each client. We're seeking a Senior Data Engineer to design and lead the implementation of data flows between operational systems and BI/analytics platforms. Our Data Services team manages the ingestion, storage, and availability of diverse datasets, enabling analysts and data scientists to generate insights that support operational and tactical decisions. We're expanding our team of Data Engineers to ingest new datasets and maintain existing ones ensuring data More ❯

Summary Digital Futures is looking for aspiring data engineering consultants to join our Future Talent Programme. The Future Talent Programme offers a unique entry point for individuals looking to start their career in technology. The programme begins with immersive training at the Digital Futures Academy, where trainees gain … to-one mentoring and group project work. Certification – As part of your graduation from the Digital Futures Academy, you will achieve the AWS Data Engineer Associate certification. The cost of your certification is covered by Digital Futures. Employment – Once your deployment has been secured, we will offer you … with data scientists and analysts to ensure that data is properly formatted and accessible. Troubleshooting and resolving data pipeline and infrastructure issues. Helping to design and maintain data warehouses, data lakes, and other data storage solutions. Developing More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes … value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools … to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data More ❯

be part of our journey. Job summary As an Enterprise BI & Analytics Architect at Enable, you will design and implement a cohesive internal data ecosystem that powers scalable reporting and analytics across the organization. You will lead the design of our enterprise BI architecture, define data governance practices, and ensure data quality, consistency, and accuracy. Collaborating with leadership, technical teams, and business stakeholders, you will deliver trusted insights and foster a data-driven culture. Reporting directly to the COO, you’ll play a critical role in defining and enabling Enable … Snowflake. Advanced proficiency in data modeling, data warehousing, and dimensional modeling concepts. Strong command of data transformation and pipeline tools, such as DBT, Apache Spark, or equivalent. Expertise in implementing data governance frameworks, including data quality management, metadata management More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of … per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible … for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and More ❯

Product Owner (Data & Analytics) Bristol Hybrid - 3 days pw onsite £60,000 to £70,000 We currently have an exciting opportunity for a Data Product Owner to join a leading and customer centric financial services company. In this role, you’ll drive the evolution and implementation … of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as … the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate More ❯

Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to … create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of … data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data More ❯

Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior … members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

Leonardo Bristol, England, United Kingdom Join or sign in to find your next job Join to apply for the Senior Data Engineer role at Leonardo Leonardo Bristol, England, United Kingdom 2 weeks ago Be among the first 25 applicants Join to apply for the Senior Data … markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Job Description The Leonardo Cyber & Security Division, one of the three divisions in Leonardo UK, is … with a focus on ensuring data accuracy, quality, and security Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable Experience working in government, defence, or highly regulated industries with knowledge of relevant standards Experience with additional data processing and More ❯

We are seeking a skilled, motivated Data Engineer to join our dynamic and innovative team. As a Data Engineer in the Data & Insight Team you will work as part of a team of data engineers to design, develop, test and maintain data products and our data analytics platform. This is a fantastic opportunity to join our team at a pivotal moment. As we upgrade our data platform to modernise our analytics and AI capabilities, you'll play a crucial role in building the architecture and pipelines … engineering pipelines and products to ingest and transform structured and semi-structured data. Understanding of data modelling techniques and data pipeline design patterns and behaviours. Experience with pipeline management and orchestration tools such as Airflow. Experience with low/no-code pipeline development More ❯

hours per week, Monday to Friday Duration: Permanent Location: Gloucester Job Ref: 203895 About the role Benefact Group is seeking a Lead Data & Analytics Engineer to join our Gloucester office. The role involves leading the design, development, and optimization of cloud-based data pipelines and analytics … solutions using modern cloud technologies. You will ensure scalable, secure, and efficient cloud data services that drive insights across the organization, providing technical leadership and strategic direction. Joining our expanding and innovative group offers a great opportunity to develop your career within an inclusive, purpose-led organization. Key … responsibilities Team Leadership & Management: Manage a team of data engineers, providing mentorship and support to ensure successful project delivery. Foster a collaborative, high-performance environment, supporting the Head of Data Operations in coordinating activities and achieving milestones. Cloud Data Engineering: Lead the design, build More ❯