151 to 175 of 217 Data Pipeline Jobs in the South West

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to … you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively with the wider IT function to enable to organisation to leverage its data and orchestrate data-driven decisions. As part of this role, you will be responsible for. Help create a scalable data platform and integrate data … integrity and a focus on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data Lake, Delta Lake, Azure Synapse More ❯

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to … you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively with the wider IT function to enable to organisation to leverage its data and orchestrate data-driven decisions. As part of this role, you will be responsible for. Help create a scalable data platform and integrate data … integrity and a focus on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data Lake, Delta Lake, Azure Synapse More ❯

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to … you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively with the wider IT function to enable to organisation to leverage its data and orchestrate data-driven decisions. As part of this role, you will be responsible for. Help create a scalable data platform and integrate data … integrity and a focus on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data Lake, Delta Lake, Azure Synapse More ❯

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to … you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively with the wider IT function to enable to organisation to leverage its data and orchestrate data-driven decisions. As part of this role, you will be responsible for. Help create a scalable data platform and integrate data … integrity and a focus on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data Lake, Delta Lake, Azure Synapse More ❯

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data, and Design teams to …/tools: Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object More ❯

Social network you want to login/join with: A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will … come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust … data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps More ❯

that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with … data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning … of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience More ❯

that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with … data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning … of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience More ❯

Social network you want to login/join with: Data Engineering Manager, swindon, wiltshire col-narrow-left Client: McCabe & Barton Location: swindon, wiltshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: A leading Financial Services client in the City of London … is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and … have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Online job hunting tools Experience designing, improving and maintaining robust data pipelines Strong … SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps Experience working in fast-paced More ❯

want to login/join with: South Manchester – Remote (On-site just once a month MAX) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly scaling tech business? This is a great opportunity to join a leading SaaS provider generating close … platform supports millions of users across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the central data warehouse. Working with a fully cloud-based Azure ecosystem More ❯

want to login/join with: South Manchester – Remote (On-site just once a month MAX) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly scaling tech business? This is a great opportunity to join a leading SaaS provider generating close … platform supports millions of users across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the central data warehouse. Working with a fully cloud-based Azure ecosystem More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL, GIS analysis and visualisation. You should be someone … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from … datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python SQL, PostgreSQL PostGIS GIS software - QGIS, Desktop GIS packages AWS FME for data More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL, GIS analysis and visualisation. You should be someone … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from … datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python SQL, PostgreSQL PostGIS GIS software - QGIS, Desktop GIS packages AWS FME for data More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL, GIS analysis and visualisation. You should be someone … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from … datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python SQL, PostgreSQL PostGIS GIS software - QGIS, Desktop GIS packages AWS FME for data More ❯

Data Engineer | Software and Analytics Scale Up | Bristol/Hybrid | £60 - 65,000 + bonus (doe) iO Associates are delighted to be partnering with an exciting Software and Analytics scale up, who are looking for a Data Engineer to join their growing data team. Focused on the IoT devices arena, this Tech-for-Good … to provide technology to those that need it most, and creates a safer environment for all to live in. Key responsibilities: Manage ClickHouse clusters to handle large-scale data storage and analytics. Manage MySQL database performance, including design of data models, query optimization and indexing. Advise and implement elegant data models, working with product … and understanding of database design principles. Experience with NoSQL databases like ElasticSearch, Dynamo DB. Experience with ETL tools and data integration processes. Familiarity with data pipeline orchestration and data streaming technologies such as RabbitMQ, Kinesis, Kafka. Please note that you will be required to work in the Bristol office 4 days per week. More ❯

to improve society by helping people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service. We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust, and … freedom to help us design optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic, but we strive for interactions … things they are good at and enjoy. Methods was acquired by the Alten Group in early 2022. Requirements On-site, Full time. We are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure More ❯

s why we support you to pursue a career that's unique to you. Because success is personal. What you'll be doing Key activities include: Analysing large data sets by applying a variety of logical techniques to make complex problems approachable. Using creativity and collaboration to bring data stories to life through varied and well … designed visualisations. Taking the lead on individual and collaborative projects to enhance the running of the operation. Boosting efficiency through tool creation and process optimisation. Building and maintaining data pipelines using a variety of off the shelf and in-house tools. Being a pioneer of new tech & data concepts to future proof the business. Identifying commercial … opportunities & risks. Being courageous and driving substantive change in the business with incisive, data led recommendations. What skills do you need? Ability to work as part of a team of likeminded data professionals. Power user level of SQL, preferably multiple dialects (Standard, T-SQL, etc.). Experience using visualisation software (Tableau, Power BI, etc.). High More ❯

cloud, while learning new tools and pushing your engineering skills forward. What Youll Do Design and develop robust backend applications using Go/Golang Build scalable APIs and data pipelines integrating with multiple platforms Write clean, well-documented code with strong testing practices Collaborate in agile sprints to deliver high-quality features and improvements Develop and manage CI … ideally Google Cloud Platform , or AWS/Azure Familiar with agile development, version control, and dev standards Confident writing maintainable, scalable, and production-ready code Desirable: CI/CD pipeline experience (GitHub Actions preferred) Experience with microservices , Kubernetes , or serverless architectures Infrastructure automation using Terraform Frontend experience with JavaScript , TypeScript , or frameworks like Svelte , React , or Vue Understanding of More ❯

Location: Birmingham, Bristol, Cambridge, Cardiff, Edinburgh, Gatwick, Glasgow, Leeds, Liverpool, Manchester, Milton Keynes, Newcastle, Reading, Southampton Business Line: Enabling Functions Date published: 28-May-2025 Job Title: Data Analyst/Technical Business Analyst Connect to your Industry: Do you enjoy being the “voice of the business" ensuring that our technology teams deliver solutions that meet business needs? If … so, this opportunity is for you! Deloitte is looking for a mid-level Data Analyst/Technical Business Analyst to join its talented Business Change & Analysis team. Connect to your career at Deloitte: Deloitte drives progress. Using our expertise, we help clients become leaders. We invest in outstanding people, build diverse teams, and empower them to achieve more. … firm, using traditional and innovative tools to enable positive transformation. Industry experience is welcomed but not required. Your role involves ensuring solutions meet business and technical needs, transforming data into insights for strategic decisions, understanding business processes, eliciting requirements, and improving user experience and technical quality. You will also support the Head of Business Analysis in practice development More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in healthcare and biotechnology. ZONTAL has offices in the US, Europe … the job. Your Responsibilities: Be a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution, focusing on overall Platform architecture … sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in healthcare and biotechnology. ZONTAL has offices in the US, Europe … the job. Your Responsibilities: Be a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution, focusing on overall Platform architecture … sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in healthcare and biotechnology. ZONTAL has offices in the US, Europe … the job. Your Responsibilities: Be a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution, focusing on overall Platform architecture … sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in healthcare and biotechnology. ZONTAL has offices in the US, Europe … the job. Your Responsibilities: Be a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution, focusing on overall Platform architecture … sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in healthcare and biotechnology. ZONTAL has offices in the US, Europe … the job. Your Responsibilities: Be a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution, focusing on overall Platform architecture … sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker More ❯