1 to 25 of 79 Data Pipeline Jobs in Bristol

on financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Summary The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will … be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organisation, ensuring data availability, quality … guiding and upskilling more junior data engineers and setting data standards and guidelines. What you'll do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy, and More ❯

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

Are you an experienced Data Engineer with in depth knowledge of both on-premises SQL data warehouses and modern Lakehouse architectures hosted on Azure? Do you enjoy bringing ideas to the table and sharing knowledge with stakeholders? If so, the Data Engineer role here … Microsoft Fabric, including hands-on development and implementation of a robust strategy for transitioning datasets, ETL pipelines, and reporting solutions to the cloud. ETL & Pipeline Development: Build scalable ETL processes using Azure Data Factory, Azure Synapse, and other Fabric-native tools, ensuring a smooth integration between the … migration strategies and ETL development Advanced SQL & Python: Proficiency in writing advanced SQL queries, stored procedures, and Python scripts for data manipulation, pipeline development, and automation ETL & Data Pipelines: Experience with ETL tools (both on-prem like SSIS, and cloud-based like Azure Data More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes … value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools … to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of … per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible … for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and More ❯

Product Owner (Data & Analytics) Bristol Hybrid - 3 days pw onsite £60,000 to £70,000 We currently have an exciting opportunity for a Data Product Owner to join a leading and customer centric financial services company. In this role, you’ll drive the evolution and implementation … of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as … the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate More ❯

Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to … create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of … data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data More ❯

Leonardo Bristol, England, United Kingdom Join or sign in to find your next job Join to apply for the Senior Data Engineer role at Leonardo Leonardo Bristol, England, United Kingdom 2 weeks ago Be among the first 25 applicants Join to apply for the Senior Data … markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Job Description The Leonardo Cyber & Security Division, one of the three divisions in Leonardo UK, is … with a focus on ensuring data accuracy, quality, and security Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable Experience working in government, defence, or highly regulated industries with knowledge of relevant standards Experience with additional data processing and More ❯

We are seeking a skilled, motivated Data Engineer to join our dynamic and innovative team. As a Data Engineer in the Data & Insight Team you will work as part of a team of data engineers to design, develop, test and maintain data products and our data analytics platform. This is a fantastic opportunity to join our team at a pivotal moment. As we upgrade our data platform to modernise our analytics and AI capabilities, you'll play a crucial role in building the architecture and pipelines … engineering pipelines and products to ingest and transform structured and semi-structured data. Understanding of data modelling techniques and data pipeline design patterns and behaviours. Experience with pipeline management and orchestration tools such as Airflow. Experience with low/no-code pipeline development More ❯

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to be readily available for reporting. The business have office locations around the UK, however their technology hub is based just outside of Bristol and you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively … on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data More ❯

Senior Data Engineer I am looking for a Senior Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand … new data warehouse that will enable data to be readily available for reporting. The business have office locations around the UK, however their technology hub is based just outside of Bristol and you would work collaboratively with the Engineering manager and other Engineers. You will also … on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data More ❯

to safeguard and secure the future of our organisation. About the role Hear from the Hiring Manager "We are looking for a skilled Data Engineer to join our team and help us build robust data pipelines and infrastructure. This role is crucial for ensuring the availability … and quality of data for our business intelligence and analytics initiatives." Please note this is a hybrid role, with the expectation of working at our office in Bradley Stoke (BS32 4QQ) or another NRS site a minimum of two days per week. Key Deliverables Design, develop, and maintain … across all data platforms. Optimise data storage and retrieval processes for performance and efficiency. Monitor and troubleshoot data pipeline issues to ensure smooth operation. Stay updated with the latest data engineering technologies and best practices. Document data engineering processes More ❯

Data Engineer/Data Scientist (Imaging & Data Labelling) Location: Southwest UK (On-site/Hybrid) Clearance: Sole British National with active SC Clearance Engagement: Contract – Outside IR35 Overview: We are seeking a skilled Data Engineer/Data Scientist with strong … experience in data labelling and imaging datasets to support a critical defence-related project in the Southwest UK. The ideal candidate will have a solid background in building and managing data pipelines, annotating and labelling image-based data for machine learning workflows, and working … contributor in preparing high-quality datasets to support AI and ML initiatives in a mission-critical context. Key Responsibilities: Develop and maintain robust data pipelines to ingest, clean, transform, and store large volumes of imaging data. Lead and support the data labelling process—developing tools and More ❯

Principal Data Engineer Location: Bristol (hybrid) Salary: Competitive + 28% pension contributions Job type: Permanent/fulltime or 6 - 12 month contract (both option available) Summary of any essential experience required for the role Strong Python programming knowledge, ideally Pyspark Knowledge of the Azure Databricks platform and associated … and to take a pragmatic, collaborative approach to solving problems. Adept at communicating technical concepts to a nontechnical audience. Awareness of the modern data stack and associated methodologies You will be a key individual contributor and be responsible for: Building and developong re-useable pipelines for analytics and … and Data to grow the platform and release new capabilities Deploying production AI models with automated monitoring from the data pipeline to the model runs and outputs As well as supporting the team responsibilities on: Work to Extract, Load & Transform (ELT) data sets More ❯

Join to apply for the Senior Data Engineer (GCP/Kafka) role at Lloyds Banking Group Join to apply for the Senior Data Engineer (GCP/Kafka) role at Lloyds Banking Group This range is provided by Lloyds Banking Group. Your actual pay will be based … work in the UK without requiring sponsorship, to be considered for this position. ABOUT THIS OPPORTUNITY A great opportunity has arisen for a Data Engineer to work within the Personalised Experiences and Communications Platform to join product engineering cross functional teams. As a Data Engineer your … responsibilities will be delivering the highest quality data capability, drawing upon your engineering expertise, whilst being open minded to the opportunities the cloud provides. What you'll be doing... Building reusable data pipelines at scale, work with structured and unstructured data, and feature engineering More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, bristol col-narrow-left Client: Location: bristol, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead … Data scientist - Equity-Only role 1% About Luupli Luupli is a social media app 'in-development', which will provide opportunities for diverse creators coming from marginalized communities. Luupli will highlight the work of diverse creators and provide them access to all the opportunities in the social media space. … Job Description: As a Lead Data Scientist at Luupli, you will play a pivotal role in leveraging AWS analytics services to analyse and extract valuable insights from our data sources. You will collaborate with cross-functional teams, including data engineers, product managers, and business More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling … looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the design and implementation of scalable, secure data pipelines - getting experimental … and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that … for their very first Data Engineer. You’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. You’ll be leading on the design and implementation of scalable, secure data pipelines - getting … experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to More ❯

Job Title: Data & AI Engineer, Associate Manager CL8 Locations: London/Bristol/Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically … Sweet, Accenture CEO Key responsibilities · Deploy machine learning models to production and implement measures to monitor their performance · Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice · Define, document and iterate data mappings based on concepts and … Python · Extensive experience with cloud platforms (AWS, GCP, or Azure) · Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc ) o Software development best practices including CI/CD, TDD and More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in … a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution … software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and More ❯

Senior Data Engineer (GCP/Kafka) Apply locations: Bristol Harbourside, London 25 Gresham Street Time type: Full time Posted on: Posted Yesterday Time left to apply: End Date: May 12, 2025 (25 days left to apply) Job requisition id: 111909 End Date: Sunday 11 May 2025 Salary Range … Flexible Working Options: Hybrid Working, Job Share Job Description Summary: A great opportunity has arisen for a Data Engineer to work within the Personalised Experiences and Communications Platform to join product engineering cross functional teams. As a Data Engineer, your responsibilities will include delivering the highest … quality data capability, drawing upon your engineering expertise, whilst being open-minded to the opportunities the cloud provides. What you’ll be doing... Building reusable data pipelines at scale, working with structured and unstructured data, and feature engineering for machine learning or curating data More ❯

JOB TITLE: Senior Data Engineer SALARY: Bristol £70,930 - £86,690 per annum | London £82,000 - £100,200 per annum LOCATION(S): Bristol or London HOURS: Full-time - 35 hours per week WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week … work in the UK without requiring sponsorship, to be considered for this position. ABOUT THIS OPPORTUNITY A great opportunity has arisen for a Data Engineer to work within the Personalised Experiences and Communications Platform to join product engineering cross functional teams. As a Data Engineer your … responsibilities will be delivering the highest quality data capability, drawing upon your engineering expertise, whilst being open minded to the opportunities the cloud provides. What you'll be doing Building reusable data pipelines at scale, work with structured and unstructured data, and feature engineering More ❯

multi-modal datasets into high-quality training inputs for cutting-edge AI models for drug discovery. You'll help evolve our data pipeline and storage infrastructure to support faster, more reliable turnarounds for research and development of new models. You'll join a multidisciplinary team, collaborating closely … degree; or a PhD with 3 years experience; or equivalent experience. Proven ability to design flexible, maintainable ETL systems. Experience with data pipeline orchestration tools such as Prefect, Airflow, Argo, Databricks, or Spark. Understanding of the ML model lifecycle; prior work with scientific or ML workflows is … of new drug candidates to human clinical trials with unprecedented speed and across multiple target classes and mechanisms of action. Iambic is advancing a pipeline of potential best-in-class and first-in-class clinical assets, both internally and in partnership, to address urgent unmet patient need. Learn more More ❯