176 to 200 of 217 Data Pipeline Jobs in the South West

Iambic Therapeutics. You will be a key player in applyingadvanced software engineering skills to build technologies that support our drugdiscovery efforts. Your key responsibilities include development of training data workflows for the training of machine-learning (ML) models and scalable deployment of machine-learning technologies, and creation, testing and maintenance of software systems.This role is remote, with preference … Iambic platform has demonstrated delivery of new drug candidates to human clinical trials with unprecedented speed and across multiple target classes and mechanisms of action. Iambic is advancing a pipeline of potential best-in-class and first-in-class clinical assets, both internally and in partnership, to address urgent unmet patient need. Learn more about the Iambic team, platform … pipeline, and partnerships at iambic.ai . MISSION & CORE VALUES Our mission is to deliver better medicines through innovations in AI-based discovery technologies. The culture and work at Iambic Therapeutics are profoundly strengthened by the diversity of our people and our differences in background, culture, national origin, religion, sexual orientation, and life experiences. We are committed to building an More ❯

to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and … best practices Working closely with the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number of applications we expect to … What you'll bring: Previous experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing Solid scripting and automation skills More ❯

to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you’ll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and … best practices Working closely with the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number of applications we expect to … What you’ll bring: Previous experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing Solid scripting and automation skills More ❯

A forward-thinking engineering organisation is seeking a Senior Software Engineer to play a key role in the development of a new greenfield platform designed to transform how data is ingested, analysed, and visualised across critical infrastructure. You’ll join a cross-functional, agile team of software engineers and product experts to help shape the architecture, design, and … stakeholders to align software with business needs What you’ll need: Strong experience building production systems with Java and the Spring ecosystem Proven backend system design expertise (APIs, data layers, infrastructure) Experience with GraphQL and REST APIs Proficient in writing testable code and using testing frameworks like JUnit Familiarity with CI/CD tools (e.g., GitLab, Gradle) and … cloud platforms (Azure preferred) Excellent communication skills and a proactive mindset Agile development experience Bonus experience (not essential): Knowledge of data pipelines or ETL processes Exposure to frontend technologies Benefits: 26 days holiday + bank holidays (option to buy/sell 5 days) Private medical insurance Enhanced pension scheme Life assurance Flexible working hours (core 10am–3pm) Cycle More ❯

will play a key role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Role Overview: Develop ETL processes to extract and normalise capacity data from infrastructure … sources. Automate data ingestion and processing into SQL Server databases. Normalising raw infrastructure and monitoring data into structured formats suitable for graphing and trending Collaborate with DBAs and technical teams to ensure transparency and supportability. Build data flows that support capacity reporting and trending, using modern technologies. Skills & Experience Required: 3+ years' experience in … ETL/data processing roles. Proficiency with ETL tools, SQL Server, RESTful APIs. Experience working with infrastructure data (e.g., Nutanix, VMware, Dell EMC desirable). Scripting experience in Python, SQL (T-SQL), Excel VBA. Knowledge of data optimisation, large datasets, JSON/XML formats. Experience of setting up SQL DTSS and Control/M More ❯

ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯

the job done using data to drive decisions and inform growth? Obsessed with Big Data? Interested in understanding how you build a data pipeline that becomes the lifeblood of our digital teams? Do you live to drive actionable insights that steer strategy, drive business performance and change the way we view the digital … landscape? At Screwfix, our omnichannel approach provides a wealth of data to do exactly that and allows us to understand how customers interact with our business, across multiple touchpoints that help shape the way customers purchase from us. Delving into analytics tools such as GA4, ContentSquare, PowerBI and Tealium, feeding insights into the wider digital team, helping create … a data driven ecosystem that is hugely valued within the business to continue to evolve and iterate on our proposition. Join our dynamic team as a key player in shaping the future of our web channels! Reporting to the Senior Ecommerce Analytics & Insight Manager, you'll be central to our efforts to understand what drives our online success. More ❯

We’re hiring a Data Engineer to join a long-term programme within the National Data Exploitation Capability (NDEC) - a critical function supporting both national and international investigations into the most serious and organised crime. This role sits at the heart of the UK’s ability to rapidly process and exploit large volumes of data … Tech Stack: - Microsoft SQL Server Stack: SQL Server, SSIS, C#, T-SQL - Python, Apache Airflow - Elastic/OpenSearch (interchangeable) Experience Required: - Proven ability to design, build and maintain data pipelines - Experience in system integration, ETL, and managing structured/unstructured data - Background in working within secure, enterprise-scale environments - Strong understanding of data quality … to enhance your existing clearance This is a unique opportunity to apply your engineering expertise to a national mission, enabling law enforcement to act quickly and confidently using data-led insights. If you’re looking for a purposeful technical challenge in a secure and high-trust environment, we’d like to hear from you. #J-18808-Ljbffr More ❯

year support for production-grade software systems, with engineers switching between these in line with their career aspirations and development plans. The Opportunity Roke is recruiting for a Data Architect who is driven by solving varied and interesting client problems. Data Architect will be responsible for the strategy, architecture and high level design of data … in a pre-sales capacity to develop relationships and solutions that can support future business growth. For this specific role, we are seeking someone with strong experience in data strategy and governance, who can design data pipelines and data platforms for both structured and unstructured data applications, they will be supported by … a team of data engineers to deliver on the strategy and designs. The ideal candidate will have a passion for supporting the development of capability within their own technical area. This senior position will be pivotal to capability development through; involvement with business development activities, supporting our account managers in the development of customer offerings to address market More ❯

systems engineering to help shape and deliver the future of our client's systems landscape. This role is instrumental in defining strategy, managing capabilities, and enhancing tool and data integrations within a complex engineering environment. Key Responsibilities: Define and oversee the strategic direction of the software and systems architecture. Provide leadership in capability management and future capability planning. … Develop and evolve technical solutions aligned with long-term engineering goals. Design and enhance metric dashboards using Power BI and integrate with relevant databases. Ensure seamless interaction and data flow between tools such as IBM DOORS and Cameo. Apply a holistic infrastructure viewpoint to assess and evolve the tool-chain. Use Python and Back End development skills to … automate, integrate, and optimise systems and work-flows. Contribute to IT and system architecture frameworks that support engineering and data management. Collaborate with internal teams to understand current tool usage and data pipelines, and drive improvements. Skills & Experience: Demonstrable experience as a Software Architect within systems engineering or complex engineering environments. Deep understanding of IT infrastructure More ❯

and prototyping to secure deployment and ongoing support. Key Responsibilities: Leading the design and development of Python-based software systems in a high-security setting Working closely with data scientists, analysts, and engineering teams to deliver scalable, reliable solutions Architecting secure applications and services in line with defence-grade standards Mentoring developers and enforcing best practices across code … testing, and deployment Integrating machine learning models and real-time data pipelines where applicable Collaborating with stakeholders to gather requirements and showcase technical progress Essential Skills & Experience: Proven expertise in Python development in production environments Experience in secure or regulated industries (Defence, Government, Aerospace, etc.) Solid grasp of CI/CD, containerisation (Docker/Kubernetes), and cloud or More ❯

and prototyping to secure deployment and ongoing support. Key Responsibilities: Leading the design and development of Python-based software systems in a high-security setting Working closely with data scientists, analysts, and engineering teams to deliver scalable, reliable solutions Architecting secure applications and services in line with defence-grade standards Mentoring developers and enforcing best practices across code … testing, and deployment Integrating machine learning models and real-time data pipelines where applicable Collaborating with stakeholders to gather requirements and showcase technical progress Essential Skills & Experience: Proven expertise in Python development in production environments Experience in secure or regulated industries (Defence, Government, Aerospace, etc.) Solid grasp of CI/CD, containerisation (Docker/Kubernetes), and cloud or More ❯

the job done using data to drive decisions and inform growth? Obsessed with Big Data? Interested in understanding how you build a data pipeline that becomes the lifeblood of our digital teams? Do you live to drive actionable insights that steer strategy, drive business performance and change the way we view the digital … landscape? At Screwfix, our omnichannel approach provides a wealth of data to do exactly that and allows us to understand how customers interact with our business across multiple touchpoints that help shape the way customers purchase from us. Delving into analytics tools such as GA4, ContentSquare, PowerBI and Tealium, feeding insights into the wider digital team, helping create … a data driven ecosystem that is hugely valued within the business to continue to evolve and iterate on our proposition. Join our dynamic team as a key player in shaping the future of our web channels! Reporting to the Senior Ecommerce Analytics & Insight Manager, you'll be central to our efforts to understand what drives our online success. More ❯

Partner Experience Manager you will have the unique opportunity to support sustainable revenue growth in EMEA region by informing business decisions with diverse and reliable partner (our customer) data sets Join us as a Partner Experience Manager and be a visionary force behind partner success and lead transformative initiatives across Pax8 - leveraging data, research, and feedback … of the partner experience Why Join Us As a Partner Experience Manager Lead Strategic Initiatives: Drive cross functional programs to shape and elevate a world class partner experience Data Driven Insights: Leverage data, tools, and feedback to define partner personas, map journeys, and identify growth opportunities Craft Unique Value Propositions: Design differentiated experiences that resonate with … Partner Support: Deliver high impact, value added reporting and insights that empower top tier partners to succeed Decode The Voice Of the Partner: Continuously analyse feedback and engagement data to uncover trends, highlight wins, and surface opportunities for an exceptional partner experience Spot And Seize Improvement Opportunities: Leverage reports and dashboards to identify actionable enhancements across the partner More ❯

for this role are required to hold at least an active SC security clearance, and be willing and eligible to obtain DV. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in a military setting. Our growing … team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Liaise closely with … Strong python proficiency, or familiarity with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness program 25 days annual leave More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Data Engineer - Remote - £65,000 My client, a growing, high-impact consultancy is looking for a hands-on Data Engineer to join its expert team. Working across a mix of exciting, high-profile clients in various different sectors. You will join their expanding team to build robust platforms and create intelligent solutions. If you thrive in … fast-paced environments, enjoy variety in your work, and want to build meaningful data products using Snowflake, dbt, Python, and SQL, this role is for you. Requirements: Experience designing and building scalable data pipelines using Snowflake, dbt, and Python Proven experience as a Data Engineer or Analytics Engineer Great knowledge of Snowflake SQL optimization … and warehouse design experience Strong Python skills for scripting, orchestration, and data manipulation Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and More ❯

In this role, the Data Scientist will be responsible for analyzing large sets of sales, market, and supply chain data to drive accurate demand forecasts. Supports the activities within Consumer Products for Sales, Marketing, and management relative to annual planning, long-term planning, monthly tracking, and analysis of the demand plan. This position will interact with … CP Sales, Trade, Finance, Operations, Logistics, and Marketing to facilitate the planning process (mid to long term). Your Story. In this role, the Data Scientist will analyze large datasets related to sales, market, and supply chain to develop demand forecasts. The role supports Consumer Products activities across Sales, Marketing, and management for planning purposes, including annual, long … Assistance Access to Employee Store What You Do. Analyze historical sales, promotions, and market trends to forecast product demand using statistical models and machine learning algorithms. Integrate external data sources, such as competitor pricing, economic indicators, and consumer sentiment, to improve forecast accuracy. Develop and automate predictive models to optimize long-term forecasting, collaborating with the Sr. Marketplace More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯