26 to 40 of 40 Data Pipeline Jobs in the South West

Job summary We're seeking an experienced, forward-thinking Technical Lead to drive the delivery and evolution of the South West Secure Data Environment (SWSDE). This pioneering regional platform is transforming how health and care data is securely and ethically linked for research. Our aim is to improve health and wellbeing by making research safer … forward and grow our capacity to deliver projects. The Technical Lead will build a multi-disciplinary technical team and oversee all aspects of SWSDE's delivery, including infrastructure, data pipelines, security, governance and scalability. You will ensure the environment remains robust, trusted and aligned with the highest standards of data protection and interoperability, including SATRE and … ISO27001, giving partners and the public confidence their data is safe. This hands-on role suits a leader who thrives on managing complexity and problem solving. Collaboration is key, working with partners across the NHS, local authorities, academia and national bodies. This is a rare opportunity to shape a regionally significant, nationally connected data platform, setting More ❯

Senior Data Engineer Location: Trowbridge (Hybrid, 2 days in office) Salary: £70,000 Be part of a forward-thinking data and analytics team shaping the future of our client's operations across the UK, Ireland, and North America. This is a fantastic opportunity to lead data infrastructure projects, including a major cloud migration to … Azure, and support strategic analytics initiatives for both B2C and B2B businesses. Key Responsibilities: Manage and optimize cloud-based data infrastructure (Azure). Lead the migration of data environments to Azure. Maintain high-quality, secure data pipelines with a strong focus on governance. Mentor and support a Data Engineer apprentice. Collaborate across … teams to enhance reporting, analytics, and business intelligence solutions. What You Bring: 5+ years of experience in SQL production environments and data engineering. Strong expertise in SQL, T-SQL, Azure, DataBricks, and SSIS. Experience with data integration, modeling, and performance optimization. Problem-solving mindset and a collaborative approach. Desirable: Experience handling data from APIs More ❯

Data Engineer/Software Engineer – Data Consultancy (Gloucestershire) Salary: £50,000 – £70,000 + £5,000 Training & Development Budget Clearance: Active DV or DV Eligible Location: On-site, in Gloucestershire Type: Permanent | Multiple Roles Available Are you passionate about data engineering and looking to make an impact in a fast-growing, forward-thinking consultancy … We’re recruiting for a Data Consultancy that delivers cutting-edge data-driven solutions to clients across highly secure environments. 🔍 What You’ll Do As a Data Engineer/Software Engineer , you’ll be working on complex data challenges—designing, building, and maintaining data pipelines and analytical systems that drive … people from a variety of technical backgrounds — what matters most is your ability to code and solve problems. You’ll need: Strong SQL skills Proficiency in Python (for data processing, ETL, or automation) The ability to work effectively in a collaborative, on-site team environment Active DV clearance , or eligibility to obtain it 🎓 What’s On Offer More ❯

Data Engineer/Software Engineer – Data Consultancy (Gloucestershire) Salary: £50,000 – £70,000 + £5,000 Training & Development Budget Clearance: Active DV or DV Eligible Location: On-site, in Gloucestershire Type: Permanent | Multiple Roles Available Are you passionate about data engineering and looking to make an impact in a fast-growing, forward-thinking consultancy … We’re recruiting for a Data Consultancy that delivers cutting-edge data-driven solutions to clients across highly secure environments. 🔍 What You’ll Do As a Data Engineer/Software Engineer , you’ll be working on complex data challenges—designing, building, and maintaining data pipelines and analytical systems that drive … people from a variety of technical backgrounds — what matters most is your ability to code and solve problems. You’ll need: Strong SQL skills Proficiency in Python (for data processing, ETL, or automation) The ability to work effectively in a collaborative, on-site team environment Active DV clearance , or eligibility to obtain it 🎓 What’s On Offer More ❯

Senior Data Engineer At BNY, our culture allows us to run our company better and enables employees growth and success.As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the worlds investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients … finance and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary. Were seeking a future team member for the role of Senior Data Engineer, Vice President , to join our Investment Management Engineering team. This role is located in London . In this role, youll make an impact in the following ways: Lead … the design and development of data pipelines feeding the BNY Investments analytical platform, ensuring high quality and performance. Provide architectural oversight by designing scalable, secure, and cost-efficient data systems tailored to support BNYs Investments business needs. Contribute to the design and development of AI/ML initiatives ongoing in BNY Investments Mentor and coach junior More ❯

Senior Data Engineer At BNY, our culture allows us to run our company better and enables employees growth and success.As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the worlds investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients … finance and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary. Were seeking a future team member for the role of Senior Data Engineer, Vice President , to join our Investment Management Engineering team. This role is located in London . In this role, youll make an impact in the following ways: Lead … the design and development of data pipelines feeding the BNY Investments analytical platform, ensuring high quality and performance. Provide architectural oversight by designing scalable, secure, and cost-efficient data systems tailored to support BNYs Investments business needs. Contribute to the design and development of AI/ML initiatives ongoing in BNY Investments Mentor and coach junior More ❯

We are looking for 8+ years experienced highly skilled Software Engineer with strong experience in Java, Spring, and Microservices development, along with exposure to big data processing and cloud-native technologies. The ideal candidate will design, build, and maintain scalable systems that process large volumes of data in real time. JD: Design, develop, and maintain scalable … microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services in containerized environments (Docker/Kubernetes). Write efficient and optimized SQL queries for relational databases. Integrate and manage … programming skills in Java and Spring Boot. Hands-on experience with Microservices architecture and RESTful APIs. Proficiency with Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda More ❯

New Contract Opportunity for a multiple Security Cleared Data Scientists with an Industry Leading National Security Consultancy in Cheltenham. Active eDV (West) Required Up to £850 p/d Inside IR35 6-12 month engagement Urgent requirement - ASAP start 3-4 days on site per week in Cheltenham The Role As a Data Scientist, you’ll … work within a multidisciplinary team to extract insight from complex, high-volume datasets. You’ll design and implement advanced analytical and machine learning models, develop robust data pipelines, and deliver actionable intelligence to inform decision-making at the highest levels. This role offers the opportunity to apply your technical skills to highly operational challenges in a fast-paced … secure setting. You’ll work closely with engineers, analysts, and mission specialists to ensure data-driven outcomes that make a tangible difference. Key Responsibilities Perform data wrangling , cleaning, transformation, and preparation of large, complex datasets Develop and deploy machine learning models to solve real-world operational problems Write clean, maintainable Python code for data More ❯

New Contract Opportunity for a multiple Security Cleared Data Scientists with an Industry Leading National Security Consultancy in Cheltenham. Active eDV (West) Required Up to £850 p/d Inside IR35 6-12 month engagement Urgent requirement - ASAP start 3-4 days on site per week in Cheltenham The Role As a Data Scientist, you’ll … work within a multidisciplinary team to extract insight from complex, high-volume datasets. You’ll design and implement advanced analytical and machine learning models, develop robust data pipelines, and deliver actionable intelligence to inform decision-making at the highest levels. This role offers the opportunity to apply your technical skills to highly operational challenges in a fast-paced … secure setting. You’ll work closely with engineers, analysts, and mission specialists to ensure data-driven outcomes that make a tangible difference. Key Responsibilities Perform data wrangling , cleaning, transformation, and preparation of large, complex datasets Develop and deploy machine learning models to solve real-world operational problems Write clean, maintainable Python code for data More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. More ❯

that this is a fully on site role, and candidates for this role are required to hold an active DV security clearance. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in a military setting. Our growing … team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Liaise closely with … Strong python proficiency, or familiarity with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness program 25 days annual leave More ❯

that this is a fully on site role, and candidates for this role are required to hold an active DV security clearance. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in a military setting. Our growing … team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Liaise closely with … Strong python proficiency, or familiarity with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness program 25 days annual leave More ❯

growth in a world-class technology environment Key Responsibilities Define and implement AI/ML security strategies, policies, and architectures. Design secure AI/ML models, systems, and data pipelines. Conduct AI risk assessments and develop mitigation strategies. Ensure data security, privacy, and compliance with GDPR, ISO 27001, and the EU AI Act. Lead AI/ More ❯