51 to 75 of 106 Data Pipeline Jobs in the South West

Senior Data Engineer Ledbury/Malvern/Gloucester/Cheltenham Area On-site - 5 Days Per Week Up to £85,000 + Benefits Security Clearance: Active SC Clearance Required Methods Business and Digital Technology is a £100M+ IT Services Consultancy delivering complex digital transformation programmes across government … regulated sectors. We are seeking an experienced Senior Data Engineer to join a growing team supporting the delivery of secure, mission-critical data platforms. This role requires an individual who is comfortable operating across hybrid environments, combining on-premises infrastructure with Azure cloud technologies to deliver ...

external market. Exceptions above the standard range are managed through governance controls to protect internal equity. Your impact At Leonardo, our Principal Data Engineers lead the design and delivery of secure, scalable data solutions that underpin critical defence, government, and commercial operations. As a technical authority … people manager, youll guide engineering teams through the full data lifecycletransforming raw data into actionable insight across hybrid and cloud environments. This role blends technical leadership, stakeholder engagement, and team development, offering the opportunity to shape data strategy and capability across multiple programmes. Your ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting high-profile government programmes, is hiring a DV Cleared Data Engineer … join a critical, secure environment. This role involves designing, building, and maintaining robust data pipelines and platforms to enable advanced analytics and intelligence operations. What you'll be doing: Develop, optimise, and support scalable data pipelines (batch and streaming) within secure environments. Manage ETL/ ...

skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorganChase within the [insert LOB or sub LOB], you are an integral part of an agile team that works to enhance, build … recovery, and archiving strategy Preferred qualifications, capabilities, and skills Proven experience working in SRE or Infrastructure Deployment roles, Mid level data pipeline or analytical product creation Proven Data Quality issue root cause analysis ABOUT US J.P. Morgan is a global leader in financial services, providing ...

Data Engineer 6 Month Contract Location: Home/Malvern (onsite 3 days a week) Rate: £550 - £600 per day (Inside IR35) Skills: SC Clearance, Python, SQL, Databricks, AWS, Data Engineering, ETL/ELT, Data Pipelines We are looking to recruit an SC Cleared Data … leading technology consultancy to join a long-term Central Government programme supporting a major Defence digital transformation initiative. This is a hands-on data engineering role working across a broad and evolving technology landscape, with a strong focus on building, developing and supporting modern data solutions ...

play a vital role in making pet healthcare more accessible through innovation, operational excellence, and outstanding customer experience. Help Shape the Future of Data at Pet Drugs Online We're looking for a BI Developer to join our growing team and play a key role in transforming data … Excellent analytical and problem-solving abilities, with strong attention to detail. Nice to Have Experience using Python for data analysis, automation, or pipeline support. Knowledge of SQL Server administration, performance tuning, indexing, and maintenance. Advanced DAX development and optimisation experience. Experience enabling self-service BI through training ...

pipelines, translating the Data Architect's designs into working technical capability. This is a technical leadership position combining hands-on delivery oversight, pipeline implementation, test coordination, assurance support and service handover. You will lead day-to-day technical delivery and provide direction and mentoring to Data … considerations. Define and coordinate unit, integration, performance, security and operational acceptance testing. Lead defect triage, manage technical risks and resolve complex integration issues. Ensure pipeline solutions include monitoring, logging, alerting, error handling, retry logic and appropriate operational support procedures. Coordinate evidence for assurance and accreditation activities with cyber security ...

Consulting Limited is looking for a Senior Data Engineer to work in Bath on a hybrid basis. This contract role lasts … months, requiring expertise in AWS Cloud architecture and data services, along with skills in ETL development and Data Pipeline automation. The ideal candidate will engage with both business and technical stakeholders, ensuring effective communication across varying levels of seniority. Experience with AWS Glue, Lambda ...

land development and a family-run legacy, their expert land development consultants combine generations of expertise with the most reliable and comprehensive land data in the industry that is trusted and used by market leaders. Backed by a dedicated customer success team, they provide innovative tools, trusted insights … unparalleled service to help achieve their clients land goals. The role: The Geospatial Data Manager owns our clients data and leads the data team. The role has one main responsibility. To develop, maintain and take ownership of the datasets that the company uses ...

Outside IR35 - 3-5 month contract - 2-3 days per week in Bristol Lead the technical delivery of a Databricks migration and wider data platform transformation Hands-on role focused on Databricks, Spark, Python and SQL, with some mentoring responsibilities We're looking for an experienced Data Engineering Lead to join a Bristol-based organisation during a major data transformation programme. What you'll be doing This is a hands-on contract focused on helping deliver a migration to Databricks, improving data engineering practices and supporting the wider evolution ...

AnalystApplylocations: United Kingdom - Chippenhamtime type: Full timeposted on: Posted 3 Days Agojob requisition id: R57529**Job Summary:**Today, much of the financial data required to understand and drive business performance is spread across different systems (NetSuite ERP, OneStream, CRMs, Workday Adaptive, project management tools, Workday, BI tool, Excel … data and workforce analytics (attrition, headcount, cost-per-hire).* Basic programming skills (Python, SQL) for data transformation and pipeline work.* Understanding of AI governance and data ethics principles in a business context.* Experience with prompt engineering or LLM-assisted reporting workflows.**WHAT ...

Simply the Best'. Job Category Technology Position Type Permanent Target Openings 1 What Is the Opportunity? Heres what youll be doing: Data isnt just numbers to usits the driving force behind how we champion and protect millions of small business owners. Joining our award-winning, international data team, youll dive headfirst into modern Big Data and analytics technologies to solve real-world problems. In this role, youll work at the intersection of business strategy and technical innovation. You'll team up with cross-functional developers, data engineers, and data ...

Senior Data Engineers, alongside the opportunity to grow towards senior-level responsibilities. Tech StackSpark | Airflow | Kubernetes | Azure | CubeJSWhat You'll Be DoingData Pipeline Development – designing & developing efficient, scalable & robust Data PipelinesSupport and main the data platform to ensure security, reliability, and scalability. Working … with the wider engineering team to gather pipeline requirements, project goals & deliver insights where applicable. Collaborating with engineers, product teams, and customer-facing stakeholdersWhat We're Looking For3-7 years' commercial Data Engineering experienceExcellent understanding of data modelling principles and data warehousing concepts. ...

Join a fast-growing consultancy at the forefront of secure data and cloud infrastructure, delivering AI-ready platforms for some of the UK's most high-impact projects. We're looking for an experienced AWS Data Engineer to help design, build, and maintain a secure, scalable … data platform for a government client - supporting real-time and batch processing that underpins critical analytics and decision-making. What you'll be doing: Building, testing, and maintaining robust data pipelines Designing logical and physical data models Scaling the data platform ...

Software Engineer – Java, Spring Boot & Big Data | eDV Cleared | National Security Join a technology and engineering team delivering systems that support customers across National Security, Defence and Intelligence, working on solutions that operate in some of the most demanding and sensitive environments in the sector. We are looking … Software Engineer with strong experience in Java, Spring Boot and big data engineering to join a growing engineering function, designing, developing and maintaining scalable software and data-processing solutions with a strong focus on automation, reliability and operational excellence. Key Responsibilities Design, develop, test and maintain ...

/ML-enabled capabilities. You will work closely with Operations, Technology, and Compliance to modernize processes end-to-end, strengthen controls and data quality, and ensure change is implemented smoothly with minimal disruption to business-as-usual delivery. Job responsibilities Serve as an SME for payments operations … technologies (e.g., UiPath, Alteryx, Python, SQL) and/or cloud technologies. Working understanding of platform architecture concepts, including API integrations and data pipeline design. Project delivery certifications (e.g., PMP, PRINCE2, Agile/SAFe) are beneficial but not required; domain/operational expertise is prioritized. J.P. Morgan ...

days a week in the office Duration: 6 months initially You must have strong expertise in designing, architecting, and delivering enterprise-scale data platforms on Google Cloud Platform (GCP). The ideal candidate will have extensive experience with BigQuery, cloud data migration, data warehousing … while working closely with client stakeholders to define architecture and drive successful delivery. Key Responsibilities Design and implement scalable, secure, and high-performance data architectures on GCP, with BigQuery as the core data warehouse. Define end-to-end data architecture, including ingestion, transformation, storage ...

design, build, test, and deploy scalable AI services integrated with strategic systems and operational processes. You will collaborate with software engineers, AI and data science specialists, operations stakeholders, and business partners to improve operational workflows, controls, and the software development lifecycle. You will focus on hands-on engineering … experience Demonstrate strong Python programming skills Design, develop, and integrate RESTful APIs, such as with FastAPI Build and support ETL and data pipeline engineering workflows Apply Infrastructure as Code practices, such as Terraform, and work within CI/CD pipelines Design and integrate databases and data ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … delivery to frontend and downstream consumers, with particular attention to latency and throughput given real-time processing requirements. Own data storage and pipeline architecture, including integration with streaming/event infrastructure. Implement authentication and authorisation in line with the team's chosen cloud identity and access management ...

AtkinsRéalis is seeking Data Architects to join the Solution Design team and help shape our customers' digital journeys. You will design and communicate data-centric solutions, lead data architecture initiatives, and contribute to enterprise data strategy within a government/defense oriented … context. The role requires experience across data modelling, governance, data pipelines, and modern platforms on cloud and on‐prem environments, with a strong stakeholder engagement and a pragmatic, #J-18808-Ljbffr ...

Searchability NS&D in Gloucester is seeking a Data Engineer for a permanent role with active Enhanced DV clearance. Hybrid working when possible, on-site in Gloucester when required. You will design and manage data pipelines, ETL processes, and data integration for National Security … clients using Apache tools including NiFi, Kafka, and SQL/NoSQL databases like MongoDB. Proficiency in Groovy, Python or Java for ETL, data modeling, and data governance is essential. #J-18808-Ljbffr ...

problem-solving skills, and ability to thrive in a fast-paced, collaborative environment. Preferred qualification, capabilities, and skills Agentic AI and data pipeline/processing experience a plus. Product development lifecycle experience a plus. ABOUT US J.P. Morgan is a global leader in financial services, providing strategic ...

Consulting is hiring a Principal GCP Data Engineer in Bristol to lead data engineering efforts for complex client programmes. You will own end-to-end data solutions, guide architecture, and drive best practices across teams with a focus on production-grade pipelines and cloud … native patterns. You will mentor teammates, influence client stakeholders, and contribute to design discussions beyond data processing, shaping the overall data strategy for large-scale engagements. #J-18808-Ljbffr ...