22 of 22 Big Data Jobs in the South West

growth and development opportunities in an environment that embraces your unique skills and experience. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly within a Java context, along with a passion for creating innovative solutions tailored to the unique demands of public sector projects. As a Developer at IBM you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. … processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and More ❯

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction … transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders … including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs. Keep our data separated and secure across national boundaries through multiple data centers and AWS regions. Create data tools for analytics and data More ❯

The Data Management practice within the Insights and Data business unit of Capgemini is a global practice involved on a broad range of business and IT focused topics from Information Strategy, Governance, Master Data Management, Data Architecture, Data Migration and Lifecycle Management. We help our … clients build an enterprise class data platform that allows them to move ahead in their journey of big data and insights. Primarily working with leading software vendors like SAP, Informatica, IBM, Oracle et al, the team are first and foremost Consultants, putting client requirements and industry best … integration projects for our clients. Our ETL Specialists work closely with the project and client teams to understand the requirements, analyse source and target data architecture and systems, propose the most effective solution and work with a team of experts to deliver. We are looking for our ETL Specialists More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your work will support … data-driven decision-making across the business, helping to drive forward key customer insights and analytics. In this role, you will work closely with cross-functional teams to deliver high-quality data infrastructure that powers marketing efforts and analytics. Reporting directly into the Head of Data, you … will collaborate with a team of experienced data professionals while continuing to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet More ❯

Principal Data Engineer, Consulting Bristol Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly … with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyse and cleanse data using a range of tools and techniques. More ❯

Principal Data Engineer Consulting Bristol, UK £90,000 £100,000 Hybrid A leading consultancy is seeking a Principal Data Engineer to take ownership of delivering scalable, cloud-first data solutions across greenfield and transformation programmes. This is a hands-on role where you'll design, build, and … deploy enterprise-grade platforms and pipelines using AWS and modern ETL tools. As Principal Data Engineer, youll work directly with clients to understand complex requirements, shape the solution architecture, and lead end-to-end technical deliveryalways with a focus on quality, performance, and value. Your responsibilities as Principal Data Engineer include: Building cloud-native data platforms using AWS services such as Redshift, Glue, S3, Lambda, and DynamoDB Designing and implementing ETL/ELT pipelines using Matillion and similar tools Leading on solution deployment using infrastructure-as-code and CI/CD practices Transforming diverse data formats More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

Your role and responsibilities We are seeking a highly skilled and experienced Senior Java Engineer to join our agile team and work on innovative big data systems that support public sector projects. As a Senior Java Engineer, you will play a critical role in designing, developing, and delivering … professional experience The ideal candidate will have a strong focus on delivering exceptional user experiences and a proven track record of working with complex data-intensive applications. Proven experience as a Java Engineer with a strong focus on user experience. Deep understanding of Java and its ecosystems, including experience … with popular Java frameworks (e.g. Spring, Hibernate). Familiarity with big data technologies and tools (e.g. Hadoop, Spark, NoSQL databases). Strong experience with Java development, including design, implementation, and testing of large-scale systems. Experience working on public sector projects and understanding of the unique challenges and More ❯

Geospatial Data Engineer - Contract Hybrid - Bath (1 day a week on-site) £400-£450 per day Deemed Outside IR35 (pending QDOS assessment) This Contract Geospatial Data role is a fantastic opportunity to work on cutting edge data problems at a leading environmental risk consultancy. The position has … their field with a powerful and highly regarded platform built using the latest technologies. You will be working in a team of software and data engineers supporting data workflow & orchestration, within an AWS environment and must have experience of RASTER data sets. In this role, you will … be: Developing robust pipelines to process big data sets (Raster experience essential) Configuring CI/CD pipelines Managing data storage within an AWS environment Improving data automation, workflow and efficiency Developing Python based ML pipelines K ey skills for this role include: Good knowledge of Python More ❯

Geospatial Data Engineer - Contract Hybrid - Bath (1 day a week on-site) £400-£450 per day Deemed Outside IR35 (pending QDOS assessment) This Contract Geospatial Data role is a fantastic opportunity to work on cutting edge data problems at a leading environmental risk consultancy. The position has … their field with a powerful and highly regarded platform built using the latest technologies. You will be working in a team of software and data engineers supporting data workflow & orchestration, within an AWS environment and must have experience of RASTER data sets. In this role, you will … be: Developing robust pipelines to process big data sets (Raster experience essential) Configuring CI/CD pipelines Managing data storage within an AWS environment Improving data automation, workflow and efficiency Developing Python based ML pipelines K ey skills for this role include: Good knowledge of Python More ❯

Your role and responsibilities We are seeking a highly skilled and experienced Senior Java Engineer to join our agile team and work on innovative big data systems that support public sector projects. As a Senior Java Engineer, you will play a critical role in designing, developing, and delivering … professional experience The ideal candidate will have a strong focus on delivering exceptional user experiences and a proven track record of working with complex data-intensive applications. Proven experience as a Java Engineer with a strong focus on user experience. Deep understanding of Java and its ecosystems, including experience … with popular Java frameworks (e.g. Spring, Hibernate). Familiarity with big data technologies and tools (e.g. Hadoop, Spark, NoSQL databases). Strong experience with Java development, including design, implementation, and testing of large-scale systems. Experience working on public sector projects and understanding of the unique challenges and More ❯

the second phase of a key new Observability project. This ground-breaking new venture within an established, global business is developing an exciting new data monitoring infrastructure. This will involve getting stuck deeply into their Redis/Loki/AWS environment, working with Golang and generating Grafana dashboards. Ideally … you will have worked in a Big Data environment. They are looking for a real Redis experience whose experience goes in-depth as they have selected Redis as the entire back-end database (noSQL) for this platform. In this contract role, you will contribute to the design and … in-depth experience * Grafana/Loki/Prometheus or other equivalent Observability/Monitoring technologies * Developing refined dashboards for visualisation of observability and measurement data * Experience with Cyber/Network Security analytics with modern Big Data approaches Reach out to discuss, and send your CV for immediate More ❯

Job Title: Data Engineer - Microsoft Azure Location: Weybridge Rate: £19.93ph to £35.60ph PAYE - Depending on Experience Employment Type: Contract (Duration: June 1, 2025 - October 1, 2025) Hours: 37.5 per week Reference: PG4194 Job Description: Responsibilities: Design, develop, and maintain scalable data solutions and pipelines using Microsoft Azure, translating … architectural designs into technical implementations for data acquisition, processing, storage, and insights. Improve and automate existing data workflows and business automations to enhance data quality and streamline processes, leveraging Azure technologies for better performance and reliability. Create interactive Power BI reports, dashboards, and visualizations; optimize data models and DAX calculations for accuracy and performance. Collaborate with cross-functional teams to gather requirements and deliver tailored data solutions that meet business needs. Establish and promote best practices in data management and governance, guide in structuring cloud environments, and support data initiatives and future More ❯

while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights … and story refinement and estimation process through to delivery Provides out of hours application support and coordination of Production releases Analyzes complex flows of data between technical systems to develop solutions that meet the business needs Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts … event driven architecture and distributed messaging technologies (e.g. Kafka ) Experience with Docker and running Production workloads on Kubernetes Experience using and designing schemas/data structures on relational databases (e.g. PostgreSQL , MySQL , Aurora , and Oracle ) Experience in applying appropriate data structures and algorithms to solve business and technical More ❯

a PSW or a Graduate visa** We ae looking to hire an Application Support Developer to join our innovative team. Specializing in IoT and big data analytics, we provide remote monitoring systems for the maritime and industrial sectors, with customers around the globe. This new pivotal role will … will be the bridge between developers and our customers. My client works on a IOT product hardware that sits on a boat and gathers data, Interfacing in in C C++, LINUX based systems like a raspberry Pi. They have many boats online and need support to bring them online … and fix bugs in the software The data is delivered to the cloud via azure and data is written in Python and C++ and this is what they need support with. In 2 years you would be in SW team after this 2 years and they would replace More ❯

a PSW or a Graduate visa** We ae looking to hire an Application Support Developer to join our innovative team. Specializing in IoT and big data analytics, we provide remote monitoring systems for the maritime and industrial sectors, with customers around the globe. This new pivotal role will … will be the bridge between developers and our customers. My client works on a IOT product hardware that sits on a boat and gathers data, Interfacing in in C C++, LINUX based systems like a raspberry Pi. They have many boats online and need support to bring them online … and fix bugs in the software The data is delivered to the cloud via azure and data is written in Python and C++ and this is what they need support with. In 2 years you would be in SW team after this 2 years and they would replace More ❯

robust cloud infrastructure. Quickest way to enter a lucrative career within Cloud Computing. Option to enter other career paths including Cyber Security, Artificial Intelligence, Big Data, Machine Learning, Cloud Security, Data Analytics, Networking, and DevOps. More ❯

Computing. Increased earning potential and job security. Flexible working opportunities within the industry. Platform to enter other career paths including Cyber Security, Artificial Intelligence, Big Data, Machine Learning, Cloud Security, Data Analytics, Networking, and DevOps. More ❯

Kubernetes, OpenShift, MicroK8s • Infrastructure as Code (IaC), automation & configuration management • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring More ❯

grad to 2 years-ish). We ae looking to hire an Application Support Developer to join our innovative team. Specializing in IoT and big data analytics, we provide remote monitoring systems for the maritime and industrial sectors, with customers around the globe. This new pivotal role will More ❯

Kubernetes, OpenShift, MicroK8s Infrastructure as Code (IaC), automation & configuration management Ansible (plus Puppet, Saltstack), Terraform, CloudFormation NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark RedHat Enterprise Linux, CentOS, Debian or Ubuntu Java 8, Spring framework (preferably Spring More ❯

could be working with KPMG clients to get them ready to implement change, identifying the right insights to improve performance, harnessing the power of data, improving efficiency, reducing costs and making the most of technology. You'll think critically about how to evolve workforces for the future, providing insight … teams within Corporate Services and People to find your niche and expand your skills. Within People teams, you could be looking at how automation, big data, and machine learning are combining to fundamentally reshape our workforces. You'll focus on the Environment and Social Governance (ESG) agenda - particularly More ❯