1 to 25 of 72 Big Data Jobs in the UK excluding London

xperience and Education Required Approximately 10 years of industry experience implementing data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, and similar technologies. 3–5 years of team management experience. 3–5 years of consulting experience … preferred). Minimum of 5 years’ experience in data architecture, data modelling, or related disciplines. Bachelor’s degree or equivalent experience required; Master’s degree preferred. Strong knowledge of data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with ...

xperience and Education Required Approximately 10 years of industry experience implementing data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, and similar technologies. 3–5 years of team management experience. 3–5 years of consulting experience … preferred). Minimum of 5 years’ experience in data architecture, data modelling, or related disciplines. Bachelor’s degree or equivalent experience required; Master’s degree preferred. Strong knowledge of data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger commercial decision making and elevate campaign management for client facing teams. … work effectively both independently and within a team, and contribute proactively to improving engineering standards and working practices. You possess a deep understanding of data and business requirements and can translate these into clear technical specifications. You write clean, maintainable, and high quality code, and you are capable ...

About The Role Team Data and Information Services Working Pattern - Hybrid 2days per week in the Vitality Bournemouth or London Office.Full time hours per week. We are happy to discuss flexible working! Top 3 skills needed for this role: Proven delivery of scalable data solutions Demonstrated expertise … modern data engineering practices Established capability in stakeholder engagement and cross-team collaboration What this role is all about: Were looking for a Senior Data Engineer whos passionate about using data to make a positive impact. Youll take ownership of building scalable data pipelines, working independently ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Senior Data Engineer Role Description We are seeking a skilled and experienced Senior Data Engineer with a strong focus on Databricks to join our team. … candidate will have expertise in Python/Pyspark, CI/CD pipelines, and hands-on experience with Databricks to design, implement, and optimize scalable data solutions. This role will be based in our Guildford office with office attendance expected fortnightly on a Wednesday. Salary Information Pay: Circa ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

employers actively hiring across these roles. Job Description: UK-Based (On-Site, Hybrid or Remote) About the Role We're looking for experienced Data Engineers at all levels—from Data Engineer through to Senior, Lead, Principal, Analytics Engineer and Data Platform Engineer positions—for upcoming roles across … data pipelines, warehouses, lakehouses and the platforms that data teams depend on. These are hands-on engineering roles where you'll build and operate the foundations that analytics, BI, data science and ML all stand on. You'll work across the full data engineering lifecycle—from ...

ESSENTIAL ROLES & RESPONSIBILITIES Identify and understand customer data-centric use cases within regulated financial services environments Design and implement data ingestion, processing, and transformation pipelines on Azure Build and maintain data pipelines for cleaning, normalisation, enrichment, and preparation Apply appropriate data modelling techniques and architecture patterns … with a strong focus on medallion architecture Orchestrate, monitor, and optimise Azure Databricks jobs and Azure Data Factory pipelines across development, UAT, and production environments Configure platforms, clusters, and compute resources to optimise performance, cost, and reliability Use automated CI/CD pipelines to manage, deploy, and version data ...

workplace and at home, theres nothing we cant achieve. BASIC QUALIFICATIONS - Experience implementing AWS services in a variety of distributed computing environments - Data lake architecture and design (Lake Formation, S3-based architectures) - Medallion architecture implementation (bronze/silver/gold layer design) - Data strategy and governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance - Data quality and lineage frameworks PREFERRED QUALIFICATIONS - Experience and technical expertise (design ...

Platform Engineer (Data Platforms) Location: London We're looking for a Platform Engineer to build and maintain scalable, secure and high-performance data platforms . You'll play a key role in ensuring reliable data services while working closely with data scientists, analysts and engineering teams. … What you'll be doing Building and maintaining scalable data platform infrastructure Ensuring high availability, performance and security of data services Developing and maintaining data pipelines Collaborating with data teams to integrate tools and services Troubleshooting complex platform and data infrastructure issues Supporting cross-team ...

IMSERV is one of the UK’s leading data collection and energy metering experts, delivering award winning services to more customers in more places, meeting industry targets and becoming a benchmark for excellence. We offer a range of specialist metering technology for electricity, gas, and water along with highly … accurate energy data collection services. All this is wrapped up with an easy-to-view online data management analysis and reporting software. PURPOSE OF THE ROLE: The purpose of the role is to design, build, and manage scalable data solutions focusing on the ingestion, transformation, and management ...

LGBTQ+ business community. Please do not contact the recruiter directly. Job Description: The Platform & Engineering team at Royal Canin is responsible for managing our data capabilities, including the creation, operation, and optimization of the data platform, assets, and pipelines. This is a growing team, supporting an advanced analytics … agenda at Royal Canin that is rapidly transforming it into a data driven organisation. To accelerate achieving this objective, we are looking for an experienced Data Engineering Manager with knowledge on Product Engineering to join our team. Senior Data Engineering Manager, Analytics Products leads and develops ...

Test Engineer (Data & Automation) Location: Hybrid 3 days onsite a week (Manchester/Leeds/Birmingham/Newcastle/London) NEED ACTIVE SC CLEARANCE Overview We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation … data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working ...

Product Lead on behalf of a well-respected Lloyd's Market Insurer. This role will act as the vital bridge between complex data infrastructure and actionable business insights. The successful candidate will lead BI initiatives and activities and own the entire lifecycle of reporting solutions. Key Responsibilities Establishing … such as Lloyd’s regulatory reporting, external and internal Audit reporting and Finance Close reporting. Supporting the business through standardisation and automation of operational data reporting solutions. Ensuring continuous delivery of customised business reporting solutions. Supporting the business on troubleshooting data issues, identifying patterns and correlations among ...

Data Intellect it has never been just about data or technology, they are our tools. It's about human intellect, collaboration and providing solutions for the most complex of challenges. We do this by living the [DI] code: We are Problem Solvers who are Humble, possess … Attitude with a focus on Togetherness. "We are not big on egos, but we're not for the faint-hearted either" - Steve Turner, CEO What you'll be doing: Implement, configure and evolve SaaS data products within client environments, taking solutions from initial onboarding through to long-term ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions at pace. Active … clearance is essential, we are seeking DV cleared candidates only. The role You'll design and deploy production-grade data pipelines, from ingestion through to consumption, within a modern big data architecture. Work is delivery focused and delivered using agile engineering practices. Typical responsibilities Build and operate ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

hands-on Solution Architect position sitting within the Strategy & Governance team. You will be responsible for end-to-end solution design, supporting a major data platform transformation and enabling the development of next-generation cybersecurity products. You will operate at the intersection of architecture, engineering, and governance, shaping technical … requirements through to production support) Produce and maintain architecture artefacts: High-Level Designs (HLDs) Low-Level Designs (LLDs) Reference architectures Architecture Decision Records (ADRs) Data Platform Transformation Contribute to the design and evolution of a petabyte-scale cyber data platform Support a major replatforming initiative from Databricks ...

cloud. BASIC QUALIFICATIONS - Experience as technical specialist in design and architecture - Experience implementing AWS services in a variety of distributed computing environments - Data lake architecture and design (Lake Formation, S3-based architectures) - Medallion architecture implementation (bronze/silver/gold layer design) - Data strategy and governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance PREFERRED QUALIFICATIONS - Experience in IT implementation - Data quality and lineage frameworks - Data ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that support analytics and operational decision … making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that support analytics and operational decision … making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop ...