76 to 100 of 264 Big Data Jobs in the UK

valued for their unique perspectives. We are all accountable for sustaining a diverse and inclusive environment. - What You Will Contribute To Altos We have an opportunity available for a Data Scientist to work in the field of cells, genomics and related areas. Responsibilities - Generate insights and models from multi-omics datasets (using public and internal data) to understand … patterns, trends and relationships within data to inform decision-making and solve problems. Design, develops and programs methods, processes, and systems to extract, consolidate and analyze unstructured, diverse "big data" sources to generate actionable insights. Build databases and is responsible for the curation of Data, including experimental data management. Extracting knowledge, insights and predictions from … data using statistical methods, machine learning and data visualization. Work with scientists to identify optimal ways to prepare, annotate, store and navigate their datasets, including data application design and improvement. Define and document best practices for capturing and entering experimental metadata, and educate scientists and collaborators about these standards. Build pipelines for quality control, processing and analysis More ❯

Palantir Foundry Engineer/Palantir/Data/Foundry/London/Permanent/DV Clearance Vivo Talent is engaged exclusively to recruit a Palantir Foundry Engineer for a client of ours based in London. You will be engaged in designing and delivering scalable data solutions that power key insights across the organisation. It is an ideal opportunity … for a Data Engineer who has extensive experience working with Big Data technologies and Palantir Foundry. What You’ll Do: Build and deploy large-scale data processing systems, leveraging Big Data frameworks and cloud platforms. Champion code quality and maintainability through best practices and mentoring team members. Estimate technical effort and provide guidance on … data architecture decisions. Utilise Palantir Foundry to model, integrate, and optimize data pipelines, helping turn raw data into actionable insights. What We’re Looking For: Proficiency in Java, Scala, or Python. Hands-on experience with cloud platforms (AWS, Azure, GCP) and data tools like Databricks. Strong knowledge of ETL/ELT pipelines, distributed systems, and SQL. More ❯

Palantir Foundry Engineer/Palantir/Data/Foundry/London/Permanent/DV Clearance Vivo Talent is engaged exclusively to recruit a Palantir Foundry Engineer for a client of ours based in London. You will be engaged in designing and delivering scalable data solutions that power key insights across the organisation. It is an ideal opportunity … for a Data Engineer who has extensive experience working with Big Data technologies and Palantir Foundry. What You’ll Do: Build and deploy large-scale data processing systems, leveraging Big Data frameworks and cloud platforms. Champion code quality and maintainability through best practices and mentoring team members. Estimate technical effort and provide guidance on … data architecture decisions. Utilise Palantir Foundry to model, integrate, and optimize data pipelines, helping turn raw data into actionable insights. What We’re Looking For: Proficiency in Java, Scala, or Python. Hands-on experience with cloud platforms (AWS, Azure, GCP) and data tools like Databricks. Strong knowledge of ETL/ELT pipelines, distributed systems, and SQL. More ❯

Senior Data Engineer - Cardiff/Hybrid - 65,000 - 75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

Senior Data Engineer - Cardiff/Hybrid - £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

We are looking for Data Scientist at Northampton, UK – 2-3 days per week Onsite Role Description: As a Data Scientist, you will be responsible for developing advanced analytics, predictive models, and data-driven solutions that enhance payment processing, fraud detection, merchant onboarding, and customer experience. You will work closely with product, engineering, and operations teams to … analysis. Develop statistical models and forecasting tools to support operational efficiency and risk mitigation. Apply NLP, anomaly detection, and clustering techniques to uncover patterns in payment and customer data. Data Exploration & Insight Generation Perform exploratory data analysis (EDA) to identify trends, outliers, and opportunities for optimisation. Translate complex data into actionable insights through dashboards, reports, and visualisations. … Collaborate with business stakeholders to define KPIs and measure product performance. Data Engineering Collaboration Work with data engineers to build scalable data pipelines and ensure data quality, consistency, and availability. Support integration of structured and unstructured data sources across Our Client services. Contribute to the design of data lakes, warehouses, and real-time analytics More ❯

succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Analytics & AI - Data Science & AI - Senior Consultant EY exists to build a better working world. We empower our people by offering the culture, tech, teams, scale, challenges, learning … tax and transactions. EY teams ask better questions to find new answers for the complex issues facing our world today. The Team and the opportunity As part of our Data Analytics and AI team, the Data Scientist & AI role is pivotal in enabling our clients to derive significant value from their information assets. Through collaboration and domain expertise … our team embeds innovative data analytics solutions into existing business areas, transforming data into strategic assets. We are looking for a Data Scientist who is passionate about leveraging data to solve complex problems and drive business outcomes. You will play a key role in driving growth by developing new and existing client relationships and delivering first More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team that invests in your … growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team that invests in your … growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark More ❯

Databricks Data Engineer | London | £50,000 - £70,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. Due to exciting growth plans we are … now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication … skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional office visits each month 💰Salary: £50,000-£70,000 DOE 🤝Collaborative culture and great team support 📈Vast L&D opportunities both internally and externally More ❯

Databricks Data Engineer | London | £50,000 - £70,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. Due to exciting growth plans we are … now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication … skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional office visits each month 💰Salary: £50,000-£70,000 DOE 🤝Collaborative culture and great team support 📈Vast L&D opportunities both internally and externally More ❯

Senior Data Engineer – Up to £77k Liverpool Hybrid – 2 Days Onsite Per Week An exciting opportunity for a Senior Data Engineer to join a small, high-impact team where you’ll own the full data lifecycle — from ingestion and modelling to analytics enablement and optimisation. This role is perfect for someone who enjoys being hands-on while … also shaping technical direction, mentoring others, and ensuring data drives meaningful business decisions. What you’ll do: Design and deliver scalable data architectures across lakes, warehouses, and streaming platforms Build and maintain robust ETL pipelines for high-volume, multi-source data Develop data models to support analytics, reporting, and visualisation Optimise data pipelines and systems … for performance and reliability Implement strong data quality and validation processes Work closely with engineers, analysts, data scientists, and stakeholders to meet business needs Mentor junior engineers and champion best practices Evaluate and introduce modern tools, technologies, and cloud solutions Ensure documentation, knowledge sharing, and continuous improvement across the team What you’ll bring: Strong experience as a More ❯

Data Delivery Pod Lead London - 3 days on-site required 6 Months UMBRELLA only Role Purpose GBM Data & Analytics is a world class "data-driven" organization that provides trusted data insights and packaged consumable insights to deliver business value and great customer experience. Our global team is formed of Data, Analytics, Technology and Delivery resources. … Our GBM Data Analytics Platform is the largest aggregation of data ever. We have over 300 sources and a rapidly growing book of work. We are utilising the latest technologies to solve business problems and deliver value and truly unique insights. The Delivery Pod lead will lead a team of data, analytics, technology and delivery resources on … a broad range of data and analytics use cases. Delivery is end-to-end; from understanding the problem, designing a solution, assisting data engineers in acquiring and processing the data, ensuring the right models are built and tested, and finally overseeing the deployment into production. We need people with experience spanning technology, data, analytics and delivery More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines … using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities: • Design and develop ETL pipelines using … ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet them. • Develop mapping documents and transformation business rules. • Ensure continuous More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines … using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities: • Design and develop ETL pipelines using … ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet them. • Develop mapping documents and transformation business rules. • Ensure continuous More ❯

for what's next. An environment where your skills will evolve at the frontier of innovation and AI, ensuring continuous growth and development. We are looking for a Principal Data Engineer to work alongside our market-leading engineers and architects to deliver complex projects and make valuable impacts for our customers. We look for people who embody: Innovation to … every result. ‍Integrity always. About The Role The purpose of this role is to engage with enterprise-level organisations to offer a consultative view and direction on best practice data architecture using Google Cloud solutions. This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect … on client-facing delivery projects Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability Identify, scope, and participate in the design and delivery of cloud data platform solutions Deliver highly scalable big data architecture solutions using Google Cloud Technology: Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and More ❯

a three-time gold investor in people award winner, an advocate of supporting women in engineering and developing their people to be the best they can be? As a data engineer specialising in generative AI; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. The opportunity: The business is looking for a Data Engineer to join an Information Management GenAI delivery Office, who will be able to evaluate design, deploy, improve and support the companies data sets. The Data Engineer will ensure data pipelines are designed to be resilient … secure and responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. The Data Engineer will provide knowledge in data management and data quality to guarantee compliance to company data governance. A key part of this role is More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

to humanity's enduring challenges. We are seeking to recruit a Full Stack Software Engineer to help design, build, and maintain user facing components of our scalable, high-performance data platform supporting our bio-informaticians and science teams. You'll collaborate closely as part of a cross functional team working with architects, platform and data engineers to deliver … platform tools to help manage the full data lifecycle in the platform, monitor sequencing device telemetry and provide the tooling our science teams need to discover and use the data. Key Responsibilities Design, develop, and support web applications deployed to support the data platform. Own the full stack development for tools that support data management across the … full lifecycle, including ingest monitoring, curation, managing releases, monitoring data quality, and user access control management. Build and support components to help manage ingest from and monitor distributed next-generation sequencing devices, including device telemetry (Kafka, MQTT streaming from Oxford Nanopore NGS devices). Design, develop, and maintain platform tools to support our bioinformaticians and science teams in discovering More ❯

Job Title: Lead Data Engineer Duration: long-term contract Location: UK Based Hybrid (x2-3 days from Birmingham) Visa: No sponsorship available/No PSW Overview: We’re looking for a hands-on Lead Data Engineer to design, build, and optimize scalable data pipelines and infrastructure for global banking projects. You’ll lead a team, drive engineering … best practices, and ensure data reliability, security, and compliance. Key Responsibilities: Lead and mentor a team of data engineers, establishing best practices in data engineering. Design, build, and maintain scalable, secure , and reliable data pipelines and architectures. Develop and optimize ETL processes, integrating diverse data sources into unified platforms. Ensure data quality, governance, and … compliance with regulatory requirements. Collaborate with data scientists, analysts, and IT teams to support analytical and business goals. Monitor, troubleshoot , and enhance data performance and infrastructure. Key Skills & Experience: Strong experience with SQL/NoSQL databases, data warehousing, and big data (Hadoop, Spark). Proficient in Python, Java, or Scala with solid OOP and design More ❯

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimise their costs and maximise the benefits from their investments in these technologies. Coeo have a strong emphasis on consulting skills, and we expect our team … has been established for over 17 years and has exclusively focused on Microsoft technologies. Our mission is to “ help our clients predict their future ” through the better use of data, technology, people and processes. To do this our business has always focused on Managed Services Data Platform Consultancy Analytics Consultancy Adoption and Change Management There has never been … client sites across the UK and occasionally abroad, with nights away from home. Job Summary: We are seeking an experienced Principal Consultant with a strong background in SQL Server, Data Warehousing, and Business Intelligence tools. The ideal candidate will have hands-on experience with Data Warehousing, SAP Business Objects Data Services, SAP Business Objects, and Crystal Reports. More ❯

humanity's enduring challenges. We are seeking to recruit a Senior Full Stack Software Engineer to help design, build, and maintain user-facing components of our scalable, high-performance data platform supporting our bioinformaticians and science teams. This role blends hands-on engineering (70–80%) with people leadership and a focus on engineering excellence, raising the bar on standards … security, reliability, observability, and quality. You'll collaborate closely within a cross-functional team, working with architects, platform engineers, and data engineers to deliver platform tools that manage the full data lifecycle, monitor sequencing device telemetry, and provide the tooling our science teams need to discover and use data. Key Responsibilities Design, develop, and support web applications deployed … to support the data platform. Own full stack development for tools supporting data management across the full lifecycle, including ingest monitoring, curation, release management, data quality monitoring, and user access control. Build and support components to manage ingest from and monitor distributed next-generation sequencing devices, including device telemetry (Kafka, MQTT streaming from Oxford Nanopore NGS devices More ❯