1 to 25 of 78 Big Data Jobs in the City of London

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from … various sources into our data warehouse or data lake. Data Transformation with Python: Write, optimize, and maintain production-grade Python scripts to clean, transform, aggregate, and process large volumes of data. Database Interaction (SQL): Develop complex, high-performance SQL queries (DDL/DML) for data extraction, manipulation, and validation within relational and data warehousing environments. More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from … various sources into our data warehouse or data lake. Data Transformation with Python: Write, optimize, and maintain production-grade Python scripts to clean, transform, aggregate, and process large volumes of data. Database Interaction (SQL): Develop complex, high-performance SQL queries (DDL/DML) for data extraction, manipulation, and validation within relational and data warehousing environments. More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

The Global Director of Data and Information will be responsible for developing and executing a comprehensive data and information strategy that aligns with the organisation’s business goals. You will; help the organisation gain the benefit from the data within our business systems. identify and exploit opportunities to integrate operational and telemetry data into our Business … Intelligence ensure the organisation adheres to the key principles of information management, particularly Accountability, Integrity, Compliance and Usability. This role involves leading data governance, analytics, and data management initiatives, ensuring that data is effectively utilized to drive strategic decision-making across the organisation. The ideal candidate will possess strong leadership skills, a deep understanding of data architecture, and a proven ability to leverage data for business insights. Key Responsibilities: Strategy Development : Define and implement a global andData and Information strategy that aligns with the organisation’s overall objectives and priorities, considering and anticipating future scalability and compliance requirements. Team Management : Recruit, mentor, and develop a high-performing data team, promoting a culture of More ❯

The Global Director of Data and Information will be responsible for developing and executing a comprehensive data and information strategy that aligns with the organisation’s business goals. You will; help the organisation gain the benefit from the data within our business systems. identify and exploit opportunities to integrate operational and telemetry data into our Business … Intelligence ensure the organisation adheres to the key principles of information management, particularly Accountability, Integrity, Compliance and Usability. This role involves leading data governance, analytics, and data management initiatives, ensuring that data is effectively utilized to drive strategic decision-making across the organisation. The ideal candidate will possess strong leadership skills, a deep understanding of data architecture, and a proven ability to leverage data for business insights. Key Responsibilities: Strategy Development : Define and implement a global andData and Information strategy that aligns with the organisation’s overall objectives and priorities, considering and anticipating future scalability and compliance requirements. Team Management : Recruit, mentor, and develop a high-performing data team, promoting a culture of More ❯

Analytics Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design … and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high … experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal candidate for … the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at the centre … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal candidate for … the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at the centre … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups to hire … multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What you’ll do 🌳 Build and … deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering, security, and product teams to deliver at More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups to hire … multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What you’ll do 🌳 Build and … deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering, security, and product teams to deliver at More ❯

Job Description: Scala/Spark • Good Big Data resource with the below Skillset: Java Big data technologies. • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A More ❯

Job Description: Scala/Spark • Good Big Data resource with the below Skillset: Java Big data technologies. • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A More ❯

Java with Big Data Contract London (Hybrid) Candidate must have Bigdata Experience. Description: • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives More ❯

Java with Big Data Contract London (Hybrid) Candidate must have Bigdata Experience. Description: • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives More ❯

Senior Data Engineer - Trino/Starburst 🚀 Senior Data Engineer Opportunity Salary: Up to £75k (Based on candidate experience) + Excellent benefits Work commute Model: Mostly remote with just 1 day per week on-site Location: London/Portsmouth Job Type: Permanent Ready to Shape the Future of Data? My client is a leading UK-based IT services … and consulting company seeking an experienced Senior Data Engineer who thrives on building robust, scalable systems that unlock the true potential of enterprise data. This is your opportunity to join their cutting-edge AI & Data team as a Senior Data Engineer . What You'll Be Doing 🔧 Build & Optimise : Take ownership of Starburst (Trino) and Dell Data Lakehouse deployments, turning complex data ecosystems into seamless, high-performance platforms 🔗 Connect Everything : Create unified data experiences by integrating diverse data sources across multiple environments ⚡ Performance Mastery : Fine-tune containerised solutions for maximum scalability and lightning-fast query performance 🛡️ Secure by Design : Implement bulletproof security frameworks and ensure rock-solid compliance across all data touchpoints More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a career … defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate Will Have: Previous experience … as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI/CD practices , AWS , and GIT More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a career … defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate Will Have: Previous experience … as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI/CD practices , AWS , and GIT More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team that invests in your … growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team that invests in your … growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark More ❯

Databricks Data Engineer | London | £50,000 - £70,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. Due to exciting growth plans we are … now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication … skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional office visits each month 💰Salary: £50,000-£70,000 DOE 🤝Collaborative culture and great team support 📈Vast L&D opportunities both internally and externally More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines … using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities: • Design and develop ETL pipelines using … ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet them. • Develop mapping documents and transformation business rules. • Ensure continuous More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines … using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities: • Design and develop ETL pipelines using … ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet them. • Develop mapping documents and transformation business rules. • Ensure continuous More ❯