1 to 25 of 49 Big Data Jobs in London

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help … organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design … and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and More ❯

Senior Data Engineer Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect … with and understand their organisations, their people, their customers, and citizens. We are a team of creative engineers and technologists dedicated to unleashing the potential of data in new and impactful ways. We design and build bespoke data platforms and unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming data into actionable insights and tangible outcomes. We engineer data to life. Requirements The Role: The Senior Data Engineer at Simple Machines is a dynamic, hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions. This position blends deep technical expertise in modern data More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design and … build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience … within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Analytics Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design … and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high … experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation … and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect, design, and implement scalable … Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows using Agile best practices More ❯

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing … products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform … Load) processes to ingest data from various sources • Ensure data quality, integrity, and reliability through thorough testing and validation Database Management • Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes) • Monitor and assist in maintaining database performance and security Data Integration: • Collaborate with data analysts and scientists to integrate More ❯

A global IT services, consulting, and business solutions company has partnered with a leading financial services organisation to hire an experienced Data Architect for a 6-month contract. In this role, you'll design and implement enterprise-scale Data Lake solutions, define architectural standards, and guide best practices across large-scale digital transformation programmes. You'll collaborate with … cross-functional teams to ensure scalable, secure, and high-performance data systems that align with business objectives. This is a hybrid role requiring 2 days per week on-site in Central London. Ready to shape the future of data architecture in financial services? Apply now to join a high-impact team at the forefront of transformation. Key Responsibilities … Design and develop enterprise-grade data architecture frameworks supporting Data Lakes and Big Data platforms Create conceptual, logical, and physical data models for robust, scalable storage solutions Define and maintain the overall structure of data flows and models across multiple platforms Oversee integration of diverse data sources into unified and secure data More ❯

Legal Data Analytics Manager Location: London Permanent role. Primary skills Data statistics & Analysis; Client Dashboards;To extract Data, consolidate and analyse it; Create automation solutions including AI solutions; Quantitative analytics (e.g. offer calculations for claims); Analysis for Decision making; Modelling of quantum exposure; Record Data breach analytics The Data Analytics Manager will focus on building … internal client relationships and on the delivery of day-to-day matter work in the data analytics team. Management of people ensuring the appropriate resourcing of matters, training, reporting and you will work closely with the Senior Manager, Data Analytics. The Data Analytics Manager will be responsible for providing expertise, advising on any issues within the team … of the team. The role will ensure the overall provision of high quality services and will play a key part through effective consultancy in building the reputation of the Data Analytics Team, both internally and externally to clients. Responsibilities: With the Head of Data Analytics you’ll be part of the design, development and ongoing evolution of dashboards. More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

Data Delivery Pod Lead London - 3 days on-site required 6 Months UMBRELLA only Role Purpose GBM Data & Analytics is a world class "data-driven" organization that provides trusted data insights and packaged consumable insights to deliver business value and great customer experience. Our global team is formed of Data, Analytics, Technology and Delivery resources. … Our GBM Data Analytics Platform is the largest aggregation of data ever. We have over 300 sources and a rapidly growing book of work. We are utilising the latest technologies to solve business problems and deliver value and truly unique insights. The Delivery Pod lead will lead a team of data, analytics, technology and delivery resources on … a broad range of data and analytics use cases. Delivery is end-to-end; from understanding the problem, designing a solution, assisting data engineers in acquiring and processing the data, ensuring the right models are built and tested, and finally overseeing the deployment into production. We need people with experience spanning technology, data, analytics and delivery More ❯

for what's next. An environment where your skills will evolve at the frontier of innovation and AI, ensuring continuous growth and development. We are looking for a Principal Data Engineer to work alongside our market-leading engineers and architects to deliver complex projects and make valuable impacts for our customers. We look for people who embody: Innovation to … every result. ‍Integrity always. About The Role The purpose of this role is to engage with enterprise-level organisations to offer a consultative view and direction on best practice data architecture using Google Cloud solutions. This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect … on client-facing delivery projects Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability Identify, scope, and participate in the design and delivery of cloud data platform solutions Deliver highly scalable big data architecture solutions using Google Cloud Technology: Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and More ❯

About the Role: Developing the audiences based on all the platforms and data available and interrogating data sources to derive insight to support the creation of the audiences, as well as curating insights from the local markets. Providing the information required to enable the definition of targetable audience groups from the initial segment definitions and insights. Manage the … creation process. This role will be part of a team of audience insights specialists that play a crucial role in understanding audience behavior and preferences. As experts in consumer data, analysis, and MarTech – we gather valuable insights to help our clients make informed decisions and develop effective marketing strategies, utilizing the industry's most robust dataset in Omnicom's … proprietary platform – Omni. We're looking for curious colleagues, who enjoy learning more about data, insights tools, and meeting the ever-changing needs of the industry. Key Responsibilities: Strategic partner for audience creation and optimizations through media campaign process Create audience insights: market, and audience sizing, behavioral insights on personas, to refine the audience segmentation Insight development and curation More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

ecommerce sites and TV channels, making every screen a doorway to discovery, delight and community. The Opportunity Here at QVC UK we are on the search for a Senior Data Scientist to join our growing advanced analytics team, in Chiswick Park, London. Reporting to the VP Advanced Analytics, you will develop models, programming and data engineering. This job … streaming services, websites, mobile apps and social pages. QVC International has team members in the U.K., Germany, Japan, Italy, Poland and China. Your Impact You will develop models, programming & data engineering You'll define new and advanced analysis techniques and approaches You will ensure the stability and quality of our models In cooperation with different internal partners, you will … stack You will optimise existing methods, technologies and tools and keep yourself informed about new trends in the market You will help train and onboard new colleagues, less experienced data scientists and engineers What You Bring You will have a Masters degree (PhD preferred) in Applied Mathematics, Physics, Statistics or another quantitative discipline You will have several years of More ❯

DataStage Developer (Mappings) - MUST BE AT LEAST BPSS CHECKED X1 Senior and X1 Junior This position requires a strong grasp of data transformation processes and the ability to work effectively within an Agile environment. The successful candidate will be responsible for designing, developing, and implementing DataStage mappings aligned with project requirements and industry best practices. Key Responsibilities * Design, develop … and implement DataStage mappings in accordance with project requirements and industry standards. * Apply MOSAIC or IBM 10-step Data Migration Methodologies to ensure robust and effective data transformation. * Collaborate with cross-functional teams to understand business needs and deliver tailored data solutions. * Implement XML, XSLT, and other relevant technologies for data manipulation and transformation. * Use Jira … for project management, task tracking, and progress monitoring. * Uphold high standards of code quality, efficiency, and performance. * Provide mentorship and support to junior team members. Job Role/Specialty * Data Engineer - Data Modeling * Service Context * Service: Hybrid Cloud & Data * Service Area: Big Data Services Required Skills and Qualifications * Eligibility Requirement: Must be a UK national More ❯

and real ownership come together to shape the future of ad-fraud prevention. The Opportunity In this role, you'll help shape a platform that processes large volumes of data and safeguards digital advertising integrity. You'll design simple, effective solutions, write maintainable Python code, and ensure reliability through testing and observability practices. The work spans implementation, documentation, and … platform team responsible for building and scaling the backend systems that power a machine-learning driven ad-fraud prevention platform. You'll work extensively with Python and large-scale data sets, supporting model training on billions of data points, delivering features to data science teams, and helping launch new models, tracking capabilities, and integration's across major … ad platforms. The work spans everything from developing big-data pipelines on cloud infrastructure (AWS, Redshift, or equivalent) to supporting greenfield projects like new affiliate products and upcoming channel integration's. You'll contribute to a fast-paced engineering environment that deploys to production twice a week, where processes exist but can evolve and where autonomy and technical More ❯

years, Global Relay has set the standard in enterprise information archiving with industry-leading cloud archiving, surveillance, eDiscovery, and analytics solutions. We securely capture and preserve the communications data of the world's most highly regulated firms, giving them greater visibility and control over their information and ensuring compliance with stringent regulations. Though we offer competitive compensation and benefits … and all the other perks one would expect from an established company, we are not your typical technology company. Global Relay is a career-building company. A place for big ideas. New challenges. Groundbreaking innovation. It's a place where you can genuinely make an impact - and be recognized for it. We believe great businesses thrive on diversity, inclusion … tens of thousands of users globally to solve real world business problems. You also get to tackle interesting and engaging problems to do with scalability and high availability in big data environments. At Global Relay we are continuously pushing the boundaries of Java technology. This is an opportunity to work alongside some of the best Java developers in More ❯

Senior Data Scientist - £75,000 to £85,000 + 3 days a week onsite Method Resourcing is supporting a high-growth data function in central London who are building out their Data Science capability and looking for an experienced Senior Data Scientist ready to progress into a leadership role. You'll join a flat-structured team … presenting to senior leadership, able to mentor others, and capable of stepping into a Lead role within 1-2 years. The Role You'll act as the blend of: Data & AI evangelist - educating stakeholders on possibilities and translating technical outcomes to business value. Data specialist - shaping data science strategy, building production-ready ML models, and embedding best … Translate complex business problems into research questions with quantifiable objectives. Identify, acquire, and work with structured and unstructured datasets. Build, validate, deploy, and monitor production ML models. Partner with data engineers, ML engineers, architects, and business teams to shape ML initiatives. Present insights clearly through strong data visualisation and storytelling. Uphold software engineering and MLOps best practices (testing More ❯

We're looking for three talented Principal Data Scientists to join our supportive and forward-thinking Commercial Data team. Each role offers a unique opportunity to make a real impact and shape how we use data to create meaningful change across the business. You'll join a team that values openness, curiosity, and innovation, where your voice … is heard and your contributions make a difference. Here, you can grow, mentor others, explore new ideas and help us deliver smarter, more impactful solutions across the business. Principal Data Scientist Pricing - We're looking for someone who's eager to make a genuine difference, helping shape how we approach pricing in a rapidly evolving energy industry. You'll … work closely with our Pricing team, combining your technical strengths with a collaborative, people-first mindset to deliver insights that drive smarter, fairer and more sustainable decisions. Principal Data Scientist AI & Flex - This role will focus on supporting AI and Data Science within our Flex space one of the most exciting and strategically important areas of the business. More ❯

is to address critical challenges such as climate change and food security through sustainable practices and cutting-edge solutions, while safeguarding the planet's resources. Job Description The Geospatial Data Scientist will leverage advanced geospatial analytics, machine learning, and remote sensing expertise to transform complex agricultural and earth observation data into actionable insights that drive innovation in Syngenta … s Computational Agronomy Department. This role will develop cutting-edge models and algorithms that enable data-informed agricultural decision-making, supporting Syngenta's mission to improve global food security and sustainable farming practices. Working within cross-functional teams, the Geospatial Data Scientist will bridge technical expertise with agricultural knowledge to create scalable, data-driven solutions for modern … agricultural challenges. Accountabilities Develop and implement advanced geospatial and machine learning models to analyze agricultural datasets (satellite imagery, drone data, IoT sensors) and extract meaningful patterns. Design, build, and maintain scalable, cloud-enabled large data pipelines for cleaning, transforming, and integrating diverse geospatial data sources. Perform statistical analysis and data mining to uncover spatial and temporal More ❯

development of and provide hands-on technical leadership in the delivery of proofs-of-concept or proofs-of-architecture for our customers. • Collaborate with application engineers, product managers, and data scientists to deliver solutions that solve real-world problems • Deeply embedded with our most strategic platform customers, serving as their technical thought partner in ideating and building novel applications … publishing notebooks to our internal and external repositories. • Validate, synthesize, and deliver high-signal feedback to the Product and Research teams. Technical Skills – Must have: • AI Solution Architects are data and analytics professionals with at least 5 years of experience with knowledge of Transformer (and other Deep Learning) Architectures, data lake architectures, data integration, and data … or any POC to create SML • Expertise in optimizing AI solutions for runtime cost. • Expertise in conversational system architecture • Extensive knowledge on API's & Integrations, Patterns. • Extensive knowledge of big data technologies • Knowledge on Statistical Methods • OTHER SKILLS WE'D APPRECIATE 1. Understanding of NLP engines, Artificial Intelligence, Machine Learning frameworks etc. EDUCATION QUALIFICATION • Graduate in Engineering OR More ❯

to apply as soon as you can. If you have any questions, please do contact the team at Job Description Your AI era starts now At Lloyds Banking Group, data isn't just something we store in the cloud. It's the juice that keeps ideas flowing, decisions sharper, and progress unstoppable. Our Chief Data & Analytics Office has … one mission: weave data, analytics and AI into every decision we make. The goal? Simple. Every choice, everywhere, driven by data. As a Data Science & AI Graduate, you won't be on the sidelines watching the algorithms run the show. You'll be training models, crafting algorithms, deploying scalable solutions, and showing exactly what AI can do in … the real world. Whether you're optimising performance, unlocking insight or making predictions, everything you do will be rooted in data literacy, ethics and genuine business impact. Two years. Three game-changing rotations This two-year programme blends office and home working. Across three eight-month placements, you'll see how we use data and AI to crack More ❯

API, Vision API). Infrastructure Automation: IaC with Terraform or Cloud Deployment Manager. Cloud Solution Design: Building scalable, secure, and resilient cloud architectures, including designing AI/ML infrastructure. Data Handling: Big data analytics, warehousing, and ETL/ELT processes, with a focus on leveraging data for AI/ML. Network & Security: Comprehensive understanding of cloud More ❯