1 to 25 of 88 Big Data Jobs in London

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call 07704 152 640/0203 854 0120 or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO … HAVE. Current DV Security Clearance (Standard or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new More ❯

Trade Data Architect - £800 - £900 Per Day – 6 Months – London (Hybrid) - Commodities Overview: A market leading organisation operating in the physical commodities space are searching for an experienced Data Architect with strong experience on the Azure Data stack to join one of their growing teams in London on a hybrid basis. Role & Responsibilities: Design and develop Enterprise … Data Architecture for Trade, Sales Ops and Finance use cases. Deliver effective Big Data solutions aligned with Business objectives. Responsible for creating a target state architecture that best enable seamless integration of complex systems and valuable Analytics. Own and develop Conceptual, logical, and Physical data models. Technical Requirements: Experience designing and developing enterprise data architecture … and delivering effective big data solutions aligned with business objectives. Proven experience in designing Lakehouse Architecture, Data Governance, and Data Modelling Strong understanding of data integration, data quality, and data governance. Extensive experience in working with big data technology tools and platforms such as Microsoft Azure Data Factory, Databricks, Unity More ❯

ESPN+, and much more. Innovation: We develop and execute groundbreaking products and techniques that shape industry norms. These innovations enhance how audiences experience sports, entertainment, and news. Disney's Data Product Management team guides the strategy and vision for Disney's incredible global digital products portfolio - from Disney+, Hulu, ESPN+ and the ESPN App to Marvel Unlimited, National Geographic … edge technologies ranging from Machine Learning to Extended Reality. We are seeking a Product Manager to join our team, and this role will be pivotal in building and maintaining data products that are responsible for landing, processing, and aggregating data related to user sessions and media playback. The ideal candidate will have a strong background in data management, product development, and a keen understanding of data governance and privacy. Responsibilities Oversee the vision, strategy, and technical roadmap for Disney's Media and Session Data and the associated tooling supporting Disney Entertainment and ESPN Product & Technology's digital properties. Build strategic relationships with key business, analytics, and technology leaders to ensure program and product success. More ❯

Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working to build and advance the technological backbone for Disney's media business globally. The team marries technology with creativity to build world-class products, enhance … they carry - matter to millions of people globally. Innovation: We develop and implement groundbreaking products and techniques that shape industry norms, and solve complex and distinctive technical problems. Commerce, Data & Identity provides the core product management functions for areas crucial to Disney's media businesses. These include initiatives and products that power digital commerce, identity, and growth, as well … as those that reach uniquely across The Walt Disney Company enterprise, such as messaging and privacy, among others. Additionally, it is responsible for the data engineering, science, and products for Disney Entertainment & ESPN, along with their interconnection with other parts of Disney. We are seeking a Senior Product Manager to drive the product roadmap for the Experimentation Data More ❯

Senior ML & AI Backend Engineer - Big Data, LLMs & MLOps About the Role We're an ambitious, fast-moving tech company developing next-generation solutions at the intersection of advanced Machine Learning, Big Data, and Large Language Models (LLMs). We're looking for a hands-on Senior ML & AI Backend Engineer to design and build the … systems powering ML models and LLMs in production. Design, build, and maintain end-to-end ML pipelines, championing MLOps best practices for deployment, monitoring, and iteration. Develop solutions for big data storage and processing, ensuring data quality, security, and efficiency. Integrate and optimize both classical ML models and LLMs for real-world use cases. Research and experiment … with state-of-the-art algorithms, tools, and frameworks - bringing fresh ideas from prototype to production. Collaborate closely with a cross-functional team of data scientists, engineers, and product stakeholders. Write clean, maintainable, well-tested code and help set engineering best practices. Diagnose and resolve complex technical challenges in big data and ML systems. About You You More ❯

Senior ML & AI Backend Developer You'll lead the design and deployment of scalable backend systems powering ML, big data, and LLM-driven applications. From MLOps pipelines and big data engineering to productionizing classical ML and LLMs, you'll be at the core of AI infrastructure. Key Requirements: Expert in Python, ML/AI frameworks (PyTorch … TensorFlow, Hugging Face) Proven MLOps, big data, and backend/API development experience Deep understanding of NLP and LLMs Proficient with cloud platforms (AWS/GCP/Azure), Airflow, DBT, Docker/Kubernetes Strong collaboration, problem-solving, and coding best practices Nice to have: LLM fine-tuning, streaming data, big data warehousing, open-source contributions. More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: ·Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

Join Ten10 as a Software Development Engineer in Test (Data Automation Focus) Job Type: Permanent Location: London (Hybrid working with occasional client travel) Passionate about data and automation? At Ten10, were at the forefront of helping organisations harness the power of data through quality engineering and innovative test solutions. Were looking for a Software Development Engineer in … Test (SDET) with a strong focus on data automation to join our dynamic team. If you're driven by complex data challenges and thrive in high-performance environments where ETL testing has become second nature, this is the role for you. ?? Important: All applicants must be eligible for SC clearance Why Ten10? At Ten10, were one of the … UKs leading independent Quality Engineering, Software Testing, and DevOps consultancies. We empower top-tier organisations to accelerate software delivery while maintaining confidence in qualityespecially in data-driven environments. Heres why youll love working with us: Data-Driven Projects: Collaborate on exciting and complex data pipelines, platforms, and automation solutions across industries including finance, retail, and government. Cutting More ❯

Data Architect (Customer Data) Hybrid 3 days per week in the office (West London) 2 days remote My client, a global institution based in London, are seeking an experienced Data Architect who has a strong background within the customer data space. The Data Architect will be responsible for the implementation, and management of a customer … data domain within the enterprise data architecture to support organisational goals and objectives. The ideal candidate will utilise expertise with tools such as Salesforce or other Customer Data Platforms to integrate customer-related data within the architectural framework. The ideal candidate must have: Substantial experience as a Data Architect Customer Data experience CRM experience … Salesforce ideally) Proven ability to design and implement domain-specific data architectures and models, including conceptual, logical, and physical designs. Experience with data modelling tools and methodologies Expertise in designing and managing data integration pipelines, ETL processes, and data warehousing solutions. Hands-on experience with modern tools and platforms Solid experience with database management systems (e.g. More ❯

London or Manchester BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. Job Title: Data Engineer Requistion ID: 120494 Location: London … or Manchester - Hybrid working offered, with consideration for both full and part-time applicants - please speak to your recruiter about options Grade: GG08 - GG13 We are looking for experienced Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelines More ❯

our people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … Head of Data Engineering & Insight to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct accountability for strategy … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics, fostering More ❯

our people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … Head of Data Engineering & Insight to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct accountability for strategy … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics, fostering More ❯

people to unlock their digital potential! To get a sneak peek into our culture, find us on In this role, you will be responsible for planning and overseeing the Data Services Data Engineering and Machine Learning teams engaged in enterprise-wide data projects to ensure they are completed in a timely fashion and within budget. You will … stakeholders informed the entire way. This role will be supporting the charge in implementing D&A technologies and principles and will act as a single point of contact for data engineering processes to ensure the team is delivering impactful and useful solutions. Job Responsibilities Leads both operational and directional aspects for the data engineering team Make high-judgement … and enable team to deliver on their commitments Builds team with healthy dynamics Upholds department and company policies and reinforces them when necessary Champion clean, simple, methodical, and ethical data engineering practices Create and maintain optimal data pipeline architecture Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater More ❯

AD/Director - Data Scientist - Shape the Future of Tech Led Businesses Associate Director/Director of Data Science sought by this fascinating consultancy that helps the world's leading technology-led companies understand the interactions between people and the technology they use in everyday life. The Company This medium-sized consultancy has its heritage in anthropology, business … consultancy, digital product development, data, and design. They have experienced strong growth in their data science division and seek to add an AD or Director to the team. Their focus is on helping technology-led businesses invent better futures by creating products, services, and business models that drive sustainable growth. They use a combination of social and data science to give their clients a foundational understanding of the world, their customers, and their organizations. The data science team interrogates client data (big data), surveys, and social data to garner rich insights that clients can implement to grow their offers and business. The Role Due to continued growth, our client is looking to More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

About Archive360Archive360 delivers a modern archiving platform that empowers organizations to address complex data governance and compliance challenges while leveraging AI and analytics. By transforming data into a trusted, accurate, and protected strategic asset, we help organizations achieve their business objectives and drive innovation. Position Overview:We are seeking a Pre-Sales Solutions Architect who blends technical expertise … our sales organization, bridging the gap between technical functionality and customer needs. You’ll partner closely with Sales, Product, and Engineering teams to deliver tailored solutions that solve complex data analysisand archiving challenges. Key Responsibilities: Be an expert in big data analytics to excite customers about Archive360. You will become a trusted advisor on multiple issues of … customer needs and business goals. Develop customer relationships and build internal partnerships with account executives and teams. What You Bring: Must have experience with ETL tools such as Azure Data Factory and processes for data extraction, transformation, and loading Must have experience with structured data management and migrations. Must have prior experience with involvement in application retirement More ❯

efficiency. Working at GSR is an opportunity to be deeply embedded in every major sector of the cryptocurrency ecosystem. About the role: This role sits within GSR's global Data Engineering team, where you'll contribute to the design and development of scalable data systems that support our trading and business operations. You'll work closely with stakeholders … across the firm to build and maintain pipelines, manage data infrastructure, and ensure data is reliable, accessible, and secure. It's a hands-on engineering position with scope to shape the way data is handled across the business, working with modern tools in a fast-moving, high-performance environment. Your responsibilities may include: Build and maintain scalable … efficient ETL/ELT pipelines for both real-time and batch processing. Integrate data from APIs, streaming platforms, and legacy systems, with a focus on data quality and reliability. Design and manage data storage solutions, including databases, warehouses, and lakes. Leverage cloud-native services and distributed processing tools (e.g., Apache Flink, AWS Batch) to support large-scale More ❯

Job Title: AWS Data Engineer Contract: 6 Months Location: Remote, UK Skills: Advanced knowledge of data management tools including SQL/DBMS, MongoDB, Hadoop and/or other big data technologies. Advanced programming skills in Java, Python, R, C++, C#, etc. Knowledge of statistical and data mining techniques (regression, decision trees, clustering, neural networks, etc. … . Experience with data visualization tool is plusExposure to online, mobile, and social data is a plus. Intellectual curiosity, along with excellent problem-solving and quantitative skills, including the ability to disaggregate issues, identify root causes and recommend solutions. Ability to independently own and drive model development, balancing demands and deadlinesStrong people skills, team-orientation, and a professional … teams bring the latest analytical techniques plus a deep understanding of industry dynamics and corporate functions to help clients create the most value from data. Must Have: Enterprise Knowledge Data Management, Data pipeline, Python, SQL, AWS Centralising data stored in RDBMS, Data Ingestion, and Uploading data into the database. Education: Bachelor's degree in quantitative More ❯

Senior Data Architect BDC Services - EMEA At SAP, we enable you to bring out your best. Our company culture focuses on collaboration and a shared passion to help the world run better. We prioritize building a foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and aligns with our purpose-driven and future-focused work. We … in collaboration with our clients-from discovery to delivery-to create tailored, high-value software backed by SAP. We leverage the latest technologies in AI/ML, Integration, Governance, Big Data, and Analytics, employing an agile approach to deliver solutions swiftly. EMEA Business Data Cloud (BDC) Services is a regional team under the EMEA Services organization, focused … on Data & Analytics to build a solid foundation for Business AI. We help customers innovate on Business Data Cloud and accelerate their cloud journey. SAP BDC is a data & analytics platform on BTP for the Intelligent Enterprise, enabling agility, business value, and continuous innovation through integration, data-to-value, and extensibility of SAP and third-party More ❯

Title: VP Engineering, Activation WHO WE ARE Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers are over 1,000 strong, across 20 markets around the world. WHO WE ARE LOOKING FOR This position is a hands … Internally, the role is accountable for the successful technical delivery of many products within the Activation product area, entailing hands-on architecture and guidance for the implementation of our data platforms. Externally, the role is the engineering face of Activation, entailing senior stakeholder relationship management, product positioning and customer adoption. The role demands a balance of: deep technical expertise More ❯

a Senior Security Engineer, you'll help to build and manage services that detect and automate the mitigation of cybersecurity threats across Amazon's infrastructure. You'll work with data scientists, software development engineers, and other security engineers across multiple teams to develop innovative security solutions. Our services protect the AWS cloud for all customers and preserve our customers … to be successful in this role. The team has a mix of experience levels, and we're building an environment that celebrates knowledge sharing and mentorship. Our senior engineers, data scientists, and managers truly enjoy mentoring junior engineers, data scientists, and engineers from non-traditional backgrounds through one-on-one mentoring and thorough, but kind, code reviews. About … and/or incident response in the context of large organizations. In-depth understanding of security threats, hands-on experience detecting and defending from cyber attacks, and experience using big data analytics and orchestration to address security challenges. Ability to develop code with at least one modern language such as Java, Go, TypeScript, Python, Rust and security code More ❯

Senior Data Scientist - Hybrid 3 days/week in London (Victoria) - £110k - Must be security clearable We are seeking a highly skilled Senior Data Scientist to join our clients team who will be reposrting to the Data Delivery Lead. You will be responsible for analysing and interpreting data from a variety of sources to support their … clients decision-making processes. Key Responsibilities Design and build cloud-based data analytics tools, not just consume them Work on large-scale geospatial datasets and complex structured/unstructured data Apply Machine Learning and AI techniques creatively to intelligence and analysis problems Collaborate across disciplines: work closely with engineers, intelligence analysts, and non-technical stakeholders Take ownership of … delivery aspects alongside the software engineering lead Provide technical mentorship to a junior but eager data science team Tech & Skills Requirements Python (strong requirement) SQL and/or Tableau for analytics and data visualisation Strong grasp of software development principles and how analytics tools integrate with backend systems Broad data science experience, ideally including big data More ❯