1 to 25 of 54 Big Data Jobs in London

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Requirements · Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. · Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design and … build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience … within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Analytics Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design … and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high … experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Description This position will play a critical role in the success of the Firm's Data Strategy program As a Vice President on the Data Governance team within the firmwide CDO, you will be responsible for working with stakeholders to define governance and tooling requirements and building out the Firmwide Data Lineage framework. The firmwide team also … to deliver this governance framework. In addition, you will be responsible for driving the adoption of the firmwide CDO framework by the LOBs and Corporate Functions CDOs. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality, integrity, and security of the company … s data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutions that support the firm's commercial goals by harnessing artificial intelligence and machine learning technologies to develop new products, improve productivity, and enhance risk management effectively and responsibly. Job Responsibilities Partners with CDO More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation … and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect, design, and implement scalable … Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows using Agile best practices More ❯

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing … products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform … Load) processes to ingest data from various sources • Ensure data quality, integrity, and reliability through thorough testing and validation Database Management • Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes) • Monitor and assist in maintaining database performance and security Data Integration: • Collaborate with data analysts and scientists to integrate More ❯

comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. Requirements Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models … schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to identify and address data More ❯

Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog) 3 - 6 months Remote (UK Candidates Only) £550 - £600 per day Outside IR35 We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts. As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner with responsibilities of … end-to-end design, build and deployment of industry-leading big data and AI applications. Your work will be varied and your responsibilities will include: Designing, developing, and managing end-to-end data pipelines Data processing and transformation using Spark Providing technical governance to enhance ways of working Champion DevOps and CI/CD methodologies to … ensure agile collaboration and robust data solutions Engineer and orchestrate data models and pipelines Lead development activities using Python, PySpark and other technologies Write high-quality code that contributes to a scalable and maintainable data platform To be successful in this role, you will need to have the following qualifications: Experience with Big Data Technologies More ❯

Pentaho Developer - Pentaho, Data Engineering, Cloud, Big Data, ETL, Informatica A large global organisation is looking for an experienced Pentaho Developer to design, develop, and maintain ETL workflows and data integration solutions within a modern data engineering ecosystem. The role involves building scalable data pipelines, ensuring data quality, and supporting production environments. This … full-time, permanent position. The location is London, UK. You will be required to work 3 days on-site, and 2 days remote. KEY SKILLS & EXPERIENCE: Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS). Advanced SQL for … querying and data manipulation. Familiarity with Java, Python, or VBA for Scripting and automation. Knowledge of RESTful APIs and various database systems. Skills in data profiling, data analysis, and ensuring data quality. Exposure to Banking/Financial Services domain is a plus. RESPONSIBILITIES: Design, develop, and manage ETL workflows using Pentaho Data Integration (PDI). More ❯

DATA SCIENTIST - eDV CLEARED NEW PERMANENT OPPORTUNITY AVAILABLE FOR A DATA SCIENTIST IN LONDON WITH ENHANCED DV CLEARANCE Permanent opportunity for a Data Scientist Enhanced DV security clearance is required Salary up to £95,000 + Clearance Bonus + Company Bonus Central London based organisation in an accessible location To apply please call/or email WHO … WE ARE? We are recruiting a permanent Data Scientist to work with a leading technology and engineering company that do excellent work in the National Security sector across a range of exciting projects. Due to the nature of our clients, you must hold enhanced DV security clearance. WHAT WILL THE DATA SCIENCE ENGINEER BE DOING? As a Data … you will be working alongside our team on a wide variety of projects with a special focus on innovation and AI. You could be working with all types of data (both structured and unstructured) using a variety of software - so we're open to seeing engineers with different technology backgrounds! THE DATA SCIENCE ENGINEER SHOULD HAVE.... Strong and More ❯

Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS) is a plus. Advanced SQL for querying and data manipulation. Familiarity with Java, Python, or VBA for scripting and automation. Knowledge of RESTful APIs and various database systems. Skills … in data profiling, data analysis, and ensuring data quality. Experience 612 years in Data Integration and ETL development. Minimum 35 years of hands-on Pentaho experience. Leading complex ETL projects and working with cross-functional teams. Exposure to Banking/Financial Services domain is a plus. Preferred Qualifications Certifications in Pentaho, Big Data, or … Cloud Platforms (AWS/GCP/Azure). Experience with Big Data technologies (Hadoop, Spark) and cloud data services. More ❯

Legal Data Analytics Manager Location: London Permanent role. Primary skills Data statistics & Analysis; Client Dashboards;To extract Data, consolidate and analyse it; Create automation solutions including AI solutions; Quantitative analytics (e.g. offer calculations for claims); Analysis for Decision making; Modelling of quantum exposure; Record Data breach analytics The Data Analytics Manager will focus on building … internal client relationships and on the delivery of day-to-day matter work in the data analytics team. Management of people ensuring the appropriate resourcing of matters, training, reporting and you will work closely with the Senior Manager, Data Analytics. The Data Analytics Manager will be responsible for providing expertise, advising on any issues within the team … of the team. The role will ensure the overall provision of high quality services and will play a key part through effective consultancy in building the reputation of the Data Analytics Team, both internally and externally to clients. Responsibilities: With the Head of Data Analytics you’ll be part of the design, development and ongoing evolution of dashboards. More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

for what's next. An environment where your skills will evolve at the frontier of innovation and AI, ensuring continuous growth and development. We are looking for a Principal Data Engineer to work alongside our market-leading engineers and architects to deliver complex projects and make valuable impacts for our customers. We look for people who embody: Innovation to … every result. ‍Integrity always. About The Role The purpose of this role is to engage with enterprise-level organisations to offer a consultative view and direction on best practice data architecture using Google Cloud solutions. This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect … on client-facing delivery projects Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability Identify, scope, and participate in the design and delivery of cloud data platform solutions Deliver highly scalable big data architecture solutions using Google Cloud Technology: Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

business across our Expedia, , Vrbo, and Portfolio brands, and across all our lines of businesses including Hotels, Vacation Rentals, Air, Car, Packages, and Insurtech. We are looking for a Data Scientist III to join our Growth Marketing Analytics Team. You will tackle sophisticated analytical and business problems with a focus on using statistics and data analytics to understand … display advertising), you will own relationships with our stakeholders and partner closely to plan and execute a programme of work that delivers actionable insights. You will be working with data and applying advanced data science techniques in a fun and stimulating environment. There are a variety of exciting projects that you will work on to drive business strategy. … Your insights will be used to enhance our channel strategy and competitiveness, optimize our investments and improve profitability, You will work closely with other highly-skilled data scientists across Expedia Group, as well as colleagues at various levels of seniority across Marketing, Finance and Engineering. You will partner closely with our digital marketing teams to understand the challenges they More ❯

and real ownership come together to shape the future of ad-fraud prevention. The Opportunity In this role, you'll help shape a platform that processes large volumes of data and safeguards digital advertising integrity. You'll design simple, effective solutions, write maintainable Python code, and ensure reliability through testing and observability practices. The work spans implementation, documentation, and … platform team responsible for building and scaling the backend systems that power a machine-learning driven ad-fraud prevention platform. You'll work extensively with Python and large-scale data sets, supporting model training on billions of data points, delivering features to data science teams, and helping launch new models, tracking capabilities, and integration's across major … ad platforms. The work spans everything from developing big-data pipelines on cloud infrastructure (AWS, Redshift, or equivalent) to supporting greenfield projects like new affiliate products and upcoming channel integration's. You'll contribute to a fast-paced engineering environment that deploys to production twice a week, where processes exist but can evolve and where autonomy and technical More ❯

align with Solirius Reply Values. The Role: We are looking for an experienced AI Engineer to join our team here at Solirius. You will join a multidisciplinary practice comprising Data Scientists, Data Engineers, and Software Engineers, developing and delivering exciting projects with a fantastic team of technology experts. Your primary focus will be designing, architecting, and deploying robust … Systems: Design and orchestrate autonomous agentic workflows (using frameworks like LangChain, AutoGen, or CrewAI) that can reason, plan, and execute tasks across multiple tools. Production Engineering: Work collaboratively with Data Engineers to ensure model deployments are supported by robust data storage, vector databases, and cloud infrastructure. AI-Assisted Development (AICA): Act as a practitioner and mentor for AI … understand the distinction between standard ML and agentic AI. Continuous Learning: Stay updated with the latest trends in the AI engineering field, such as the modern AI stack, synthetic data generation, and Explainable AI. Key Skills/Experience: Engineering Foundations: Strong proficiency in Python and robust software engineering principles, with experience operating as part of engineering teams. Generative AI More ❯

Senior Data Scientist - £75,000 to £85,000 + 3 days a week onsite Method Resourcing is supporting a high-growth data function in central London who are building out their Data Science capability and looking for an experienced Senior Data Scientist ready to progress into a leadership role. You'll join a flat-structured team … presenting to senior leadership, able to mentor others, and capable of stepping into a Lead role within 1-2 years. The Role You'll act as the blend of: Data & AI evangelist - educating stakeholders on possibilities and translating technical outcomes to business value. Data specialist - shaping data science strategy, building production-ready ML models, and embedding best … Translate complex business problems into research questions with quantifiable objectives. Identify, acquire, and work with structured and unstructured datasets. Build, validate, deploy, and monitor production ML models. Partner with data engineers, ML engineers, architects, and business teams to shape ML initiatives. Present insights clearly through strong data visualisation and storytelling. Uphold software engineering and MLOps best practices (testing More ❯

in Q4 2024, led by Notable Capital, CRV and Heavybit. At its core, LocalStack provides a high-fidelity emulator and local cloud development platform. Imagine developing cloud applications and data pipelines entirely on your local machine within a lightweight cloud sandbox, running in Docker Our mission is to empower developers to rapidly build and test their cloud applications, allowing … GitHub This role is ideal for someone with 5+ years of software engineering experience, strong API design skills, and solid backend expertise. You'll work on Snowflake and AWS big data emulators, building features and ensuring high-fidelity cloud platform emulation to help developers test locally with speed and confidence. Requirements What you will be working on/… messages, good performance, and easy configuration. Improve emulator usability in CLI tools, SDKs, and client integrations (e.g., JDBC, SnowSQL, 3rd part integrations). Design and implement support for additional data platform features, services, and cloud providers (e.g. Azure Synapse, BigQuery). Track cloud service evolution and update emulators to reflect new capabilities or changes. Build abstractions that make it More ❯

is Point72's core investment strategy, and its success depends upon our sector-based investing teams comprised of portfolio managers and research analysts. As an ever-increasing amount of data is applied to the fundamental equity strategies, we are seeking a dedicated data engineer intern to help design and build solutions that enable investment professionals to extract insights … from large, complex, Compliance-approved structured and unstructured data sets. Over your 10-week internship in our London office, you will gain exposure to a variety of activities, which may include: Developing and supporting data processing pipelines including but not limited to ingestion, transformation, and end-customer delivery Working closely with investment professionals, researchers, and data scientists … to design, build, launch, and maintain robust end-to-end data pipelines and tools that help extract the most value out of our data assets Building out cloud-based infrastructure using distributed techniques for other data engineers, data scientists, and researchers Creating and supporting visualisation and exploration capabilities around our big data sets What More ❯