1 to 25 of 56 Big Data Jobs in London

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Principal Data Engineer National Security client Daily rate up to £900 Central London based organisation in an easily accessible location To apply please call or email (see below) WHO WE … ARE? We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED Please either apply by More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Principal Data Engineer National Security client Daily rate up to £900 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Requirements · Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. · Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation … and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect, design, and implement scalable … Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows using Agile best practices More ❯

comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. Requirements Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models … schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to identify and address data More ❯

Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog) 3 - 6 months Remote (UK Candidates Only) £550 - £600 per day Outside IR35 We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts. As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner with responsibilities of … end-to-end design, build and deployment of industry-leading big data and AI applications. Your work will be varied and your responsibilities will include: Designing, developing, and managing end-to-end data pipelines Data processing and transformation using Spark Providing technical governance to enhance ways of working Champion DevOps and CI/CD methodologies to … ensure agile collaboration and robust data solutions Engineer and orchestrate data models and pipelines Lead development activities using Python, PySpark and other technologies Write high-quality code that contributes to a scalable and maintainable data platform To be successful in this role, you will need to have the following qualifications: Experience with Big Data Technologies More ❯

Role: Data Engineer Role type: Permanent Location: UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organisation, we push the boundaries of data science, optimisation and artificial intelligence to solve the most complex problems in the industry. Satalia, a WPP company is a community of individuals devoted to working on diverse and challenging projects, allowing … a multi-year roadmap. Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. YOUR RESPONSIBILITIE Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists have access to … the data they need in the format they need it. Implement and optimize data transformations and ETL/ELT processes, using appropriate data engineering tools. Work with a variety of databases and data warehousing solutions to store and retrieve data efficiently. Implement monitoring, troubleshooting, and maintenance procedures for data pipelines to ensure the high More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelines More ❯

DATA SCIENTIST - eDV CLEARED NEW PERMANENT OPPORTUNITY AVAILABLE FOR A DATA SCIENTIST IN LONDON WITH ENHANCED DV CLEARANCE Permanent opportunity for a Data Scientist Enhanced DV security clearance is required Salary up to £95,000 + Clearance Bonus + Company Bonus Central London based organisation in an accessible location To apply please call/or email WHO … WE ARE? We are recruiting a permanent Data Scientist to work with a leading technology and engineering company that do excellent work in the National Security sector across a range of exciting projects. Due to the nature of our clients, you must hold enhanced DV security clearance. WHAT WILL THE DATA SCIENCE ENGINEER BE DOING? As a Data … you will be working alongside our team on a wide variety of projects with a special focus on innovation and AI. You could be working with all types of data (both structured and unstructured) using a variety of software - so we're open to seeing engineers with different technology backgrounds! THE DATA SCIENCE ENGINEER SHOULD HAVE.... Strong and More ❯

Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS) is a plus. Advanced SQL for querying and data manipulation. Familiarity with Java, Python, or VBA for scripting and automation. Knowledge of RESTful APIs and various database systems. Skills … in data profiling, data analysis, and ensuring data quality. Experience 612 years in Data Integration and ETL development. Minimum 35 years of hands-on Pentaho experience. Leading complex ETL projects and working with cross-functional teams. Exposure to Banking/Financial Services domain is a plus. Preferred Qualifications Certifications in Pentaho, Big Data, or … Cloud Platforms (AWS/GCP/Azure). Experience with Big Data technologies (Hadoop, Spark) and cloud data services. More ❯

Senior Data Engineer The Senior Data Engineer will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. This position is ideal for those with strong technical expertise and a passion for working in the Insurance/Financial services industry. Client Details Senior Data Engineer The employer is a medium-sized organisation … operating in the F sector. They focus on delivering innovative solutions and maintaining a strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams … to meet business objectives. Ensure data integrity and implement best practices for data governance. Design and implement data models to support analytical and reporting needs. Monitor and troubleshoot data systems to ensure reliability and performance. Evaluate and implement new tools and technologies to improve data infrastructure. Provide technical guidance and mentorship to junior team members. More ❯

Senior Data Engineer The Senior Data Engineer will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. This position is ideal for those with strong technical expertise and a passion for working in the Insurance/Financial services industry. Client Details Senior Data Engineer The employer is a medium-sized organisation … operating in the F sector. They focus on delivering innovative solutions and maintaining a strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams … to meet business objectives. Ensure data integrity and implement best practices for data governance. Design and implement data models to support analytical and reporting needs. Monitor and troubleshoot data systems to ensure reliability and performance. Evaluate and implement new tools and technologies to improve data infrastructure. Provide technical guidance and mentorship to junior team members. More ❯

Legal Data Analytics Manager Location: London Permanent role. Primary skills Data statistics & Analysis; Client Dashboards;To extract Data, consolidate and analyse it; Create automation solutions including AI solutions; Quantitative analytics (e.g. offer calculations for claims); Analysis for Decision making; Modelling of quantum exposure; Record Data breach analytics The Data Analytics Manager will focus on building … internal client relationships and on the delivery of day-to-day matter work in the data analytics team. Management of people ensuring the appropriate resourcing of matters, training, reporting and you will work closely with the Senior Manager, Data Analytics. The Data Analytics Manager will be responsible for providing expertise, advising on any issues within the team … of the team. The role will ensure the overall provision of high quality services and will play a key part through effective consultancy in building the reputation of the Data Analytics Team, both internally and externally to clients. Responsibilities: With the Head of Data Analytics you’ll be part of the design, development and ongoing evolution of dashboards. More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

Pay: £50,000.00 - £60,000.00 per year Job description: Data & Technology Lead - London - £50k-£60k DOE + Profit Share THE AGENCY My client is an employee-owned media agency with deep expertise in property and travel sectors, along with a variety of other sectors, renowned for data-driven decision-making that delivers measurable client outcomes. Their collaborative culture … fosters trust and meaningful relationships, offering a modern Farringdon office with hybrid flexibility. THE ROLE: Data & Technology Lead As the Data & Technology Lead, you'll spearhead the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading all aspects of Data & Technology including architecture, MarTech implementation, and AI automation, you'll … ensure seamless data flow across the business to drive client performance. This pivotal Data & Technology role demands a unique blend of technical expertise, leadership, and client-facing skills. You'll manage and develop team members, oversee data engineering projects, and own the agency's core data pipelines and platforms. Key Responsibilities Data Engineering & Architecture : Lead More ❯

Who Are We Cognism is the leading provider of European B2B data and sales intelligence. Ambitious businesses of every size use our platform to discover, connect, and engage with qualified decision-makers faster and close more deals. Headquartered in London with global offices, Cognism's contact data and contextual signals are trusted by thousands of revenue teams to … WORK MODEL Remote or Hybrid: This can be a remote or hybrid role depending on your location and proximity to one of our local offices. YOUR ROLE As a Data Scientist III (Information Retrieval) , you will design and implement advanced models, drive innovation through machine learning and AI, and mentor team members. In this high-impact role, your work … will directly shape Cognism's data-driven products and business strategies. YOUR CHALLENGES & OPPORTUNITIES Develop Advanced Models – Build and maintain sophisticated statistical and machine learning models that drive business decisions and integrate with enterprise systems. Lead Innovation – Design and pilot cutting-edge predictive models and algorithms, testing scalability and implementing successful approaches into production environments. Own Projects End-to More ❯

for what's next. An environment where your skills will evolve at the frontier of innovation and AI, ensuring continuous growth and development. We are looking for a Principal Data Engineer to work alongside our market-leading engineers and architects to deliver complex projects and make valuable impacts for our customers. We look for people who embody: Innovation to … every result. ‍Integrity always. About The Role The purpose of this role is to engage with enterprise-level organisations to offer a consultative view and direction on best practice data architecture using Google Cloud solutions. This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect … on client-facing delivery projects Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability Identify, scope, and participate in the design and delivery of cloud data platform solutions Deliver highly scalable big data architecture solutions using Google Cloud Technology: Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

scalable and reliable micro services. Hands-on experience with AWS services such as S3, Lambda, Athena, EC2, SQS, RDS, DynamoDB, etc. Strong proficiency in SQL, with experience of building data pipelines, data models, and data transformation within data warehouses, knowledge of tools such as DBT is desired. Strong proficiency in Python, with a deep understanding of … team. Strong communication and interpersonal skills, with the ability to effectively collaborate with stakeholders at all levels, provide training, and solicit feedback. Preferred qualifications, capabilities, and skills Experience with big-data technologies, such as Splunk, Trino, and Apache Iceberg. Data Science experience. AI/ML experience with building models. AWS certification (e.g., AWS Certified Solutions Architect, AWS More ❯

and real ownership come together to shape the future of ad-fraud prevention. The Opportunity In this role, you'll help shape a platform that processes large volumes of data and safeguards digital advertising integrity. You'll design simple, effective solutions, write maintainable Python code, and ensure reliability through testing and observability practices. The work spans implementation, documentation, and … platform team responsible for building and scaling the backend systems that power a machine-learning driven ad-fraud prevention platform. You'll work extensively with Python and large-scale data sets, supporting model training on billions of data points, delivering features to data science teams, and helping launch new models, tracking capabilities, and integration's across major … ad platforms. The work spans everything from developing big-data pipelines on cloud infrastructure (AWS, Redshift, or equivalent) to supporting greenfield projects like new affiliate products and upcoming channel integration's. You'll contribute to a fast-paced engineering environment that deploys to production twice a week, where processes exist but can evolve and where autonomy and technical More ❯

align with Solirius Reply Values. The Role: We are looking for an experienced AI Engineer to join our team here at Solirius. You will join a multidisciplinary practice comprising Data Scientists, Data Engineers, and Software Engineers, developing and delivering exciting projects with a fantastic team of technology experts. Your primary focus will be designing, architecting, and deploying robust … Systems: Design and orchestrate autonomous agentic workflows (using frameworks like LangChain, AutoGen, or CrewAI) that can reason, plan, and execute tasks across multiple tools. Production Engineering: Work collaboratively with Data Engineers to ensure model deployments are supported by robust data storage, vector databases, and cloud infrastructure. AI-Assisted Development (AICA): Act as a practitioner and mentor for AI … understand the distinction between standard ML and agentic AI. Continuous Learning: Stay updated with the latest trends in the AI engineering field, such as the modern AI stack, synthetic data generation, and Explainable AI. Key Skills/Experience: Engineering Foundations: Strong proficiency in Python and robust software engineering principles, with experience operating as part of engineering teams. Generative AI More ❯