1 to 25 of 70 Big Data Jobs in London

Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance … cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires ...

Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance … cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires ...

Data Architect £Up to £90,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Join a world-class organisation building mission-critical data architectures for Defence, National Security, and Public Sector programmes. … commitment to supporting the Armed Forces community has also been honoured with the ERS Gold Award. If you're passionate about shaping secure, scalable data ecosystems that underpin national security, this is the opportunity for you. As a Data Architect - Defence, you will lead the technical vision ...

seeking an experienced and highly motivated Data Analytics Principal to join us on a 12-month FTC. This role is pivotal in shaping our clients’ data and analytics strategies, ensuring high-quality data analysis, and driving actionable insights to support business decisions. The Data Analytics Principal … will collaborate closely with senior leadership, cross-functional teams, and external partners to ensure that data is integrated into business strategies and operations. You will be a key point of contact for both internal and external teams building relationships and driving forward the offering of our data analytics ...

Details Role/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead … provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management: Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing data infrastructure, including data lakes, warehouses ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data-driven solutions … high-profile government clients. You’ll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data-driven solutions … high-profile government clients. You’ll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists ...

About The Role Team – Data Engineering Working Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full time, 37.5 hours per week. We are happy to discuss flexible working! Top 3 skills needed for this role: Designing and delivering scalable data pipelines Strong programming … capability with SQL Deploying and maintaining machine learning models as APIs in production environments What this role is all about: Join us as a Data Engineer and help build the data foundations that power machine learning and analytics across Vitality. You’ll work with rich datasets and modern ...

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve … efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, real-time data ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS) is a plus. Advanced SQL for querying and data manipulation. Familiarity with Java, Python, or VBA for scripting … automation. Knowledge of RESTful APIs and various database systems. Skills in data profiling, data analysis, and ensuring data quality. Experience 612 years in Data Integration and ETL development. Minimum 35 years of hands-on Pentaho experience. Leading complex ETL projects and working with cross-functional teams. ...

Senior Data Engineer The Senior Data Engineer will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. This position is ideal for those with strong technical expertise and a passion for working in the Insurance/Financial services industry. Client Details Senior … Data Engineer The employer is a medium-sized organisation operating in the F sector. They focus on delivering innovative solutions and maintaining a strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines ...

Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools ...

000.00 - £60,000.00 per year Job description: Data & Technology Lead - London - £50k-£60k DOE + Profit Share THE AGENCY My client is an employee-owned media agency with deep expertise in property and travel sectors, along with a variety of other sectors, renowned for data-driven decision-making … that delivers measurable client outcomes. Their collaborative culture fosters trust and meaningful relationships, offering a modern Farringdon office with hybrid flexibility. THE ROLE: Data & Technology Lead As the Data & Technology Lead, you'll spearhead the design, build, and optimisation of our data infrastructure, automation solutions ...

exciting opportunity has emerged for a Data Analyst to join the homelessness department at one of Adecco's leading Local Government clients in a temporary role for the next six months, with potential extension beyond this. This is a full time role (36 hours per week, Monday to Friday … would be highly desirable. The role will be reporting directly into the Assistant Director Housing Demand/Programme Director, and the work is analysing data in the service to provide management insight and is core to financial control within housing demand. It will assist in providing accurate budgetary forecasting ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver ...

week apply asap/Today Key Responsibilities: Build and optimize AI/ML pipelines for predictive modelling, NLP, and generative AI applications. Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data … with cross-functional teams to deploy AI solutions in production environments. Ensure scalability, security, and compliance of AI systems. Required Skills: Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis ...

Senior Data Scientist Employment Type: Permanent Location: [Specify location or remote flexibility] Role Overview: We are seeking a highly skilled Senior Data Scientist with expertise in multi-cloud environments and a strong background in consulting . The ideal candidate will lead advanced analytics projects, design scalable data … clients across diverse industries. This role requires a blend of technical proficiency, business acumen, and excellent communication skills. Key Responsibilities: Design and implement data science models (predictive, prescriptive, and descriptive analytics) to solve complex business problems. Work across multi-cloud platforms (AWS, Azure, GCP) to build and deploy scalable ...

Senior Data Scientist Employment Type: Permanent Location: [Specify location or remote flexibility] Role Overview: We are seeking a highly skilled Senior Data Scientist with expertise in multi-cloud environments and a strong background in consulting . The ideal candidate will lead advanced analytics projects, design scalable data … clients across diverse industries. This role requires a blend of technical proficiency, business acumen, and excellent communication skills. Key Responsibilities: Design and implement data science models (predictive, prescriptive, and descriptive analytics) to solve complex business problems. Work across multi-cloud platforms (AWS, Azure, GCP) to build and deploy scalable ...

Purpose of position As a Senior Data Engineer, you will play a pivotal role in our AI/ML workstream, you’ll work closely with business teams and data scientists to design, maintain, and improve machine learning applications. Your main responsibilities will include managing existing ML workloads … also contribute to developing Generative AI solutions and applications for the emerging Agentic Era. You’ll collaborate with a global team to create scalable data architectures optimised for AI/ML, source and prepare high-quality data, and implement robust ETL processes. You should be comfortable working independently ...

Analysts to support large-scale integration and transformation across Personal Lines and Claims. You'll work with cross-functional teams to map processes, shape data and technology change, and ensure delivery lands cleanly into the business. Workstreams: Claims & Personal Lines: BA support across core insurance processes and change initiatives. … Analysis for upgrades/migrations; experience here is a strong plus. GenAI - Next Best Action: Define use-cases and requirements for decisioning in Claims. Data Automation (Snowflake): Help migrate DLG data to Snowflake and streamline pipelines. Big Data programmes: Personal Lines data, Claims data ...