15 of 15 Big Data Jobs in the City of London

About the Job you are considering: This role involves designing, building, and supporting large‐scale Big Data solutions using Hadoop and Spark technologies. You will primarily develop and debug Spark jobs in Scala, with opportunities to use Java and Python where appropriate. The position focuses on creating scalable … data pipelines, optimizing distributed processing, and supporting analytics and data science teams. It also offers exposure to cloud‐based Big Data platforms and modern data engineering practices in a fast‐paced, data‐driven environment. Hybrid working: The places that you work from ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Senior Data Engineer Location: London (Hybrid) Function: Data Engineering/Data Platform Salary: Up to £140,000 base + bonus + benefits About the Role Our client is a global commodities and energy trading firm operating at the intersection of quantitative research, technology, and trading. Following … firm has significantly expanded its capabilities in renewable power optimisation, analytics, and physical gas trading across international markets. They are now hiring a Senior Data Engineer to join their Technology Data, AI & UX team in London. This team sits close to the trading floor and is responsible ...

Role: We're on the lookout for a Data Scientist who brings genuine depth in both data engineering and visualisation. You'll be joining a growing Data & Analytics team and stepping into a role that spans the full data journey - from architecting robust pipelines to turning … someone who's equally comfortable crafting polished Tableau dashboards, this one's for you. What You'll Be Doing: Design and maintain scalable data pipelines using PySpark and SQL across distributed environments Wrangle and analyse large, complex datasets to surface meaningful patterns and trends Build data science solutions ...

currently partnering with a high-growth Data & AI consulting firm that is delivering impactful transformation programs for global enterprise clients across CPG, Retail, Manufacturing, and Automotive . They are looking to hiring for a Sr. Manager/Director – Analytics Consulting role based in London . This is a critical … leadership position for someone who can combine deep technical expertise with strong consulting, solutioning, and client engagement capabilities to drive impactful data and AI-led transformation for enterprise clients . What You’ll Be Driving- Lead digital transformation initiatives powered by Data, AI, and advanced analytics Define ...

Contract Opportunity for an eDV Cleared Data Engineer with a leading National Security Consultancy in London. Active Enhanced DV Clearance required £680 p/d inside IR35 12-month engagement Full-time on-site in Central London The Role: You will design and deliver mission-critical data services … National Security clients. Working across AI, cyber security, cloud, big data and digital transformation initiatives, you will help shape the future of national security. You will build and manage robust data pipelines that convert raw, diverse data sources (batch, streaming, real-time and unstructured) into reliable ...

systems reliable, secure, and scalable. This is a hands-on role working across a broad stack - from Linux servers and networking to containers and big data platforms - with a strong focus on automation and problem-solving. The successful candidate must have strong on-prem experience and will ideally … full-stack infrastructure Experience with Git, Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely ...

Role Title: Scala Engineer/Data Engineer (CIP) Duration: 6 month contract Location: London, mainly remote working with 1 day per month at office for co-working days Rate: up to £598 p/d Umbrella inside IR35 Role purpose/summary What is the Customer Insight Platform … together provide a platform and services to collect, evaluate and analyse customer interaction data. Context: Teams across CIP CIP focuses on capturing customer interaction data across the client estate and making it easily available to a wide audience through several different channels. CIP processes and stores a vast amount ...

sophisticated technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive … Senior Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability of the business. ...

Contract Opportunity for an eDV Cleared Data Scientist with an Industry-Leading National Security Consultancy in London. Active eDV Required Up to £680 p/d Inside IR35 12-month engagement Urgent requirement - ASAP start 5 days on site in central London The Role: You will develop mission-critical … data solutions for National Security clients. You will contribute to advanced projects across AI, cybersecurity, cloud, big data and digital transformation, helping to shape the future of national security. Working with datasets of varying scale, you will cleanse, integrate and analyse data to enable faster, more ...

arisen for an experienced KDB Developer to work alongside their Quants and Traders. This is an exciting opportunity to take ownership of critical data and analytics capabilities in a business where your work will directly support front-office decision-making, research, and platform performance. In addition to the base … every 6 months. THE ROLE: KDB Developer This position sits within a small, highly capable team focused on building, improving and supporting the firms data environment. The successful candidate will play a key role in designing and developing scalable data collection and analytics solutions, while helping ensure ...

sourcing channels, including LinkedIn, job boards, social media, forums, and coding platforms (e.g., GitHub, Stack Overflow). Source for tech talent across Software Engineering, Big Data & AI, DevOps & Cloud. Conduct Boolean and X-ray searches to uncover hidden talent. Strong understanding of technology roles, tools, and industry trends. ...

business made up of a network of highly specialised companies, which support leading industrial groups in defining and developing business models using Artificial Intelligence; Big Data; Cloud Computing; Digital Communication and Social Networking. Your new role Due to the growth of the business, my client is looking … work for a reputable and high-growth business. This business has grown at a fast rate over the last few years and has big plans for the next 5 years to expand into new territories. This is an opportunity for a qualified ACA to apply their practice experience within ...

systems reliable, secure, and scalable. This is a hands-on role working across a broad stack - from Linux servers and networking to containers and big data platforms - with a strong focus on automation and problem-solving. The successful candidate must have strong on-prem experience and will ideally ...