1 to 25 of 51 Big Data Jobs in London

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong … proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ ...

premium experiential hospitality. Working Conditions: Permanent, London Stockley Park Mon-Fri, 9am-5pm What You'll Do: The Product Manager role sits within the Data Services department responsible for data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics … Data Science. We work in cross-functional squads composed of Data Engineers, Data Analysts, Data Scientists, and other supporting roles such as DevOps, Security and Architecture. As a Product Manager within TKO Data & AI Services department, you will be responsible for managing the entire product ...

this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure ...

Zenith UK AI Data Engineer Our Commitment At Zenith UK, we believe that fostering an inclusive culture where all talent can thrive makes our company stronger. It enables a greater idea exchange, which fosters innovation and creativity, and enriches our perspective.We are committed to Publicis Groupe’s wide variety … shaping the future of AI and thrive on complex, high-impact challenges, we encourage you to apply. What You'll Do: As a Senior Data Engineer for AI/ML, you will be the architect and builder of the data infrastructure that feeds our intelligent systems. Your responsibilities ...

London Office.Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What this role … about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. Youll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair to every challenge. Your voice will shape ...

Office. Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What this role … about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. You’ll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair to every challenge. Your voice will shape ...

About the Job you are considering: This role involves designing, building, and supporting large‐scale Big Data solutions using Hadoop and Spark technologies. You will primarily develop and debug Spark jobs in Scala, with opportunities to use Java and Python where appropriate. The position focuses on creating scalable … data pipelines, optimizing distributed processing, and supporting analytics and data science teams. It also offers exposure to cloud‐based Big Data platforms and modern data engineering practices in a fast‐paced, data‐driven environment. Hybrid working: The places that you work from ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

sits at the Intersection of Software Engineering and Offensive Security . You will Not Just Write Code; you will Architect the Cloud-Native Engines & Big Data Pipelines that Power Automated Red Teaming. Your work will "Bridge the Gap" Between Manual Research & Scalable, Real-Time Threat Simulation. Skills & Experience … Software Engineering (Python or Go) with Focus on Maintainable, Production-Grade Code. Cloud Architecture: Deep experience with Cloud-Native Services (AWS etc) & Serverless Architectures. Big Data: Proven Ability to Handle High-Volume Data Processing & Ingestion Pipelines. Offensive Exposure : Interest or Experience in Security (CTFs, Red Teaming ...

Senior Data Engineer Location: London (Hybrid) Function: Data Engineering/Data Platform Salary: Up to £140,000 base + bonus + benefits About the Role Our client is a global commodities and energy trading firm operating at the intersection of quantitative research, technology, and trading. Following … firm has significantly expanded its capabilities in renewable power optimisation, analytics, and physical gas trading across international markets. They are now hiring a Senior Data Engineer to join their Technology Data, AI & UX team in London. This team sits close to the trading floor and is responsible ...

Overview Join Chambers as a Junior Data Engineer. This is a fantastic opportunity to gain practical experience in our growing Data team and also study towards an accredited Level 5 Data Engineer Apprenticeship. If you are keen to learn, develop your data engineering skills … expected interview topics/questions. Main Duties and Responsibilities Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner Effectively create, optimise ...

Data Engineer (Innovation Group) Location: London (Hybrid – 3 days per week) Duration: 6 Months Initial Contract Rate: TBD Are you a Data Engineer who thrives on building more than just standard ETL pipelines? Our Innovation Group is looking for a technical problem-solver to design, build, and codify … rules that power our next-generation data models. The Role You will focus on the end-to-end lifecycle of data, from the initial design of structured and unstructured models to the engineering of scalable pipelines. You will be responsible for the codification of complex business rules ...

Role Overview We are looking for a skilled Data Engineer to design, build, and maintain scalable data solutions that support business intelligence and analytics initiatives. You will work closely with stakeholders to transform raw data into meaningful insights, ensuring high data quality and reliability across platforms. … Must have worked in the telecommunications domain. Key Responsibilities Design, develop, and maintain robust data pipelines and ETL processes Build and optimise data models to support reporting and analytics requirements Develop and enhance dashboards and reports using Power BI Write efficient and scalable SQL queries for data ...

Databricks Data Architect - Hybrid - Permanent Job Summary We are looking for a Databricks Data Architect with Databricks certifications to design and implement scalable data platforms using the Databricks Lakehouse architecture. The role involves building modern data pipelines, optimizing data platforms, and enabling analytics and machine … learning capabilities across the organization. Key Responsibilities Design and implement data architectures on the Databricks Lakehouse Platform Build and optimize ETL/ELT pipelines using Apache Spark and Databricks Implement Delta Lake and medallion architecture (Bronze, Silver, Gold) Ensure data governance, security, and performance optimization Integrate Databricks with ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell’s architectural … migrations/re-platforming of legacy on-premises systems* Engineering and architecture experience in designing and building containers, Microservices, Cloud Native applications, and federated Data platforms (Data Mesh)* Possesses solid experience in Data Architecture, including developing logical data models and designing solutions that leverage modern data ...

Role: We're on the lookout for a Data Scientist who brings genuine depth in both data engineering and visualisation. You'll be joining a growing Data & Analytics team and stepping into a role that spans the full data journey - from architecting robust pipelines to turning … someone who's equally comfortable crafting polished Tableau dashboards, this one's for you. What You'll Be Doing: Design and maintain scalable data pipelines using PySpark and SQL across distributed environments Wrangle and analyse large, complex datasets to surface meaningful patterns and trends Build data science solutions ...

currently partnering with a high-growth Data & AI consulting firm that is delivering impactful transformation programs for global enterprise clients across CPG, Retail, Manufacturing, and Automotive . They are looking to hiring for a Sr. Manager/Director – Analytics Consulting role based in London . This is a critical … leadership position for someone who can combine deep technical expertise with strong consulting, solutioning, and client engagement capabilities to drive impactful data and AI-led transformation for enterprise clients . What You’ll Be Driving- Lead digital transformation initiatives powered by Data, AI, and advanced analytics Define ...

currently partnering with a high-growth Data & AI consulting firm that is delivering impactful transformation programs for global enterprise clients across CPG, Retail, Manufacturing, and Automotive . They are looking to hiring for a Sr. Manager/Director – Analytics Consulting role based in London . This is a critical … leadership position for someone who can combine deep technical expertise with strong consulting, solutioning, and client engagement capabilities to drive impactful data and AI-led transformation for enterprise clients . What You’ll Be Driving- Lead digital transformation initiatives powered by Data, AI, and advanced analytics Define ...

Contract Opportunity for an eDV Cleared Data Engineer with a leading National Security Consultancy in London. Active Enhanced DV Clearance required £680 p/d inside IR35 12-month engagement Full-time on-site in Central London The Role: You will design and deliver mission-critical data services … National Security clients. Working across AI, cyber security, cloud, big data and digital transformation initiatives, you will help shape the future of national security. You will build and manage robust data pipelines that convert raw, diverse data sources (batch, streaming, real-time and unstructured) into reliable ...

Description Haver Analytics is the premier provider of time series data for the global strategy, research and quant communities. We deliver primary-sourced databases, a wealth of key survey and forecast data from our industry partners, and a robust offering of archive databases that drive machine learning … big data applications. We continuously display up-to-the-minute data from over 2500 government and private sources via integration with Microsoft Office and all leading statistical packages through our DLX® software and platform-independent HaverView(TM). We pride ourselves on the quality of the data ...

leading Tech client are looking for a talented and motivated individual to ensure the resilience, performance, and cost-effectiveness of their Azure-based data platform. This role is essential to their data ecosystem, combining platform reliability, incident response, SLA management, cost optimization (FinOps), and deployment oversight. You will … newly created role in a growing business. A brilliant opportunity! The following skills/experience is required: Proven operational leadership for large-scale data platforms. Expertise in incident management, SLA enforcement, and stakeholder communication. Hands-on experience with Azure Synapse, Databricks, ADF, Power BI. Familiarity with CI/ ...

leading Tech client are looking for a talented and motivated individual to ensure the resilience, performance, and cost-effectiveness of their Azure-based data platform. This role is essential to their data ecosystem, combining platform reliability, incident response, SLA management, cost optimization (FinOps), and deployment oversight. You will … newly created role in a growing business. A brilliant opportunity! The following skills/experience is required: Proven operational leadership for large-scale data platforms. Expertise in incident management, SLA enforcement, and stakeholder communication. Hands-on experience with Azure Synapse, Databricks, ADF, Power BI. Familiarity with CI/ ...

covered Experience in these areas is a bonus, contract or perm. IT : Software Development (Java, C#, C++, Python, Scala, JavaScript); Machine Learning/AI, Big Data & Data Analytics, Cloud, DevOps, Testing, Support, Infrastructure, Business Analysis, Project Management Digital : Product Analysis, Product Management, Propositions, Digital Risk, UX/… Architecture), Mobile & UI Developers Change & Transformation: TOM Design; Risk and Regulatory Change; Process Improvement (Lean Six Sigma); Strategy & Business Architecture, BA & PM Quant and Data Science : Market, Credit & Operational Risk; Quant & Risk Analytics, Regulatory Risk, ALM/Liquidity, Financial Crime Compliance, Information Security & Internal Audit Required Experience A minimum ...

systems reliable, secure, and scalable. This is a hands-on role working across a broad stack - from Linux servers and networking to containers and big data platforms - with a strong focus on automation and problem-solving. The successful candidate must have strong on-prem experience and will ideally … full-stack infrastructure Experience with Git, Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely ...