1 to 25 of 57 Big Data Jobs in the City of London

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯

and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

Title : Senior Cloud and Data Solution Architect Work Location: London Experience: 15+Years We at Coforge are hiring Senior Cloud and Data Solution Architect professional with the following skillset: Job Summary: We are looking for a skilled Senior Cloud and Data Solution Architect in the UK (based out of London) with a strong delivery and solutions back ground … in Data Analytics and Cloud. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Sales, Delivery, Presales, Solutioning experience is mandatory within Data Analytics alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Responsibilities: 16-18+ years … of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities📝 As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment, maintenance More ❯

Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

Job Title: Solutions Architect (Data Analytics)-Pre-sales, RFP creation Location: London (3days/week onsite) Duration: Permanent Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at … least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability … response. Ability to be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working More ❯

Responsibilities : 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients. Excellent ETL skills, Data Modeling Skills. Excellent communication skills. Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

Join a leading multi-strategy hedge fund in London, where we leverage cutting-edge technology and data to drive investment decisions across diverse asset classes. We're looking for a skilled Data Engineer to play a crucial role in building and optimizing our data infrastructure. Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes. … Collaborate with data scientists and analysts to support data-driven strategies. Ensure data accuracy, consistency, and security across various data sources. Lead a team of data engineers, providing mentorship and technical guidance. Drive innovation by exploring new technologies and best practices in data engineering. Partake in the on-call support rota. Requirements: Bachelor’s … or Master’s in Computer Science, Engineering, or a related field. 2+ years of experience in data engineering, preferably within financial services. Proficiency in SQL, Python, and big data tools like Spark. Strong understanding of cloud platforms (AWS, GCP, or Azure). Excellent problem-solving skills and a collaborative mindset. More ❯

We're Hiring: AWS Data Engineer Location: London (2-3 days in office) Experience : 2+ Years Degree: STEM/Business Rate: £225 to 245 a day Umbrella Duration : 6 months contract We're looking for a Data Engineer to help power our innovation engine. You’ll design data models, build scalable ETL pipelines, codify business logic, and … drive data integration across complex systems—structured and unstructured alike. This is your chance to turn raw data into real business value using cutting-edge tech in a collaborative, forward-thinking team. What You’ll Do: Design & implement data models and scalable ETL/ELT pipelines Map data sources, codify business logic, and build data flows Develop data quality solutions & explore new technologies Collaborate with analysts, developers, and business stakeholders What You Bring: 2+ years in data engineering or related roles Bachelor’s in CS, Engineering, Mathematics, Finance, etc. Proficiency in Python, SQL , and one or more: R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big More ❯

platform, we are looking for a Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics, fostering … an agile, value-driven, and innovation-focused culture. Collaborate with business and IT stakeholders (Data Owners, Product Owners, Business Leaders) to position data as a core strategic asset. Oversee BI delivery KPIs, service performance and budgets, ensuring high quality of service and alignment with organisational goals. Promote a data-driven culture through the adoption of self-service More ❯

leading commodities trading houses, leveraging sophisticated technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive our next wave of technological … advancements. Role Overview: As a Senior Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability of the business. This is an exciting opportunity … you can push the boundaries of technology in financial markets. Key Responsibilities: Design, develop, and maintain highly efficient Python-based applications for commodities trading, risk management, and real-time data analysis. Build scalable, high-performance data pipelines to process large datasets from multiple sources, including real-time market data and fundamental data. Implement robust APIs and microservices More ❯

complex business problems using creative solutions, then we wish to talk with you. As a Lead Architect (Azure), you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. Responsibilities: Be an integral part of large-scale … projects. Qualifications & Experience: A bachelor’s degree in computer science or related field with more than 8 years of technology experience Strong experience in System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling … including big data technologies. Exposure across all the SDLC process, including testing and deployment. Expertise in Microsoft Azure is mandatory including components like Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure DataBricks, HD Insights, ML Service etc. Good knowledge of Python and Spark are required. Experience in ETL & ELT Good understanding of one scripting More ❯

complex business problems using creative solutions, then we wish to talk with you. As a Lead Architect (Azure), you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. Responsibilities: Be an integral part of large-scale … projects. Qualifications & Experience: A bachelor’s degree in Computer Science or related field with more than 8 years of technology experience Strong experience in System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling … including big data technologies. Exposure across all the SDLC process, including testing and deployment. Expertise in Microsoft Azure is mandatory including components like Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure DataBricks, HD Insights, ML Service etc. Good knowledge of Python and Spark are required. Experience in ETL & ELT Good understanding of one scripting More ❯

Job Title: Data Engineer Location: London (Hybrid one day a week) Job Summary: Signify have partnered with a client who are seeking for a Senior Data Engineer to join their growing data team. This role involves designing, building, and maintaining data pipelines and infrastructure to support analytics and business intelligence efforts across the organisation. The ideal … candidate will have a strong background in handling large-scale data environments and a passion for creating scalable, efficient data solutions. Key Responsibilities: Manage and maintain day to day data operations, including ETL workflows, scheduled data loads, and data pipeline monitoring. Develop and optimise data pipelines for integrating structured and unstructured data from … various internal and external sources. Leverage big data technologies such as Apache Spark, Kafka, and Scala to build robust and scalable data processing systems. Write clean, maintainable code in Python or Scala to support data transformation, orchestration, and integration tasks. Work with cloud platforms like AWS to deploy, monitor, and manage data services. Utilise tools More ❯

Our Client We power the future of Marketing and realise business value by applying human creativity to AI, data, and technology. Our expert consultants partner with leading brands to unlock the power of their enterprise data and transform their Marketing capabilities, building sustainable value in a privacy-respectful way. Integrating enterprise technologies, Google’s ecosystem, and our proprietary … solutions to clients' first-party data, we create innovative solutions and unlock the power of AI, delivering tangible ROIs for our clients. Our expert consultants orchestrate Google Marketing and Google Cloud technologies to unlock ultimate AI-powered performance within our client’s organisation. About the Role As one of our Data Engineers, you will be part of a … team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. You will be designing and proposing effective combinations of Google Marketing Platform tools (GA4, Campaign Manager 360, Search Ads 360, etc.) and Google Cloud solutions (BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs, Compute Engine, etc.) to address More ❯

Chief Data Scientist London – Hybrid (3 days a week in Chelsea) Up to £120,000 + Benefits The Opportunity We are excited to be working with a long standing partner of ours on a new Chief Data Scientist position. You will be joining an organisation where data drives strategic decision-making within the property space. You’ll … lead the data science vision while remaining hands-on with AI and machine learning initiatives that have real business impact. This is ideal for someone who enjoys blending leadership, strategy, and technical depth. This would be a great opportunity for someone looking to take a step up in their career - I.e. Someone at the Principal, Manager, Head of Data Science level. Key Responsibilities Define and deliver the data science strategy to unlock business value. Identify AI/ML opportunities and develop impactful, scalable solutions. Lead and mentor a cross-functional team of scientists and engineers. Stay hands-on where needed, guiding model design, code reviews, and architecture decisions. Promote ethical, responsible AI and ensure regulatory compliance (e.g. More ❯

Principal Data Engineer, Consulting London Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly with clients to define requirements, refine solutions, and ensure successful … handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyze and cleanse data using a range of tools and techniques. Manage and process structured and semi-structured data formats such as JSON, XML, CSV, and Parquet . Operate effectively More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus on designing and implementing … end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion and related tooling. Work closely with … junior engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc. More ❯

Data Analyst 📍 Hybrid | UK or EU-based | Permanent Curious about how data can transform business strategy? Ready to shape decisions that influence thousands of customers? Want to join a high-performance team where your insights drive impact? If you thrive in a fast-paced, data-rich environment and love turning numbers into stories, this could be the … opportunity you've been waiting for. Discover the Opportunity Our client – a prominent global brand in digital entertainment - is seeking a Data Analyst to join their growing analytics function. This role is ideal for someone who’s passionate about using data to answer big questions, influence marketing strategy, and empower departments across a diverse international business. This … connect insights to actions, and help shape both customer experience and business performance. Why This Role is Great In this role, you’ll have the opportunity to: Translate complex data sets into compelling insights that inform high-level decisions Design and build engaging dashboards and reports using tools like Tableau and Power BI Collaborate closely with marketing, performance, and More ❯

is to enable smarter financial decisions so people can focus more on the positive aspects of life, rather than the stresses associated with managing money. Responsibilities As Head of Data , you will lead the development and implementation of the company’s data strategy. You’ll be responsible for ensuring stakeholders have access to accurate and timely data, working closely with a Data Product Owner to align data initiatives with business objectives. Define and communicate the organization’s data strategy, ensuring alignment with key functions such as risk, finance, product, and customer service. Promote data literacy across the organization by enabling self-service capabilities for non-technical teams. Lead the design and rollout … of a scalable data warehouse to support analytics and reporting. Translate business requirements into technical solutions in partnership with the Data Product Owner. Influence the evolution of the loan management system to reflect data strategy goals. Oversee updates to systems and processes, including the creation of robust datamarts for operational use. Manage the development and maintenance of More ❯

Senior Python Engineer – Cloud & Data Orchestration 📍 Hybrid (1–2 days/week in office) | 💼 £140k+ Package | 🕵️‍♂️ Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical services to governments and private sector clients globally and the brand are … As we continue to expand, we’re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and directly influence the future of … our engineering capability. 🔍 What You’ll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and Kubernetes in a cloud-agnostic environment Guiding architecture and implementation of large-scale data More ❯

experience within Financial Services (especially in the front and middle office), ideally in consulting or professional services environments, on high-value engagements with tight deadlines for the transformation of big data or real-time platforms. Proven track record delivering complex software transformation projects using agile methods (Scrum, Kanban, Nexus, SAFe, LESS, DSDM) in regulated environments. Technical literacy enabling … you to assess code quality, review pull requests, and gauge team productivity effectively and managing teams of 5-15 developers. Experience with modern technologies and data engineering platforms (Java/.NET, AWS/Azure, microservices, CI/CD pipelines, IaC, kafka, Databricks etc) as well as modern enterprise and integration architectural patterns. Excellent communication, influencing, and negotiation skills, comfortably … stakeholders to ensure successful outcomes. Client-focused, collaborative, and pragmatic approach to solving business problems through technology. Genuine curiosity and continuous learning mindset, staying abreast of emerging software and data technologies. Strong academic background, ideally a 2.1 or above in Computer Science or related fields. Professional technical certifications are advantageous. Benefits: Digiterre is a software and data engineering More ❯

Liquidity Data & Analytics London/Hybrid Contract until end of September £716.24 p/d Umbrella If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities … support and rewards that will take you further. We are currently seeking an experienced individual to join this team in the role Liquidity Data & Analytics. Role purpose: The role sits within the Global Treasury, Liquidity Insights & Methodologies team which is responsible for safeguarding and optimising the Group’s balance sheet and ensuring the Group’s entities adhere to the … tools (Tableau and Superset), to create appealing dashboards and analytical capabilities Have experience in database management, with strong knowledge of SQL Strong Business Analysis skill set, including expertise in data analytics and data analysis to support data-driven decision-making. Manage the implementation of technical solutions (including MI & Analytics) to support and enable Liquidity Management decision making More ❯