1 to 25 of 85 Big Data Jobs in the City of London

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯

and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Senior Data Engineer – London - Hybrid Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5TM, SKITTLES®, BEN’S ORIGINAL®, and COCOAVIA®. Alongside our consumer brands, we proudly take care … D&A capabilities and maintain them. Partnerships with other teams such as Supply, Manufacturing & R&D are also key to ensure process alignment and shared value creation. As a Data Engineer in the Commercial team, your key responsibilities are as follows: 1. Technical Proficiency: Collaborate in hands-on development using Python, PySpark, and other relevant technologies to create and … maintain data assets and reports for business insights. Assist in engineering and managing data models and pipelines within a cloud environment, utilizing technologies like Databricks, Spark, Delta Lake, and SQL. Contribute to the maintenance and enhancement of our progressive tech stack, which includes Python, PySpark, Logic Apps, Azure Functions, ADLS, Django, and ReactJs. Support the implementation of DevOps More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

a different format of this document, please get in touch with at [emailprotected] or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join us as a Data Architect. … endless learning opportunities. • Be part of an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently and securely stored, organized, and accessible across … the enterprise. Build the foundation for databases, data warehouses, data lakes, and other data storage solutions, ensuring they meet both business and technical requirements. Key responsibilities: - Develop and design the data architecture framework for the organization. - Create models for databases, data warehouses, data lakes, and other storage solutions to store and manage data More ❯

Title : Senior Cloud and Data Solution Architect Work Location: London Experience: 15+Years We at Coforge are hiring Senior Cloud and Data Solution Architect professional with the following skillset: Job Summary: We are looking for a skilled Senior Cloud and Data Solution Architect in the UK (based out of London) with a strong delivery and solutions back ground … in Data Analytics and Cloud. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Sales, Delivery, Presales, Solutioning experience is mandatory within Data Analytics alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Responsibilities: 16-18+ years … of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). More ❯

Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

Job Title: Solutions Architect (Data Analytics)-Pre-sales, RFP creation Location: London (3days/week onsite) Duration: Permanent Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at … least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability … response. Ability to be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working More ❯

Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients. Excellent ETL skills, Data Modeling Skills. Excellent communication skills. Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

Responsibilities : 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients. Excellent ETL skills, Data Modeling Skills. Excellent communication skills. Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

We're Hiring: AWS Data Engineer Location: London (2-3 days in office) Experience : 2+ Years Degree: STEM/Business Rate: £225 to 245 a day Umbrella Duration : 6 months contract We're looking for a Data Engineer to help power our innovation engine. You’ll design data models, build scalable ETL pipelines, codify business logic, and … drive data integration across complex systems—structured and unstructured alike. This is your chance to turn raw data into real business value using cutting-edge tech in a collaborative, forward-thinking team. What You’ll Do: Design & implement data models and scalable ETL/ELT pipelines Map data sources, codify business logic, and build data flows Develop data quality solutions & explore new technologies Collaborate with analysts, developers, and business stakeholders What You Bring: 2+ years in data engineering or related roles Bachelor’s in CS, Engineering, Mathematics, Finance, etc. Proficiency in Python, SQL , and one or more: R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big More ❯

Social network you want to login/join with: AWS Data Engineer, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job Description: Location: London (2-3 days in office) Experience : 2+ … Years Degree: STEM/Business Duration : 6 months contract We're looking for a Data Engineer to help power our innovation engine. You’ll design data models, build scalable ETL pipelines, codify business logic, and drive data integration across complex systems—structured and unstructured alike. This is your chance to turn raw data into real business … value using cutting-edge tech in a collaborative, forward-thinking team. What You’ll Do: Design & implement data models and scalable ETL/ELT pipelines Map data sources, codify business logic, and build data flows Develop data quality solutions & explore new technologies Collaborate with analysts, developers, and business stakeholders What You Bring: 2+ years in data More ❯

our people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … Head of Data Engineering & Insight to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct accountability for strategy … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics, fostering More ❯

platform, we are looking for a Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics, fostering … an agile, value-driven, and innovation-focused culture. Collaborate with business and IT stakeholders (Data Owners, Product Owners, Business Leaders) to position data as a core strategic asset. Oversee BI delivery KPIs, service performance and budgets, ensuring high quality of service and alignment with organisational goals. Promote a data-driven culture through the adoption of self-service More ❯

Job Role : Data & AI Senior Manager Location : London Career Level: Senior Manager As a team: Applied Intelligence, the people who love using data to tell a story. We’re also the world’s largest team of data scientists, data engineers, and experts in machine learning and AI. A great day for us? Solving big problems … using the latest tech, serious brain power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew of sharp analytical minds? You … famous brands and household names – no worrying about how to explain what you do to your family again! In this role you will: Work with clients to understand how data and analytics can help their businesses, working across industry sectors (e.g. financial services, telecoms, healthcare and life sciences, or public sector industries) Bring detailed and comprehensive industry knowledge and More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

leading commodities trading houses, leveraging sophisticated technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive our next wave of technological … advancements. Role Overview: As a Senior Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability of the business. This is an exciting opportunity … you can push the boundaries of technology in financial markets. Key Responsibilities: Design, develop, and maintain highly efficient Python-based applications for commodities trading, risk management, and real-time data analysis. Build scalable, high-performance data pipelines to process large datasets from multiple sources, including real-time market data and fundamental data. Implement robust APIs and microservices More ❯

complex business problems using creative solutions, then we wish to talk with you. As a Lead Architect (Azure), you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. Responsibilities: Be an integral part of large-scale … projects. Qualifications & Experience: A bachelor’s degree in computer science or related field with more than 8 years of technology experience Strong experience in System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling … including big data technologies. Exposure across all the SDLC process, including testing and deployment. Expertise in Microsoft Azure is mandatory including components like Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure DataBricks, HD Insights, ML Service etc. Good knowledge of Python and Spark are required. Experience in ETL & ELT Good understanding of one scripting More ❯

complex business problems using creative solutions, then we wish to talk with you. As a Lead Architect (Azure), you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. Responsibilities: Be an integral part of large-scale … projects. Qualifications & Experience: A bachelor’s degree in Computer Science or related field with more than 8 years of technology experience Strong experience in System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling … including big data technologies. Exposure across all the SDLC process, including testing and deployment. Expertise in Microsoft Azure is mandatory including components like Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure DataBricks, HD Insights, ML Service etc. Good knowledge of Python and Spark are required. Experience in ETL & ELT Good understanding of one scripting More ❯

Job Title: Data Engineer Location: London (Hybrid one day a week) Job Summary: Signify have partnered with a client who are seeking for a Senior Data Engineer to join their growing data team. This role involves designing, building, and maintaining data pipelines and infrastructure to support analytics and business intelligence efforts across the organisation. The ideal … candidate will have a strong background in handling large-scale data environments and a passion for creating scalable, efficient data solutions. Key Responsibilities: Manage and maintain day to day data operations, including ETL workflows, scheduled data loads, and data pipeline monitoring. Develop and optimise data pipelines for integrating structured and unstructured data from … various internal and external sources. Leverage big data technologies such as Apache Spark, Kafka, and Scala to build robust and scalable data processing systems. Write clean, maintainable code in Python or Scala to support data transformation, orchestration, and integration tasks. Work with cloud platforms like AWS to deploy, monitor, and manage data services. Utilise tools More ❯

genuine opportunities. Explore thousands of open positions tailored to your lifestyle, including flexible remote jobs. Exclusive Resume Review Receive expert feedback with personalized suggestions to enhance your resume. Senior Data Science Engineer This position offers you the opportunity to join a fast-growing technology organization that is redefining productivity paradigms in the software engineering industry. Thanks to our flexible … interesting problems and building the products of tomorrow, this opportunity is for you. The impact you'll make: Design and develop reusable Python packages (pip/conda) to productionize data science solutions. Process big data at scale using Hadoop/Spark and optimize workflows with Airflow/orchestration tools. Build scalable applications and REST/RPC APIs … dashboards. Languages: Python, SQL Tools: Spark, Hadoop, Airflow, Docker, FastAPI/Flask Cloud: AWS, CI/CD pipelines (Jenkins, Git) What you'll bring to us: 7+ years in data engineering/science, with expertise in Python, Spark, and SQL. Proven experience with big data processing and scalable system design. Strong knowledge of CI/CD, Agile More ❯

Our Client We power the future of Marketing and realise business value by applying human creativity to AI, data, and technology. Our expert consultants partner with leading brands to unlock the power of their enterprise data and transform their Marketing capabilities, building sustainable value in a privacy-respectful way. Integrating enterprise technologies, Google’s ecosystem, and our proprietary … solutions to clients' first-party data, we create innovative solutions and unlock the power of AI, delivering tangible ROIs for our clients. Our expert consultants orchestrate Google Marketing and Google Cloud technologies to unlock ultimate AI-powered performance within our client’s organisation. About the Role As one of our Data Engineers, you will be part of a … team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. You will be designing and proposing effective combinations of Google Marketing Platform tools (GA4, Campaign Manager 360, Search Ads 360, etc.) and Google Cloud solutions (BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs, Compute Engine, etc.) to address More ❯

Social network you want to login/join with: Solutions Architect (Data Analytics)- Presales, RFP creation, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Job Title: Solutions Architect (Data Analytics)-Pre-sales, RFP creation Location: London (3days/week onsite) Duration: Permanent Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/… AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions More ❯

Chief Data Scientist London – Hybrid (3 days a week in Chelsea) Up to £120,000 + Benefits The Opportunity We are excited to be working with a long standing partner of ours on a new Chief Data Scientist position. You will be joining an organisation where data drives strategic decision-making within the property space. You’ll … lead the data science vision while remaining hands-on with AI and machine learning initiatives that have real business impact. This is ideal for someone who enjoys blending leadership, strategy, and technical depth. This would be a great opportunity for someone looking to take a step up in their career - I.e. Someone at the Principal, Manager, Head of Data Science level. Key Responsibilities Define and deliver the data science strategy to unlock business value. Identify AI/ML opportunities and develop impactful, scalable solutions. Lead and mentor a cross-functional team of scientists and engineers. Stay hands-on where needed, guiding model design, code reviews, and architecture decisions. Promote ethical, responsible AI and ensure regulatory compliance (e.g. More ❯