1 to 25 of 45 Big Data Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to match data solutions with user requirements … Help establish data governance and quality assurance processes Drive interoperability and open standards adoption across systems Ensure secure and ethical data management practices Enable data access for AI and analytics applications Qualifications and Requirements: More than 3 years of proven Data Architect experience with strong data modeling (conceptual, logical, physical) skills Knowledge of data More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to match data solutions with user requirements … Help establish data governance and quality assurance processes Drive interoperability and open standards adoption across systems Ensure secure and ethical data management practices Enable data access for AI and analytics applications Qualifications and Requirements: More than 3 years of proven Data Architect experience with strong data modeling (conceptual, logical, physical) skills Knowledge of data More ❯

Job Title: Data Engineer Location: London (Hybrid) Salary: Open upto GBP £60,000 - £100,000 Per annum - DOE Employment Type: Full time, Permanent About the Role: We are seeking a skilled Data Engineer to join our Digital & Data team. You will work alongside product, design, and cross-disciplinary experts to deliver innovative software solutions and scalable data architectures. This is an exciting opportunity to develop your career in a collaborative, inclusive, and technology-driven environment. Key Responsibilities: Design, build, and maintain production data pipelines from ingestion to consumption in big data architectures. Develop ETL processes and manage data warehouses, data lakes, and data movement across multiple sources. Work with structured … and unstructured data, integrating from multiple systems using AWS or open-source tools. Collaborate with multiple stakeholders in an agile environment to solve complex business challenges. Participate in live problem-solving sessions, whiteboarding, and asynchronous collaboration to deliver high-quality solutions. Contribute to the technical growth of the team through knowledge sharing, mentoring, and innovation. Technologies & Tools: AWS Cloud More ❯

Job Title: Data Engineer Location: London (Hybrid) Salary: Open upto GBP £60,000 - £100,000 Per annum - DOE Employment Type: Full time, Permanent About the Role: We are seeking a skilled Data Engineer to join our Digital & Data team. You will work alongside product, design, and cross-disciplinary experts to deliver innovative software solutions and scalable data architectures. This is an exciting opportunity to develop your career in a collaborative, inclusive, and technology-driven environment. Key Responsibilities: Design, build, and maintain production data pipelines from ingestion to consumption in big data architectures. Develop ETL processes and manage data warehouses, data lakes, and data movement across multiple sources. Work with structured … and unstructured data, integrating from multiple systems using AWS or open-source tools. Collaborate with multiple stakeholders in an agile environment to solve complex business challenges. Participate in live problem-solving sessions, whiteboarding, and asynchronous collaboration to deliver high-quality solutions. Contribute to the technical growth of the team through knowledge sharing, mentoring, and innovation. Technologies & Tools: AWS Cloud More ❯

Group Life Assurance, Bonus Scheme Location : Hybrid - Homeworking with travel to Venture and client sites Role Purpose: We are seeking a Practice Lead/Principal Consultant to lead our Data & Analytics Business Unit . This is a senior leadership position at the forefront of Venture's strategy, responsible for driving our data vision, shaping client solutions, and leading … We're a consultancy that puts people at the core - our clients, our team, and our communities. As we continue to grow, we're looking for a capable, motivated Data & Analytics Practice Lead to help deliver innovative solutions and drive client success. You'll join a collaborative, supportive team where curiosity is encouraged, ownership is valued, and your growth … to building an inclusive and diverse workplace where fresh perspectives fuel innovation. No matter your background - your voice matters here. What You'll Be Doing: Head up Venture's Data & Analytics practice, defining and executing the growth strategy.Lead complex data transformation programmes for enterprise clients, ensuring best-in-class delivery. Act as a trusted advisor to C-level More ❯

Group Life Assurance, Bonus Scheme Location : Hybrid - Homeworking with travel to Venture and client sites Role Purpose: We are seeking a Practice Lead/Principal Consultant to lead our Data & Analytics Business Unit . This is a senior leadership position at the forefront of Venture's strategy, responsible for driving our data vision, shaping client solutions, and leading … We're a consultancy that puts people at the core - our clients, our team, and our communities. As we continue to grow, we're looking for a capable, motivated Data & Analytics Practice Lead to help deliver innovative solutions and drive client success. You'll join a collaborative, supportive team where curiosity is encouraged, ownership is valued, and your growth … to building an inclusive and diverse workplace where fresh perspectives fuel innovation. No matter your background - your voice matters here. What You'll Be Doing: Head up Venture's Data & Analytics practice, defining and executing the growth strategy.Lead complex data transformation programmes for enterprise clients, ensuring best-in-class delivery. Act as a trusted advisor to C-level More ❯

Do you enjoy working with data? Are you a problem solver? About our Team: LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We’re one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and … outcomes, and be more successful. About the Role: As a Data Analyst III you will consult with internal stakeholders to understand problems, collect and analyze data to support data driven business decisions. This role uses data tools to collate, model, interpret, develop visualizations/information products, and communicate to the business. Specifically, individuals in this role … for analysis and metrics to drive insights and recommendations Understanding who the customers are and what is happening in the market with necessary commercial awareness Creating visual displays of data through selected tools and analytical packages Effectively lead and manage small/operational analytics projects Requirements: Bachelors or Master Degree in Data Analytics/Math or equivalent work More ❯

Do you enjoy working with data? Are you a problem solver? About our Team: LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We’re one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and … outcomes, and be more successful. About the Role: As a Data Analyst III you will consult with internal stakeholders to understand problems, collect and analyze data to support data driven business decisions. This role uses data tools to collate, model, interpret, develop visualizations/information products, and communicate to the business. Specifically, individuals in this role … for analysis and metrics to drive insights and recommendations Understanding who the customers are and what is happening in the market with necessary commercial awareness Creating visual displays of data through selected tools and analytical packages Effectively lead and manage small/operational analytics projects Requirements: Bachelors or Master Degree in Data Analytics/Math or equivalent work More ❯

Principal Data Architect Salary : Up to £100,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is seeking an experienced Principal Data Architect to spearhead the development of enterprise-wide data architecture initiatives. This pivotal role … will drive the strategic implementation of scalable data solutions that support organizational transformation, foster innovation, and enable advanced analytics capabilities across multiple business units. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Drive data governance and stewardship transformation across the organization Build scalable data ecosystems using APIs and open standards … Work with teams and leadership to align data strategy with business goals Set up data governance, quality controls, and compliance frameworks Make data AI-ready and optimize for analytics and machine learning Embed security, privacy, and ethics into all data architecture decisions Lead the overall data architecture vision across different business areas Qualifications and Requirements More ❯

Principal Data Architect Salary : Up to £100,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is seeking an experienced Principal Data Architect to spearhead the development of enterprise-wide data architecture initiatives. This pivotal role … will drive the strategic implementation of scalable data solutions that support organizational transformation, foster innovation, and enable advanced analytics capabilities across multiple business units. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Drive data governance and stewardship transformation across the organization Build scalable data ecosystems using APIs and open standards … Work with teams and leadership to align data strategy with business goals Set up data governance, quality controls, and compliance frameworks Make data AI-ready and optimize for analytics and machine learning Embed security, privacy, and ethics into all data architecture decisions Lead the overall data architecture vision across different business areas Qualifications and Requirements More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

and more, aiming to transform traditional business models with cutting-edge digital solutions. Know more about us: https://corporate.jd.com/Key Responsibilities: Build real-time/offline data pipelines (ETL) using Hadoop/Spark/Flink Design data storage solutions (warehouses/lakes) for multi-source heterogeneous data Implement data quality monitoring and SQL … optimization Minimum Qualifications Bachelor’s+ in Data Science, CS, or Statistics 3+ years data engineering experience Proficiency in big data technologies and data modeling English as working language preferred Preferred Qualifications Experience in risk/cross-border data systems Stream processing expertise (e.g., Flink) Certifications: AWS Data Analytics, Google Cloud Data Engineer More ❯

Staff Software Engineer - Data Platform (relocation to dubai) About the Role We are looking for a highly experienced Engineer to join our Data and ML Platform team. Our mission is to simplify big data complexities and deliver fast, secure, and reliable access to data at scale. You’ll be part of a core team building … modern, distributed data systems that power real-time insights and applications across the business. This position is part of the Data Processing & Computation Platform group, where you’ll work hands-on with open-source technologies such as Apache Spark, Apache Kafka, and Apache Trino . You’ll also have the opportunity to contribute to and engage with the … global open-source community. Key Responsibilities Architect, design, and implement scalable data infrastructure and reusable components. Develop and test rapid prototypes that demonstrate data-driven value to stakeholders. Optimize compute workloads by improving performance, resource utilization, and scalability. Build robust, reusable, and production-grade data pipelines. Continuously refine engineering processes, tools, and testing practices to enhance team More ❯

Staff Software Engineer - Data Platform (relocation to dubai) About the Role We are looking for a highly experienced Engineer to join our Data and ML Platform team. Our mission is to simplify big data complexities and deliver fast, secure, and reliable access to data at scale. You’ll be part of a core team building … modern, distributed data systems that power real-time insights and applications across the business. This position is part of the Data Processing & Computation Platform group, where you’ll work hands-on with open-source technologies such as Apache Spark, Apache Kafka, and Apache Trino . You’ll also have the opportunity to contribute to and engage with the … global open-source community. Key Responsibilities Architect, design, and implement scalable data infrastructure and reusable components. Develop and test rapid prototypes that demonstrate data-driven value to stakeholders. Optimize compute workloads by improving performance, resource utilization, and scalability. Build robust, reusable, and production-grade data pipelines. Continuously refine engineering processes, tools, and testing practices to enhance team More ❯

Principal Cybersecurity Machine Learning Engineer The position is a senior technical role, requiring knowledge of data engineering, data science, advanced analytics techniques, research and development, and innovation within one or more of the Cybersecurity sciences (e.g. network, endpoint and cloud security, cryptography, malware analysis, vulnerability assessment, privileged access management, anomaly/intrusion detection, incident response, or offensive security … based employees, enhanced maternity and adoption pay and support when you return to work, and a contributory pension scheme with a generous employer contribution. In this role you will: Data Engineering Ingestion and provisioning of datasets, delta tables, and/or curated, re-usable data assets to enable Cybersecurity use cases. Support and enhancement of data ingestion … Research & Development (R&D) and Innovation Drive innovative research & development to test and evolve new technologies and advanced analytic techniques. Explore and develo innovative capabilities, exploiting emerging technologies and data science to help stay ahead of advancing cyber threats. Rapid Response Respond to urgent requests to address vulnerabilities or emerging threats. Advanced Analytics & Security Software Development Support Cybersecurity teams More ❯

Hive & SQL - Must Have Note: At least Candidate should know Scala coding language. Pyspark profile will not help here. Interview includes coding test. Job Description: Scala/Spark • Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives • Ability to multi-task and work under pressure • Demonstrated problem solving and decision-making skills • Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling More ❯

Hive & SQL - Must Have Note: At least Candidate should know Scala coding language. Pyspark profile will not help here. Interview includes coding test. Job Description: Scala/Spark • Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives • Ability to multi-task and work under pressure • Demonstrated problem solving and decision-making skills • Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯