1 to 25 of 54 Big Data Jobs in Central London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to match data solutions with user requirements … Help establish data governance and quality assurance processes Drive interoperability and open standards adoption across systems Ensure secure and ethical data management practices Enable data access for AI and analytics applications Qualifications and Requirements: More than 3 years of proven Data Architect experience with strong data modeling (conceptual, logical, physical) skills Knowledge of data More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to match data solutions with user requirements … Help establish data governance and quality assurance processes Drive interoperability and open standards adoption across systems Ensure secure and ethical data management practices Enable data access for AI and analytics applications Qualifications and Requirements: More than 3 years of proven Data Architect experience with strong data modeling (conceptual, logical, physical) skills Knowledge of data More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot, and … optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving and More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot, and … optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving and More ❯

Do you enjoy working with data? Are you a problem solver? About our Team: LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We’re one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and … outcomes, and be more successful. About the Role: As a Data Analyst III you will consult with internal stakeholders to understand problems, collect and analyze data to support data driven business decisions. This role uses data tools to collate, model, interpret, develop visualizations/information products, and communicate to the business. Specifically, individuals in this role … for analysis and metrics to drive insights and recommendations Understanding who the customers are and what is happening in the market with necessary commercial awareness Creating visual displays of data through selected tools and analytical packages Effectively lead and manage small/operational analytics projects Requirements: Bachelors or Master Degree in Data Analytics/Math or equivalent work More ❯

Do you enjoy working with data? Are you a problem solver? About our Team: LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We’re one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and … outcomes, and be more successful. About the Role: As a Data Analyst III you will consult with internal stakeholders to understand problems, collect and analyze data to support data driven business decisions. This role uses data tools to collate, model, interpret, develop visualizations/information products, and communicate to the business. Specifically, individuals in this role … for analysis and metrics to drive insights and recommendations Understanding who the customers are and what is happening in the market with necessary commercial awareness Creating visual displays of data through selected tools and analytical packages Effectively lead and manage small/operational analytics projects Requirements: Bachelors or Master Degree in Data Analytics/Math or equivalent work More ❯

Job Description – Data Architect Role Overview We are seeking an experienced Data Architect to collaborate with stakeholders and design innovative, scalable, and high-performance data solutions. The role involves shaping enterprise-wide data architectures, developing strategies and governance frameworks, and ensuring solutions align with business objectives and technology strategies. You will play a key role in … communicating data findings, building integrations, and delivering real-world value through modern data capabilities. Key Responsibilities Partner with stakeholders to understand requirements, conduct discoveries, and design data-driven solutions that are scalable, performant, and resilient. Clearly and concisely communicate data architecture, strategies, and findings to both technical and non-technical audiences. Apply data architecture principles … to solve complex challenges, including the design and implementation of enterprise-wide data architectures aligned with business and IT strategies. Define and implement data strategies, governance frameworks, and operating models (spanning technology, people, and processes). Design and maintain data models (conceptual, logical, and physical) across databases, data lakes, and warehouses. Enable data integration with More ❯

Job Description – Data Architect Role Overview We are seeking an experienced Data Architect to collaborate with stakeholders and design innovative, scalable, and high-performance data solutions. The role involves shaping enterprise-wide data architectures, developing strategies and governance frameworks, and ensuring solutions align with business objectives and technology strategies. You will play a key role in … communicating data findings, building integrations, and delivering real-world value through modern data capabilities. Key Responsibilities Partner with stakeholders to understand requirements, conduct discoveries, and design data-driven solutions that are scalable, performant, and resilient. Clearly and concisely communicate data architecture, strategies, and findings to both technical and non-technical audiences. Apply data architecture principles … to solve complex challenges, including the design and implementation of enterprise-wide data architectures aligned with business and IT strategies. Define and implement data strategies, governance frameworks, and operating models (spanning technology, people, and processes). Design and maintain data models (conceptual, logical, and physical) across databases, data lakes, and warehouses. Enable data integration with More ❯

Principal Data Architect Salary : Up to £100,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is seeking an experienced Principal Data Architect to spearhead the development of enterprise-wide data architecture initiatives. This pivotal role … will drive the strategic implementation of scalable data solutions that support organizational transformation, foster innovation, and enable advanced analytics capabilities across multiple business units. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Drive data governance and stewardship transformation across the organization Build scalable data ecosystems using APIs and open standards … Work with teams and leadership to align data strategy with business goals Set up data governance, quality controls, and compliance frameworks Make data AI-ready and optimize for analytics and machine learning Embed security, privacy, and ethics into all data architecture decisions Lead the overall data architecture vision across different business areas Qualifications and Requirements More ❯

Principal Data Architect Salary : Up to £100,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is seeking an experienced Principal Data Architect to spearhead the development of enterprise-wide data architecture initiatives. This pivotal role … will drive the strategic implementation of scalable data solutions that support organizational transformation, foster innovation, and enable advanced analytics capabilities across multiple business units. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Drive data governance and stewardship transformation across the organization Build scalable data ecosystems using APIs and open standards … Work with teams and leadership to align data strategy with business goals Set up data governance, quality controls, and compliance frameworks Make data AI-ready and optimize for analytics and machine learning Embed security, privacy, and ethics into all data architecture decisions Lead the overall data architecture vision across different business areas Qualifications and Requirements More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Databricks Data Engineer | London | £50,000 - £70,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. Due to exciting growth plans we are … now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication … skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional office visits each month 💰Salary: £50,000-£70,000 DOE 🤝Collaborative culture and great team support 📈Vast L&D opportunities both internally and externally More ❯

Databricks Data Engineer | London | £50,000 - £70,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. Due to exciting growth plans we are … now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication … skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional office visits each month 💰Salary: £50,000-£70,000 DOE 🤝Collaborative culture and great team support 📈Vast L&D opportunities both internally and externally More ❯

Databricks Data Architect – London, UK Permanent | Analytics We’re looking for an experienced Databricks Data Architect to join a growing analytics practice. This is a strategic role where you’ll combine deep technical expertise with client-facing leadership, shaping and delivering modern data solutions for leading organisations. What you’ll be doing: Leading technical teams to design … and deliver large-scale, end-to-end data solutions Architecting modern data platforms (data lakes, lakehouses, warehouses) with Databricks and related tools (Snowflake, Synapse, Azure Fabric) Applying data governance and master data management practices to ensure quality and compliance Advising clients on strategy, future-state architectures, and cloud migrations Driving collaboration, innovation, and best practices … across projects and teams What we’re looking for: 10+ years in BI/Data Warehousing, including 4+ years in solution/technical architecture Strong hands-on expertise in Databricks and cloud platforms (Azure, AWS, GCP) Experience with ETL/ELT tooling (Databricks, ADF, Informatica, SSIS, IBM DataStage) Proficiency in enterprise data modelling (ERwin, ER/Studio, Power More ❯

Databricks Data Architect – London, UK Permanent | Analytics We’re looking for an experienced Databricks Data Architect to join a growing analytics practice. This is a strategic role where you’ll combine deep technical expertise with client-facing leadership, shaping and delivering modern data solutions for leading organisations. What you’ll be doing: Leading technical teams to design … and deliver large-scale, end-to-end data solutions Architecting modern data platforms (data lakes, lakehouses, warehouses) with Databricks and related tools (Snowflake, Synapse, Azure Fabric) Applying data governance and master data management practices to ensure quality and compliance Advising clients on strategy, future-state architectures, and cloud migrations Driving collaboration, innovation, and best practices … across projects and teams What we’re looking for: 10+ years in BI/Data Warehousing, including 4+ years in solution/technical architecture Strong hands-on expertise in Databricks and cloud platforms (Azure, AWS, GCP) Experience with ETL/ELT tooling (Databricks, ADF, Informatica, SSIS, IBM DataStage) Proficiency in enterprise data modelling (ERwin, ER/Studio, Power More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs Monitor … troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills with … experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control systems More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs Monitor … troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills with … experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control systems More ❯

En:ACT (short for Enable Accurate Compliance in Transaction reporting), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted by more than 30 firms worldwide … and designed for both business and technical users. Alongside our SaaS offering, our unique model delivers consulting services across Risk & Compliance (including Transaction Reporting and Operational Resilience), ESG, Strategy, Data, and Operations. Unlike larger consultancies, we embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes and driving measurable impact. Since our launch in … creating space for our people to grow with the business. Backed by North American private equity investment, and partnerships with the London Stock Exchange Group and Snowflake’s global data platform, we are shaping the future of regulatory compliance through innovation in both advisory and technology. Our growth plans do not stop here; we are on the lookout for More ❯