1 to 25 of 121 Permanent Data Lake Jobs in Central London

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Glasgow/Leeds) Salary: £60,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional … datasets and semantic models, ensuring best practice in DAX, performance tuning, and report design. Lead the development of data architecture and standards across Azure Data Lake and Synapse environments. Contribute to the migration to Microsoft Fabric, shaping platform architecture and integration patterns. Implement and maintain data validation, monitoring, and quality frameworks. Work collaboratively … tuning. Power BI: Advanced experience managing enterprise models, datasets, and governance processes. SQL: Expert-level proficiency in query design, optimisation, and data transformation. Azure Data Lake: Deep understanding of data structures, storage layers, and integration for analytics. Microsoft Fabric (Emerging): Contribute to the organisation’s transition and adoption strategy. Git/Azure DevOps More ❯

Senior Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Glasgow/Leeds) Salary: £60,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional … datasets and semantic models, ensuring best practice in DAX, performance tuning, and report design. Lead the development of data architecture and standards across Azure Data Lake and Synapse environments. Contribute to the migration to Microsoft Fabric, shaping platform architecture and integration patterns. Implement and maintain data validation, monitoring, and quality frameworks. Work collaboratively … tuning. Power BI: Advanced experience managing enterprise models, datasets, and governance processes. SQL: Expert-level proficiency in query design, optimisation, and data transformation. Azure Data Lake: Deep understanding of data structures, storage layers, and integration for analytics. Microsoft Fabric (Emerging): Contribute to the organisation’s transition and adoption strategy. Git/Azure DevOps More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing, developing, and … optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute … to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing, developing, and … optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute … to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and More ❯

Senior Data Architect - London - Hybrid - £100,000 - £110,000 My client is an agile, data-driven company who are continuing to expand their thriving data team. They are looking to hire a senior data architect with expert data modelling and technical experience across the full Azure data stack … Flexible working hours 26 days annual leave, plus bank holidays Private medical insurance Company pension scheme And many more Key Responsibilities Design and implement scalable database solutions and data models that enable efficient data storage, integration, and retrieval. Review and optimise database implementation processes to ensure compliance with GDPR and wider data governance standards. … Develop conceptual and logical data models, diagrams, and flowcharts to support solution design. Ensure all systems are aligned with established data architecture principles and best practices. Maintain a comprehensive understanding of the data platform landscape, ensuring risks are identified, documented, and managed. Deliver high-quality, consistent, and well-documented outputs across all phases of More ❯

Senior Data Architect Location: Central London Hybrid: 2 days On-site Salary: £100k-£110k Overview Join our client, a global leading ranking and insights intelligence company, as a Senior Data Architect and shape the future of our data ecosystem. We are seeking a seasoned professional to take a leading role in designing and evolving … the backbone of our data architecture. This strategic position will leverage your technical expertise to influence everything from high-level conceptual models to optimized, scalable solutions. You will drive the development and implementation of modern data systems aligned with our long-term vision, ensuring our data infrastructure is robust, future-ready, and delivers real … Main Duties and Responsibilities Design and implement effective database solutions and models to store and retrieve company data. Assess database implementation procedures to ensure compliance with GDPR and data governance standards. Design conceptual and logical data models, flowcharts, and visual representations of data processes. Advise project teams and oversee management of the full data More ❯

Senior Data Architect Location: Central London Hybrid: 2 days On-site Salary: £100k-£110k Overview Join our client, a global leading ranking and insights intelligence company, as a Senior Data Architect and shape the future of our data ecosystem. We are seeking a seasoned professional to take a leading role in designing and evolving … the backbone of our data architecture. This strategic position will leverage your technical expertise to influence everything from high-level conceptual models to optimized, scalable solutions. You will drive the development and implementation of modern data systems aligned with our long-term vision, ensuring our data infrastructure is robust, future-ready, and delivers real … Main Duties and Responsibilities Design and implement effective database solutions and models to store and retrieve company data. Assess database implementation procedures to ensure compliance with GDPR and data governance standards. Design conceptual and logical data models, flowcharts, and visual representations of data processes. Advise project teams and oversee management of the full data More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data … maintaining ETL pipelines. Azure Synapse Analytics: Working knowledge of data modelling, views, and performance tuning. SQL: Proficient in writing, optimising, and troubleshooting queries. Azure Data Lake: Understanding of data storage and structure for analytics use cases. Git/Azure DevOps: Familiar with version control and Agile delivery workflows. Microsoft Fabric (Desirable): Awareness or More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data … maintaining ETL pipelines. Azure Synapse Analytics: Working knowledge of data modelling, views, and performance tuning. SQL: Proficient in writing, optimising, and troubleshooting queries. Azure Data Lake: Understanding of data storage and structure for analytics use cases. Git/Azure DevOps: Familiar with version control and Agile delivery workflows. Microsoft Fabric (Desirable): Awareness or More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End-to-End Data More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End-to-End Data More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End-to-End Data More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End-to-End Data More ❯

Microsoft Fabric Consultant Location: London/Hybrid Job Type: Salary: £65,000 to £75,000 + 10% Bonus, Pension, 25 days holiday, health + other benefits Microsoft Fabric | Data Modelling | Azure | Power BI Overview: A leading Data & Analytics consultancy is seeking a Microsoft Fabric Consultant to join their growing team. This is a hands-on role … focused on designing and delivering enterprise-grade solutions using Microsoft Fabric technologies. You’ll work closely with clients and internal teams to build scalable data pipelines, semantic models, and visualizations that support advanced analytics and business intelligence. This is an opportunity for you to own the new fabric division which will be focusing on clients who are going … Microsoft Fabric (Data Factory, Lakehouse, Power BI) Strong proficiency in SQL, DAX, and Power Query (M) Experience with Azure Data Services (Synapse, Data Lake, Azure SQL) Solid understanding of data modelling, ETL processes, and BI architecture Familiarity with CI/CD pipelines, DevOps, and version control (Git) Excellent communication and stakeholder More ❯

Senior Consultant – Data Architecture (Management Level) Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent Design the vision. Architect the strategy. Drive enterprise transformation. The Role We’re looking for a Senior Consultant in Data Architecture to lead the design and delivery of scalable, cloud-enabled data solutions for enterprise clients. You … ll define architecture strategies, shape data platforms, and guide organisations through modernisation initiatives that turn data into a strategic asset. This is a client-facing leadership role at the intersection of technology, strategy, and delivery. Key Responsibilities Lead client engagements focused on data architecture and modernisation. Define enterprise data strategies, architecture principles … and implementation roadmaps. Design and deliver cloud-native data platforms (AWS, Azure, GCP) and integration frameworks. Embed governance, security, and metadata management into architecture design. Translate complex technical concepts into business outcomes for stakeholders. Oversee project delivery and mentor junior consultants. Required Experience 4+ years’ experience in data architecture, data engineering, or enterprise data More ❯