1 to 25 of 58 Data Lake Jobs in Berkshire

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL … . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Data Solution Architect - Conceptual Data Models, Data Vault 2.0, Azure Up to £800 per day (Inside IR35) London/Hybrid 6 Months My client is an instantly recognisable Insurance brand who urgently require a Data Solution Architect with expertise in Conceptual Data Modelling, Solution Architecture specifically within Data, exceptional stakeholder management skills and experience of implementing Data Vault 2.0 to join a business-critical Programme ASAP. Your CV will need to clearly state how you are involved in the process of leading/managing/maintaining/uplifted/improving Conceptual Data Models, as well as where you have implemented Data … leading/managing/maintaining/uplifted/improving Conceptual Data Models) Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Advocate for positive personal participation in workshops, and demonstrate More ❯

Head of Data & BI Location: Ealing/London (Hybrid/remote – limited travel to the office) Salary: £Competitive Contract type: Fixed-Term Contract (6-8 months) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing the power of data to drive organisational change? Do you have … the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Head of Data & BI to lead on the delivery of A2Dominion’s Data & BI Strategy. You’ll oversee … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Data Services Manager, Must live within 2 hours of London or Berkshire and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Financial service background mandatory. Expanding financial services client are looking … for a Data Services Manager to join their team. The role will suit a candidate who has been a manager for a couple of years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Interim Head of Data & BI (Inside IR35 – via Umbrella or PAYE) Location: Ealing/London (Hybrid/remote – limited travel to the office) Day Rate: £Highly Competitive Contract type: Interim/Contract (35 hours per week, Monday to Friday) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing … the power of data to drive organisational change? Do you have the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Interim Head of Data & BI to lead … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Head of Data & BI Location: Ealing/London (Hybrid/remote – limited travel to the office) Salary: £Competitive Contract type: Fixed-Term Contract (6-8 months) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing the power of data to drive organisational change? Do you have … the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Head of Data & BI to lead on the delivery of A2Dominion’s Data & BI Strategy. You’ll oversee … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Senior Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Glasgow/Leeds) Salary: £60,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional … datasets and semantic models, ensuring best practice in DAX, performance tuning, and report design. Lead the development of data architecture and standards across Azure Data Lake and Synapse environments. Contribute to the migration to Microsoft Fabric, shaping platform architecture and integration patterns. Implement and maintain data validation, monitoring, and quality frameworks. Work collaboratively … tuning. Power BI: Advanced experience managing enterprise models, datasets, and governance processes. SQL: Expert-level proficiency in query design, optimisation, and data transformation. Azure Data Lake: Deep understanding of data structures, storage layers, and integration for analytics. Microsoft Fabric (Emerging): Contribute to the organisation’s transition and adoption strategy. Git/Azure DevOps More ❯

About the Company EC Markets is building a state-of-the-art in-house data centre to power our trading, operational, and marketing intelligence. About the Role We are seeking a Senior Data Engineer to lead the technical build-out of this initiative — from designing ETL pipelines to creating a secure, scalable data warehouse … that underpins business-critical reporting and analytics. This is a high-impact role at the intersection of technology and financial insight, ideal for a senior professional with deep data engineering capabilities and proven experience supporting financial or trading-driven organisations, willing to grow into a Head of Data. Responsibilities Design, develop, and deploy a robust data … engineering or infrastructure development. Experience in the financial services or fintech sector is highly desirable. Required Skills Hands-on experience designing and implementing ETL pipelines and data lake/warehouses in cloud environments. Advanced knowledge of AWS or Azure data services (Databricks, Glue, Redshift, S3 Data Lakes, Spark, or equivalent). Strong programming More ❯

Senior Data Architect Location: Central London Hybrid: 2 days On-site Salary: £100k-£110k Overview Join our client, a global leading ranking and insights intelligence company, as a Senior Data Architect and shape the future of our data ecosystem. We are seeking a seasoned professional to take a leading role in designing and evolving … the backbone of our data architecture. This strategic position will leverage your technical expertise to influence everything from high-level conceptual models to optimized, scalable solutions. You will drive the development and implementation of modern data systems aligned with our long-term vision, ensuring our data infrastructure is robust, future-ready, and delivers real … Main Duties and Responsibilities Design and implement effective database solutions and models to store and retrieve company data. Assess database implementation procedures to ensure compliance with GDPR and data governance standards. Design conceptual and logical data models, flowcharts, and visual representations of data processes. Advise project teams and oversee management of the full data More ❯

Job Title: Staff Data Engineer Location: London, Hybrid Salary: c.£140,000 + bonus + share options Why Apply? This is a unique opportunity to take a leading role in shaping the data strategy of a fast growing Insurtech scale-up. The role combines hands on technical work with strategic influence, allowing you to develop both … systems and people. You'll lead a small but high impact team, work across multiple business functions, and help deliver a modern, scalable data platform that drives business decisions. Responsibilities: Lead, mentor, and develop a high performing team of Data Engineers, fostering a culture of learning and excellence. Define and execute the data engineering … a fast-paced environment. Strong communication and stakeholder management skills, able to translate technical concepts into business value. Experience with real-time data processing, Data Lake or Data Mesh architectures is a plus. Curiosity about AI and its practical application to improve data workflows. What's in it for me? Competitive More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data … maintaining ETL pipelines. Azure Synapse Analytics: Working knowledge of data modelling, views, and performance tuning. SQL: Proficient in writing, optimising, and troubleshooting queries. Azure Data Lake: Understanding of data storage and structure for analytics use cases. Git/Azure DevOps: Familiar with version control and Agile delivery workflows. Microsoft Fabric (Desirable): Awareness or More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End-to-End Data More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End-to-End Data More ❯

Senior Consultant – Data Architecture (Management Level) Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent Design the vision. Architect the strategy. Drive enterprise transformation. The Role We’re looking for a Senior Consultant in Data Architecture to lead the design and delivery of scalable, cloud-enabled data solutions for enterprise clients. You … ll define architecture strategies, shape data platforms, and guide organisations through modernisation initiatives that turn data into a strategic asset. This is a client-facing leadership role at the intersection of technology, strategy, and delivery. Key Responsibilities Lead client engagements focused on data architecture and modernisation. Define enterprise data strategies, architecture principles … and implementation roadmaps. Design and deliver cloud-native data platforms (AWS, Azure, GCP) and integration frameworks. Embed governance, security, and metadata management into architecture design. Translate complex technical concepts into business outcomes for stakeholders. Oversee project delivery and mentor junior consultants. Required Experience 4+ years’ experience in data architecture, data engineering, or enterprise data More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms – particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisation’s data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability … and cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data More ❯

Private Equity Fund Programme Delivery Director for AI and Data projects London HQ, 200 employees £120K to £150K base + Bonus Onsite 4 Days a week - London, must be living within commuting distance to the central London office. New Programme Director role. with a Private Equity Fund, building a greenfield in-house AI and Data technical … consistent way of working across the organisation, ensuring that programmes and projects consistently deliver measurable business outcomes. Key Responsibilities: Working with the portfolio companies - building bespoke AI, ML, Data services Be the bridge between the internal software development team and outbound Portfolio teams Establish a cohesive delivery operating model Implement structured mechanisms for programme and project planning Programme … Leadership and Execution Stakeholder Engagement & Communication Change Management Data Transformation Managing internal Project Managers Projects include: AI, Dashboards, Cloud Infrastructure, Data pipelines, Data Lake, Data models. Experience & Background Proven track record of implementing world-class programme management and delivery frameworks at scale, from portfolio planning through to day-to-day execution More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining … the roadmap, proposing scalable Azure-native solutions, and collaborating with the Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure More ❯