1 to 25 of 134 Data Lake Jobs in the South East

significant decisions with confidence, provide strong foundations for the future and guide them towards their goals. Job Description Job Purpose Evelyn Partners is recruiting a skilled and experienced Data Engineer to join a growing team to deliver a large data modernisation programme. As a Data Services Data Engineer, you will be responsible … for designing, developing, and maintaining our MS SQL Server Data Warehouses and associated data feeds into and out of the warehouses, and developing on our new modern cloud data platform, requiring Snowflake, dbt and Azure Data Factory experience. Our data platform's support regulatory requirements, business intelligence & reporting needs and … GitHub. • Extensive experience in designing, building, deploying, and supporting cloud-based data products and pipelines. • Experience with Azure Storage services such as Blob Storage, Data Lake Storage, or Azure Files. • Hands-on experience designing and developing data pipelines using Azure Data Factory. • Experience of data warehouse design and implementation More ❯

Social network you want to login/join with: Data Architect (Enterprise Data Foundations), Slough col-narrow-left Client: Mars Location: Slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 5770903661a6 Job Views: 4 Posted: 02.06.2025 Expiry Date: 17.07.2025 col-wide Job Description: JOB DESCRIPTION Job Description: Come become … a part of a vibrant CDO team serving Mars Snacking Enterprise. Our team helps build the Data Platforms, Model & Engineer data products, craft Analytical products and Integrations to be a truly data driven growth engine. As we continue to expand and transform digitally, we’re actively seeking an experienced and skilled Data … technologies across traditional and contemporary software, with focus as below:Expert understanding: Azure Data Factory, Databricks, Spark, Azure SQL Database, Azure DevOps/Git, Data Lake, Delta Lake/Lakehouse architecture, Power BI.Working Knowledge: Azure WebApp, Azure Networking concepts.Conceptual Knowhow (nice to have): Azure AI Services, ML concepts, Unity Catalog, Purview. Programming: SQL, Java More ❯

for the Databricks Lakehouse Platform. Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow) and complementary cloud services (e.g. … Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build & Development Hands-on Implementation: Act as a lead engineer in the initial build-out of … sessions to ensure long-term sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data Factory, Azure Data More ❯

We are seeking a strategic and hands-on Lead Data Engineer to own the development of Aerial Direct’s cloud-native data platform. Working primarily within the Microsoft Azure ecosystem, you will be responsible for building and maintaining scalable data pipelines, optimising architecture for performance, and enabling actionable insights across the business. In addition … and evolving Aerial Direct’s Azure-based data platform, ensuring performance, security, and scalability. Design, management, and optimisation of data warehouse and data lake schemas to support downstream analytics, dashboards, and operational processes. Leading development and optimisation of ETL/ELT pipelines using Azure Data Factory, including data ingress … technical team leadership. Extensive hands-on experience with the Microsoft Azure data stack, including Azure Data Factory, Synapse Analytics, Azure SQL DB, Data Lake, Azure Storage, Key Vault, and Databricks. Demonstrated ability to optimise and extend data warehouse and data lake schemas, collaborating with stakeholders to design scalable More ❯

class opportunity to help shape our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with others passionate about solving business … problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and optimise scalable, robust, and efficient data solutions. Implement comprehensive … Proven experience working with Azure data platform services, including Storage, ADLS Gen2, Azure Functions, Kubernetes. Background in cloud platforms and data architectures, such as Corporate DataLake, Medallion Architecture, Metadata Driven Platform, Event-driven architecture. Proven experience of ETL/ELT, including Lakehouse, Pipeline Design, Batch/Stream processing. Strong working knowledge of programming languages, including Python More ❯

use cutting-edge technology to link our clients' systems, departments and sites. We provide an open technology platform that's shaping the industry for the future. We use data to help clients become more efficient, increase profitability and give more customers an amazing experience. Want to be part of it? Role Summary As a Data Architect … you'll be a critical leader in defining and delivering Keyloop's enterprise data strategy. You will guide architecture decisions, ensure best-in-class data governance, and provide the technical blueprint that empowers the organization to become truly data-driven. Main Duties/Responsibilities Lead the design and evolution of Keyloop's enterprise data … and ingestion techniques using modern tools (e.g., Azure Data Factory, Boomi, Informatica, Talend, dbt, Apache NiFi). Strong familiarity with data warehousing, data lake/lakehouse architectures, and cloud-native analytics platforms. Hands-on experience with SQL and cloud data platforms (e.g., Snowflake, Azure, AWS Redshift, GCP BigQuery). Experience with More ❯

Join to apply for the Solution Architect - Data role at Keyloop 2 days ago Be among the first 25 applicants Join to apply for the Solution Architect - Data role at Keyloop Keyloop bridges the gap between dealers, manufacturers, technology suppliers and car buyers. We empower car dealers and manufacturers to fully embrace digital transformation. How? By … use cutting-edge technology to link our clients’ systems, departments and sites. We provide an open technology platform that’s shaping the industry for the future. We use data to help clients become more efficient, increase profitability and give more customers an amazing experience. Want to be part of it? Role Summary As a Data Architect … transformation, and ingestion techniques using modern tools (e.g., Azure Data Factory, Boomi, Informatica, Talend, dbt, Apache NiFi) Strong familiarity with data warehousing, data lake/lakehouse architectures, and cloud-native analytics platforms Hands-on experience with SQL and cloud data platforms (e.g., Snowflake, Azure, AWS Redshift, GCP BigQuery) Experience with BI More ❯

Social network you want to login/join with: Senior Azure Data Engineer + Power BI, slough col-narrow-left Client: Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 5 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: EVOCS is looking for a Senior Azure Data … data marts, and data warehouse structures Integrate data from various sources including SQL databases, APIs, and cloud storage (e.g., Azure Data Lake, OneLake) Implement and maintain standards around data quality, security, and governance Participate in discussions with cross-functional teams to ensure that technical solutions align with business needs … processing using tools such as Event Hubs, Kafka, or equivalents Drive usage of Microsoft Fabric features within modern data architectures, especially OneLake, Lakehouse, and Direct Lake Power BI datasets Effectively communicate across diverse technical stakeholders and navigate challenging peer review or architectural debates Qualifications 5+ years of experience in data engineering with a More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the … front-office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to … streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions More ❯

Social network you want to login/join with: We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture and engineering. This unit is driving major transformation initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable cloud-native solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible for defining the platform strategy, leading a team of data engineers, and ensuring high standards of data quality, compliance, and performance across enterprise-grade data environments. Key Responsibilities: Design and implement enterprise-level data architecture strategies on GCP. Gather client requirements and translate business challenges into scalable data solutions. Act as a trusted expert on GCP data and More ❯

RLDatix is on a mission to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our shared passion for meaningful work … us, while a supportive, respectful culture makes it all possible. As a team, we collaborate globally to reach our ultimate goalhelping people. Were searching for aLondon-based Principal Data Engineer to join our Data and Reporting Platform team, so that we can design and implement a robust data strategy that ensures our data is accessible, reliable, and secure, to support critical business decisions. The Principal Data Engineerwill develop and maintain data models, architecture, and integration strategies to empower data-driven decisions for our global team. In this pivotal role, you will leverage your extensive experience in data engineering and architecture to design and More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with … impressive! Are you ready for a thrilling new career in a fast-paced, dynamic workplace? If so, today might be your lucky day! We’re seeking a Senior Data Engineer to join our cutting-edge technology and data teams. This hands-on technical role involves building data solutions for various projects and persistent data products. You’ll design and implement complex data pipelines, manage database populations, and ensure your solutions align with technical designs and data platform standards. While this role doesn’t include direct people management, you will support, coach, and mentor data engineers and associate engineers, helping them develop their skills. Could you be More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you … ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business … stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

Creative Assembly is looking for a Data Engineer to join the Data Platform Team in our studio based at our headquarters in Horsham, in the heart of West Sussex. This role is suitable for someone with at least two years of experience in a data engineering role. It offers the chance to grow technically … and work on cutting edge projects that improve player experiences through the use of data. Key Responsibilities The data platform team ensures consistent, timely, and accurate data delivery to consumers, while maintaining scalable and efficient pipelines. Our stack consists of: AWS Kinesis Databricks DLT PowerBI/Fabric SQL Server On a day-to-day basis, you … game development process Passionate about helping enable teams to transform data into valuable insights Desirable Experience working with enterprise data warehouse or data lake platforms Experience working with a cloud platform such as AWS Have used PySpark for data manipulation Previous exposure to game or IoT telemetry events and how such More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to … power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT … and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders More ❯

Job Description: The Food & Nutrition Data Architect will be a key driving force in transforming the Food & Nutrition (F&N) business segment. Working closely with our partners, you will have overall accountability for data solution design, including Analytics, Visualisation, Dashboards, and Ops. You will be responsible to bring in thought leadership in your domain of expertise … and apply them to ways of working. As a trusted advisor, you will collaborate with segment cross-functional teams to design and implement cutting-edge data solutions that enhance customer experiences, drive revenue growth, and maintain a competitive edge in the digital marketplace. Moving to One Enterprise Data Platform for Food is a strategic Mars Food … strategy roadmap, working in synergy with segment Data Platform Lead, Segment EA and central Mars Inc COE Analytics teams - to enhance the data lake and a real-time reporting environment for operations. Lead complex data improvement and project management engagements, spanning cross divisions and markets in F&N. Lead the evaluation More ❯

Social network you want to login/join with: Senior Azure Data Engineer - Remote, slough col-narrow-left Client: Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Remote Working - UK Home-based with occasional travel into the office … allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business … and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and More ❯

our people, customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Overview: As a Senior Technical Consultant - Data and AI, you will be responsible for designing, implementing, and optimizing data and AI solutions for our clients. You will work closely with clients to understand their … business needs and translate them into technical solutions that leverage the latest technologies in data and AI. This role requires a deep understanding of data architecture, machine learning, and AI technologies, as well as strong problem-solving and communication skills. Key Responsibilities: Design and implement data and AI solutions that meet client requirements. Collaborate … with clients to understand their business needs and translate them into technical solutions. Develop and maintain data pipelines, data warehouses, and data lakes using tools such as Azure Data Factory, Azure Synapse Analytics, and Azure Databricks. Implement machine learning models and AI algorithms using frameworks like Azure Machine Learning, Microsoft Cognitive Services More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Social network you want to login/join with: Data Engineering Manager - ID40916, oxford district col-narrow-left Client: Humand Talent Location: oxford district, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 5 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: We’re looking for an experienced Data Engineering Manager to lead a team in designing and building cutting-edge data solutions, driving the strategy for a fast-growing, innovative company. If you're passionate about building scalable data platforms, optimising pipelines, and empowering teams to leverage data effectively, this could be your next big move! What You’ll Do … Lead and mentor a team of data engineers, fostering a high-performance culture ? Design, build, and optimise data pipelines and platforms to support business insights ? Work with modern cloud-based data technologies to ensure scalability and efficiency ? Collaborate with cross-functional teams to drive data-driven decision-making ? Ensure best practices in More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

Job Description: The Food & Nutrition Data Architect will be a key driver in transforming the Food & Nutrition (F&N) business segment. Working closely with partners, you will be responsible for data solution design, including Analytics, Visualization, Dashboards, and Operations. You will bring thought leadership in your domain and collaborate with cross-functional teams to implement innovative … data solutions that enhance customer experience, drive revenue, and maintain a competitive edge in the digital marketplace. Moving towards One Enterprise Data Platform for Food is a strategic Mars Food & Nutrition goal. We aim to harness data and insights to solve critical business problems and simplify the global data and analytics user … experience, unlocking growth and operational excellence. What are we looking for? Hands-on experience designing scalable, greenfield data platforms in cloud environments using Azure D&A stack, Databricks, and Azure Open AI. Proficiency in coding (Python, PL/SQL, Shell Script), relational and non-relational databases, ETL tools (e.g., Informatica), and scalable data platforms. Knowledge of More ❯

Social network you want to login/join with: Data and AI - Senior Consultants/Senior Managers, slough col-narrow-left Client: Wavestone Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Company Description Wavestone is a leading global transformation … For more information, visit www.wavestone.com and become part of our journey to shape a positive and impactful future. Job Description Becoming part of the UK team in our Data & AI Service Line will present new opportunities for you to make a positive impact as we embark on securing major projects with our top international clients. This will mean … working with our FTSE100 clients and beyond on a wide range of advisory projects, bringing deep business and technology expertise to help address Data and AI opportunities and challenges across their organisations. Wavestone has a significant and growing capability in Data & AI that is in high demand from our clients. Our clients trust us to tailor More ❯