1 to 25 of 32 Permanent Data Lake Jobs in the South East

focused on building and running cloud platforms rather than line management. The difference you’ll make Engineering and operating the AWS data lake infrastructure, ensuring high availability, resilience, performance, and security Designing, building, and maintaining Infrastructure as Code (IaC) for AWS environments, shared services, and data platform components Managing and supporting data lake platform services and applications, including ingestion frameworks, processing engines, and access layers Implementing and maintaining cloud‐native security controls, including IAM, encryption, network controls, and policy enforcement Supporting DevOps and platform automation, including CI/CD pipelines, environment ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

Help Shape the UKs Energy Future Data Engineer Opportunity with the Civil Works Alliance (CWA), Supporting Sizewell C As part of the CWA (Civil Works Alliance), you will support the building of Sizewell C. Sizewell C will be a 3.2-gigawatt power station generating low-carbon electricity …/CD & Release Management Technical Documentation Technical Azure Databricks, PySpark, Python & SQL Azure Data Factory Azure Functions Azure Data Lake/Lakehouse REST APIs & Third-Party System Integration Azure SQL Logic Apps Azure DevOps, Git & CI/CD Docker/Containers Data Quality ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

Join a leading independent technology and services provider as a Senior Data Engineer! Job Overview: The Senior Data Engineer is responsible for designing, developing, and maintaining scalable data platforms and pipelines that support analytics, reporting, and business transformation initiatives. The role requires expertise … data processing. Experience with cloud platforms such as AWS, Azure, or GCP. Knowledge of Data Warehouse and Data Lake architectures. Experience with orchestration tools such as Airflow, ADF, or equivalent. Understanding of data governance, data quality, and security practices. ...

Senior Data Engineer – Market Data We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process billions of market … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...

Lead Data Engineer - Fully Remote (UK) - AWS - AI & Machine Learning - Up to £110,000 Are you a Senior Data Engineer looking for the opportunity to own a data function rather than simply contribute to one? We're working with a high-growth technology business … that is scaling rapidly and investing heavily in its data, analytics and AI capabilities. The organisation develops cutting-edge products that combine data, machine learning and AI to help global enterprise clients make better decisions through intelligent, evidence-driven insights. This is an opportunity to join ...

STRATEGIC DATA ARCHITECTS | 6 VACANCIES | LONDON Looking for your next Data Architecture opportunity? This is a rare chance to help shape the future of enterprise data within a major organisation undergoing significant transformation. You'll play a key role in defining data … Contract Length: 12 Months Opportunities: 6 Positions Available Must be Eligible for DV Clearance What You'll Do * Define and evolve enterprise-wide data architecture and strategy. * Support the transition to a modern cloud-based data platform. * Develop and embed data standards, architecture principles ...

DATA PLATFORM MANAGER UP TO £80,000 LIVERPOOL STREET, LONDON OVERVIEW We are hiring a Data Product Manager to join a fast-growing, PE-backed telecommunications business undergoing a major data transformation. This is a high-visibility role focused on shaping and delivering data … highly regarded, and central to future growth. The business is investing in a modern data platform, including next-generation data lake capabilities, real-time analytics, AI-enabled use cases, and improved self-service reporting. RESPONSIBILITIES Own the end-to-end lifecycle of data ...

Title: Snowflake Data Architect Salary: Paying between £85-£110,000 Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data Engineering … experience with dbt (data build tool) or equivalent transformation frameworks. AWS Integration : Solid understanding of AWS IAM, S3 data lake patterns, and PrivateLink for cross-cloud data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector ...

Robert Walters is partnering with a leading consumer-focused organisation undergoing significant investment in its enterprise data capabilities to recruit a Data Platform Architect . This is an excellent opportunity for either an established Data Architect or a Senior/Lead Data … looking to step into their first formal architecture role . You will take technical ownership of the evolution of a modern cloud-based data platform, helping define the architecture, standards and engineering patterns needed to support analytics, data products and an expanding AI strategy. While ...

Developer to design, build, and maintain data-driven applications. You'll play a pivotal role in integrating with data lakes, lake house architectures, and enterprise databases, all while working with large-scale data systems that drive our analytics and business-critical applications. What … Develop and maintain pipelines for ingesting, transforming, and serving data across systems. Integration: Seamlessly integrate applications with data lakes and lake house platforms. Data Models: Design and implement data models for structured, semi-structured, and unstructured data. APIs & Services: Develop APIs ...

Senior Data Architect - Databricks - London - Permanent - Hybrid - Up to £110,000 Are you a Databricks expert looking to take ownership of enterprise-scale data architecture and drive a major cloud transformation programme? We're looking for a Senior Databricks Architect to lead the design of enterprise … domain and platform teams to enable data-driven decision making. Skills & Experience Extensive experience using Databricks. Strong understanding of Data Lake architectures. Strong knowledge around modern cloud data platforms (Azure, AWS, GCP) Excellent stakeholder management and communication skills. Legacy integration experience. Knowledge around ...

Senior Data Architect Public Sector | Hybrid | Discovery Phase Programme Location: Remote - Once or twice across the contract onsite to your local office Salary: £550 - £580 per day IR35 - Inside ir35 10 Week Discovery with an option to go on for 2 years Provided data architecture leadership … large-scale public sector discovery, defining the data strategy, governance framework, and information architecture required to enable secure data sharing across multiple organisations. Key Responsibilities Led the data architecture workstream, identifying data risks, dependencies, and opportunities across complex organisational landscapes. Defined target ...

Role Overview We have an exciting opportunity for a Lead Data Engineer to join our growing Data & AI function within FSP. The successful applicant will work alongside our architects and consultants to deliver high-quality data solutions across a variety of cloud platforms … created & managed in our customers organisations Develop high-quality data products utilising (primarily) cloud native patterns Engineer cloud-based data lake patterns to connect and leverage organisational & external data Provide technical support and guidance through prototyping, testing, build, and launch of data ...

Senior Data Architect - London (Hybrid) - Snowflake - Up to £120,000 A leading organisation undergoing significant investment in its data and cloud capabilities is looking for a Senior Data Architect to help shape and evolve its next-generation data ecosystem. This … beneficial: Snowflake Kafka or other streaming technologies Azure, AWS or GCP Kubernetes and container-based platforms Data Warehousing and Data Lake technologies CI/CD tooling and deployment automation Infrastructure as Code ETL/ELT frameworks API integration and distributed systems Data Governance ...

senior leadership. Responsibilities Develop tools and capabilities to support centralization of FP&A and forecasting data into CDLF (Commercial Data Lake for Finance): Define the system and technology vision, and manage key governance processes. Lead large cross-functional teams, including COE, BTS, Forecasting, Commercial partners … vendors, in developing forecasting capabilities that may include a Commercial Data Lake, visualization and reporting tools, and a commercial FP&A/forecasting platform. Lead the development of assessments including smaller proof-of-concept and purpose-built tools for specific business unit teams, forecasters ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

Cleared Data Architect - AWS Up to £870 per day London/Hybrid - 2 -3 days a week 6 months My client is an instantly recognisable consultancy who require a DV Cleared Data Architect with strong AWS experience. Key Requirements: Proven commercial … experience working as a Data Architect within the Defence space. Active DV Clearance and sole UK nationality Strong AWS data lake, platform and security expertise Apache NiFi architecture, governance and pipeline delivery Secure data integration experience across multiple security domains API, file-based ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

Santander is seeking a Senior AWS Cloud Engineer to lead the data lake platform in Milton Keynes. You will design, build, and run secure cloud data infrastructure, enabling data products and analytics across the organisation. The role focuses on hands-on engineering rather ...

Senior Data Engineer Rate: To £650 p/d Inside IR35 Duration: 6 months Work Arrangements: Hybrid - 3 days in Central London office Public facing, household name, critical national infrastructure organisation are seeking an experienced Data Engineer with a strong background in modern data … robust data pipelines using modern data engineering best practices Hands-on development with ETL/ELT processes, data lake architectures, and ideally Medallion architecture principles Strong experience AWS data services (S3, Glue, and Athena) Proficient in Git for source control ...

Data Engineer – Azure/Databricks/3-month contract/Remote Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/…/WFH Duration – Initial 3 month Day Rate – £400-500 per day Outside IR35 Role/Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze/silver/gold) for ingestion, processing, and reporting Develop ingestion patterns ...

lead a team, manage senior stakeholders across multiple functions and markets, and oversee major change activity including ERP upgrades, AI, data lake and broader finance transformation initiatives.What you'll do:Develop the finance transformation strategy & roadmaps for Sky: to meet business priorities and in the broader organisation … transform finance operations, decision-making and colleague experience.Projects: deliver strategic change and transformation initiatives successfully, including ERP upgrades, AI and data lake initiatives. Lead complex business change programmes, ensuring successful adoption of new processes, technologies and ways of working across multiple markets and functions.Activate resources: defining, leading ...