1 to 25 of 31 Data Lake Jobs in Central London

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

Team, joining a global team of data technology professionals to deliver critical analytics engineering requirements for the strategic cybersecurity data lake and analytics platform. The position is a technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure and platform engineering … foundation. Principal Accountabilities: Cloud Infrastructure & Platform Engineering/Platform Operations & Production Support Operation and enhancement of the strategic cybersecurity data lake and advanced analytics platform in Azure cloud. Build and manage CSA Azure platform to enable application deployments. Engineer solutions on the Azure platform using Infrastructure ...

Data Engineering Lead Department: CSG - Operations Hub (Data/Intelligence/Support) Employment Type: Permanent Location: London - Woolgate Description We are looking for an experienced Data Engineering Lead to play a pivotal role in shaping and delivering our enterprise data platform. This … experience with Microsoft Azure data technologies, including: Azure Data Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation is at the heart … works. Core experience with AWS, with substantial and mature Azure platform offering. Experience with other cloud platforms, e.g. Azure, GCP and data lake architectures. Strong experience and programming skills in languages such as Python and SQL and the ability to write complex SQL queries. Use of GitHub ...

Data Architect – Leading Investment Bank – London/Hybrid (Tech stack: Data Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue … Capital Markets Data) Our client is a leading global investment bank with a strong presence across financial markets and commodities. They are now looking for an experienced Data Architect to help shape and deliver their enterprise-wide data strategy, working across business and technology ...

trusted data models, reusable datasets, reporting foundations and self‐service analytical capabilities. Bring the team onto a centralized snowflake data lake, starting from scratch and ensuring best practices for data stewardship are implemented (data modelling, quality and governance, for example). … analytics solutions. Act as the senior link between Ad Sales and central data platform teams, ensuring that the Snowflake data lake, ingestion patterns and governance controls support the division's current and future BI needs. Collaborating with engineers, analysts and technical teams across the BBC. ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands‐on exposure to: AWS cloud & migration Python development SQL, databases & data platforms Data pipelines & ETL/ELT APIs & backend engineering CI/CD & production systems Analytics & modern data platforms AI/ ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands-on exposure to: ☁️ AWS cloud & migration 🐍 Python development 🗄️ SQL, databases & data platforms 🔄 Data pipelines & ETL/ELT 🔌 APIs & backend engineering 🚀 CI/CD & production systems 📊 Analytics & modern data platforms 🤖 AI/ ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

strategic, sustainable decisions by bringing transparency to markets across the world. We create a comprehensive view of commodities markets, providing companies with the data and intelligence to successfully navigate across global value chains every day. Our customers benefit from instant access to price assessments, reports and forecasts … more about ICIS at the link below. explore About the role: To provide dedicated analytical capability within Customer Intelligence, connecting customer research, CRM data, product usage data and business performance metrics into clear, actionable insight. This role is designed to build future data science ...

Data Migration Specialist Location: Sheffield, UK (Hybrid/Onsite) Contract Duration: 6 Months Start Date: Immediate Are you a senior Data Migration Specialist with deep expertise in Azure data engineering and enterprise-scale transformations? We are looking for a hands-on technical lead … advanced analytical queries, and reconciliation). Strong Azure Cloud Stack Experience: Azure Data Factory (ADF) Azure SQL DB Azure Data Lake/Lakehouse architectures Python for data manipulation & automation Proven experience across all migration phases: Strategy, Discovery, Cleansing, Mapping, Execution, and Post-migration ...

Data Architect 6 months Hybrid working with 2 to 3 days per week on site in either London or Corsham. Active … clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture click apply for full job details ...

Senior Data Engineer Microsoft Fabric London | Hybrid currently typically 2 days per month in London or Birmingham £65,000£75,000 + 10% bonus + 7% pension + benefits If your Microsoft Fabric experience goes beyond building the initial solution and youve actually had to support, improve … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams to ensure seamless data flow and accessibility, supporting … concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

Experis - ManpowerGroup is seeking a Data Architect for a 6-month hybrid role, with 2–3 days on site in London … Corsham. Active DV clearance is required, and the daily rate is £860 inside IR35. You will specify target designs for the data lake, ingestion, governance and security architecture, acting as the design authority to ensure secure, scalable, auditable solutions across classified environments. The position requires extensive experience ...

Burns Sheehan is seeking a hands-on Contract Business Analyst to support a data lake migration project in London. You will bridge between technical teams and business stakeholders to ensure the right data, reports and applications are defined, tested and signed off as part ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...