16 of 16 Data Lake Jobs in Central London

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

experience with Azure Cosmos DB, including data modelling, partitioning, indexing, throughput optimisation, and Change Feed processing. Experience with Azure Data Lake Storage (ADLS), OneLake, ABFS, and Azure Key Vault. Strong understanding of data modelling concepts, including temporal data patterns such … , including ISINs, CUSIPs, LEIs, PermIDs, and asset classifications. Experience with entity resolution, record matching platforms, and third-party enrichment services. Experience with Delta Lake and Change Data Feed (CDF) patterns. Knowledge of Cosmos DB SDK optimisation techniques, including bulk operations, optimistic concurrency, and RU optimisation. Experience ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Analytics . Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best ...

Enhanced DV Clearance Required ABOUT THE ROLE We're supporting a secure government programme seeking an experienced Business Analyst to join a major Data transformation initiative. You'll work closely with technical teams and senior stakeholders to improve data governance, interoperability, and information management across … complex enterprise environment. This is an opportunity to work on high-impact projects within the National Security sector, helping shape data strategy and drive business change. THE ROLE As a Business Analyst, you'll bridge the gap between business and technical teams, translating complex data requirements ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

London (Hybrid - 1-2 days per week onsite) Salary: £90,000 - £100,000 + Excellent Benefits Job Type: Permanent Are you an experienced Data Architect looking to shape the future of enterprise data platforms? We're working with a leading global organisation that is investing heavily … cloud, data and AI transformation. As part of this growth, they're looking for a Senior Data Architect to design and deliver enterprise-scale data platforms that power advanced analytics, machine learning and AI solutions. This is an opportunity to work on large-scale ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Senior Manager - Data Management | Financial Markets | London A commodities-focused financial-services firm is hiring a senior manager to build its enterprise data-management capability from the ground up. This is a rare opportunity to create and lead the operating model for data ownership … embed clear accountability, and play a key role in a major data-platform transformation to Databricks and a modern data-lake environment. We’re looking for someone with: Financial-markets experience and strong exposure to trading, market and risk data A track record ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Artificial intelligence ...

Summary We are seeking an experienced Data Solutions Architect with deep expertise in designing and specifying Customer data solutions in a Retail environment. Collaboration will be key as you propose and socialise target and transition states for Customer data mastering, management, and consumption. … will propose technologies and solutions that deliver measurable business outcomes, such as improved personalization, enhanced data quality, and accelerated analytics capabilities. You will also oversee the design of customer-related data solutions to ensure strategic alignment. Your coverage will include the systems and processes that master ...

Locations: - Noida, Bangalore Key Responsibilities: Pharma & Clinical Domain Delivery Manage delivery of programs within regulated GxP environments Oversee transformation programs across Clinical Data Management and safety systems Collaborate with Regulatory, Quality, Medical Affairs, and Clinical Operations stakeholders to align delivery outcomes with business-critical compliance requirements Multi-Program … pipelines, RAG architectures, NLP, computer vision, and AI governance frameworks: AI & Analytics Data governance, MDM, API-led integration, data lake/warehouse architectures, real-world data (RWD): Data & Integration Veeva Vault, Oracle Clinical, Argus Safety Clinical Systems Jira, Confluence, MS Project ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where … platforms from the ground up Designing robust data pipelines using Databricks and SQL Working with modern Lakehouse/Data Lake architectures Delivering analytics and insight solutions that drive business decisions Improving platform performance, scalability and data quality Providing technical leadership within ...

leading multinational hospitality group operating within a fast-paced and commercially driven environment. Due to continued international growth and investment in technology and data, the business is seeking a Senior BI Developer to join its London-based team. Key Responsibilities Lead the development, enhancement, and support … skills and experience working with complex datasets Good understanding of financial reporting, budgeting, forecasting, and planning processes Experience with API integrations, Data Lake environments, or data management processes would be advantageous Exposure to Power BI, Azure, or other modern BI technologies would be beneficial Excellent ...

solve business problems. Key responsibilities: Build web-based tools to deliver exposure and portfolio insights Integrate analytics platforms with modern data lake architecture Develop solutions using AI, natural language querying, and automation Support exposure and financial calculation engines using standard data formats Collaborate with Underwriting … Pricing, Claims, and Data teams A strong role at the intersection of development, data, and insurance analytics, with broad exposure to key business areas. Please apply for more information ...