76 to 100 of 201 Data Lake Jobs in London

Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower … scale data platform powered by modern cloud technologies. In this role, you will manage and enhance a petabyte-scale Data Lake and will create secure, efficient, and scalable environments for our data platforms. You will leverage cloud-native technologies and AWS tools such ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling such as CI/CD pipelines and version control The ability … will be responsible for the design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisation’s architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping ...

scalable dimensional data models and reporting frameworks. Integrate Power BI with enterprise data platforms including Azure SQL, Data Lake, Synapse, Fabric, and Oracle environments. Establish governance, security, audit, and reporting standards. Define and implement Row-Level Security (RLS), workspace controls, and access management. … Power BI DAX Power Query Semantic Models Dataflows Deployment Pipelines Power BI Administration Experience integrating Power BI with: Azure SQL Azure Data Lake Microsoft Fabric Azure Synapse Enterprise Data Platforms Strong dimensional data modelling experience. Experience designing secure and governed analytics solutions. Knowledge ...

Role: Data Team Lead- AD Location: London Salary: Competitive salary and package dependent on experience Career Level: Associate Managing Director (CL5) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance, which requires 5 years continuous UK address history at the point … drive adoption of modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Provide strategic direction across data architecture, engineering, analytics, governance and AI. Own delivery across large, complex programmes, ensuring scope ...

Cloud Data Architect (Manager) – BIP xTech About BIP BIP is an international consultancy working with leading organisations to deliver transformation, create long-lasting value and shape the future with confidence. We bring together deep industry expertise, innovative thinking and a collaborative approach to help our clients solve complex … Future Together We Go Further About BIP xTech BIP xTech is BIP’s Centre of Excellence for Artificial Intelligence, Big Data, and Modern Data Platforms. We work with our clients to design and deliver scalable, cloud-native data platforms that enable advanced analytics ...

Head of Data & Analytics Department: Technology Employment Type: Full Time Location: London Reporting To: Chief Information Officer Compensation: £100,000 - £110,000/year Description Job Title: Head of Data & Analytics Salary: £100,000- £110,000 + Bonus + EV Allowance Location: Hybrid (2-3 days … week in London office) We're looking for a Head of Data and Analytics to own our data strategy and turn the information flowing through Pod into decisions that grow the business. You'll build and lead a small central data team, and work ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

Data Engineer (Python SQL AWS) London/WFH to £85k Do you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role at a scaling Investment Research tech company with … great benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus will be on designing and maintaining ...

Contract Delivery Manager – Global Data Strategy Location: London/Hybrid working with limited ad-hoc days in the office per month Contract: 9 months+ Rate: £400 per day (inside IR35) We are looking for an experienced Data Delivery Project Manager to join a Global Data Strategy function, working across multiple Data, Product and Engineering teams to deliver strategic data initiatives. This is a hands-on delivery role focused on coordinating complex programmes, projects and data products, managing dependencies and ensuring teams remain aligned to strategic objectives. ...

Elevate your career by steering multi-faceted tech programs, integrating innovative solutions for a dynamic impact across global operations. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity … data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns with demonstrated experience architecting end-to-end data solutions Experience navigating complex ...

with hundreds of thousands of restaurant, grocery and convenience partners across the globe About this role We're looking for an experienced Senior Data Engineer to join the Insights & Enablement team within Retail Media Tech at JET. This team sits at the heart of JET's retail media … Core (or dbt Cloud) and Airflow for orchestration and transformation at scale. Solid grounding in data warehouse and data lake architecture, including dimensional modelling and layered architectures (Gold/Silver/Bronze or equivalent). Production experience with GCP (BigQuery, Dataflow ...

About UBDS Digital UBDS Digital, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI, cyber security and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. … highly governed environments Experience with Azure data and integration technologies such as Data Factory, Synapse Analytics, Data Lake Storage, Functions, Logic Apps or API Management Experience with Azure Databricks in large-scale enterprise environments Knowledge of enterprise application and data integration ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

successful candidate will formulate and design the solutions to deliver to the requirements coming from different business lines and operational departments that have data provision, reporting, and analytics use cases. This is to keep us aligned with the longer term agreed strategies at a business, data, and technical level. The role is an important bridge to translate business department and data office requirements into technically deliverable solutions that are performant, robust, reliable, and manageable in the long term. Is a key mechanism to drive consistency of design across deliveries and projects. ...

Data Migration Specialist Location: Sheffield, UK (Hybrid/Onsite) Contract Duration: 6 Months Start Date: Immediate Are you a senior Data Migration Specialist with deep expertise in Azure data engineering and enterprise-scale transformations? We are looking for a hands-on technical lead … advanced analytical queries, and reconciliation). Strong Azure Cloud Stack Experience: Azure Data Factory (ADF) Azure SQL DB Azure Data Lake/Lakehouse architectures Python for data manipulation & automation Proven experience across all migration phases: Strategy, Discovery, Cleansing, Mapping, Execution, and Post-migration ...

Placed at the heart of Gensler’s People + Process + Technology, the Global Design Technology Studio is advancing a growing data and machine learning foundation that is shaping how the firm designs and delivers its work for generations to come. We believe that when the right intelligence … data and ML platforms, ideally including Azure ML, Databricks, Azure Data Factory or Fabric pipelines, Blob/Data Lake storage, and MLflow or similar tooling. Experience building production‐grade ETL/ELT pipelines and supporting ML workloads from ingestion through deployment. Comfort moving ...

client is a public sector technology consultancy. Description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain … these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Your role at our client As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands ...

Project description Build reusable platform capabilities and data products that let quantitative researchers discover, access, and consume data across a complex, disparate landscape, and then accelerate the good prototypes to production. Responsibilities Design, build, and enhance data pipelines and integration frameworks supporting AI, analytics … environments. Strong communication skills and ability to interact efficiently with various stakeholder groups including business users. Nice to have Experience with Databricks, Spark, Delta Lake, or similar modern data engineering platforms. Experience designing enterprise data lakes, lakehouses, or large-scale analytical platforms. Domain experience within ...

Description Data Modeller Investment Banking We are looking for an experienced Data Modeller with a strong Investment Banking background to support complex data initiatives across trading, risk, settlements, and regulatory reporting. This is a niche, hands-on modelling role (not architecture) for someone … work closely with business SMEs and technical teams to design robust logical and physical models. Key Responsibilities Develop logical and physical data models for data warehouses, data lakes, and data marts Work closely with business SMEs to translate requirements into scalable data ...

Senior Data Engineer Microsoft Fabric London Hybrid currently typically 2 days per month in London or Birmingham £65,000 £75,000 + 10% bonus + 7% pension + benefits If your Microsoft Fabric experience goes beyond building the initial solution and you've actually had to support, improve … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

Macquarie Group is seeking a Data Platform Engineer to design, build and optimize … petabyte-scale data platform powered by modern cloud technologies in a hybrid work model. You will manage a Data Lake, ensure secure, scalable environments, and drive performance with AWS tools such as S3, EKS, Glue, Airflow, Trino and Parquet. The role emphasizes delivering high-performance ...

fraud losses that the operation's leadership runs on. Take a central role in the bank's new Microsoft Fabric data lake programme - designing and building the fraud analytics layer on it over the coming months. Mentor and upskill the bank's own analyst team - knowledge transfer … sits alongside it. Experience with cloud data platforms (Azure, Fabric, Databricks or similar) is a strong plus given the data lake programme ahead. Clear English and the credibility to present analysis and recommendations to senior stakeholders. Confirmed availability for an immediate start and genuine willingness ...

genuinely collaborative. Because when you’re trying to change an industry, you need people who have each other’s backs. As a Senior Data Engineer at Emergn you will help us shape Emergn exciting future and play an important role in our growth. We want you to: Lead … Apache Spark in data engineering environments. Strong experience building solutions on Azure (e.g., Data Factory, Synapse, Data Lake). Practical experience with Microsoft Fabric and modern cloud data architectures. Experience in data processing libraries such as Pandas, NumPy ...