126 to 150 of 611 Data Lake Jobs in the UK

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data ...

ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy). You’ll work with a modern, cutting‐edge data stack and play a key role in shaping data … design within a modern cloud‐based environment Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Experience working with lakehouse/medallion architectures in Databricks Experience with experimentation support tooling ...

Type: Permanent Location: United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Data Engineer We have an exciting role for you Data Engineer ! Careers at TCS: It means more TCS is a purpose-led transformation company … maintain Azure-based data pipelines and ETL solutions. Work with Azure Data Factory, Databricks, Synapse, and Data Lake to support data integration, migration, and analytics requirements. Collaborate with stakeholders to understand business needs, troubleshoot data issues, and ensure secure ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

Powering Progress strategy on the journey to net-zero emissions. Achieving this ambition requires uniting Shell's strategic and technical expertise across data, strategy, architecture, and innovation. This integration is essential to drive the transformative shifts needed in IT. As part of this journey, we are seeking … driven architecture (event hub, event bus, Kafka), ELKIntermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQLIntegration experience with Confluent/Kafka, API Management, Logic AppsCI/CD & DevOps: Brings substantial experience ...

Define and own data products: Set up and define data products, including data warehouse and data lake requirements. Drive analytics maturity: Define how usage and outcomes are captured and analyzed, including analytics for LLM/agent interfaces. What you'll bring … Claude specifically, including having built agents. Experience setting up and defining data products (data warehouse, data lake).Scrum of Scrums experience. Experience working as part of a globally distributed team of Product Leads. This position may require frequent travel. Be Hungry. Be Humble. ...

team you'll be working with: We are seeking an accomplished and detail-oriented Snowflake Data Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data engineering, ETL/ELT pipelines, and cloud-native data platforms … platforms (AWS, Azure, GCP).Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon).Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop).Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

communications there is always a talented team working to maximise the potential of the sport. Role Overview We are looking for a Data Analyst to join our IT department. Reporting into our IT Systems Manager, this role will maintain, develop and optimisation of data enterprise solutions. … capture processes Monitor data quality, integrity and performance across data platforms Maintain medallion architecture layers in a data lake to manage structured and semi-structured data Apply data modelling best practises to support enterprise reporting and analytics Building data ...

Blood and Transplant (NHSBT) is a unique organisation that works to save and improve lives every day. Are you a skilled data engineering professional who thrives on transforming complex data into powerful insights that support vital services? This is an exciting opportunity to join NHS Blood … Server Tools. Experience with MS Azure technologies such as Azure Data Factory, Synapse Analytics, Databricks, Azure SQL, Azure Data Lake Storage etc. Knowledge of data modelling, architectural principles and big data tools. Experience in diagnosing and troubleshooting complex data ...

seeking a Data Infrastructure Architect with 7+ years of experience in designing and governing enterprise-scale data platforms within regulated environments. The role ensures data is accessible, trusted, secure, and optimized for analytics, machine learning, and AI-driven solutions. Ideal candidates will either already … have transitioned to or be ready to transition from a hands-on delivery role to strategic influence, shaping data architecture standards and guiding technology decisions across the organization. The Architecture & Modernization (A+M) team drives the Firm's multi-year technology modernization roadmap, focusing on architecture frameworks, product delivery ...

annum. 37 Competency and value framework (CVF) level? 2 24/09/2026, 12:00 Permanent Full Time Leek Wootton As anAssociate Data Engineer,with a specialization inPower BI, your primary responsibility will be to build and maintain data pipelines and reporting solutions using Power … into a variety of data stores e.g. databases and data lakes. You will work closely with data analysts, and business stakeholders to ensure data accessibility and quality. Main Responsibilities: Work with the Data Engineer to ensure the data ...

Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed … Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...

realized as secure and robust solutions. Apply AI tools and techniques to improve Solution Architecture practices - including accelerating requirements analysis, pattern identification, data modeling, and architecture documentation. Ensure full conformance with firm-wide, CIB, and sub-Line of Business (sub-LOB) architecture patterns and standards, participating in architecture … Persistence, Data Streaming, Data Quality and Metadata Management. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Demonstrated ...

opportunity to discuss your flexible working requirements during the interview process, and at offer stage. We’re reshaping our Digital, Technology and Data function for the future, creating new opportunities, strengthening our capability, and building clearer, more resilient ways of working so we can deliver even better services … with Power BI or Strategy Experience with working within the MS Azure Cloud data platform (Data Factory, Data Lake and Databricks) Strong SQL skills with experience of Microsoft SQL Server Management Studio or equivalent Experience working on data warehouse projects ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Day rate: £550 p/d (Outside IR35) Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project on an initial 6-month contract. You’ll be working between the technical teams and business stakeholders, helping to make sure the right data, reports and applications are identified, tested and signed off as part of the data ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...

Title Technical Data Project Manager – Data Platform Modernization Department Technology/Data Platforms Location London, UK Role Summary A Technical Data Project Manager … lead delivery of data platform modernization initiatives within a global banking environment. The role focuses on execution across data lake, data fabric, and DevOps‐enabled delivery models, working closely with engineering, architecture, and business stakeholders. Key Responsibilities Lead end‐to‐end delivery ...

Location-Basildon, UK -5 days from Office JD: Mandatory Skills : AWS Lambda, Datalake house Architecture, ETL Concepts Overview We are seeking a talented and experienced to join the Data Solutions domain in EMEA In this role you will design build Data Lakehouse Engineer and optimize scalable … flows and ELT/ETL patterns Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and Lakehouse layers Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle Monitor troubleshoot ...

embedded technical expert within the Cloud Engineering & FinOps team, working alongside fellow FinOps engineers to build, maintain, and continuously improve the data and AI/ML capabilities that power CBRE's cloud cost management practice. You bring deep, hands‐on expertise in data engineering … Skills Data engineering: strong proficiency with Apache Spark, dbt, Airflow/Azure Data Factory or equivalent orchestration, Data Lake/Apache Iceberg, and advanced SQL for large‐scale transformations. Microservices & APIs: experience building modular, production‐grade microservices and REST APIs using Python (FastAPI ...

that makes you unique is welcome; join us and let's build what's next - together! About the RoleWe're seeking a Principal Data Engineer who can work across the full stack of Anaplan's data platform, setting the technical direction for how we ingest, transform … workflow orchestration tools (e.g., Apache Airflow, Dagster).Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg).Advanced SQL skills and proficiency in Python. Strong background in modern software development practices (testing, code ...

Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed … Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...