126 to 150 of 297 Data Lake Jobs

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

reporting engineer to enhance their career with a modern business who have big plans for 2026. Power BI, Power Platform, Azure Data Lake and Data Services experience are all essential qualities to apply for this role. In this role you will be responsible for designing … driven policy. Key Skills Requirements Include: Strong experience with Power BI Key understanding of data sourcing inc. Data Lake, Power Platform and SQL Familiarity with Data Factory Understanding of CI/CD for Power BI Keen interest in the future ...

Title: Data Engineer Salary: £60,000 + Bonus Location: Fully Remote (UK-based) Overview We are seeking an experienced Data Engineer to join our Data team and play a key role in developing scalable, cloud-based data pipelines and infrastructure. This role … will support the organisation's growing data strategy by ensuring high-quality, reliable, and accessible data for analytics, reporting, and future AI/ML capabilities. The ideal candidate will have strong expertise in Azure, Databricks, and Python, with a proven track record of building and maintaining ...

with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. … Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion ...

with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. … Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion ...

Role: Senior Data Architect Domain: Commodities Trading Location: London (hybrid 3 days per week) Contract: Initial 12 months Rate: £750-850/d inside IR35 X4 Technology are partnered with a global energy trading firm embarking on a major data transformation to enable AI-driven capabilities … confidently consumed by AI and analytics solutions by driving data productisation, enterprise & cross-portfolio modelling, business rule definition, Azure data lake maturity, data quality assurance and advanced concepts like ontology and data mesh. Your work will support large-scale trading ...

Role : Senior Data Architect Domain: Commodities Trading Location : London (hybrid 3 days per week) Contract : Initial 12 months Rate : £750-850/d inside IR35 X4 Technology are partnered with a global energy trading firm embarking on a major data transformation to enable AI-driven capabilities … confidently consumed by AI and analytics solutions by driving data productisation, enterprise & cross-portfolio modelling, business rule definition, Azure data lake maturity, data quality assurance and advanced concepts like ontology and data mesh. Your work will support large-scale trading ...

Role : Senior Data Architect Domain: Commodities Trading Location : London (hybrid 3 days per week) Contract : Initial 12 months Rate : £750-850/d inside IR35 X4 Technology are partnered with a global energy trading firm embarking on a major data transformation to enable AI-driven capabilities … confidently consumed by AI and analytics solutions by driving data productisation, enterprise & cross-portfolio modelling, business rule definition, Azure data lake maturity, data quality assurance and advanced concepts like ontology and data mesh. Your work will support large-scale trading ...

Power BI/Analytics Engineer (Data & Reporting) Overview We’re looking for an experienced Power BI-focused analytics engineer to take ownership of a growing reporting and data environment. This role sits at the intersection of business intelligence, data modelling, and light data … modelling and star schema design. Experience working with cloud-based data platforms (e.g. Microsoft Fabric, Synapse, Azure SQL, Data Lake or similar). Comfortable supporting end-to-end analytics workflows , including light data engineering and data preparation tasks. Familiarity with ...

people, generation after generation. It's a purpose that drives everything we do. And you can play your part too join our Central Data Office as a Senior Data Engineer. How you'll make a difference As a Senior Data Engineer … curious and highly passionate about using data to make an impact. Significant experience with Azure Data Factory, Data Lake, Databricks and SQL. A collaborative, supportive approach with the ability to step up as technical lead, communicate clearly and support colleagues Proficiency in data ...

pipelines using Azure Databricks and PySpark. Support data migration activities from legacy systems to modern cloud based architecture. Implement Delta Lake for efficient data storage and retrieval. Collaborate with data scientists and analysts to enable advanced economic modelling and forecasting. Ensure … hands on experience with Azure Databricks and Spark. Proficiency in PySpark, SQL, and Python (Scala desirable). Experience with Azure services: Data Lake, Synapse, Key Vault. Proven track record in ETL pipeline development and data migration. Familiarity with Delta Lake and data ...

Title: Senior Systems Developer DETAILS We are seeking a highly skilled Senior Systems Developer with extensive experience in data architecture, system design, and enterprise-level application development. The successful candidate will be responsible for constructing scalable systems, designing robust data models, and guiding the technical direction … backend and data-driven solutions across the organisation. DUTIES & RESPONSIBILITIES · Design, develop, and maintain sophisticated backend systems, APIs, and services. · Lead architectural decisions to ensure systems are scalable, secure, and high-performing. · Implement best practices for software engineering, and cloud-native development. · Collaborate with cross-functional teams (Data ...

client is seeking an experienced Data Architect to lead the design and delivery of enterprise-grade Azure data solutions . This role will focus on building scalable, secure, and cost-optimised architectures that support ingestion, storage, modelling, and analytics across complex data landscapes. Data … landscapes and provide modernisation or migration strategies. Azure Data Platform Expertise Design and implement solutions using: Azure Data Lake Storage Gen2 Azure Synapse Analytics Azure Databricks Azure Data Factory Azure SQL/Managed Instance Azure Cosmos DB Azure Event Hub/ ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid – 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data‐driven consultancy helping enterprise‐scale organisations modernise their data estates. With several major new projects … Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse architecture Solid knowledge of data ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid – 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data‐driven consultancy helping enterprise‐scale organisations modernise their data estates. With several major new projects … Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse architecture Solid knowledge of data ...

Hiring Data Analyst, Data Engineer and Data Scientists Must have Security Clearance Warrington If you have 4–5 years of experience in data roles and a passion for Generative AI, ChatGPT, machine learning, and Azure’s modern data stack … want to hear from you. What We’re Hiring For We have multiple opportunities available across our growing capability: 📊 Data Analyst You’ll transform raw data into compelling insights, build enterprise-grade Power BI solutions, and work with Azure technologies such as Data Factory ...

Data Engineer Our financial services client based in Reading is looking to recruit an experienced Data Engineer to join ASAP. The position will be fully remote working with occasional visits to their offices in Reading. To be considered for the role you must have the following … Data Factory. Basic understanding of Azure Fabric and appropriate implementation. Familiarity with the management and use cases of Azure Data Lake Storage. Familiarity with the development of analytics Azure Synapse. Familiarity with Azure database service with strong knowledge of the SQL language. An understanding ...

What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/Delta … Lake/BigQuery). Familiarity with eventing technologies (e.g. Event Hubs/Kafka) and file formats such as Parquet/Delta/Iceberg. Want to learn more? Get in touch for an informal chat. ...