151 to 175 of 316 Data Lake Jobs

client is seeking an experienced Data Architect to lead the design and delivery of enterprise-grade Azure data solutions . This role will focus on building scalable, secure, and cost-optimised architectures that support ingestion, storage, modelling, and analytics across complex data landscapes. Data … landscapes and provide modernisation or migration strategies. Azure Data Platform Expertise Design and implement solutions using: Azure Data Lake Storage Gen2 Azure Synapse Analytics Azure Databricks Azure Data Factory Azure SQL/Managed Instance Azure Cosmos DB Azure Event Hub/ ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid – 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data‐driven consultancy helping enterprise‐scale organisations modernise their data estates. With several major new projects … Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse architecture Solid knowledge of data ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid – 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data‐driven consultancy helping enterprise‐scale organisations modernise their data estates. With several major new projects … Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse architecture Solid knowledge of data ...

Hiring Data Analyst, Data Engineer and Data Scientists Must have Security Clearance Warrington If you have 4–5 years of experience in data roles and a passion for Generative AI, ChatGPT, machine learning, and Azure’s modern data stack … want to hear from you. What We’re Hiring For We have multiple opportunities available across our growing capability: 📊 Data Analyst You’ll transform raw data into compelling insights, build enterprise-grade Power BI solutions, and work with Azure technologies such as Data Factory ...

Data Engineer Our financial services client based in Reading is looking to recruit an experienced Data Engineer to join ASAP. The position will be fully remote working with occasional visits to their offices in Reading. To be considered for the role you must have the following … Data Factory. Basic understanding of Azure Fabric and appropriate implementation. Familiarity with the management and use cases of Azure Data Lake Storage. Familiarity with the development of analytics Azure Synapse. Familiarity with Azure database service with strong knowledge of the SQL language. An understanding ...

What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/Delta … Lake/BigQuery). Familiarity with eventing technologies (e.g. Event Hubs/Kafka) and file formats such as Parquet/Delta/Iceberg. Want to learn more? Get in touch for an informal chat. ...

Senior Data Engineer, Azure London/hybrid Circa £90k-£100k + bonus + benefits Senior Data Engineer required by global banking organisation to help build and scale a modern data platform within a complex financial services environment. This role plays a key part … with technologies such as Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark ...

know Snowflake) Key Responsibilities: * Candidate will have extensive working knowledge on PostgreSQL, Snowflake and Greenplum databases. * Snowflake internals and integration with other data processing technologies. * Data lakes, data structures and data models suited to Snowflake architecture. * Snowflake modelling - roles, schemas and databases. … Experience of building data ingestion pipelines with tools like Informatica, Talend etc. * Effective management of data from various sources like JSON, XML, CSV etc. * Expertise in Patroni for HADR and streaming replication. * Strong knowledge of Postgres/Greenplum database backup and recovery strategies. * Proven experience ...

Senior Data Engineer, Azure London/hybrid Circa £90k-£100k + bonus + benefits Senior Data Engineer required by global banking organisation to help build and scale a modern data platform within a complex financial services environment. This role plays a key part … with technologies such as Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data ...

questions, including pay details for this role. Job Description: The Asset Liquidity and Funding Analytics (ALFA) team is seeking an experienced Software/Data Engineer to extend the strategic Liquidity and Funding platform at TD Securities. This Dublin-based permanent role will join a high-performing global engineering … reliable data pipelines using Databricks and Apache Spark. We need both. Experience with cloud data warehouse/data lake architectures and tooling. Experience building solutions using cloud providers, preferably Azure (AWS/GCP also valued). Experience with modern data lakehouse ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

troubleshooting Familiar with the Agile. Well communication. Good English listening and speaking for communicating requirements and development tasks/issues Hands-on experience with lake houses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time-series data, market feeds, transactional records, and risk … work with and manage stakeholders Desirable skills/knowledge/experience: Ability to prepare and process datasets for Power BI usage Experience with One Lake, Azure Data Lake, and distributed computing environments Understanding of financial regulations such as GDPR, SOX etc. Spark application performance tuning Knowledge ...

troubleshooting Familiar with the Agile. Well communication. Good English listening and speaking for communicating requirements and development tasks/issues Hands-on experience with lake houses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time-series data, market feeds, transactional records, and risk … work with and manage stakeholders Desirable skills/knowledge/experience: Ability to prepare and process datasets for Power BI usage Experience with One Lake, Azure Data Lake, and distributed computing environments Understanding of financial regulations such as GDPR, SOX etc. Spark application performance tuning Knowledge ...

supporting an organisation that's undergoing a large scale digital transformation, and they're looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You'll play a key part in shaping the organisation's data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You'll be involved in everything from ingesting and transforming data ...

supporting an organisation that's undergoing a large scale digital transformation, and they're looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You'll play a key part in shaping the organisation's data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You'll be involved in everything from ingesting and transforming data ...

supporting an organisation that's undergoing a large scale digital transformation, and they're looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You'll play a key part in shaping the organisation's data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You'll be involved in everything from ingesting and transforming data ...

supporting an organisation that’s undergoing a large scale digital transformation, and they’re looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You’ll play a key part in shaping the organisation’s data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You’ll be involved in everything from ingesting and transforming data ...

What you'll be doing Own the architecture for the AI/Data platform Design how Azure, Microsoft Fabric, Data Lake, ML tooling and governance all fit together Ensure scalable, secure, well-governed architecture aligned to regulatory expectations Define integration patterns with Legacy platforms … MLOps and cloud security teams Provide architectural assurance across partner and internal workstreams What you'll need Strong Azure background (Fabric, Data Lake, ADF, Databricks a plus) Deep experience designing enterprise data/AI platforms Understanding of AI governance, privacy, lineage and auditability Ability ...

Senior Data Engineer* ?? Location: Leeds, West Yorkshire (Hybrid 2 days per week) ?? Employment Type: Permanent ?? Status: Actively Hiring ?? Salary: £55,000-£65,000 + Excellent Benefits WRK digital is excited to be partnering exclusively with a high-profile, UK-leading organisation, currently shortlisting for a Senior Data … contributing to the evolution of modern data architecture. Key Experience Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Title: SQL Data Architect - Azure Stack Location: Remote with occasional travel to Birmingham Salary/Rate: Up to £600 per day inside IR35 Start Date: 12/01/2026 Job Type: Contract - 12 months Company Introduction: We have an exciting opportunity now available with … stored procedures, triggers, and query optimization; SSIS (package design, orchestration, deployment) Azure Data Factory (pipelines, triggers, integration runtimes); Azure Data Lake Storage (Gen2, security, folder structures); Microsoft Fabric (Lakehouse, OneLake, Data Engineering); Databricks (Spark SQL, notebooks, Delta Lake, integration with ADF/ ...

cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role … MLOps concepts, model registration, deployment (AKS, ACI), and monitoring. • Hands-on experience with Azure data services such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics. • Solid understanding of software engineering principles, including version control (Git), testing ...

cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role … MLOps concepts, model registration, deployment (AKS, ACI), and monitoring. • Hands-on experience with Azure data services such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics. • Solid understanding of software engineering principles, including version control (Git), testing ...

cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role … MLOps concepts, model registration, deployment (AKS, ACI), and monitoring. • Hands-on experience with Azure data services such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics. • Solid understanding of software engineering principles, including version control (Git), testing ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Protocol (MCP) for advanced context-aware analytics and automation. Develop and maintain security analytics and data pipelines within Sentinel Data Lake to support large-scale threat detection, incident response, and threat hunting, while optimizing cost and enabling Agentic AI-driven security operations. Integrate and automate … team of Cyber Defence Security Engineers. The Requirements: Must-Have Skills: Microsoft Sentinel Expertise : Architecture, deployment, management, including AI for Security, Data Lake optimization, MCP, and Sentinel Graph. Cloud Security Tools : Hands-on with Wiz Cloud (Defend, Runtime Sensor, Code), CSPM, and CWP. Automation & Integration : Using Sentinel ...