Permanent Data Lake Jobs in London

26 to 50 of 106 Permanent Data Lake Jobs in London

Senior Data Engineer - Databricks

London, United Kingdom
Nigel Frank International
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Senior Data Engineer - Databricks

City of London, London, United Kingdom
Nigel Frank International
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Senior Azure Data Engineer - Databricks - London

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Azure Data Engineer

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Data Engineer - Azure

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Lead Azure Data Engineer - £85,000

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Azure Data Engineer - £85,000

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Data Engineer - Azure & Snowflake

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Azure Data Engineer - £85,000

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Infrastructure Engineer GBP 55000

Wembley, London, United Kingdom
Hybrid / WFH Options
Nextech Group Limited
App Services, virtual networks, Exchange Online, Intune). * Implement Azure security best practices and Microsoft Defender. * Monitor and mitigate security incidents. * Protect sensitive data and ensure data governance compliance. * Collaborate … with Data and AI teams on Azure-based solutions. * Guide on Azure services for Data and AI (Data Lake, Data Factory, OpenAI). * Integrate Data and AI solutions with existing systems. * Maintain on-premises infrastructure (Windows Server, Active Directory … CV to connor . thomas @ nextech - group . co . uk. They are interviewing IMMEDIATELY!! Keywords: Azure, Entra ID, SQL, Exchange Online, Intune, Data, Windows Server, Active Directory, Oracle, VMware, Red Hat, Enterprise, Linux, Cisco Switches, Palo Alto Firewalls, PowerShell, Python more »
Employment Type: Permanent, Work From Home
Salary: £55,000
Posted:

Master Data Transformation Lead - Contract

Greater London, England, United Kingdom
JSS Transform
Master Data Transformation Lead 12 Month Contract Our Global Retail Client has a brand new role as a Master Data Programme Lead to oversee every aspect of a programme from conception to implementation. You will provide expertise, tools and frameworks to ensure successful delivery of programme … and in function especially in cases of high demand where value is at risk and additional effort is needed. Programme Experience & Skills Master data Led Master Data strategy and implementation programs focused on creating a Master Data Function and Governance at Group level to … volume, data environments designed for analytics and CRM use cases. Led projects to select, design, implement and manage data lake/data warehouse platforms. (Some of the following types of providers: AWS, Microsoft Azure, Google Cloud Platform, Databricks, Snowflake, Cloudera, Spark, MongoDB more »
Posted:

Azure Data Engineer - Fixed Term Contract

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »
Employment Type: Permanent
Salary: £50000 - £70000/annum
Posted:

Azure Data Platform Engineer - Fixed Term Contract

London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »
Employment Type: Permanent
Salary: £50000 - £70000/annum
Posted:

Senior Data Engineer

City Of London, England, United Kingdom
TalentWave
the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … similar role. Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps. SQL Server, including Store Procedures, T-SQL, or similar enterprise database toolset. Familiarity with more »
Posted:

Data Platform Engineer - London/Hybrid - £70,000 FTC

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and … implementation of a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Data Support Engineer

London, England, United Kingdom
iO Associates - UK/EU
Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »
Posted:

Software Engineer with C# Java and Azure

London
Nexus Jobs Limited
years of design and development. experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online … DevOps and CI/CD pipeline. Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus. General business skills: Clear communication to translate and more »
Employment Type: Permanent
Salary: £60,000 - £95,000
Posted:

Data Engineer - Energy & Commodities Group - London

London Area, United Kingdom
Vertus Partners
My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead … the development of robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise … in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data more »
Posted:

Lead Data Engineer

London Area, United Kingdom
Talent
Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a … with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks. Proficiency in coding with Spark and a strong understanding of design aspects. Deep understanding of engineering best practices and the ability more »
Posted:

Senior Data Engineer

Teddington, London, United Kingdom
Matchtech
We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications … part of the solution design About the Candidate Essential experience Experience with the following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI/CD pipelines Coding in SQL and PySpark/Python DW/Data Vault concepts Power … AP, AR etc) - Highly desirable Preferred experience Knowledge of D365 Finance module and building data models and reports from the export to Datalake functionality Working knowledge with Microsoft D365 Data (Dataverse) Integration with datalake Understanding of core Finance principles and terminology. Knowledge of Azure AI services more »
Employment Type: Permanent
Salary: £55000 - £60000/annum
Posted:

Data Support Engineer

London, England, United Kingdom
iO Associates - UK/EU
infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Burns Sheehan
Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £60,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity … to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
VIOOH
Role Title: Senior Data Engineer Reports to: Tech Lead Data Engineering Location: Hybrid working environment (Remote and Paddington, London) Role Type: Permanent, Full-time How do we say our name, well it sounds like 'view'. It's also a lot shorter than saying 'Viewed Impressions … are a dynamic team building a global platform which automates the buying and selling of outdoor advertising, enables programmatic trading and delivers dynamic, data -driven content to screens in locations and moments to better resonate with and influence consumers. We’ve recently redesigned our people strategy to create … have key capabilities which will be released such as data intensive services and real time dashboards based on our data lake and our data gateway, in addition to complex infrastructure upgrades. You will be involved in the design and construction of new data more »
Posted:

Data Architect

London Area, United Kingdom
AgnesCole Consulting
Data Architect (Azure) Our client, a leading analytics and consulting firm, is seeking an experienced Data Architect to join their dynamic team. In this role, you will be responsible for designing and implementing robust data solutions leveraging the power of Microsoft Azure. Key Responsibilities … Analyse business requirements and translate them into scalable, secure, and efficient data architectures Design and implement data pipelines, data lakes, and data warehouses on the Microsoft Azure platform Ensure data integrity, reliability, and performance through the effective use of Azure … services such as Data Factory, Synapse Analytics, Cosmos DB, and more Collaborate with cross-functional teams to identify and address data-related challenges Stay up-to-date with the latest Azure technologies and best practices, and recommend innovative solutions to drive business value Qualifications: Bachelor's more »
Posted:

Developer (Python & Azure)

London Area, United Kingdom
Mastek
Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Work closely with … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »
Posted:
Data Lake
London
10th Percentile
£61,025
25th Percentile
£77,500
Median
£112,500
75th Percentile
£142,500
90th Percentile
£155,665