1 to 25 of 47 Permanent Data Lake Jobs in London with Remote Work Options

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

This is an exciting opportunity for a Data Architect to join a growing Data & AI team. The successful applicant will work alongside architects and consultants to deliver high-quality data solutions to help customers become more successful in becoming a data-guided … platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data models … in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding of Azure infrastructure more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with Azure more »

A Data Platform Product Manager required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. You will be required to build strong relationships across the client and use … a strong commercial mindset and data expertise to define and execute the roadmap and backlog for the data engineering and products. Experience should include: Significant experience 3 years+ as a data business partner/manager/product owner/data analyst or … technical business analyst in a data platform domain Be an experienced subject matter expert within the data platform domain, with strong technical knowledge and demonstrable passion, including understanding on (some of): Data lakes, data marts, data warehousing (Azure Data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

Data Integration Manager A brand new and exciting opportunity has recently arisen for a Data Integration Manager with excellent knowledge in Azure and Salesforce SQL to join one of the UK's most notorious Charities. We're in search of an … experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will oversee the entire data flow process, including cleansing, harmonization, and integration into Salesforce NFP … Cloud and Marketing Cloud. Proficiency in data management technologies, especially Azure Data Lake, Salesforce NFP, and Azure Data Factory, is essential for this role. Skills that are required for a Data Integration Manager are: Expert in Azure Experience working with data more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and … implementation of a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Role Title: Senior Data Engineer Reports to: Tech Lead Data Engineering Location: Hybrid working environment (Remote and Paddington, London) Role Type: Permanent, Full-time How do we say our name, well it sounds like 'view'. It's also a lot shorter than saying 'Viewed Impressions … are a dynamic team building a global platform which automates the buying and selling of outdoor advertising, enables programmatic trading and delivers dynamic, data -driven content to screens in locations and moments to better resonate with and influence consumers. We’ve recently redesigned our people strategy to create … have key capabilities which will be released such as data intensive services and real time dashboards based on our data lake and our data gateway, in addition to complex infrastructure upgrades. You will be involved in the design and construction of new data more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - Databricks - £70-75,000 - London/Hybrid Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Data Engineer … to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. … years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Experience of working with a number of different data sources more »

Senior Data Engineer - Azure/Databricks - £75-80,000 Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer … depth knowledge of and experience with Databricks Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Experience of working with a number of different data sources more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As … they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase … carbon neutrality. Role Overview: As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be more »

is growing rapidly and we are looking for a results-oriented and passionate Staff Software Engineer to help create the next generation of data infrastructure built for … scale, resilience and reliability. This is a high impact role. You will build real-time data pipelines and a data lake for valuable internal tools used by leadership, compliance, finance, and product teams to make strategic business decisions. You will be responsible for our Data API that powers public-facing applications used globally to follow the open-source ledger. WHAT YOU WILL DO: Build real time data pipelines and tools to keep pace with the growth of our data and its consumers Power our externally-facing data more »

functional requirement to differing audiences Run agile grooming sessions and leading ‘Show & Tell’ workshop sessions Microsoft azure data stack (Data lake, data bricks etc.) - Bonus SharePoint experience - Bonus more »

I am searching for a talented Data Architect to join my client, a leading Fintech company in London. In this exciting role, you'll be responsible for designing, developing, and implementing the data architecture that forms the backbone of their data-driven strategy. You … ll work closely with stakeholders across the business to understand their needs and translate them into robust, scalable data solutions. Job Title: Data Architect Location: London (Hybrid) Salary: £95,000 - £100,000 Industry: Fintech Start: ASAP What you'll be doing: Design and develop enterprise-level … data architectures and solutions. Select and implement appropriate data management tools and technologies. Ensure data quality, consistency, and security across the organization. Collaborate with data engineers and analysts to deliver successful data projects. Stay up-to-date on the latest more »

Role - Azure Data Engineer Rate - £600 per day inside Hybrid working - 1 day a week onsite (Centre of London) Duration - Initial 6 months My client is a large Financial services organisation based out of London and they are going through a huge data transformation that is … expected to run for at least 18 months. My client is seeking experienced Azure Data Engineers for a stakeholder-facing project. This role will have particular emphasis on Azure, Databricks and DevOps. Our client is in the consultancy sector but does not have a preference for previous experience … There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks) Databricks Spark Delta Lake SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing more »