26 to 50 of 95 Data Lake Jobs in the UK with Remote Work Options

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

Data Engineer Location: London (hybrid) Salary: Competitive, based on experience and expertise **Note: Due to the nature of client work, candidates must be sole British nationals eligible to work on secure client sites.** Are you ready to join a high-achieving team that creates innovative solutions? We are … a premier recruitment agency seeking an exceptional Data Engineer for a prestigious consulting firm renowned for its groundbreaking solutions and industry leadership. If you're passionate about cloud technologies, data engineering, and digital transformation projects, this role is an exciting opportunity for you! About the Role … As a Data Engineer, you'll join our dynamic and forward-thinking Engineering Team, participating in a broad spectrum of digital projects that span cultural awareness, business continuity, and more. You will have the autonomy to manage your time and diary to suit your work/life balance more »

Are you an experienced Data Engineer who wants to work at the cutting edge of engineering sustainability? Our client is on a mission to empower engineers to use AI to overcome their most difficult physics and design challenges and build truly great products. With strong product-market fit … which includes a scale-out Engine (Trino), general-purpose distributed compute (Spark), and ad-hoc containerized compute. They utilize an S3 data lake and are soon incorporating dbt and Airbyte. Their cloud-agnostic architecture runs on AWS, with plans to expand to Azure, GCP and on-prem. … STACK: Programming languages: Python, Flask, React Databases & Storage: Redis, Postgres, AWS Athena SQL, Athena & EMR Spark, ECS Fargate, Azure Synapse/Data Lake Analytics, HDInsight Tools & Platforms: Docker, Temporal, Plotly KEY RESPONSIBILITIES Design and implement mid-to-low level data engineering systems Deliver hands-on more »

Role Title: Senior Data Engineer Reports to: Tech Lead Data Engineering Location: Hybrid working environment (Remote and Paddington, London) Role Type: Permanent, Full-time How do we say our name, well it sounds like 'view'. It's also a lot shorter than saying 'Viewed Impressions … are a dynamic team building a global platform which automates the buying and selling of outdoor advertising, enables programmatic trading and delivers dynamic, data -driven content to screens in locations and moments to better resonate with and influence consumers. We’ve recently redesigned our people strategy to create … have key capabilities which will be released such as data intensive services and real time dashboards based on our data lake and our data gateway, in addition to complex infrastructure upgrades. You will be involved in the design and construction of new data more »

AZURE DATA ARCHITECT £100K + BENEFITS & BONUS HYBRID WORKING - TRAVEL TO LONDON REQUIRED My client is a Microsoft Gold Partner who build data & AI driven services, products, platforms and experience on the Azure platform. They are leading in their space and growing due to significant client … demand. I'm looking for an Azure Data Architect to join the team at a pivotal time in the company's growth. This role will be responsible for engaging with varying customers to understand their business challenges and goals surrounding data. You will work with senior stakeholders to … in leading workstreams in these engagements Commercial experience in the Azure Data Platform (Azure Data Factory, Azure Data Lake storage, Azure Synapse, Databricks, Azure SQL etc) Experience with Data Governance and Purview A strong pedigree in SQL ideally across the full more »

I am looking for a Machine Learning (ML) and Data Engineer to join my clients growing Data & AI team and contribute to Artificial Intelligence technology solutions for their public sector and enterprise clients. This role is offering a generous salary of up to £70K! As a … ML and Data Engineer, you will collaborate with a team of data scientists, data architects, software engineers, business analysts and delivery managers to deliver innovative solutions that leverage the power of cloud-based AI. This is an exciting opportunity for a driven individual to … Microsoft Azure AI services. Experience with Azure data and analytics services, such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, etc.. Experience with Azure DevOps, GitHub, or other tools for version control, testing and deployment. This is an more »

Data Insight Analyst at top Lloyd's market Insurer 🌟 Excellent Salary + Bonus + 31 days holiday + Excellent Benefits Hybrid working: London Office (2/3 days a week in the office) Are you passionate about data analysis, visualization, and driving business insights? Do you … thrive in a dynamic, innovative environment? Look no further! Our Lloyds Market Insurer customer is seeking a talented and creative Data Insights Analyst to work directly with teams across the business to deliver the information they need. This is an organization at the forefront of cutting-edge data services, capturing, transforming, and analyzing diverse data through their modern cloud-based platform, generating invaluable insights for their business. Now needing a Data Analyst to take this to the next level! As the successful Data Insights Analyst you will need: Essential skills more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership : Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: £575 to £625 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Data Engineer role … recently operating at a hands on lead level Ideally educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data more »

working with a leading Blockchain analytics platform, with a stellar leadership team and excellent backing. Seeking to hire an experienced senior level Backend & Data Engineer, with strong Python skills and backend architecture ability. The Role Working alongside a strong technical and engineering team, you will take ownership of … redeveloping the architecture of their entire backend systems, focusing on growth. Working with Python and extrapolating high volumes of data from the blockchain, you will be responsible for the overall vision, strategy and execution of the company’s Software products. You will take ownership of: Technical Leadership: Team … building out complex Backend services, along with high-throughput Data warehousing. Min 7yrs with Python Big Data & Data lake solutions; PostgreSQL, Clickhouse or SnowFlake etc Cloud Infrasutcurre (AWS services) Data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper Hands-on more »

DATA ARCHITECT £100,000 - £110,000 HYBRID - LONDON This scale-up telecom group is looking for someone to be hands-on when driving forward their platform's expansion to incorporate data from all business areas as they become more digitally driven... THE COMPANY This group is … to grow into other areas. They aren't just localised to this area though as they've expanded into a global presence. Their data function has undergone extreme change over the two years and they are now in a good position for you to join the team! THE … EXPERIENCE To be a successful Data Architect in this area you should be proficient in the following: Expertise in Data Lake migration Azure experience is going to be beneficial Experience with big data Previous python & engineering experience will be useful to understand the more »

Lead Data Engineer £80- £100K Hybrid, 3 days a week in Chiswick, London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which … who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modelling within a cloud … based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to more »

Hi LinkedIn, I'm actively seeking a UK BASED Senior Azure Data Engineer. Salary - £60 - 75K base plus benefits Location: UK BASED - Remote working Sponsorship: Not provided Are you passionate about collaborating with clients across various sectors to explore intricate business challenges and develop comprehensive analytical solutions that … enhance their processes and enable data-driven insights? My client are a vibrant and entirely remote data and analytics consultancy dedicated to addressing their clients' most difficult business issues by leveraging cutting-edge software in the data engineering field. Their team combines modern tools … and methodologies with proven principles to deliver exceptional data engineering solutions. The Role: Establish trusted partnerships with clients, engaging with everyone from data custodians and analytical users to senior executives. Work autonomously within a compact team to tackle complex data engineering projects across diverse more »

is a predominantly remote role with some occasional travel into Canary Wharf. The main activities of the role will be: Understand and implement data fabric principles and methodologies to enhance data ingestion and processing. Design and implement compliance scanning solutions on on-prem/cloud along … Information Technology, or a related field. Extensive experience in Infrastructure DevOps and Automation within the financial services industry. Strong understanding of data lake principles, data fabric, and related methodologies. Deep expertise in Infrastructure As Code (IaC) principles and best practices. Proficiency with IT tooling and … workplaces Exclusive discounts with major retailers, discount gym memberships and access to our wellness centre Protecting your privacy and the security of your data is a longstanding top priority for Bell Integration. Please consult our Privacy Notice (click here) to know more about how we collect, use and more »

Review clients’ requirements Working closely with key business stakeholders Experience: Around 3 years experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure … Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to … facilitate the transfer of data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal more »

looking for someone to help lead the team in this transition. The right person will be both technically capable of working within a Data environment as well as leading a team of BI Developers. The role is suited for a creative and driven individual who can effectively take … making process Work with management to develop the reporting system Develop ETL processes using Kimball methodology Key skills Microsoft Azure, Synapse, Data lake SQL PowerBI Must have experience leading a team What’s on Offer Up to £60k Salary + Pension Hybrid working/3 days on more »

DFIR, threat intelligence, DLP, deception technologies, XDR and vulnerability management In-depth knowledge of at least one SIEM platform or security data lake and related processes Knowledge of various security tools, their functions and comparisons Knowledge of network and cloud security fundamentals Ability to explain complex technical more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »

Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »

Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data life-cycle are adequately provisioned. They will also be expected … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »