176 to 200 of 462 Data Lake Jobs in the UK

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from … computer vision to video replay systems. Our technology shapes officiating, data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on … lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from … computer vision to video replay systems. Our technology shapes officiating, data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on … lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools More ❯

About BMLL We are the leading independent provider of harmonised Level 3 historical data and analytics to the world's most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 … on the business, with a blend of data science, sales, and marketing. Advanced Resources: Access to a petabyte-scale data lake and an award-winning data science environment to drive your analysis. High-Impact Projects: Contribute to high-impact initiatives, working with a … the evolution of the product. Leverage Advanced Resources: Assist in technical prototyping for external partners and clients, utilizing a petabyte-scale data lake and cutting-edge data science tools. Contribute to Product Development: Support the product team in the development and management of the product More ❯

CANDIDATES MUST BE PORTUGAL, SPAIN or UK BASED) For more information visit us: www.marionete.co.uk SKILLS Must-Have Requirements Minimum of 5 years in Data Engineering. Speaks fluent English (written and verbal) for effective collaboration with stakeholders. Proven ability to communicate complex technical concepts to both technical and non … technical audiences. Capable of providing technical guidance and mentoring to junior team members. Experience working in cross-functional teams , including data scientists, analysts, and DevOps engineers. Ability to influence and establish best practices in data engineering processes. Self-motivated with a growth mindset and an eagerness … GitLab CI/CD. Nice-to-Have Skills Azure Ecosystem : Knowledge of Azure services like Azure Data Factory , Azure Data Lake , or Azure Synapse . Understanding of Azure’s security and identity management practices (e.g., IAM, RBAC). Snowflake Data Warehouse Experience : Designing More ❯

Fabric Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Fabric Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on … projects on Fabric implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform … focused on MS Fabric Strong ETL experience with tools such as ADF or SSIS Experience working with Azure technologies - Synapse, Databricks, Data Lake Knowledge of data architecture principles and data modelling In this role you will be required to attend the office on More ❯

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment; as such, those with only theoretical viewpoints will not be considered. The ideal candidate will be able … maintain an end-to-end advanced analytics solution on cloud. You will have exposure to cloud, preferably in Microsoft Azure, build and maintain data pipelines, understand CI/CD for end-to-end cloud solutions, be able to manage and maintain pre-existing ecosystems, and be competent in … take responsibility for the work you deliver Open to learning new technologies, methodologies, and skills Preferred: Strong development skills with Azure Data Lake, Azure Data Factory, SQL Data Warehouse, Azure Blob, Azure Storage Explorer, Stream Analytics, and Event Hub. Experience working with the More ❯

We are looking for a data scientist who will help us discover the information hidden in vast amounts of data and make smarter decisions to deliver even better products. Your primary focus will be on applying data mining techniques, statistical analysis, and building high … quality prediction systems integrated with our products. A data scientist is someone who creates value from data. Such a person proactively fetches information from various sources and analyses it to better understand how the business performs and to build AI tools that automate certain processes within the company. … reporting SQL at least basics but by year 3 should be quite proficient with at least pulling data Data Lake implementation and processing. Knowledge of Snowflake or equivalent XGBoost, LightGBM and the ability to use them for tabular data NLP and familiar More ❯

Data & AI Technologies - Technical Trainer Salary: Up to £60,000 (Based on candidate experience) Hybrid Model: Mostly remote (ad-hoc travel to London expected) Job Type: Permanent About you: You will have a hands-on technical training session covering Data-focused our AI & Data Practice, specializing in Starburst, Dell Data Lakes, and Data Warehousing solutions. you'll design and deliver training that enables clients to maximize value from modern data architectures and be adept at teaching complex concepts to a variety of learners while ensuring training … and virtual sessions, guiding hands-on workshops and offering immediate feedback Design and develop content, including creating hands-on training for Starburst, Dell Data Lakes, and Data Warehouse Develop practical labs, case studies, and learning materials Adapt teaching methods to different technical levels Stay current with More ❯

Data Modeler A SME Insurer are looking for a Data Modeler to build out data models to facilitate reporting, generating insights and data science applications. The role would be working close with Bas and Data Engineers and translate business requirements … into effective data models and mapping documents. Essential skills for the Data Modeler: Strong experience as a Data Modeler/Architect London … Market Insurance industry experience Using Data Modelling such as Erwin Experience with modelling methodologies including Kimball etc Usage of Data Lake formats such as Parquet and Delta Lake Strong SQL skills Rate: £600 - £700 P/D Outside IR35 Contract Duration: 6 months Location More ❯

Data Modeler A SME Insurer are looking for a Data Modeler to build out data models to facilitate reporting, generating insights and data science applications. The role would be working close with Bas and Data Engineers and translate business requirements … into effective data models and mapping documents. Essential skills for the Data Modeler: Strong experience as a Data Modeler/Architect London … Market Insurance industry experience Using Data Modelling such as Erwin Experience with modelling methodologies including Kimball etc Usage of Data Lake formats such as Parquet and Delta Lake Strong SQL skills Rate: £600 - £700 P/D Outside IR35 Contract Duration: 6 months Location More ❯

Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire Software Engineering Manager - Data Operations About the Role It's an exciting time at Capital One UK. We're on a mission to create our next generation, cloud-based data ecosystem, to unlock the power of data, increase financial inclusion and deliver transformative experiences to our customers. The Win with Data team owns the data ecosystem. It captures and distributes data in real time, makes sure … data is accurate & easy to use, enabling analysis for deep insight backed by the power of a Cloud based data Lake House, scalable machine learning, and powerful data processing, to provide the right data to enable effective Business decisions. We are More ❯

opportunity to spread your wings and develop your skill set to keep up with the ever-growing demands of the digital landscape. Our Data Services Group team helps apply cutting edge technology and techniques to bring solutions to our clients. As part of that, you'll sit side … recognised organisations. Your key responsibilities Participate in presentations and proposals for medium complex projects or elements of highly complex projects Logical and physical data modelling - Design, develop, and maintain data pipelines and models Assists in data modelling and design reviews, striving for improved usability … PowerPlatform (PowerApps/Power Automate/Power BI) Good understanding of Azure cloud ETL toolset, including Azure SQL Server, Azure Data Factory, Datalake Familiar with Cloud technologies including Microsoft Azure Cloud infrastructure, data stores connections, cloud functions concepts Experience in programming languages like Python, Java, or More ❯

bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory, and operational challenges. We provide data-driven, technology-enabled advisory and consulting, implementation, staffing and managed services solutions to the regulatory compliance, risk, financial crimes, and capital markets functions of … Design and implement Databricks-based solutions for managing, processing, and analyzing large datasets within the financial services sector. Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to develop and optimize data pipelines, workflows, and data models. Guide and support the migration of … legacy systems to Databricks, ensuring seamless transitions from legacy to cloud-based environments. Ensure data integrity, security, and compliance with financial industry regulations. Build and optimize ETL processes using Databricks, Spark, and other data processing tools. Implement data governance best practices within the Databricks More ❯

The Food & Nutrition Data Architect will be a key driving force in transforming the Food & Nutrition (F&N) business segment. Working closely with our partners, you will have overall accountability for data solution design, including Analytics, Visualisation, Dashboards, and Ops. You will be responsible to bring … them to ways of working. As a trusted advisor, you will collaborate with segment cross-functional teams to design and implement cutting-edge data solutions that enhance customer experiences, drive revenue growth, and maintain a competitive edge in the digital marketplace. Moving to One Enterprise Data … in synergy with segment Data Platform Lead, Segment EA and central Mars Inc COE Analytics teams - to enhance the data lake and a real-time reporting environment for operations. Lead complex data improvement and project management engagements, spanning cross divisions and markets in More ❯

Overview The Manual Data QA will be responsible for executing comprehensive manual tests to ensure the quality of data flows across various Chambers products and platforms, with a primary focus on the Databricks environment. This role plays a critical part in maintaining the integrity and reliability … of our data services. Main Duties and Responsibilities Testing Execution : Conduct detailed manual tests to validate data flows and processing within the Databricks platform. Ensure that data integrity, accuracy, and consistency are maintained across all stages of data handling. Strategy and Planning … data solutions into existing systems. Skills and Experience Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data More ❯

Job Description: The Food & Nutrition Data Architect will be a key driving force in transforming the Food & Nutrition (F&N) business segment. Working closely with our partners, you will have overall accountability for data solution design, including Analytics, Visualisation, Dashboards, and Ops. You will be responsible … them to ways of working. As a trusted advisor, you will collaborate with segment cross-functional teams to design and implement cutting-edge data solutions that enhance customer experiences, drive revenue growth, and maintain a competitive edge in the digital marketplace. Moving to One Enterprise Data … in synergy with segment Data Platform Lead, Segment EA and central Mars Inc COE Analytics teams - to enhance the data lake and a real-time reporting environment for operations. Lead complex data improvement and project management engagements, spanning cross divisions and markets in More ❯

Overview: The Manual Data QA will be responsible for executing comprehensive manual tests to ensure the quality of data flows across various Chambers products and platforms, with a primary focus on the Databricks environment. This role plays a critical part in maintaining the integrity and reliability … of our data services. Main Duties and Responsibilities: Collaborate with cross-functional teams to understand data migration requirements and ensure smooth data transition to the cloud platform. Develop and execute comprehensive test plans for data migrations, database implementations, and ETL processes. Perform … assess system scalability and identify potential bottlenecks. Skills and Experience: Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. Azure certified Data Engineer/Architect Knowledge More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. Azure certified Data Engineer/Architect Knowledge More ❯

Your new company Working for a global small/medium Asset Management firm. Your new role Working as a Data Engineer in three key areas, firstly the support of ETL monitoring … and maintaining the ETL process, where you will manage, support and develop ETL pipelines to ingest data into their data lake/data warehouse - diagnosing and fixing data-related issues, log analysis, tracing errors back to the source. Secondly, Mi reporting …/Bi reporting and data analysis providing analysis/reports from the in-house data warehouse. You will be supporting extending business reports and migrating business reports into Power Bi as well as liaising with users to determine requirements for reporting/data extracts More ❯

Your new company Working for a global small/medium Asset Management firm. Your new role Working as a Data Engineer in three key areas, firstly the support of ETL monitoring … and maintaining the ETL process, where you will manage, support and develop ETL pipelines to ingest data into their data lake/data warehouse - diagnosing and fixing data-related issues, log analysis, tracing errors back to the source. Secondly, Mi reporting …/Bi reporting and data analysis providing analysis/reports from the in-house data warehouse. You will be supporting extending business reports and migrating business reports into Power Bi as well as liaising with users to determine requirements for reporting/data extracts More ❯

our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with … others passionate about solving business problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management … data platform services, including Storage, ADLS Gen2, Azure Functions, Kubernetes. Background in cloud platforms and data architectures, such as Corporate DataLake, Medallion Architecture, Metadata Driven Platform, Event-driven architecture. Proven experience of ETL/ELT, including Lakehouse, Pipeline Design, Batch/Stream processing. Strong working knowledge More ❯

Head of Data Architecture Our trusted partner is hiring a Head of Data Architecture to lead the data architectural strategy as our client moves from legacy on-premise data into a cloud-first data approach . Our client is seeking … manager with recent architecture capabilities to deliver new designs & changes to existing/new business data solutions leveraging tools such as Databricks, Datalakes, Synapse, and ER Studio with experience in Azure or AWS. Our client is offering a basic salary of £100,000 to £120,000 + … on a hybrid basis (some meetings can also be in London). This is an exciting/challenging opportunity. You will lead the data architecture function, set the architectural direction, and establish the enterprise data catalog during a pivotal period in our client's history. Role More ❯

Sr. Product Mgr, Business Data Technologies At Amazon, data is critical to everything we do, from understanding product inventories across our global fulfillment centers to predicting what products to recommend to customers. Data ceaselessly informs our flywheel, helping us to understand customer needs, onboard … new sellers and selection, and identify opportunities for cost savings. Business Data Technologies (BDT) provides trustworthy, intuitive, and cost-efficient solutions for Amazonians to secure, store, analyze, and transform this data at unparalleled scale. BDT owns, develops, and operates Andes, one of the largest data … policies and law of the land. The BDT Data Governance organization works to ensure that users of the Andes data lake and policy owners have a consistent and seamless experience complying with Amazon's data handling policies across multiple applications, UIs, APIs, CDK More ❯

Azure Data Engineer | Work From Home 🚀 📍 Location: Work From Home - Need to be based around either London or the Midlands 💰 Salary: £60,000 - £70,000 (Basic) 🏢 Company: Managed Service Provider Role: As an Azure Data Engineer within a managed service provider, you will design, develop, and … maintain modern data solutions leveraging the Microsoft Azure ecosystem. Your responsibilities include building robust data … pipelines, integrating diverse data sources, and enabling advanced analytics using services like Azure Data Factory, Synapse Analytics, Data Lake, and Microsoft Fabric. You'll play a key role in helping clients unlock the value of their data through scalable, secure, and More ❯