326 to 350 of 432 Data Lake Jobs in the UK

I am representing a global tech company driven by innovation, who are looking for a talented Data Engineer to join their cutting-edge team. This is a FULLY REMOTE role but will require you to be available to travel occasionally to their London office. You will work on … a very exciting and innovate list of projects for the business and really spearhead a new data platform being built. They are looking for intelligent, self motivated & resourceful problem solvers! Someome who can figure out a problem and work through the best solution. What We're Looking For … including version control (GitHub). A proactive approach to problem-solving, with the ability to identify optimization opportunities and drive continuous improvement. PowerBI Azure Datalakes Github/Version Control What You'll Do: Design, develop, and optimize scalable ELT pipelines, ensuring reliable data delivery from diverse sources such More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer - About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … API development RabbitMQ/Message queue PostgreSQL Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing More ❯

must live within a reasonable distance to the office or be willing to relocate by the role commencement date. Job Purpose As a Data Analyst, you will play a critical role in leveraging data to drive insights, optimise business performance, and … support decision-making. You will work with existing data platforms while contributing to the development of an Azure-based data lake, ensuring seamless integration and enabling advanced analytics. Your responsibilities will span across data extraction, cleaning, visualisation, and analysis, as well as collaborating … business challenges and opportunities. This role will require a bright and enthusiastic individual who has a proven track record of working in a data reporting team supporting all areas of the business. Candidates will need retail experience and a minimum of 5 years IT experience with SQL, SSIS More ❯

Senior Data Engineer – Snowflake Platform Build Location: London (2 days a week on site) Contract: 6 month sign on (18–24 month project) We’re building the next version of our data platform, with Snowflake at the core. The PoC is in place — now we need … before to lead the implementation and help scale the platform across the business. The project involves migrating our current on-prem Data Lake to Snowflake, while keeping storage on a private cloud . You’ll be setting the foundations: building out ETL pipelines, establishing best practices, and … in Python , PySpark , and Spark Hands-on with platform setup – ideally with a DevOps-first approach Exposure to AWS environments Experience working with data from trading platforms or within commodities, banking, or financial services Tech environment: Primary Platform: Snowflake Other Tech: DBT, Databricks, Spark, PySpark, Python Cloud: AWS More ❯

Senior Data Engineer – Snowflake Platform Build Location: London (2 days a week on site) Contract: 6 month sign on (18–24 month project) We’re building the next version of our data platform, with Snowflake at the core. The PoC is in place — now we need … before to lead the implementation and help scale the platform across the business. The project involves migrating our current on-prem Data Lake to Snowflake, while keeping storage on a private cloud . You’ll be setting the foundations: building out ETL pipelines, establishing best practices, and … in Python , PySpark , and Spark Hands-on with platform setup – ideally with a DevOps-first approach Exposure to AWS environments Experience working with data from trading platforms or within commodities, banking, or financial services Tech environment: Primary Platform: Snowflake Other Tech: DBT, Databricks, Spark, PySpark, Python Cloud: AWS More ❯

your own ideas to our initiatives. What will your role look like? You will work on a modern tech stack, addressing software and data challenges that propel our business. You will design and deliver robust, scalable solutions within an agile, DevOps environment … utilizing the latest Microsoft and Azure technologies. Initially, you will collaborate closely with a Technical Architect to develop a cutting-edge data lake for HRPW, laying the groundwork for custom AI solutions to improve team efficiencies. Key responsibilities include: Collaborating with our AI team on developing custom … Assessing trade-offs and barriers pragmatically during software delivery. Leading non-functional improvement efforts such as security and performance profiling. Liaising with the data engineering group to stay updated on Azure data tooling and promote best practices. Ideal candidate qualities: Passionate about technology, especially the Microsoft More ❯

having fun in a collaborative environment. Yelp is seeking an entry-level Software Engineer who is excited to work at the intersection of data and backend engineering. In this role, you'll help design and develop systems that power Yelp's advertising platform-from building SDKs for large … scale event ingestion to designing data pipelines that process and analyze those events. You'll be joining the Product Monetization Platform team, which is responsible for collecting and processing ad-related events. Our work supports critical business functions, including billing, analytics, machine learning, and ad serving. This is … for projects, feature enhancements, and bug fixes. Work with large-scale data storage solutions, including Apache Cassandra and various data lake systems. Collaborate with cross-functional teams, including engineers, product managers and data scientists, to understand business requirements and translate them into effective More ❯

Principal Data Engineer – Consulting Location: Leeds, Bristol or London (hybrid) Salary: £90,000 – £105,000 (depending on experience) + bonus + benefits NOTE: Candidates for this role must be eligible for UK Security Clearance. Are you passionate about designing modern data solutions that drive real business … value? We're looking for an experienced, hands-on Principal Data Engineer to join our growing consulting practice. This is a fantastic opportunity to work across greenfield projects, collaborating closely with clients to deliver scalable, cloud-native data platforms and pipelines. About the Role You’ll … lead the design and implementation of cutting-edge data architectures using AWS technologies such as Redshift, S3, Lambda, Glue, Step Functions, and Matillion. Your role will include liaising with stakeholders to shape technical solutions, driving delivery excellence, and ultimately empowering clients to take ownership of their platforms. We More ❯

The Apprentice will be involved with analysing financial data, identifying trends and creating models that present results in an informative and visual way. You will develop database skills to be able to interpret and relay data confidently and clearly to others. You will become an expert … cloud-based financial software and applications in our portfolio, in order to build some basic reports that look for trends and present key data to be shared with clients. Observe and participate with database management in data warehouses and data lakes for consolidation of … client systems and data. Handle client support queries on their data issues and participate in scoping meetings with clients to ascertain their needs. Observe and support with software launches and integrations and learn the process of moving data from source to warehouse via middleware and API. More ❯

oriented Power BI Developer. You will need to have strong analytical capabilities, deep understanding of finance processes, and a passion for turning complex data into clear insights using Power BI. This role is responsible for working within Enterprise Integration and Reporting team and alongside the Finance team, and … maintain Power BI reports and dashboards that meet finance business needs. Work with finance stakeholders to understand reporting requirements and translate them into data models and visualisations. Connect to, transform, and model data from D365 Finance and Operations and other relevant systems. Ensure data … terminology, and common reporting requirements. Excellent communication skills with the ability to work across business and technical teams. Familiarity with Azure Data Lake, Synapse, or similar tools (desirable but not essential). Experience Needed to Fulfil the Role: Multiple years’ experience delivering Power BI solutions with hands More ❯

of the Master Systems Integration service. This might involve ensuring that projects contribute to the development and implementation of ontologies, technical submittal reviews, data migration processes, and program development. Compliance with Security Standards: The Project Manager is responsible for ensuring that data migration processes are conducted … Good understanding of networking principles. Knowledge of working in AWS, GCP and migration of data from building outputs to data lake an advantage. Must have excellent verbal and written communication skills. Strong interpersonal skills and an ability to deal with both internal and external customers. … project budgets effectively and efficiently allocate resources. Technical Proficiency: Understanding of MSI Concepts: Familiarity with Master Systems Integration concepts and practices, including ontologies, data migration, and technical submittal review. Technical Background: A background in a technical field related to systems integration, information technology, or a relevant domain. Security More ❯

TrueNorth are working with a growing e-commerce company that are looking for I'm currently a Staff Data Engineer to join them on an initial 6-month contract (with strong potential to … extend). This is a fully remote role and sits outside IR35. Key Requirements: Significant experience designing and scaling cloud-based data lake architectures (ideally Delta Lake on Databricks or similar) Deep expertise in workflow orchestration using Airflow, with production-grade DAGs and solid dependency management … is preferable Strong background in building reliable, scalable batch and streaming pipelines using Spark (ideally Scala) Python and SQL Hands-on experience implementing data quality, observability, and lineage systems across distributed environments Proven leadership in technical design, platform adoption, and mentoring engineers on best practices The role can More ❯

Senior Data Engineer - Contract - London A Senior Data Engineer is required by a Reinsurance broker to design, implement, and maintain data solutions in their Azure cloud platforms. You will need extensive experience in SQL, NoSQL, Data Lakes, Data Mining, DML … DQL, Data Modelling, and Scripting. This is a hybrid contract role. Sound like a bit of you? Then get involved. More ❯

Senior Data Engineer - Contract - London A Senior Data Engineer is required by a Reinsurance broker to design, implement, and maintain data solutions in their Azure cloud platforms. You will need extensive experience in SQL, NoSQL, Data Lakes, Data Mining, DML … DQL, Data Modelling, and Scripting. This is a hybrid contract role. Sound like a bit of you? Then get involved. More ❯

of security controls to Business Risk Owners. The Lead Cybersecurity Analytics Cloud Infrastructure & Site Reliability Engineer will be part of the CSA Platform & Data Engineering … Team, joining a global team of data technology professionals to deliver critical analytics engineering requirements for the strategic cybersecurity data lake and analytics platform. As an HSBC employee in the UK, you will have access to tailored professional development opportunities and a competitive pay and … and object-oriented programming. Expertise in cloud technologies, with a focus on Azure. Deep knowledge of Azure Cloud services, including IAM, Active Directory, Data Factory, Databricks, Functions, Kubernetes, Azure Monitor, and more. Familiarity with PowerBI, Synapse Analytics, and S3 is a plus. This role is based in Sheffield. More ❯

support. Strong skills in X , C#, integrations, and Azure DevOps. Comfortable working with ALM tools, version control (Git/TFS), and the D365 data model. Great communicator who can work well with both technical and non-technical colleagues. Experience managing change and solving problems in a complex technical … environment. Bonus points for: Familiarity with Azure services, security, and integration patterns. Experience defining D365 security roles and permissions. Understanding of Data Lake or other data platforms. Experience working in Agile teams and with ITIL principles. A degree in a technical subject and/or More ❯

systems, recognizing the ongoing need for hybrid solutions. Centralized Cloud Solutions: Develop centralized solutions for firewalls and DNS management within the Azure environment. Data Warehouse Implementation: Utilize Azure Synapse for data warehousing solutions to support analytics and reporting needs. Migration Strategy: Plan and execute the migration … Experience in designing and implementing cloud networks, including VPNs and hybrid solutions. Familiarity with data management solutions, particularly Azure Data Lake and Azure Synapse. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment. Excellent communication skills to liaise with More ❯

systems, recognizing the ongoing need for hybrid solutions. Centralized Cloud Solutions: Develop centralized solutions for firewalls and DNS management within the Azure environment. Data Warehouse Implementation: Utilize Azure Synapse for data warehousing solutions to support analytics and reporting needs. Migration Strategy: Plan and execute the migration … Experience in designing and implementing cloud networks, including VPNs and hybrid solutions. Familiarity with data management solutions, particularly Azure Data Lake and Azure Synapse. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment. Excellent communication skills to liaise with More ❯

Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over … the growth of our business. Responsibilities Guide a team of engineers in developing applications that empower our clients to optimize marketing campaigns through data-driven insights and automated actions, with a specific focus on leveraging LLMs and AI. Own the technical roadmap for your team, aligning it with … and asynchronous APIs. Deep understanding of cloud infrastructure (AWS, GCP) and experience deploying and managing applications at scale. Strong understanding of data lake architectures, including experience with data ingestion, storage, processing, and retrieval of large volumes of structured and unstructured data. Familiarity with containerization technologies More ❯

include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology More ❯

Imagine being part of a team where your data analysis skills can impact millions of consumers worldwide. In Fulfillment by Amazon (FBA), you will help third-party businesses (our Selling Partners) leverage the robust data and analytics capabilities that Amazon has built over the last … using FBA, generating over 3 billion units served in the EU last year alone. In this role, you will use your expertise in data engineering, business analytics, and problem-solving to provide critical insights that drive the success of the FBA program and our selling partners. Are you … Key job responsibilities In a typical day, as a Support Engineer, you will: Trace Seller specific defects across upstream systems and data lake to detect, investigate, and fix the root causes (e.g., algorithmic bottlenecks, data quality issues, software flaws). Develop the tools for the More ❯

digital analytics, technologies and tools to integrate, digitalise and analyse fragmented, complex processes - turning them into simplified, actionable information. And as a result, data is transformed into intelligence for the right people, in the right place, at the right time. By bringing clarity to risks, we empower teams … mitigate risks across the entire organisation. We do this by helping them to: Transform current business processes into fully digitalised applications to collect data efficiently. Bring data to life by integrating operational processes with culture, risks, and incidents throughArtificial Intelligence (AI) and Machine Learning (ML). … feedback from leadership, project teams, and clients based on project delivery. Channel feedback and market requirements for continuous improvement. Leverage dss+ data lake to derive thought leadership content. Collaborate with dss+ Marketing team to manage internal and external marketing efforts across various channels. Who you are With More ❯

Senior GCP Data Engineer Start: ASAP Duration: initial 12-month contract Pay: inside IR35, negotiable Location: central London (3-days per week in office) We are looking for a Senior GCP Data Engineer to join its Cyber Security team on a contract basis. You'll be … responsible for delivering high-quality data engineering solutions using Google Cloud Platform, supporting large-scale data ingestion, transformation, and integration projects. Key Responsibilities: - Build and maintain APIs and backend systems - Develop and optimise GCP-based data pipelines (BigQuery, DataFlow, Composer) - Design scalable data models and cloud data lakes - Integrate data from cloud and on-prem sources - Automate infrastructure with Terraform and CI/CD tools - Collaborate with product teams to deliver business value Requirements: - 8+ years in data engineering, with strong GCP expertise - Proficient in More ❯

Senior Data Engineer | Music Industry | Up to £85K | AWS, Python, SQL Are you passionate about music and data ? We're looking for a Senior Data Engineer to build and scale a cutting-edge data platform in the music industry. What You’ll … Do: 🎵 Design & develop robust data pipelines (ETL/ELT) ensuring accuracy & reliability. ☁️ Own & evolve our AWS-powered data platform , integrating multiple sources (databases, APIs, external datasets). 🚀 Optimise performance —tune queries, enhance scalability & streamline infrastructure. 🔍 Work with data modelling & integration , collaborating closely with analysts … stakeholders. 🛠 Tech stack: AWS, Python, SQL, Data Lakes/Warehouses, APIs. What We’re Looking For: ✅ Strong expertise in Python & SQL for data processing. ✅ Experience with AWS services (Lambda, S3, Glue, Redshift, etc.). ✅ Background in building & optimising scalable data platforms . ✅ Knowledge of More ❯

Strong knowledge of Python frameworks (e.g. Flask, Django), data libraries (Pandas, NumPy) Cloud-native experience, especially Microsoft Azure (Functions, Data Lake, etc.) Familiarity with DevOps practices (Git, CI/CD, testing frameworks) Experience with SQL/NoSQL databases and API integration Proven experience working in More ❯