126 to 150 of 240 Data Lake Jobs in the UK

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. JOB DETAILS JOB TITLE: Senior Software Engineer - Data JOB BAND: D CONTRACT TYPE: Permanent, Full-time DEPARTMENT: Archives Technology & Services LOCATION: Glasgow Pacific Quay or Salford Dock House or Newcastle-upon-Tyne Broadcasting … analyse a wide variety of media metadata sources and contribute to the design, build, and maintenance of a cutting-edge cloud data lake which unites the BBC's multitude of media metadata sources, empowering the search, discovery and broadcast re-use workflows of the future. ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business‐specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands‐on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Lead and mentor engineers, setting direction, standards, and ways of working Drive delivery against milestones, managing risks, dependencies, and quality Collaborate with product, data, and cloud teams to ensure cohesive delivery Create a strong team culture focused on accountability, quality, and continuous improvement. Architecture & Engineering Define scalable, secure … optimise scalable ETL/ELT pipelines using modern cloud data integration and orchestration services. Design and implement secure, scalable data lake, lakehouse, and analytics platforms supporting structured, semi-structured, and unstructured data. Establish robust data governance, quality, lineage, metadata management, and security practices ...

Title: Data Solution Architect Location: Paddington Duration: 6 months possible extension Our client is leveraging the power of data and AI to solve business problems, improve customer experience, and drive commercial value. This is an architecture-led role within the Data Architecture & Design team … helping shape how data solutions are designed, governed, and made supportable across multiple business areas. What you'll be doing: Provide architecture and design guidance across a portfolio of data projects, ensuring solutions align with platform strategy and future changes Guide functional design for data ...

Data Engineer 2-3 days p/w on site in Milton Keynes Contract until the end of the year Technical Skills. Expert in Data Bricks, ADF & SQL (SQL queries, SQL Server Integration Services (SSIS) (Stored Procedures Development). Expert in Data Modelling & Data … Teams/SharePoint/One Drive Understanding of database management systems and ETL (Extract, transform, load) framework Understanding of MS Azure data lake design (e.g. dimensional modelling) and data mining Business Skills Proven abilities to take initiative and be innovative Analytical mind with a problem ...

Data Engineer/Permanent/London Hybrid - 3 days onsite/up to £45,000 This is a fantastic opportunity to join a leading global organisation with a strong international presence, dedicated to delivering customer-centric services while investing in innovation, technology, and growth. The role offers … support your progression. What you'll do: Build and optimise Azure data pipelines (ADF, Databricks) Support migration into Azure Data Lake Drive data quality, governance, and performance Collaborate with global teams in an agile environment What you'll bring: Strong SQL + ...

influential company. Among top performers, you can make a direct and meaningful impact. As a Lead Engineer at JPMorgan Chase within our Market Data Services team you will play a pivotal role in designing, delivering and maintaining critical data distribution systems within the firm. These systems … skills Formal training or certification on infrastructure engineering concepts and advanced applied experience in Cloud technologies including Kubernetes, Terraform and AWS Data Lake technologies (e.g. Snowflake, Databricks, AWS Glue/Athena, Lake Formation) Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support ...

Data Engineering Lead required by our client an international educational establishment to provide the technical engine for the Value Management Office automating the visibility of portfolio performance and benefit realization across the organization. It is responsible for building and maintaining the "Value Dashboard," ensuring that data … integrated to provide a real-time view of strategic ROI. The role holder defines technical standards for value-tracking tools and creates automated data objects that link project outputs to the organisation’s strategic objectives. Role specific skills Full-Stack Analytics Engineering: Mastery of the lifecycle from data ...

based streaming and serving platform for the Corporate Bank, enabling the Corporate banking growth strategy Functional leadership of a global team of c.150 data engineers and software engineers Budget oversight of c.£15m pa change budget Interfaces with Accountable Execs (Business Product Owners) in the Corporate Bank Skills … Scaled Agile, LeSS or similar enterprise frameworks Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate ...

Public facing, household name, critical national infrastructure organisation are seeking an experienced Data Engineer with a strong background in modern data engineering practices and technologies. Note - this is a part-time contract role requiring 2 days a week for a period of 6 months … robust data pipelines using modern data engineering best practices Hands-on development with ETL/ELT processes, data lake architectures, and ideally Medallion architecture principles Strong experience AWS data services (S3, Glue, and Athena) Proficient in Git for source control ...

Developer/Senior Developer - Azure Data Platform/DataBricks Location: Leicester (Hybrid: 3 days per week in-office) Contract Type: 12-Month Fixed Term Contract Job Schedule: Full-time The Opportunity We are seeking a skilled Developer/Senior Developer to join a rapidly expanding Business Intelligence Systems … similar Spark-based platforms) and Azure Data Factory (ADF). Languages: SQL and Python. Data Platforms: Azure Data Lake and SQL Server RDBMS. ETL Tools: SQL Server Integration Services (SSIS) and ADF. Soft Skills: Excellent English communication skills and a proven ability ...

Lead Data Scientist required by an established UK organisation on a 12-month fixed-term contract. This is an excellent opportunity for a technically strong data science professional who enjoys leading high-performing teams while remaining hands-on with advanced analytics, machine learning and AI. … play a key role in shaping the organisation's data strategy, delivering innovative analytical solutions and driving commercial value through data. The Role Reporting into the Head of Analytics, you'll lead a team of Data Scientists and Analysts, providing both technical direction and people leadership. ...

Contract Cloud Data Platform Specialist 6-Month Contract | SC Clearance (Current, Lapsed or Eligible) Hybrid working (2 days p/week onsite near Cardiff for the first month then 1 day onsite p/month thereafter) Budgets are tight at £300 - £400 p/day (ideally closer … enterprise cloud data services. You'll need experience with: Microsoft Databricks Microsoft Fabric Azure Data Factory Azure Data Lake Azure SQL Power BI Administration and operational support of Azure data platforms You'll also ideally have experience with: Azure DevOps ...

Data Engineering Lead required by our client an international educational establishment to provide the technical engine for the Value Management Office automating the visibility of portfolio performance and benefit realization across the organization. It is responsible for building and maintaining the "Value Dashboard," ensuring that data … integrated to provide a real-time view of strategic ROI. The role holder defines technical standards for value-tracking tools and creates automated data objects that link project outputs to the organisations strategic objectives. Role specific skills Full-Stack Analytics Engineering: Mastery of the lifecycle from data ...

Data Engineering Lead required by our client an international educational establishment to provide the technical engine for the Value Management Office automating the visibility of portfolio performance and benefit realization across the organization. It is responsible for building and maintaining the "Value Dashboard," ensuring that data … integrated to provide a real-time view of strategic ROI. The role holder defines technical standards for value-tracking tools and creates automated data objects that link project outputs to the organisations strategic objectives. Role specific skills Full-Stack Analytics Engineering: Mastery of the lifecycle from data ...

Azure Data Engineer | £450/day Outside IR35 | 6 Months | Fully Remote (UK) We are working directly with an IT consultancy that's winning serious work across the public sector and is looking for an experienced Azure … Data Engineer to join a key programme. You'll be responsible for building scalable data pipelines and data lake architecture across Azure Databricks , using Python, PySpark, SQL, Azure Data Factory and Microsoft Fabric . We're looking for someone ...

Applied Data Scientist – Fraud Detection Contract: 6 months Engagement: Inside IR35 Location: Fully remote, with occasional travel to the London office. The Role We're looking for an experienced Applied Data Scientist to help improve the performance of our production fraud detection models. Working within … Data Scientist or Applied Data Scientist. Strong Python and Pandas. Advanced SQL. Experience working with Azure Data Lake or similar cloud data platforms. Experience working with very large datasets. Strong feature engineering experience. Experience improving production classification models. Excellent understanding ...

Role Overview We have an exciting opportunity for a Senior Data Engineer to join our growing Data Architecture & Engineering team. The successful applicant will work alongside our architects and consultants to deliver high-quality data solutions to help our customers become more successful … created & managed in our customers organisations Develop high quality data products utilising (primarily) cloud native patterns Engineer cloud-based data lake patterns to connect and leverage organisational & external data Provide technical support and guidance through prototyping, testing, build, and launch of data ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients … senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Data Engineer II Are you passionate about building scalable, high-performance data-driven applications? Do you enjoy turning complex datasets into robust, reliable … required. A collaborative mindset and willingness to learn and communicate openly within the team. Nice to have Exposure to data lake concepts or formats such as Delta Lake or Iceberg. Any experience with search, graph, or large-scale analytical databases. Interest in AI, machine learning pipelines ...

Synthesia is seeking a Data role at the intersection of applied research, data engineering, and ML infrastructure. You will manage the data lifecycle for researchers, working with over a million hours of video and audio data to power model improvements … scalable pipelines in a hybrid Europe setting. You will collaborate closely with model training teams to build a world-class data lake and drive longer-term data strategy. #J-18808-Ljbffr ...

Solution Architect – 6-month Contract Willis Re is building its global technology estate from the ground up, centered on data, analytics, and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics, and client-facing platforms. … Responsibilities Design secure, scalable, cloud-native solutions on Microsoft Azure, encompassing infrastructure, PaaS services, networking, identity, security, and observability. Architect data-lake platforms, designing performant pipelines, sound data models, and strong governance for large volumes of reinsurance placement, exposure, claims, and market data. Build proofs ...

client is looking to appoint a Business Systems & Data Manager to take ownership of the systems that underpin the group's operations and be a key part of moulding the data environment. Our client, the Ashcourt Group, is one of the fastest growing businesses … applications. There is also scope to develop the SQL estate, integrating the systems into it, with a view to implementing a data lake in time. The role will act as a bridge between IT and business users to help translate complex data concepts into actionable ...