126 to 150 of 470 Data Lake Jobs in the UK

driven by continuous improvement with a focus on great results for our customers. About the role We are looking for an experienced Data Engineer to join our Applications and DevOps team based at our Head Office on the Gateshead Quayside. As a Data Engineer … services. Experience building and maintaining data pipelines, lakehouses, and data transformations using Microsoft Fabric, Azure Data Lake, Azure Synapse, or related Azure services. Knowledge of CI/CD pipelines, version control, and DevOps practices related to data engineering. Proficiency ...

accurate and keep it accurate as the models change underneath us The data layer on AWS. Our Parquet data lake, the pipelines that feed it and the query layer that lets clients analyse long date ranges quickly Technology partners. Finding, assessing and recommending the vendors … better, cheaper and more reliably Our stack Python, with Polars, Pandera and Celery SQL and MongoDB Columnar analytics on a Parquet data lake Docker AWS, managed as infrastructure as code What you’ll need An experienced data engineer, typically with seven years or more ...

Senior Fabric Engineer: Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs. Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic … decisions and drive business transformation. Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and PowerBI to build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

analytical platform that powers our partnership-driven business model. We combine actuarial expertise with advanced technology to deliver innovative, scalable solutions. The Senior Data Engineer is responsible for advancing a programme of change across our evolving Analytics Data Platform. They will deliver projects that underpin essential … best practices Built and maintained data products using the Microsoft Data Stack (Azure Data Factory, Data Lake Storage, Fabric or Synapse Analytics) Expert-level proficiency in PySpark/Python Applied experience of DBT, AirFlow, or similar for data transformation ...

patterns. 7+ years strong hands-on experience with Azure-based data platforms, including Azure Data Factory, Databricks, data lake architectures, SQL, and dimensional data modeling, with the ability to build practical end-to-end solution designs. Proven ability to own solution … data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power ...

patterns. 7+ years strong hands-on experience with Azure-based data platforms, including Azure Data Factory, Databricks, data lake architectures, SQL, and dimensional data modeling, with the ability to build practical end-to-end solution designs. Proven ability to own solution … data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power ...

Senior Fabric Engineer: Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs. Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic … decisions and drive business transformation. Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, andPowerBIto build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data ...

Senior Fabric Engineer: Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs. Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic … decisions and drive business transformation. Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, andPowerBIto build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data ...

Join the Chief Data & Analytics Office at JPMorganChase and help accelerate our data and analytics journey. You will lead complex, multi-functional technology projects that impact clients, employees, and stakeholders firmwide. Bring your technical fluency and analytical reasoning to drive innovative solutions, manage resources, and foster … data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills: Experience navigating complex data governance, security ...

have experience of providing data governance expertise, in a large-scale data governance environment defining and implementing data standards and policies? This consulting opportunity is to support our client, a leading pharmaceuticals organisation, in defining, implementing and aligning data governance policies, standards … frameworks. The role focuses on improving data quality, compliance and governance performance across business areas and data teams. The project needs a consultant who has: proven experience in data governance roles within large-scale data environments, ideally within pharmaceuticals strong stakeholder engagement ...

client is looking for an experienced Data Engineer with a strong eye towards solution architecture. This is a hands-on engineering role for someone who enjoys building robust data solutions but is also comfortable looking beyond individual pipelines or features to consider how the overall platform … ownership of significant technical problems, translate business requirements into well-designed solutions, and help establish the architectural and engineering standards that allow our data platform to scale. The successful candidate will be an experienced engineer first and foremost, with the capability and ambition to take increasing responsibility ...

Coventry is recruiting a BI & Insight Analyst on a 2‐month contract to support data migration to a Data Lake and deliver BI reporting. You will extract, cleanse and analyse data, develop Power BI dashboards, and collaborate with HR, Digital Services and other … stakeholders to provide actionable insights and robust management information. Experience with Data Warehouse/Data Lake, ETL and governance is desirable; basic DBS may be required. #J-18808-Ljbffr ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. Understanding of data governance and compliance frameworks. Experience in the healthcare sector or knowledge of NHS data ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you’re an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … environment, and competitive reward package. About you Technical Skills Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics Azure Data Lake Storage (ADLS) Azure SQL Database and SQL Server Microsoft Fabric (preferred) Advanced SQL development and performance tuning skills Experience with Python, PySpark, or Scala ...

Data Engineer will work as part of a small but wide-ranging Data team, building and supporting RDT’s data offerings and collaborating closely with the wider Software Engineering, Platform Engineering, QA and Release teams. The Data team at RDT works across … complex stored procedures, relational database design, indexing Knowledge of Azure/cloud data technologies like Data Factory, Data Lake, Synapse, Microsoft Fabric ETL/ELT design and development Power BI modelling and development, awareness/experience of shaping and consuming data ...

team. This role is an exciting opportunity to build Xelix's data platform from the start: the pipelines, data lake and Snowflake warehouse that become the company's single source of truth, built AI-native so a small team delivers in weeks what used … doing Build and run ingestion from our platform databases and business tools (HubSpot, Xero, Intercom, Gong and more) into our data lake and Snowflake warehouse, with a first version of the priority sources live within your first six weeks Work AI-native from day one: AI coding ...

full supply chain from instrument and edge ingestion, through modelling and governance, to exposure for AI, workflow, analytics and customer data lake consumers. You will drive a critical transformation: moving IDBS from a traditional electronic lab notebook capture tool to an enterprise Data Product Provider. … modern lakehouse architecture, including medallion data tiers, transactional storage engines and change data capture patterns (for example Databricks and Delta Lake). Strong grasp of scientific data modelling, including unstructured to structured transformation, data contracts, schema evolution, ontologies and provenance standards ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

seeking a Director, Solution Consulting specialising in Marketing Cloud and Data 360. You will be a recognised expert and thought leader in customer engagement and data architecture. You will act as a strategic advisor to our largest, most complex enterprise customers. You will guide them through … handling. Integration architecture: Marketing Cloud Connect, REST/SOAP APIs, API-triggered and event-driven messaging, and ETL/data lake patterns. Data modelling, MDM, SQL, and DevOps/deployment lifecycle. Email deliverability: sender reputation, IP warm-up, and SPF/DKIM/ ...