51 to 75 of 230 Data Lake Jobs in England

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

Required Skills Data Architect Azure London Job Summary Data Architect – Insurance (Azure Data Platform) We're working with a leading organisation investing heavily in its data and analytics capabilities, and they're looking for an experienced Data Architect with … models, integration frameworks and enterprise data standards Lead the architecture of modern Azure-based data platforms, including Data Lake, Lakehouse and Data Warehouse environments Drive the design of scalable data pipelines, ETL/ELT frameworks and integration patterns Establish ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With... As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that … Specialist tracks (we'd love depth in one of these; you don't need all of them): Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search ...

controls and operational guardrails Technical Leadership & Standards Serve as the senior technical authority for the Databricks platform architecture Establish engineering best practices covering Delta Lake design, workload orchestration, compute optimization, and cost management Provide technical assurance across platform implementation activities delivered by internal teams and external partners Define reusable … stakeholder engagement, and consulting capabilities Experience translating business requirements into strategic platform architecture solutions Technical Skills Deep expertise in Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and cluster management Strong experience designing cloud-native data platforms on AWS Hands‐on knowledge of AWS services including ...

Data Architect Salary: Up to £72,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 01/09/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

summary If you enjoy turning complex, real-world data into reliable, usable information that supports better decision-making, this could be a highly rewarding role for you. At NHS Greater Manchester, we are bringing together data from across health and care partners, including NHS providers, local … develop the data pipelines that underpin our Analytics and Data Science Platform (ADSP) - a Snowflake-based data lake house used daily by analysts, data scientists, finance teams and senior leaders across the system. This is a hands-on technical role within ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

sponsorship is not available for this role. Role Overview We are seeking an experienced Business Analyst to join a large-scale R&D data engagement with a leading global pharmaceutical company, focused on the analysis, mapping, and business interpretation of raw scientific instrument and equipment data. The role … sits at the intersection of laboratory science and business/data analysis — translating raw outputs from instruments such as plate readers, Raman spectrometers, and cell counters into structured, business-relevant insights, mappings, and documentation that support downstream data and analytics initiatives across the R&D function. ...

Products & Insights group. You will manage a small team of product managers, including the Product Manager who owns our new data lake, and keep hands-on product work of your own: the foundations that let teams across Wise build with GenAI in production. What … leadership and partner teams, and bring company context back to the team Guide the Product Manager's who owns our data lake and analytics platforms, helping them build product craft and stay close to the teams who depend on them. Stay accountable for the group's delivery ...

public sector organisation is seeking a Senior Data & Reporting Engineer to join via a Consultancy to support a major cloud-based data programme focused on occupancy analytics and smart building technologies. You will play a pivotal role in designing, developing and optimising data pipelines … quality, validation and reconciliation techniques. Experience creating and optimising reporting datasets and semantic models. Knowledge of data warehouse and data lake architectures. Experience with data governance, metadata management and data lineage. Excellent analytical and problem-solving skills. Experience working within Agile ...

Senior Data Engineer Location: Newcastle upon Tyne (Hybrid) Salary: £60,000 per annum Contract: Fixed Term - 2 Years About the Role We are looking for an experienced Senior Data Engineer to lead the design, development and optimisation of modern data platforms and pipelines. This … exciting opportunity to shape how data is managed, integrated and utilised across a large and evolving organisation. Working closely with technical and business stakeholders, you will play a key role in developing scalable data solutions that enable high-quality reporting, analytics and data-driven ...

about our mission and what we offer . The Role We are looking for a Product Manager to own our new data lake: the platform that will hold the data behind analytics, reporting and AI at Wise. We are moving from systems we have outgrown … large, visible project end to end. What you'll do Own one of Wise's biggest product bets: the data lake at the core of our data infrastructure, behind real-time fraud detection, workforce management, analytics, financial reporting, and the big data ...

Drive the future of analytics and data intelligence by designing architectures that turn raw data into actionable insights at scale. As a Senior Analytics Solutions Architect, you’ll partner with customers to architect end-to-end analytics platforms from data lakes and lakehouses … teams, and elevating the broader analytics community through thought leadership, workshops, and reference architectures. Key job responsibilities Architect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch). Lead analytics modernisation — guide customers migrating from ...

STRATEGIC DATA ARCHITECTS | 6 VACANCIES | LONDON Looking for your next Data Architecture opportunity? This is a rare chance to help shape the future of enterprise data within a major organisation undergoing significant transformation. You'll play a key role in defining data … Contract Length: 12 Months Opportunities: 6 Positions Available Must be Eligible for DV Clearance What You'll Do * Define and evolve enterprise-wide data architecture and strategy. * Support the transition to a modern cloud-based data platform. * Develop and embed data standards, architecture principles ...

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. • Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. • Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). • Experience with AWS cloud services including S3, Glue, Lambda, IAM. • Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. • Understanding of data governance and compliance frameworks. • Experience in the healthcare sector or knowledge of NHS data ...

Solution Architect Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics and client‐facing … solutions on Microsoft Azure, spanning infrastructure, PaaS services, networking, identity, security and observability. Data Engineering: Design solutions around our data lake platform, architecting performant pipelines, sound data models and strong governance for large volumes of reinsurance placement, exposure, claims and market data. Hands ...

platform for the LGBTQ+ business community. Please do not contact the recruiter directly. About the Job you are considering: Join Capgemini’s Insights & Data (I&D) practice, where we Consult with Purpose, Continuously Evolve, and Architect Tomorrow .We are seeking a highly skilled and experienced Data … that you will be unable to work at home 100% of the time. Your Role: Manage largescale data programmes Data Lake Data Warehouse Analytics AIML aligned to insurance business objectives Oversee delivery of multiproject portfolios across policy claims underwriting and customer data ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

IR35, £800 - £950 per day)Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics … solutions on Microsoft Azure, spanning infrastructure, PaaS services, networking, identity, security and observability.* **Data Engineering:** Design solutions around our data lake platform, architecting performant pipelines, sound data models and strong governance for large volumes of reinsurance placement, exposure, claims and market data.* **Hands ...

exciting opportunity has arisen for a Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

Azure Databricks Data Lake Deployment Squad Lead** (Contract) Duration: Up until 31 March 2026 (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile This role will manage a scrum … team that will ingest data required for the ECB Onboarding program into the EMEA Data Platform with a focus on data required by the EUAG Finance Department. Key Responsibilities: Facilitate efficient and effective software delivery from inception to go-live for the EMEA Data ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger commercial decision making and elevate campaign management for client facing teams. … 2+ years experience as data engineer on AI/ML project with Python Strong experience using Databricks, including Jobs, Asset Bundles, Delta Lake, and MLflow, as well as Azure data engineering tools such as Azure Data Factory and Azure Data Lake ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...