1 to 25 of 411 Data Lake Jobs in England

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

Job Description - Data Product Architect (15830) Data Product Architect Luton/Hybrid COMPANY When it comes to innovation and achievement there are few organisations with a better track record. Join us and you'll be able to play a big part in the success of our … stakeholders within and outside IT, the Architecture function ensures that a common technology architecture framework is defined and adopted across the organisation. The Data Product Architecture (DPA) team are responsible for both shaping the longer-term direction of Data Architecture used by the easyJet business functions … warehousing, data management etc. Familiarity with patterns, practices, and frameworks of Enterprise Architecture. Familiarity with AWS Cloud technologies and concepts like Lake House Architecture and Databricks. Extensive Data modelling experience from conceptual to logical models. Taking long term ownership of the data More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database • MongoDB • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.) • A collaborative team player, approachable, self-efficient and influences a positive work environment • Demonstrates curiosity • Resilient in More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database. • MongoDB. • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.). • A collaborative team player, approachable, self-efficient and influences a positive work environment. • Demonstrates curiosity. • Resilient More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

Job summary The post holder will lead the Trust on a smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure, whilst managing a team of Data Engineers and developers. The Data Engineering Manager plays a pivotal … Factory and other ETL tools. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric. Take ownership of the data engineering … and other ETL tools. 4. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric. 5. Take ownership of the data More ❯

Job Purpose and Background in summary CDP's Data Team are looking for a skilled, enthusiastic and communicative Solution Data Architect who is passionate about designing data solutions to drive companies, investors, and governments to build a thriving economy which works for people and … runs the world's only independent environmental disclosure system. As the founder of environmental reporting, we believe in transparency and the power of data to drive change. Partnering with leaders in enterprise, capital, policy and science, we surface the information needed to enable Earth-positive decisions. We helped … and regions disclose their environmental impacts in 2024. Financial institutions with more than a quarter of the world's institutional assets use CDP data to help inform investment and lending decisions. Aligned with the ISSB's climate standard, IFRS S2, as its foundational baseline, CDP integrates best-practice More ❯

Amazon Music is awash in data! To help make sense of it all, the DISCO (Data, Insights, Science & Optimization) team: (i) enables the Consumer Product Tech org make data driven decisions that improve the customer retention, engagement and experience on Amazon Music. We build … and maintain automated self-service data solutions, data science models and deep dive difficult questions that provide actionable insights. We also enable measurement, personalization and experimentation by operating key data programs ranging from attribution pipelines, northstar weblabs metrics to causal frameworks. (ii) delivering exceptional … technologies like Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, and Lambda. Your team will manage the data exchange store (Data Lake) and EMR/Spark processing layer using Airflow as orchestrator. You'll build our data university and partner with Product, Marketing, BI More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data engineering platforms. This hands-on role will partner with senior-level … technology product roadmap in driving Data Governance policy implementation. What you will be responsible for End-to-end Cloud Data Lake design & development including data ingestion, data modeling, and data distribution. Build data integrations and hand-offs … teams spread globally. What we value These skills will help you succeed in this role: Full stack cloud developer skills: Data (Delta Lake/Databricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management. Strong experience in Python, Scala/PySpark, PERL More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

Enterprise Data Architect - Hybrid Working out of Southampton or London - £150,000+ package - FS brand This position provides strategic technology leadership, focusing on the development, maintenance, communication, and governance of the organisation's technology strategy, architecture, and roadmaps. The role emphasises balancing business objectives, industry trends, innovation, and … Azure-hosted data and digital capabilities. Its data platform is built on a Lakehouse architecture using Azure Data Lake and Microsoft-based data services. This platform supports reporting, analytics, and insights and is evolving to deliver advanced business intelligence. Experience and … Skills Data Warehousing and Data Lakes (e.g., Azure Data Lake) Reporting and analytics tools (e.g., Power BI) Analytics, Data Mining, and Data Science Data integration, migration, and ETL processes Master and reference data management Data More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

Title: Head of Data Engineering Industry: FinTech Location: London Salary: Up to £140,000 Seeking an experienced Head of Data Engineering to lead data strategy, architecture, and team management in a fast-paced fintech environment. This role involves designing scalable Apache Spark , Databricks , and … Snowflake solutions on Azure , optimizing ETL/ELT pipelines , ensuring data security and compliance, and driving innovation in big data processing. The ideal candidate has 8+ years of data engineering experience , strong leadership skills, and deep expertise in cloud-based data infrastructure. … within fintech or financial services. Strong hands-on experience with Apache Spark, Databricks, Snowflake, and Azure Data Services (Azure Data Lake, Azure Synapse, etc.). Deep understanding of distributed computing, data warehousing, and data lake architectures. Proficiency in Python, SQL More ❯

Delivery Consultant - Data Analytics, AWS Professional Services Are you a Data Analytics specialist? Do … you have Real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake and Data engineering experience? Do you like to solve the most complex and high scale (billions+ records) data challenges in … as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker and Amazon Quicksight. Solutions - Deliver technical engagements with partners and customers. This includes participating in pre-sales visits, understanding More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

daily towards creating the world we want tomorrow. Job Description: Lead Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data More ❯

all these transactions for analysis and reporting. Amazon Web Services is seeking a Data Engineer to join the AWS Data Lake team. has a culture of data-driven decision-making, and demands business intelligence that is timely, accurate, and actionable. The AWS Data … their use of the AWS Cloud. We collect and process billions of usage transactions every day into actionable information in the Data Lake and make it available to our internal service owners to analyze their business and serve our external customers. We are truly leading the way … with the ever-increasing volume of data produced by AWS services. The successful candidate will shape and build AWS' data lake and supporting systems for years to come. You should have deep expertise in the design, creation, management, and business use of large datasets, across More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯