1 to 25 of 264 Data Lake Jobs in England

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

Job Description - Data Product Architect (15830) Data Product Architect Luton/Hybrid COMPANY When it comes to innovation and achievement there are few organisations with a better track record. Join us and you'll be able to play a big part in the success of our … stakeholders within and outside IT, the Architecture function ensures that a common technology architecture framework is defined and adopted across the organisation. The Data Product Architecture (DPA) team are responsible for both shaping the longer-term direction of Data Architecture used by the easyJet business functions … warehousing, data management etc. Familiarity with patterns, practices, and frameworks of Enterprise Architecture. Familiarity with AWS Cloud technologies and concepts like Lake House Architecture and Databricks. Extensive Data modelling experience from conceptual to logical models. Taking long term ownership of the data More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database • MongoDB • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.) • A collaborative team player, approachable, self-efficient and influences a positive work environment • Demonstrates curiosity • Resilient in More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database. • MongoDB. • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.). • A collaborative team player, approachable, self-efficient and influences a positive work environment. • Demonstrates curiosity. • Resilient More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

Job summary The post holder will lead the Trust on a smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure, whilst managing a team of Data Engineers and developers. The Data Engineering Manager plays a pivotal … Factory and other ETL tools. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric. Take ownership of the data engineering … and other ETL tools. 4. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric. 5. Take ownership of the data More ❯

Job Purpose and Background in summary CDP's Data Team are looking for a skilled, enthusiastic and communicative Solution Data Architect who is passionate about designing data solutions to drive companies, investors, and governments to build a thriving economy which works for people and … runs the world's only independent environmental disclosure system. As the founder of environmental reporting, we believe in transparency and the power of data to drive change. Partnering with leaders in enterprise, capital, policy and science, we surface the information needed to enable Earth-positive decisions. We helped … and regions disclose their environmental impacts in 2024. Financial institutions with more than a quarter of the world's institutional assets use CDP data to help inform investment and lending decisions. Aligned with the ISSB's climate standard, IFRS S2, as its foundational baseline, CDP integrates best-practice More ❯

Amazon Music is awash in data! To help make sense of it all, the DISCO (Data, Insights, Science & Optimization) team: (i) enables the Consumer Product Tech org make data driven decisions that improve the customer retention, engagement and experience on Amazon Music. We build … and maintain automated self-service data solutions, data science models and deep dive difficult questions that provide actionable insights. We also enable measurement, personalization and experimentation by operating key data programs ranging from attribution pipelines, northstar weblabs metrics to causal frameworks. (ii) delivering exceptional … technologies like Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, and Lambda. Your team will manage the data exchange store (Data Lake) and EMR/Spark processing layer using Airflow as orchestrator. You'll build our data university and partner with Product, Marketing, BI More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data engineering platforms. This hands-on role will partner with senior-level … technology product roadmap in driving Data Governance policy implementation. What you will be responsible for End-to-end Cloud Data Lake design & development including data ingestion, data modeling, and data distribution. Build data integrations and hand-offs … teams spread globally. What we value These skills will help you succeed in this role: Full stack cloud developer skills: Data (Delta Lake/Databricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management. Strong experience in Python, Scala/PySpark, PERL More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

Title: Head of Data Engineering Industry: FinTech Location: London Salary: Up to £140,000 Seeking an experienced Head of Data Engineering to lead data strategy, architecture, and team management in a fast-paced fintech environment. This role involves designing scalable Apache Spark , Databricks , and … Snowflake solutions on Azure , optimizing ETL/ELT pipelines , ensuring data security and compliance, and driving innovation in big data processing. The ideal candidate has 8+ years of data engineering experience , strong leadership skills, and deep expertise in cloud-based data infrastructure. … within fintech or financial services. Strong hands-on experience with Apache Spark, Databricks, Snowflake, and Azure Data Services (Azure Data Lake, Azure Synapse, etc.). Deep understanding of distributed computing, data warehousing, and data lake architectures. Proficiency in Python, SQL More ❯

Delivery Consultant - Data Analytics, AWS Professional Services Are you a Data Analytics specialist? Do … you have Real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake and Data engineering experience? Do you like to solve the most complex and high scale (billions+ records) data challenges in … as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker and Amazon Quicksight. Solutions - Deliver technical engagements with partners and customers. This includes participating in pre-sales visits, understanding More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

all these transactions for analysis and reporting. Amazon Web Services is seeking a Data Engineer to join the AWS Data Lake team. has a culture of data-driven decision-making, and demands business intelligence that is timely, accurate, and actionable. The AWS Data … their use of the AWS Cloud. We collect and process billions of usage transactions every day into actionable information in the Data Lake and make it available to our internal service owners to analyze their business and serve our external customers. We are truly leading the way … with the ever-increasing volume of data produced by AWS services. The successful candidate will shape and build AWS' data lake and supporting systems for years to come. You should have deep expertise in the design, creation, management, and business use of large datasets, across More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Technical Data Specialist Contract onsite in London Day rate: £650 - £858 per day inside IR35 We're currently seeking an accomplished and highly ambitious Technical Data Specialist to work with our exceptional client, a world class brand in a secure environment to drive major business transformation … process and technical change across this complex organisation. This contract roles will require you to conduct security clearance prior to assignment. The Technical Data Specialist role is conducted in an environment that is far from ordinary, therefore, we're not looking for ordinary. The Technical Data Specialists set the vision for the organisation's use of data (through data design) to ensure that data is managed properly and meets the organisation's needs. You will work with key internal and external partners to deliver data architecture More ❯

Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities: Lead the global BI organisation across APAC … Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation. Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data … a modern, cloud-based BI ecosystem, including: Data Integration: Fivetran, HVR, Databricks, Apache Kafka, Google BigQuery, Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and … communicating enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience … advise clients on reference architectures Design and develop scalable Databricks solutions on both Azure and AWS environments Lead the architecture and deployment of data solutions using Databricks Requirements: Expert in capturing end-user requirements and aligning technical solutions to the business objectives Experience in leading, designing, and implementing More ❯

My client is based in the London area are currently looking to recruit for an experienced Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data … Your role will include: Responsible for designing and developing conceptual/logical/physical data models for Enterprise scale data lake and data warehouse solutions. Create functional & technical documentation - e.g. data integration architecture documentation, data models, data … ERwin, PowerDesigner, Dimensional Modelling) An understanding of SQL/database management. Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around AWS. My client is providing access to; Hybrid 2/3 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical More ❯

employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. AWS Data Engineer Support | S2 | Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to … talk to you! Join our community. We have an exciting opportunity for an AWS Data Engineer Support to join our team of analysts to create the data and insights which support the functional areas of the bank. You'll play a key role understanding the types … using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda Understanding of the principles behind designing and implementing data lake, lake house and/or data mesh architecture Problem solving skill with basic knowledge of the change management process Demonstrates understanding More ❯