76 to 100 of 416 Data Lake Jobs

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Join us and build for travelers everywhere. the company seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of the company … with tools like Circus Train , a Hive dataset replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Real EstateSalary: 60000Posted Date: 2026-06-10Contact Email: reasonableaccommodations@marsh.comMercer is seeking candidates for the following position based in the London office:Data EngineerWhat can you expect As a Data Engineer, you will be responsible for supporting the design, development, and maintenance of our data … Terraform)Experience with CI/CD pipelines and version control systems like Git.Familiarity with Dremio and/or Databricks as a data lake engine.Why join our team:We help you be your best through professional development opportunities, interesting work and supportive leadersWe foster a vibrant and inclusive ...

About The RoleTeam – Data and Information ServicesWorking Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full-time hours per week. We are happy to discuss flexible working!Top 3 skills needed for this role:Proven delivery of scalable data solutionsDemonstrated expertise … warehousing, data management and ETL. Strong experience delivering data solutions within BI warehouses and/or data lake environments across both on-premise and cloud platforms. Hands-on experience with Big Data technologies, data ingestion and streaming. Confident ...

About The RoleTeam – Data and Information ServicesWorking Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full-time hours per week. We are happy to discuss flexible working!Top 3 skills needed for this role:Proven delivery of scalable data solutionsDemonstrated expertise … warehousing, data management and ETL. Strong experience delivering data solutions within BI warehouses and/or data lake environments across both on-premise and cloud platforms. Hands-on experience with Big Data technologies, data ingestion and streaming. Confident ...

Powering Progress strategy on the journey to net-zero emissions. Achieving this ambition requires uniting Shell’s strategic and technical expertise across data, strategy, architecture, and innovation. This integration is essential to drive the transformative shifts needed in IT. As part of this journey, we are seeking … driven architecture (event hub, event bus, Kafka), ELKIntermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQLIntegration experience with Confluent/Kafka, API Management, Logic AppsCI/CD & DevOps:Brings substantial experience ...

suffers from inconsistent definitions and manual processing. This position exists to fix these foundational issues, unify customer data into a single lake, and ensure that data is never an afterthought in our product lifecycle. It bridges the gap between technical execution and business value, enabling … analytics are baked into new features from day one, rather than added as an afterthought. Enable Personalisation: Build a unified customer data lake that allows for advanced cohort segmentation and personalised experiences for our fans. Leadership & Roadmap: Review and manage the Data & BI teams, setting ...

trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help … efficient data pipelines and architectures.Oversee the development and implementation of ETL/ELT processes, data warehousing, and data lake solutions.Collaborate with stakeholders to understand business requirements and translate them into technical data solutions.Ensure data quality, consistency, and security across ...

team you'll be working with: We are seeking an accomplished and detail-oriented Snowflake Data Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data engineering, ETL/ELT pipelines, and cloud-native data platforms … platforms (AWS, Azure, GCP).Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon).Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop).Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines.Understanding of data ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … Data Engineer or Solutions Architect Strong expertise in Databricks, Apache Spark, PySpark and SQL Experience designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...

mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.Strong understanding of Master Data Management principles, including domain identification, golden record design, survivorship rules, matching and merging, reference data, data ownership, stewardship and data … rights, escalation routes, data standards and ongoing service management.Strong Microsoft Azure data platform knowledge, ideally including Azure Data Lake, Microsoft Fabric, Azure SQL, Synapse, Databricks, integration services, Power BI and common enterprise integration patterns.Hands-on knowledge of Microsoft Purview, including data ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

sexual orientation, veteran status, or any basis prohibited by the laws that govern its operations.How does this role contribute to our collective success Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used … related design and/or build work. The ideal experience would be working with data models and enterprise data lake/warehouse initiatives but a background in Software Engineering would also be useful.Experience in data analysis, data integration and data ...

Required Skills Data Architect Azure London Job Summary Data Architect – Insurance (Azure Data Platform) We're working with a leading organisation investing heavily in its data and analytics capabilities, and they're looking for an experienced Data Architect with … models, integration frameworks and enterprise data standards Lead the architecture of modern Azure-based data platforms, including Data Lake, Lakehouse and Data Warehouse environments Drive the design of scalable data pipelines, ETL/ELT frameworks and integration patterns Establish ...

tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management … scalable ETL/ELT pipelines using modern tools and framewor ks.Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, AD F).Data Governance: Understanding of GDPR, PII, and secure data management principl es.Communication: Strong data storytelling skills to simplify ...

data warehouse solutions with Azure Data Factory (ADF) and Azure Databricks, services related to Azure Analytics, Azure data lake storage Gen2, Azure SQL/Postgres, Azure analytics services and good understanding of Azure identity (SPN, SAMI, UAMI etc.) experience in designing large data distribution, integration with service-oriented architecture, data mesh, data Lake and data analytics solution using Azure data services with large and multi-format data proficient coding experience using Spark (Python/Scala) and SQL hands on experience ...

controls and operational guardrails Technical Leadership & Standards Serve as the senior technical authority for the Databricks platform architecture Establish engineering best practices covering Delta Lake design, workload orchestration, compute optimization, and cost management Provide technical assurance across platform implementation activities delivered by internal teams and external partners Define reusable … stakeholder engagement, and consulting capabilities Experience translating business requirements into strategic platform architecture solutions Technical Skills Deep expertise in Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and cluster management Strong experience designing cloud-native data platforms on AWS Hands‐on knowledge of AWS services including ...

team you'll be working with: We are seeking a pragmatic, detail oriented and experienced Lead Enterprise Data Architect to join our growing Data & AI practice. The ideal person for this role will have extensive Data expertise gained from working at senior management … responsible for leading client engagements, defining architectural frameworks, as well as defining high level operating models and governance frameworks for managing the Data Architecture. You will also love to collaborate with other Data professionals, engineers, and business or operations experts to understand and address their data ...

Data Architect Salary: Up to £72,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 01/09/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

summary If you enjoy turning complex, real-world data into reliable, usable information that supports better decision-making, this could be a highly rewarding role for you. At NHS Greater Manchester, we are bringing together data from across health and care partners, including NHS providers, local … develop the data pipelines that underpin our Analytics and Data Science Platform (ADSP) - a Snowflake-based data lake house used daily by analysts, data scientists, finance teams and senior leaders across the system. This is a hands-on technical role within ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

Lead Data Engineer - Fully Remote (UK) - AWS - AI & Machine Learning - Up to £110,000 Are you a Senior Data Engineer looking for the opportunity to own a data function rather than simply contribute to one? We're working with a high-growth technology business … that is scaling rapidly and investing heavily in its data, analytics and AI capabilities. The organisation develops cutting-edge products that combine data, machine learning and AI to help global enterprise clients make better decisions through intelligent, evidence-driven insights. This is an opportunity to join ...