201 to 225 of 498 Data Lake Jobs

market intelligence. With an insight into over 50 overseas markets, we deliver the world's most complete, accurate and up-to-date automotive data and insights, creating significant competitive advantage to our customers. Find out more about what we do here: JATO Our vision Our vision … future and stakeholders in our desires. Our strategic intent is to help customers create significant competitive advantage by constantly leading in connected data, information and knowledge provision, ultimately improving our customers’ work processes, informed decision-making and business results. Role Overview We're seeking an Azure Data ...

this role matters You’ll play a central role in ensuring data flows reliably and efficiently at scale. You will directly enable faster insights, smarter decision‐making, and a resilient data ecosystem that supports everything from operational reporting to ground breaking modelling. How you'll contribute … ingestion and transformation pipelines using technologies such as Spark, Scala, Python, AWS, DBT, and Snowflake Owning and improving the organisation's Data Lake environment and data platform. Ensuring it remains robust, scalable, and future‐ready Owning ETL processing, table refreshes, defect resolution, and other ...

Elevate your career by steering multi-faceted tech programs, integrating innovative solutions for a dynamic impact across global operations. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity … data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns with demonstrated experience architecting end-to-end data solutions Experience navigating complex ...

Role: Microsoft Fabric Data Engineer Location: London (Hybrid) Employment: Fulltime Role overview: The role is responsible for the design, development, and maintenance of scalable data solutions using Microsoft Fabric. The role focuses on building end-to-end data pipelines, working with business users … participate in sprint ceremonies Technical Skillset: Microsoft Fabric (Dataflows, Lakehouse, Warehouse) Azure Data Services (Synapse, Data Factory, Data Lake) SQL (advanced) and Python/Spark for data transformation Strong understanding of data modelling (e.g. star schema) Experience building scalable ...

Team Favia's Data Platform team builds the real-time infrastructure that powers decision-making across one of the world's largest digital asset exchanges. We operate at the intersection of streaming data, large-scale platform engineering, and AI-driven automation — processing billions of events daily … Partner with ML/AI, analytics, and product engineering teams to deliver platform capabilities that accelerate their work Evolve Favia's data-lake and warehouse architecture to support both batch and streaming workloads seamlessly Set technical direction for the team — balancing reliability, velocity, and cost efficiency ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

Senior Systems Manager - Data Application Deadline: 29 June 2026 Department: IT and Business Systems Employment Type: Permanent - Full Time Location: Silverstone Description As Senior Systems Manager for Data at Silverstone Circuits, you will be the founder member of our new data team … will lead and support the shaping of this key new capability for Silverstone. You will be responsible for the engineering and governance of our Datalake while acting as a business partner and change advocate, ensuring Silverstone can use data effectively. You’ll bridge technical solutions with commercial objectives ...

successful candidate will formulate and design the solutions to deliver to the requirements coming from different business lines and operational departments that have data provision, reporting, and analytics use cases. This is to keep us aligned with the longer term agreed strategies at a business, data, and technical level. The role is an important bridge to translate business department and data office requirements into technically deliverable solutions that are performant, robust, reliable, and manageable in the long term. Is a key mechanism to drive consistency of design across deliveries and projects. ...

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment and as such those with only theoretical viewpoints will not be considered. The ideal candidate will … take responsibility for the work you deliver Open to learning new technologies, methodologies, and skills Preferred: Strong development skills withAzure Data Lake,Azure Data Factory, SQL Data WarehouseAzure Blob, Azure Storage Explorer, Stream Analytics and Event Hub. Experience working with the Microsoft Azure ...

business, operating across 100+ markets and backed by Francisco Partners. As we accelerate our transition to a modern, cloud-native SaaS platform, Platform & Data Engineering sits at the heart of our technical strategy. This is a high-impact leadership role reporting directly to the CTO, responsible for setting … tenancy, and developer-facing APIs - in a complex, multi-product enterprise SaaS environment.Hands-on background in data platform engineering: data lake architecture, ELT pipelines, and familiarity with Snowflake, Databricks, and AWS data services (Athena, Glue, EMR).Experience building AI/ML infrastructure: feature ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation. In this role you will play a key role in: Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage. Develop architectures ...

successful multinational technology business is looking for a Data Observability Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end‐to‐end, designing ...

Project description Designed and implemented a scalable enterprise Lakehouse platform on Azure using Azure Data Factory, Delta Lake, ADLS Gen2, and Databricks. Migrated legacy ETL processes to cloud-native ELT pipelines supporting both batch and near real-time workloads. Established reusable data frameworks, metadata-driven … validation, and automated CI/CD pipelines. Responsibilities Designed and implemented scalable data pipelines using Azure Data Factory, Databricks, Delta Lake, Python, and SQL.Architected Lakehouse solutions supporting enterprise analytics, AI/ML, and Generative AI workloads.Developed structured and unstructured data pipelines ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation.In this role you will play a key role in:Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage.Develop architectures supporting GenAI ...

Sailors who operate those reactors in the U.S. Navy's submarine and aircraft carrier Fleets. Join the Naval Nuclear Laboratory (NNL) as a Data & AI Engineer and play a central role in modernizing the data foundations that power the Naval Reactors Program. In this role … will help transform the financial data ecosystem by designing, building, and maintaining secure, scalable data infrastructure that enables accurate, timely, and actionable analytics across the enterprise. You will partner with teams across Financial Services, IT, Digital Transformation, and other mission-critical organizations to advance ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

NewDay Technology Limited in London is seeking a Senior Data Engineer to lead the design, build and evolution of core … pipelines powering analytics and data science across the business. You will champion DBT, Spark, Python and SQL, shape the Data Lake, drive CI/CD for data solutions, mentor engineers, and collaborate across teams to deliver scalable, robust data platforms. This ...

Description Test Engineer, Cloud & Data Key Responsibilities Design, develop, and execute comprehensive test strategies for cloud-native data platforms. Build and maintain automated test frameworks for platform, integration, API, and end-to-end testing. Validate platform functionality across cloud services, infrastructure, data pipelines … transformation processes o Data quality and reconciliation Strong SQL skills. Familiarity with data warehouses and data lake technologies. DevOps & CI/CD Experience with: o Jenkins o GitHub Actions o Azure DevOps o Bamboo Understanding of Infrastructure as Code (Terraform preferred ...

Senior Data Engineer - Dudley Senior Data Engineer with excellent experience in Microsoft Fabric, Data lakes, data engineering, data development, data integrations, SQL, data warehousing, & Azure data platforms is required by a leading company near ...

successful multinational technology business is looking for a Data Observability Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end-to-end, designing ...

test, and deploy high-fidelity rule-based and anomaly-based detections-as-code Detect and respond to cyber threats using security data lake, SIEM, and cloud platforms Respond to alerts, cyber threats, and drive end-to-end incident response investigations Perform digital forensic investigations to include collection … response operations Conduct threat hunts across corporate, cloud and product environments Support data engineering workflows for core security data lake and SIEM platforms Be an active member of D&R on-call rotations Coach and mentor security engineers within the detection & response team ...

Placed at the heart of Gensler’s People + Process + Technology, the Global Design Technology Studio is advancing a growing data and machine learning foundation that is shaping how the firm designs and delivers its work for generations to come. We believe that when the right intelligence … data and ML platforms, ideally including Azure ML, Databricks, Azure Data Factory or Fabric pipelines, Blob/Data Lake storage, and MLflow or similar tooling. Experience building production‐grade ETL/ELT pipelines and supporting ML workloads from ingestion through deployment. Comfort moving ...

stack and evolving toward a Lakehouse and semantic layer direction. Your Core Impact Design the Lakehouse: Build and own our unified data lake foundations, focusing on scalable ingestion, lifecycle management, and optimised access patterns. Build the Semantic Layer: Implement “metrics-as-code” so KPIs like … control of their business and removing high third‐party commission fees. The Technical Essentials The Azure Specialist: Deep experience with Azure Data Lake, Azure SQL, Data Factory, and Power BI. The DataOps & DevOps Advocate: Proficient with Git, CI/CD (Azure DevOps/GitHub Actions ...