201 to 225 of 485 Permanent Data Lake Jobs

Team Favia's Data Platform team builds the real-time infrastructure that powers decision-making across one of the world's largest digital asset exchanges. We operate at the intersection of streaming data, large-scale platform engineering, and AI-driven automation — processing billions of events daily … Partner with ML/AI, analytics, and product engineering teams to deliver platform capabilities that accelerate their work Evolve Favia's data-lake and warehouse architecture to support both batch and streaming workloads seamlessly Set technical direction for the team — balancing reliability, velocity, and cost efficiency ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

Senior Systems Manager - Data Application Deadline: 29 June 2026 Department: IT and Business Systems Employment Type: Permanent - Full Time Location: Silverstone Description As Senior Systems Manager for Data at Silverstone Circuits, you will be the founder member of our new data team … will lead and support the shaping of this key new capability for Silverstone. You will be responsible for the engineering and governance of our Datalake while acting as a business partner and change advocate, ensuring Silverstone can use data effectively. You’ll bridge technical solutions with commercial objectives ...

successful candidate will formulate and design the solutions to deliver to the requirements coming from different business lines and operational departments that have data provision, reporting, and analytics use cases. This is to keep us aligned with the longer term agreed strategies at a business, data, and technical level. The role is an important bridge to translate business department and data office requirements into technically deliverable solutions that are performant, robust, reliable, and manageable in the long term. Is a key mechanism to drive consistency of design across deliveries and projects. ...

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment and as such those with only theoretical viewpoints will not be considered. The ideal candidate will … take responsibility for the work you deliver Open to learning new technologies, methodologies, and skills Preferred: Strong development skills withAzure Data Lake,Azure Data Factory, SQL Data WarehouseAzure Blob, Azure Storage Explorer, Stream Analytics and Event Hub. Experience working with the Microsoft Azure ...

business, operating across 100+ markets and backed by Francisco Partners. As we accelerate our transition to a modern, cloud-native SaaS platform, Platform & Data Engineering sits at the heart of our technical strategy. This is a high-impact leadership role reporting directly to the CTO, responsible for setting … tenancy, and developer-facing APIs - in a complex, multi-product enterprise SaaS environment.Hands-on background in data platform engineering: data lake architecture, ELT pipelines, and familiarity with Snowflake, Databricks, and AWS data services (Athena, Glue, EMR).Experience building AI/ML infrastructure: feature ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation. In this role you will play a key role in: Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage. Develop architectures ...

successful multinational technology business is looking for a Data Observability Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end‐to‐end, designing ...

Project description Designed and implemented a scalable enterprise Lakehouse platform on Azure using Azure Data Factory, Delta Lake, ADLS Gen2, and Databricks. Migrated legacy ETL processes to cloud-native ELT pipelines supporting both batch and near real-time workloads. Established reusable data frameworks, metadata-driven … validation, and automated CI/CD pipelines. Responsibilities Designed and implemented scalable data pipelines using Azure Data Factory, Databricks, Delta Lake, Python, and SQL.Architected Lakehouse solutions supporting enterprise analytics, AI/ML, and Generative AI workloads.Developed structured and unstructured data pipelines ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation.In this role you will play a key role in:Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage.Develop architectures supporting GenAI ...

Sailors who operate those reactors in the U.S. Navy's submarine and aircraft carrier Fleets. Join the Naval Nuclear Laboratory (NNL) as a Data & AI Engineer and play a central role in modernizing the data foundations that power the Naval Reactors Program. In this role … will help transform the financial data ecosystem by designing, building, and maintaining secure, scalable data infrastructure that enables accurate, timely, and actionable analytics across the enterprise. You will partner with teams across Financial Services, IT, Digital Transformation, and other mission-critical organizations to advance ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

NewDay Technology Limited in London is seeking a Senior Data Engineer to lead the design, build and evolution of core … pipelines powering analytics and data science across the business. You will champion DBT, Spark, Python and SQL, shape the Data Lake, drive CI/CD for data solutions, mentor engineers, and collaborate across teams to deliver scalable, robust data platforms. This ...

Description Test Engineer, Cloud & Data Key Responsibilities Design, develop, and execute comprehensive test strategies for cloud-native data platforms. Build and maintain automated test frameworks for platform, integration, API, and end-to-end testing. Validate platform functionality across cloud services, infrastructure, data pipelines … transformation processes o Data quality and reconciliation Strong SQL skills. Familiarity with data warehouses and data lake technologies. DevOps & CI/CD Experience with: o Jenkins o GitHub Actions o Azure DevOps o Bamboo Understanding of Infrastructure as Code (Terraform preferred ...

Senior Data Engineer - Dudley Senior Data Engineer with excellent experience in Microsoft Fabric, Data lakes, data engineering, data development, data integrations, SQL, data warehousing, & Azure data platforms is required by a leading company near ...

successful multinational technology business is looking for a Data Observability Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end-to-end, designing ...

test, and deploy high-fidelity rule-based and anomaly-based detections-as-code Detect and respond to cyber threats using security data lake, SIEM, and cloud platforms Respond to alerts, cyber threats, and drive end-to-end incident response investigations Perform digital forensic investigations to include collection … response operations Conduct threat hunts across corporate, cloud and product environments Support data engineering workflows for core security data lake and SIEM platforms Be an active member of D&R on-call rotations Coach and mentor security engineers within the detection & response team ...

Placed at the heart of Gensler’s People + Process + Technology, the Global Design Technology Studio is advancing a growing data and machine learning foundation that is shaping how the firm designs and delivers its work for generations to come. We believe that when the right intelligence … data and ML platforms, ideally including Azure ML, Databricks, Azure Data Factory or Fabric pipelines, Blob/Data Lake storage, and MLflow or similar tooling. Experience building production‐grade ETL/ELT pipelines and supporting ML workloads from ingestion through deployment. Comfort moving ...

stack and evolving toward a Lakehouse and semantic layer direction. Your Core Impact Design the Lakehouse: Build and own our unified data lake foundations, focusing on scalable ingestion, lifecycle management, and optimised access patterns. Build the Semantic Layer: Implement “metrics-as-code” so KPIs like … control of their business and removing high third‐party commission fees. The Technical Essentials The Azure Specialist: Deep experience with Azure Data Lake, Azure SQL, Data Factory, and Power BI. The DataOps & DevOps Advocate: Proficient with Git, CI/CD (Azure DevOps/GitHub Actions ...

Software Engineer focused on AI Integration, you will be responsible for designing, developing, and implementing the agentic platform for our proprietary Data Lake tool, JCRSD. This role is primarily focused on Python-based components and requires strong container orchestration skills to ensure seamless deployment. This role … databases (e.g., Postgres, MySQL), distributed databases, or NoSQL databases. Prior experience or familiarity with Big Data Platforms or Data Lake architectures. DoD 8140/8570 IAT Level II compliance certifications may be required in this position as directed by the customer. We have many more ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … engineering concepts and proficient applied experience Good working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and Python Experience across the data lifecycle, including ingestion, transformation, storage, and access patterns Advanced proficiency in SQL, including ...

Make your mark for patients We are looking for a Clinical Data Layer Lead who is collaborative, strategic, and outcomes-focused to join our Biometrics & Data Science team, based in any of our Brussels (Belgium), Monheim (Germany), Slough (UK) or Raleigh (US) offices. About the role … will own the vision, strategy, governance, adoption, and continued development of our Clinical Data Layer. As its Functional System Owner, you are going to help clinical data move securely and efficiently from source systems into trusted data products. Your work will enable study delivery ...

Communicate complex technical and architecturalconcepts to business and senior stakeholders in a clear, simplified manner Review and approve test strategies, functional testcases, and data validation approaches. Ability … design data architectures supporting NLP andAI‐driven analytics, including ingestion, curation, and governance ofunstructured data within Data Lake, Data warehouse platforms. Experience translating business and compliancerequirements into NLP‐enabled analytical use cases, such as: Textclassification and categorization, Entity extraction, Risk indicatoridentification ...

unstructured data. Build batch and real-time processing solutions using BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services. Develop data-processing components and integrations using Java or Python, SQL, REST APIs, Kafka, and containerized services on GKE. Implement reusable ingestion and transformation frameworks supporting full … incremental, and event-driven loads. Design data models and optimize BigQuery tables through partitioning, clustering, efficient SQL, and cost-aware processing patterns. Produce high-level and low-level technical designs, document assumptions, and contribute to architecture reviews. Implement data-quality checks, schema validation, reconciliation, audit logging ...