126 to 150 of 215 Delta Lake Jobs

cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Job Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats Hands‐on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge of structural data formats including Parquet, JSON … pipelines and implementing automated data quality checks Job Responsibilities Construct scalable data ingestion pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows. Implement Delta Live Tables (DLT) to automate batch and real-time streaming data processing. Build and maintain the Medallion Architecture silver & gold layer across shared storage. ...

cross-cloud data engineering initiative, building scalable pipelines between Azure and Google Cloud. Key skills: Strong Python & SQL experience Hands-on Azure Databricks, Delta Lake & Unity Catalog Strong GCP/BigQuery/GCS experience Apache Airflow/Cloud Composer for pipeline orchestration Experience building ELT/data pipelines ...

Excellent stakeholder management and communication skills. Experience providing technical leadership or mentoring. Desirable: Experience with Unity Catalog, dbt or similar transformation frameworks. Knowledge of Delta Lake, data governance and metadata management. Experience with CI/CD and automated testing. #J-18808-Ljbffr ...

keyboard. Deep Spark expertise — architecture, performance tuning, streaming, debugging, the advanced stuff that separates architects from diagram-drawers. Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure a bonus. Battle-tested in migrations — you've led large transformation ...

peers on safe and effective usage within team practices. Preferred Qualifications, Capabilities, and Skills: Experience building data products on Databricks using lakehouse patterns, including Delta Lake and medallion architecture Familiarity with enterprise data platforms and data mesh principles, including domain-aligned datasets and well-defined data contracts Exposure ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone ...

Databricks and Fabric architecture, including Lakehouse patterns Ability to oversee ingestion, transformation and reporting layers across enterprise data flows Working knowledge of Databricks (Delta Lake, pipelines, orchestration) and Fabric (Power BI, semantic models) Experience in operating appropriate governance over data quality, lineage, access and cross-border data controls ...

legacy operational platforms. Experience with regulatory, client or operational reporting. Experience supporting data migration, legacy system modernisation or platform replacement. Experience with Databricks, Delta Lake, Spark SQL or PySpark. Experience defining validation frameworks, data quality dashboards or metadata-driven rule engines. Experience working in consultancy or client-facing ...

development, and technology governance Design of scalable, secure, and cost-optimised cloud data platforms Databricks & Azure Expertise Deep understanding of Databricks Serverless, SQL Warehouses, Delta Lake, Unity Catalog, and platform governance Azure networking, identity, security, and private connectivity architecture Enterprise-scale performance and workload optimisation FinOps Leadership Design ...

time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge of Databricks/Snowflake environments, including Unity Catalog, workspaces, Delta Lake, and networking/security (VPNs, Private Links, Firewalls) and/or Snowflake Platform including Cortex, Horizon and Snowpark. Advanced proficiency in Azure ...

discussions, including vendor conversations and the technical sections of proposals Desirable Experience with NHS or other routine healthcare data at patient level Unity Catalog, Delta Lake and medallion structure, bronze to silver to gold Exposure to dbt and dimensional modelling Experience contributing to vendor or partner relationships, such ...

scalable data solutions. Strong hands-on experience with Microsoft Fabric and Databricks. Strong programming capability across PySpark and T-SQL. Experience working with Delta Lake, Lakehouse architectures and modern cloud data platforms. Understanding of data quality frameworks, testing approaches and governance principles. What's on Offer Salary ...

into technical solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management ...

help the team do better and be better, again and again Write maintainable, testable code and enjoy providing code reviews Be experienced with Databricks, Delta Lake and Lakehouse architecture for efficient data management; experience with ETL processes and optimizing data pipelines for performance Be strong in Python ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

Candidate can clearly articulate what modern features they used recently and why (platform evolution awareness is essential for this role).Should HaveStrong command of Delta Lake and performance patterns:MERGE/CDC strategies, partitioning/file sizing, OPTIMIZE/ZORDER, VACUUM, table maintenance automation.Production architecture practices:Environment separation ...

Spark SQL), including performance tuning (partitioning, shuffle optimization, caching), troubleshooting, and designing scalable batch/stream processing patterns.Deep lakehouse and data platform expertise (e.g., Delta Lake concepts, schema evolution, data quality frameworks, lineage/metadata, and governance patterns) applied in production environments.Strong DevSecOps and platform engineering capability, including ...

PyTorch.Experience with data visualisation tools such as PowerBI and TableauExperience deploying models into production using Azure servicesExposure to data engineering fundamentals (e.g., data pipelines, delta lake)Knowledge of experience tracking tools (MLFlow, Azure ML tracking)Connect to your business – TaxInnovation and tax consultancy may not seem ...

days on site), the role requires 8+ years in data engineering, strong PySpark/SQL, and active SC clearance. You will implement governance, Delta Lake, Unity Catalog, and CI/CD practices to ensure reliable #J-18808-Ljbffr ...

structure data What we are looking for: Proven Data Engineering experience. Experience building production-grade pipelines at scale Proven experience with Databricks, including Delta Lake and Unity Catalog Strong Python and SQL Strong experience with Azure cloud data services This is an exciting opportunity for an experienced Data ...

Skills & Experience: Hands-on experience with Databricks and Microsoft Fabric Experience building and running production-grade pipelines Strong PySpark and SQL skills Experience with Delta Lake and Lakehouse architectures Good grasp of data modelling, orchestration and workflow automation Comfortable working with structured and semi-structured data (Parquet, JSON ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

platform adoption, performance, cost and standards-compliance metrics, using them to guide roadmap priorities and architecture governance decisions.PERSONAL PROFILEDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or equivalent Lakehouse platforms, including administration, cost management, and performance optimisation.Strong understanding of cloud-native architecture principles, cost models ...