176 to 200 of 213 Delta Lake Jobs

Requirements 7+ years experience in data engineering or data platform development Strong experience with Databricks, Spark and distributed data processing Experience with Unity Catalog, Delta Lake and streaming architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting ...

development Strong experience with modern cloud data platforms, Spark and distributed data processing Experience with data cataloguing and governance tooling, open table formats (e.g. Delta Lake, Iceberg) and streaming architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement ...

data/analytics platforms and/or MLOps capabilities in a complex enterprise environment. Hands-on experience operating Databricks (workspace administration, cluster policies, jobs, Delta Lake, Unity Catalog, access controls, and production support) Experience implementing MLOps practices across the model lifecycle (CI/CD, versioning, monitoring, reproducibility) Strong ...

patterns, standards and trade offsRequirements7 to 10+ years' experience in data platform architecture, data engineering or cloud data infrastructureDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or an equivalent Lakehouse platform, including administration, cost management and performance optimisationStrong understanding of cloud native architecture principles, cost ...

engineering standards, ensuring high-quality testing, documentation, code quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model ...

managing data/analytics platforms and/or MLOps capabilities in a complex enterprise environment.Hands-on experience operating Databricks (workspace administration, cluster policies, jobs, Delta Lake, Unity Catalog, access controls, and production support)Experience implementing MLOps practices across the model lifecycle (CI/CD, versioning, monitoring, reproducibility) Strong ...

PySpark to build data products, collaborate across Product, Analytics, Security and Software, and help optimize ETL pipelines in a Lakehouse architecture using Databricks and Delta Lake. #J-18808-Ljbffr ...

scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission … flowing through our platform. We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats.We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will ...

cross-cloud data engineering initiative, building scalable pipelines between Azure and Google Cloud. Key skills: Strong Python & SQL experience Hands-on Azure Databricks, Delta Lake & Unity Catalog Strong GCP/BigQuery/GCS experience Apache Airfl click apply for full job details ...

Events invites a Senior Data Engineer to lead the design and optimisation of our modern data platform on Azure, with a focus on Databricks, Delta Lake, and Medallion modelling. You will build scalable pipelines, drive data governance and collaborate with analysts and data scientists across global events ...

platform to a modern Azure-based data ecosystem. As a Data Engineer you will design, build and optimise scalable data pipelines on Databricks and Delta Lake, supporting Pricing, Underwriting and analytics. You will collaborate with Data Architects and Analysts to ensure data quality, governance and real-time/ ...

Somerset Bridge Group is modernising its data platform to a cloud-based ecosystem using Azure Databricks, Delta Lake and Power BI. You’ll join the Enterprise Data Team to design, build, and optimise scalable data solutions for Pricing, Underwriting, Claims, and more. The role focuses on building data ...

reporting and insights. The role requires 6+ years in data/analytics engineering and hands-on Databricks experience, plus strong Spark, SQL, Python, and Delta Lake skills. #J-18808-Ljbffr ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...

Metaflow or similar workflow tools.Kafka, Pulsar, Redis Streams, RabbitMQ or other event-driven technologies.Triton Inference Server, Ray Serve, TorchServe, BentoML or Seldon Core.DVC, LakeFS, Delta Lake, Feast or other data-versioning and feature-store technologies.Terraform, Pulumi, CloudFormation or Ansible.GPU cluster management or high-performance computing.Aerial, satellite ...

consolidation.• Ensure efficient scheduling and orchestration of jobs using Databricks Workflows• Collaborate with data scientists and platform teams to improve query performance on Delta Lake.• Develop automated monitoring and alerting mechanisms using Databricks REST APIs, Prometheus, or Azure Monitor.• Maintain best practices for data engineering performance, testing, and documentation.Technical … Skills Required• Strong proficiency with Databricks, Apache Spark (SQL, PySpark, Scala), and Delta Lake.• Deep understanding of Spark execution plans, shuffle optimization, and data partitioning strategies.• Experience tuning job configurations (e.g., memory management, parallelism, caching, adaptive query execution).• Familiarity with orchestration tools: Databricks Workflows, Airflow, or Azure Data ...

will spend time building pipelines, modelling data and driving best practices across the platform. The role focuses on hands-on engineering with Databricks, Delta Lake and Azure Data Factory, delivering enterprise-grade data platforms with CI/CD practices and cost monitoring. #J-18808-Ljbffr ...

experience. DLT with Expectations implementation. Modern ingestion with AutoLoader/Lakeflow Connect . Ability to articulate recent Databricks feature usage . Should Have Strong Delta Lake performance skills—MERGE/CDC, partitioning, OPTIMIZE/ZORDER, VACUUM. Cloud integration (Azure/AWS/GCP). Ability to standardise ...

analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits Databricks strives to provide comprehensive benefits and perks. For specific details in your region, refer to the regional benefits ...

Preferred Qualifications Background in financial services, derivatives pricing, market data, or valuation concepts Experience with distributed compute or job scheduling systems Familiarity with Databricks, Delta Lake, or similar analytics platforms Knowledge of reactive or event-driven programming #J-18808-Ljbffr ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. Specific ...

cloud governance, security and data protection controls. A strong track record of integrating AWS architectures with modern data platforms such as Databricks Lakehouse or Delta Lake, and resolving complex cross-team architecture issues. Experience chairing or presenting at a Technical Design Authority or equivalent architecture governance forum, securing ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...