26 to 36 of 36 Delta Lake Jobs

vector stores, and LLM evaluation methods. Experience working with structured and unstructured datasets (documents, logs, text, images). Familiarity with scalable data storage solutions (Delta Lake, Parquet, Redshift, DynamoDB). Understanding model optimization techniques (quantization, distillation, inference optimization). Strong capability to debug, tune, and optimize distributed systems ...

skills, experience working with data pipelines, and an understanding of cloud-based storage such as Amazon S3. Experience with tools like Databricks, Delta Lake, or BI platforms such as Power BI or Tableau would be advantageous. This organisation operates globally and is continuing to invest heavily ...

data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/ ...

vector stores, and LLM evaluation methods. Experience working with structured and unstructured datasets (documents, logs, text, images). Familiarity with scalable data storage solutions (Delta Lake, Parquet, Redshift, DynamoDB). Understanding model optimization techniques (quantization, distillation, inference optimization). Strong capability to debug, tune, and optimize distributed systems ...

business problems, such as forecasting daily/hourly reactive workloads, predicting asset failures, and optimising resource allocation. · Databricks Ecosystem Mastery: Utilise Databricks (Unity Catalog, Delta Lake, MLflow) to ingest, process, and analyse large-scale structured and unstructured data from diverse sources (e.g., SAP Datasphere, S3). · Algorithm Versatility ...

some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality, governance and observability … architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. Proven ...

leading projects or workstreams end-to-end Strong background in data engineering (pipelines, ETL, data platforms) Experience with Azure data services including Databricks and Delta Lake Experience with Databricks/modern data tooling Strong SQL and data modelling skills Experience integrating data via APIs and external systems Strong ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

will have over 7 years of experience in regulatory technology within financial services, deep knowledge of SA‐CCR methodology, and strong skills in Databricks, Delta Lake, and Spark. This hybrid role offers competitive compensation, a supportive work culture, and the opportunity to innovate in a compliance-focused environment. ...