176 to 200 of 245 Delta Lake Jobs in the UK

observability Knowledge of Auto Loader, Lakeflow Connect and batch, streaming or incremental ingestion patterns Production-level PySpark and SQL development skills Strong knowledge of Delta Lake, including MERGE, schema evolution, OPTIMIZE, ZORDER and VACUUM Experience with Databricks Workflows, orchestration and CI/CD Understanding of monitoring, alerting, replay ...

speaking with experienced technical leaders who can combine strong Databricks expertise with architecture and delivery experience. Essential Strong hands-on Databricks experience Lakehouse Architecture Delta Lake & Unity Catalog Team leadership experience Azure/AWS/GCP Stakeholder management Enterprise-scale data platform delivery Desirable Databricks certifications MLflow Mosaic ...

data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/ ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

creation of data domains that align with the banks underlying capabilities Data Engineering & Platforms Design data product schemas across Snowflake and Databricks, including Delta Lake structures and access patterns Define and enforce architectural guardrails for data product design, including performance, scalability, security, and cost efficiency Set design standards ...

data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/ ...

control the creation of data domains that align with the banks underlying capabilitiesData Engineering & PlatformsDesign data product schemas across Snowflake and Databricks, including Delta Lake structures and access patternsDefine and enforce architectural guardrails for data product design, including performance, scalability, security, and cost efficiencySet design standards and review ...

Technology Experience... Spring Boot, Dropwizard, JDBI, Liquibase, Microsoft SQL Server, or Azure Cosmos DB. Azure DevOps, Docker, Kubernetes, Helm, or other Azure services. Databricks, Delta Lake, or data‐intensive financial calculations. Jest, React Testing Library, Playwright, or JUnit. Why This Role Matters at Conga Rebates ...

solid understanding of agile delivery practices including CI/CD, Application Resiliency, and Security. Preferred Qualifications, Capabilities, And Skills Production experience with Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Jobs) and workflow orchestration with Apache Airflow. Experience with evaluation frameworks and approaches (golden datasets, LLM-as-judge, human ...

covering the full lifecycle, discovery, design and build, through to production release and support Deep hands‐on experience of the core platform: Unity Catalog, Delta Lake, workflows and jobs, declarative pipelines, SQL warehouses, cluster and compute configuration Migrated data at scale off on‐prem or legacy platforms ...

models and datasets is highly desirable. Broader experience with cloud data platforms such as Azure, and familiarity with Databricks features beyond dbt, such as Delta Lake or Unity Catalogue. Familiarity with data visualisation tools and BI tools and their data requirements. Previous involvement in large‐scale data migration … transformation on Databricks SQL (Databricks SQL/Spark SQL) VS Code UI for SQL and dbt coding Git/GitHub Databricks Workflows/Delta Live Tables for orchestration Modern data visualisation and self‐serve/conversational analytics tooling Benefits: A relaxed working environment with regular socials including a summer ...

escalating, managing and reporting control issues with transparency. Skills & ExperienceEssentialProven in-depth commercial experience in the following key areas: Databricks – Lakehouse architecture, Spark, Delta Lake, workflows and performance tuning. Apache Spark & Scala – High-performance distributed data processing and optimisation. Cloud Data Engineering (AWS) – Cloud-native data platforms … Applications DevelopmentDemonstrated knowledge of client core business functionsDemonstrated leadership, project management, and development skillsRelationship and consensus building skillsPreferredKafka/Event-Driven ArchitectureApache Iceberg/Delta LakePythonAI/ML & LLM integrationFinancial Services/Capital MarketsEducation: Bachelor's degree/University degree or equivalent experienceMaster's degree preferredWhat we'll provide ...

only. Multi-cloud platform depth (AWS and GCP): hands-on experience with data services across one or both of AWS (Redshift, Glue, S3/Lake Formation, MSK, RDS) and GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Data flow mapping and optimisation: demonstrable experience producing current-state data … serving, and GenAI/RAG architectures grounded in proprietary content. Lakehouse and modern data platform design: strong knowledge of open table formats (Apache Iceberg, Delta Lake), zone architecture (landing, cleansed, curated), streaming and batch pipeline patterns, and data quality frameworks. Project engagement and design assurance: able to engage ...

Databricks and Azure, delivering scalable, governance-backed data foundations for AI-powered trading workflows and analytics. The role demands strong Python and SQL, Delta Lake expertise, batch and streaming pipelines, and collaboration with AI engineers, trading teams #J-18808-Ljbffr ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures Benefits Annual bonus Equity scheme Car allowance Private medical healthcare Paid Microsoft Certifications And more ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures Benefits Annual bonus Equity scheme Car allowance Private medical healthcare Paid Microsoft Certifications And more ...

track. Required Skills & Experience Technical Skills Strong experience with Python and SQL. Hands-on experience with Apache Spark. Experience with Databricks (Unity Catalog/Delta Lake). Experience orchestrating workflows with Apache Airflow. Familiarity with GCP services (GCS, BigQuery). Experience with dbt and ads/payments APIs ...

spanning legacy, cloud and hybrid environments Comprehensive, hands-on experience architecting enterprise-scale solutions on the Databricks Lakehouse Platform, including workspace design, cluster strategy, Delta Lake and Unity Catalog Deep expertise in medallion architecture, data ontologies, data products and data contracts, with strong command of data quality frameworks ...

fixing performance bottlenecks in live systems through profiling and measurement. Nice to Have Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful. The Founders Sanj (CRO): PhD in AI (Gatsby Unit, UCL), ex-Huawei ...

regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission … flowing through our platform. We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats. We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role ...

Somerset Bridge Group is modernising its data platform to a cloud-based ecosystem using Azure Databricks, Delta Lake and Power BI. You’ll join the Enterprise Data Team to design, build, and optimise scalable data solutions for Pricing, Underwriting, Claims, and more. The role focuses on building data ...

reporting and insights. The role requires 6+ years in data/analytics engineering and hands-on Databricks experience, plus strong Spark, SQL, Python, and Delta Lake skills. #J-18808-Ljbffr ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures Benefits Annual bonus Equity scheme Car allowance Private medical healthcare Paid Microsoft Certifications And more ...