51 to 75 of 77 Delta Lake Jobs

stakeholder expectations, navigate complex requirements, and deliver tailored solutions across diverse industries. 7 years' experience working with Databricks. Good hands on experience with Spark, Delta Lake, and Unity Catalog Strong understanding of cloud platforms like Azure, AWS and/or Google Cloud Experience designing data lakes, lakehouses ...

optimise Data engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with Azure … services: Data Lake Storage (Gen2), Key Vault, Azure Functions Familiarity with CI/CD for Databricks deployments Strong troubleshooting in distributed Data environments Excellent communication and collaboration skills Nice to have: Immediate availability Experience with enterprise-scale Databricks environments Knowledge of Azure Synapse, Power BI and cost optimisation strategies ...

optimise Data engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with Azure … services: Data Lake Storage (Gen2), Key Vault, Azure Functions Familiarity with CI/CD for Databricks deployments Strong troubleshooting in distributed Data environments Excellent communication and collaboration skills Nice to have: Immediate availability Experience with enterprise-scale Databricks environments Knowledge of Azure Synapse, Power BI and cost optimisation strategies ...

includes several high profile household name What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/Delta Lake/BigQuery). Familiarity with eventing technologies (e.g. Event Hubs/Kafka) and file formats such as Parquet/Delta/Iceberg. Want to learn more? Get in touch for an informal chat. ...

kick out of making complex data architectures simple and elegant Be able to explain technical decisions to non-technical humans Bonus points: Experience with Delta Lake/Iceberg, real-time streaming, or LLM orchestration What's on offer: Work on genuinely interesting problems (behavioural + financial data = never ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

align data strategy with business objectives and communicate across all stakeholder levels Databricks platform expertise - Deep hands-on experience with Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and multi-cloud implementations Must be eligible for SC clearance Nice to Have: Cloud-native architecture expertise - Hands-on experience with ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

shell scripting 2+ years of experience with Agile engineering practices. 1+ years of experience with DataBricks 1+ years of experience in Lakehouse, Iceberg or Delta lake. At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position ...

shell scripting 2+ years of experience with Agile engineering practices. 1+ years of experience with DataBricks 1+ years of experience in Lakehouse, Iceberg or Delta lake. At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position ...

shell scripting 2+ years of experience with Agile engineering practices. 1+ years of experience with DataBricks 1+ years of experience in Lakehouse, Iceberg or Delta lake. At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position ...

shell scripting 2+ years of experience with Agile engineering practices. 1+ years of experience with DataBricks 1+ years of experience in Lakehouse, Iceberg or Delta lake. At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position ...

shell scripting 2+ years of experience with Agile engineering practices. 1+ years of experience with DataBricks 1+ years of experience in Lakehouse, Iceberg or Delta lake. At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position ...

platforms, supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing … Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash, or PowerShell ...

modular, test-driven design Experience with Behave for unit and BDD testing (mocking, patching) Proficiency in PySpark and distributed Data processing Solid understanding of Delta Lake (design and maintenance) Hands-on with Docker for development and deployment Familiarity with Azure services: Functions, Key Vault, Blob Storage Ability ...

modular, test-driven design Experience with Behave for unit and BDD testing (mocking, patching) Proficiency in PySpark and distributed Data processing Solid understanding of Delta Lake (design and maintenance) Hands-on with Docker for development and deployment Familiarity with Azure services: Functions, Key Vault, Blob Storage Ability ...

particularly Databricks SQL . Demonstrable experience designing data models (e.g., star schema) and scalable architecture. Knowledge of Azure Modern Data Warehouse tools: Synapse, Databricks, Delta Lake, Unity Catalog. Experience with pipeline orchestration (e.g., Synapse pipelines). Proven background in ITIL change management and incident management . Implementing data ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

alignment among cross-functional stakeholders. Technical Skills: Cloud Architecture: Deep expertise in Microsoft Azure, including: Azure Functions, Azure AI Search, API Management, Azure Data Lake, Azure Service bus, (link removed) NET Frameworks Azure AD/Entra ID, Azure App-Insights, Azure DevOps and CI/CD pipelines Databricks: Hands … experience with: Data engineering workflows Delta Lake and Spark optimization Integration with Azure services Unity Catalog Data Serving strategies Frontend Development: Proficiency in React, Angular, JavaScript and related frameworks Experience with enterprise-grade Front end applications. Integration of frontend apps with Azure-hosted APIs Responsibilities: Architect & review scalable ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

expertise in Python (primary) and some Java. Proven track record leading small teams while staying technically engaged. Background in financial markets, ideally across delta one, store of value, or FICC options trading. Experience with Linux-based, concurrent, low-latency systems. Familiarity with Airflow/Dagster (pipeline orchestration), Kafka (streaming … Delta Lake/Apache Iceberg (data lakes), and relational databases. Exceptional communication skills, comfortable working directly with both engineers and business stakeholders. Degree in Computer Science, Mathematics, Engineering, or equivalent work experience. Why This Role? This is a unique opportunity for a hands-on data leader to step ...

Responsibilities Analyze and document existing data pipelines, including diagrams and data-flow mapping. Develop and automate ETL pipelines using Python. Work with Databricks notebooks, Delta Lake, and Databricks Genie bots. Design, optimize, and debug ETL pipelines. Use SQL for querying, validation, and optimization in the Lakehouse environment. Person ...

similar BI tools (Qlik, Tableau, etc.) Python preferred (R or Scala also considered) Advanced Excel capabilities Nice to Have: Knowledge of OneLake and Delta Lake Experience with Spark Familiarity with Databricks Interested? Please submit your updated CV to Olivia Yafai at Crimson for immediate consideration. Not interested ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...