26 to 47 of 47 Delta Lake Jobs

Kimball, Data Vault). Experience exposing Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks ...

journeys. What You'll Bring Extensive experience designing and delivering end-to-end data platforms using Databricks , with a strong focus on Lakehouse Architecture , Delta Lake, and scalable data engineering patterns. A solid background in data analytics, consulting, or a similar technical discipline. Strong knowledge of structured … Kimball , and Data Vault . Hands-on experience exposing Lakehouse solutions to BI tools (e.g. Power BI , Tableau ). Proficiency in Databricks Workflows , Delta Live Tables , and Spark for batch and streaming pipelines. Strong programming capability in Python , Scala , and/or SQL . Practical experience with at least ...

business. Contribute to architectural discussions and the ongoing data platform roadmap. Tech You'll Use Databricks: Lakeflow Declarative Pipelines, Lakeflow Workflows, Unity Catalog, Delta Lake Azure: ADLS Gen2, Data Factory, Event Hubs (optional), Key Vault, private endpoints Languages: PySpark, Spark SQL, Python, Git DevOps: Azure DevOps Repos & Pipelines … Azure + Databricks . Strong PySpark and Spark SQL skills within distributed compute environments. Experience working in a Lakehouse/Medallion architecture with Delta Lake. Understanding of dimensional modelling (Kimball), including SCD Type 1/2. Exposure to operational concepts such as monitoring, retries, idempotency and backfills. Mindset Good ...

Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture, delta lake tables, security policies, and data governance within Fabric. o Build scalable, reusable data assets and engineering patterns that support analytics, reporting ...

business-aware mindset — someone who understands how good data engineering creates real value, not just technical output Solid hands-on experience with Databricks, Delta Lake, PySpark, and Spark SQL Strong Python and SQL skills with a focus on clean, maintainable, production-ready code Working knowledge of CI/ ...

cloud data strategy, define engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit … Data Services and Databricks in enterprise environments. Proven delivery experience within the Lloyd's of London or London Market insurance sector Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling. Strong Python, PySpark and Spark SQL capability Solid understanding of data governance Proven track record ...

local enough to do this without relocating. What you’ll be doing Build, enhance and maintain data pipelines using Azure Databricks , Data Factory , and Delta Lake Develop and optimise Lakehouse components and cloud-based data flows Create robust data models to support analytics, MI and downstream reporting Assist ...

wont just be delivering features; youll be setting direction. The tech youll work with Core:Azure, Databricks, Python, SQL, dbt, MQTT Storage & Serving:Delta Lake, Postgres, TimescaleDB Modelling & ML:MLflow Visualisation:Grafana What makes you a great fit Youre someone who can zoom out to architecture and zoom ...

/ELT pipeline development and optimisation Data governance, quality, lineage, and platform best practice Experience working with both technical and business stakeholders Experience with Delta Lake, Spark, Azure Databricks, Azure Data Factory, Synapse, or Fabric would be highly beneficial. This is a great opportunity for a contractor ...

streamlined data analysis, product builds and reduced time to market Competencies and Behaviours 1 -3 years analytics/data science experience Practical knowledge of; Delta Lake architecture and versioned datasets, Data pipelines, orchestration and scheduling concepts Proficiency in analytical programming language such as python and/ ...

alignment among cross-functional stakeholders. Technical Skills: Cloud Architecture: Deep expertise in Microsoft Azure, including: Azure Functions, Azure AI Search, API Management, Azure Data Lake, Azure Service bus, (link removed) NET Frameworks Azure AD/Entra ID, Azure App-Insights, Azure DevOps and CI/CD pipelines Databricks: Hands … experience with: Data engineering workflows Delta Lake and Spark optimization Integration with Azure services Unity Catalog Data Serving strategies Frontend Development: Proficiency in React, Angular, JavaScript and related frameworks Experience with enterprise-grade Front end applications. Integration of frontend apps with Azure-hosted APIs Responsibilities: Architect & review scalable ...

experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory • Hands-on data engineering experience (Spark/PySpark, Delta Lake) • Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC • Experience leading Agile teams and managing risks, dependencies, and senior ...

Spark. Strong grasp of data modelling, normalization and API development for large scale analytical or trading systems. Experience with lakehouse architectures (Databricks ideally, or Delta Lake). Exposure to real time and historical market data within Fixed Income, ETFs or Equities would be excellent. Operational instincts - extreme agency ...

experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory• Hands-on data engineering experience (Spark/PySpark, Delta Lake)• Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC• Experience leading Agile teams and managing risks, dependencies, and senior ...

/ELT development, PySpark, Glue Catalog) Apache Spark AWS Redshift (modelling, optimisation) AWS Lambda AWS RDS AWS Step Functions Experience with Open Table Formats: Delta Lake Apache Hudi Strong knowledge of S3-based data lakes and modern cloud-native data architectures Data Engineering & Architecture Skills Dimensional Modelling (Star ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality, governance and observability … architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. Proven ...

some of the organisation's most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality, governance and observability … architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. Proven ...

data testing Advanced skills in SQL, Databricks, Pyspark, Spark SQL and scripting skills in Python preferred Experience with Azure DevOps and Delta Lake concepts would also be an added advantage Interested? Apply now for immediate consideration ...

Responsibilities Define and maintain the end-to-end architecture for Azure Databricks-based data platforms. Design Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and associated Azure services. Produce and maintain High-Level Designs (HLDs) and Low-Level Designs (LLDs). Establish and govern data ingestion … dependencies and support mitigation planning. Essential Skills and Experience Demonstrable experience designing Azure Databricks architectures in enterprise environments. Strong understanding of Databricks Lakehouse architecture, Delta Lake, and governance concepts. Architectural-level knowledge of Spark-based platforms. Experience designing secure, governed data platforms in regulated or public sector environments. ...

based development workflows Experience working independently and communicating effectively in distributed teams Desirable : Familiarity with (or happy to learn): Apache Spark (EMR) and Delta Lake PostgreSQL (Aurora) CI/CD (Github Actions) and IaC (Helm, CloudFormation) Monitoring (Sentry) Knowledge/interest in research or academic writings/publishing ...

working on behalf of a major client in the energy sector. The position focuses on designing, developing, and maintaining Azure-based data platforms-particularly Delta Lake and modern analytics services-while providing architectural leadership and hands-on click apply for full job details ...