726 to 750 of 1,441 Databricks Jobs

Navigating Large-Scale Disparate Data: Direct the extraction, wrangling, and consolidation of messy, unstructured, and semi-structured datasets from disjointed platforms (e.g.Salesforce, Stripe, NetSuite, Databricks data warehouse ,and distributor billing CSVs). Single Source of Financial Truth: Collaborate with Data Engineering to automate data pipelines, standardize core SaaS metrics, andestablishautomated ...

commercial performance, including revenue, profitability, customer behavior and product adoptionDeveloping forecasts, scenario models and sensitivity analysis to support commercial planning, prioritization and investment decisionsUsing Databricks, SQL and Python notebooks to build reproducible analyses and automate reporting workflowsProducing and maintaining stakeholder-facing dashboards, clearly communicating performance, trends and prioritiesPresenting findings ...

cloud governance. Platform engineering, DevSecOps and governance-as-code. Containers and orchestration technologies such as Kubernetes and Azure Kubernetes Service (AKS). Microsoft Purview, Databricks or enterprise data platform architecture. Zero Trust architecture, secure access service edge and technologies such as Zscaler. Artificial intelligence, Microsoft Copilot or agentic AI architecture ...

cloud governance. Platform engineering, DevSecOps and governance-as-code. Containers and orchestration technologies such as Kubernetes and Azure Kubernetes Service (AKS). Microsoft Purview, Databricks or enterprise data platform architecture. Zero Trust architecture, secure access service edge and technologies such as Zscaler. Artificial intelligence, Microsoft Copilot or agentic AI architecture ...

cloud governance. Platform engineering, DevSecOps and governance-as-code. Containers and orchestration technologies such as Kubernetes and Azure Kubernetes Service (AKS). Microsoft Purview, Databricks or enterprise data platform architecture. Zero Trust architecture, secure access service edge and technologies such as Zscaler. Artificial intelligence, Microsoft Copilot or agentic AI architecture ...

practice. Nice to have Experience integrating with AI/ML systems or model-serving infrastructure. Exposure to enterprise data platforms (for example Palantir Foundry, Databricks or Snowflake). Observability tooling (Prometheus/Grafana, ELK/OpenSearch). Container orchestration (Kubernetes, ECS) and infrastructure as code. Experience in regulated, safety-critical ...

vector databases and semantic search pipeline design. Essential - Experience with Model Context Protocol (MCP). Essential - Experience with large‐scale data platforms such as Databricks and search engines such as Elasticsearch, in an analytical or AI feature engineering context. Essential - Demonstrated ability to design enterprise‐grade AI systems with strong ...

world. About the role: This role sits within the Great Lakes Data & BI team, responsible for building and maintaining data products within the Azure Databricks lakehouse, including Silver and Gold table transformations and semantic layer outputs, and for diagnosing and resolving data issues arising from the data intake platform. Reporting … while collaborating with the wider business, from Underwriters to Actuaries. Key Responsibilities: Design, build, and maintain Silver and Gold table transformations within the Azure Databricks lakehouse, in line with agreed medallion architecture principles Contribute technical input into data modelling discussions for Silver and Gold layers, working closely with ...

reliable partner to the wider organisation. Responsibilities Technical Delivery Design and build ingestion pipelines across a variety of sources using ADF and Databricks orchestration patterns. Build and optimise data transformations in Databricks, including fact/dimension modelling for data marts. Implement metadata-driven engineering practices that use platform contracts … review. Skills & Technologies Core Data Engineering Data warehouse and data mart modeling: fact/dimension design, slowly changing dimensions, schema evolution. Platform Stack Databricks notebooks and workflows; Azure Data Factory pipelines. Metadata-driven orchestration patterns and platform contract design. Analytics Consumption Power BI/Fabric semantic model and report delivery ...

role for you. Responsibilities Building and operating cloud data and platform solutions across modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data … requirements and contribute to solutions that meet both technical and business needs Required Experience Cloud engineering across one or more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering ...

will work across the following: Building and operating cloud data and platform solutions across modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data … meet both technical and business needs We are looking for experience in the following: Cloud engineering across one or more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering ...

will work across the following: Building and operating cloud data and platform solutions across modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data … meet both technical and business needs We are looking for experience in the following: Cloud engineering across one or more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering ...

will work across the following: Building and operating cloud data and platform solutions across modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data … meet both technical and business needs We are looking for experience in the following: Cloud engineering across one or more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering ...

Halfords is seeking a Data Solution Architect to design end-to-end data solutions that deliver genuine business value. You’ll work with Data and Lead Solution Architects to translate requirements into data flows, models ...

Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business. Location: UK, remote with very occasional visits … plus 10% bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape ...

Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business. Location: UK, remote with very occasional visits … plus 10% bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape ...

Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business. Location: UK, remote with very occasional visits … plus 10% bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape ...

Data Science Festival is seeking a Data Solutions Architect to guide design and architecture across a large-scale data platform in Greater London. This senior role emphasizes shaping how data solutions are crafted while working ...

About Scale Factory We are an AI enablement consultancy. Delivering quality-led AI-first foundations, embedding capability and excellence into the foundational fabric of the companies we work with. We give leaders the confidence to ...

ingestion pipelinesto handle data movement, transformation and visualisations from structured andunstructured sources. Have experiencewith the Azure Platform including: DataIngestion: Azure Data Factory (ADF), Databricks, Logic Apps and Function App DataStorage: ADLS, SQL Server and Unity Catalog (Medallion Architecture) Strongunderstanding of the Databricks Platform including managing, developing anddeploying workflows, jobs ...

Data Engineer (Azure | Databricks | PySpark | SQL) Contract | Remote | UK Public Sector Project We are seeking a Data Engineer to support delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery teams to implement pipeline builds, data models … Responsibilities Build and maintain ETL pipelines and code in cloud data platforms. Support ingestion activity and onboarding of new data sources. Work with the Databricks Data Intelligence Platform and develop Data Engineering workloads. Construct raw, refined and curated data layers; catalogue assets appropriately. Validate solutions against functional and non-functional ...

data engineering, with real ownership of production pipelines Strong SQL and Python, plus hands-on Git Production experience with at least one of Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow or PySpark Cloud-native orchestration and distributed data processing Infrastructure as code (e.g. Terraform) CI/… warehouse and lakehouse Clear communication, with the ability to explain technical decisions to non-technical stakeholders Nice to have Azure, AWS or GCP certifications Databricks, Snowflake or similar certifications Experience leading large-scale data engineering projects What's on offer £60,000 to £75,000 base salary Hybrid working with ...

Data Lake, designing and developing sophisticated data models for analytics, to deploying Azure Logic Apps and Function Apps for process automation. With tools like Databricks, Data Factory, Azure SQL Server, and Python you will help formulate a data driven platform and develop data pipelines that convert raw data into actionable … work environment Develop and implement data ingestion solutions on the Azure platform, ensuring scalability, reliability, and performance. Leveraging technologies such as Azure Data Factory, Databricks, Delta Lake, and Python Design and maintain robust ETL/ELT processes to integrate data from various sources into Azure data services Help to implement ...

readiness across the firm.## **What you will be doing** * Design and maintain scalable, secure data lake and lakehouse solutions using Azure Data Lake, Databricks and Delta Lake — built to support real-time insight, advanced analytics and AI/ML at enterprise scale.* Develop and optimise batch and streaming ETL/… data engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data Services (Data Lake Storage, Synapse Analytics, Data Factory).* Experience with data governance and cataloguing tools such as Collibra ...

your team. Key Responsibilities Discipline Expertise and Leadership Technology breadth : Deep, production‐grade experience across AWS & or Azure native services, with expert-level Databricks and/or Snowflake and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker … metadata management and cataloguing, through to advanced analytics and decision‐making. AI : You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud‐native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human ...