1,051 to 1,075 of 1,445 Databricks Jobs

engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines that machine learning systems depend on, training … pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs in performance, cost, and maintainability Own and continuously improve ...

engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines that machine learning systems depend on, training … pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs in performance, cost, and maintainability Own and continuously improve ...

engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines that machine learning systems depend on, training … pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs in performance, cost, and maintainability Own and continuously improve ...

engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines that machine learning systems depend on, training … pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs in performance, cost, and maintainability Own and continuously improve ...

Howden Group Services is expanding its internal data engineering capability and is looking for a highly experienced Senior Data Engineer with deep expertise in Databricks and Azure data services. The ideal candidate will have a strong background in designing and delivering scalable, metadata‐driven data solutions, particularly in metadata ingestion … frameworks and orchestration processes. Design and implement scalable and reusable metadata‐driven services to optimise data pipelines. Architect and maintain robust data solutions using Databricks and Azure services (such as Autoloader, Spark Declarative Pipelines Azure Data Factory (ADF), Azure Functions, and Azure Data Lake Storage (ADLS)).). Establish ...

candidates will have a proven track record of collaborating across team boundaries; experience with SQL, Power BI and Azure DevOps (ADO); and familiarity with Databricks from a business user perspective. Key Responsibilities: Work directly with business stakeholders to elicit, clarify, and document detailed data requirements, translating business needs into clear … improving handover quality and time to value Partner with data engineers to ensure business and data requirements are appropriately reflected within the Databricks Medallion Architecture (Bronze/Silver/Gold) Own and maintain requirements and backlog content within Azure DevOps (ADO), ensuring requirements, acceptance criteria, dependencies, data lineage and supporting ...

Partner with Finance and business stakeholders to validate methodologies and ensure value estimates are reproducible and operationalised. Build scalable analytical solutions and pipelines using Databricks, Spark, and Python. Establish strong data validation, audit, and reconciliation practices to support decision-making. Required Skills Advanced SQL for large-scale customer, loyalty, payment … transaction analysis. Strong Python skills for statistical modelling, cohort analysis, weighting, matching, and reproducible analytics. Hands-on experience with Databricks, Spark/PySpark, Delta tables, and automated data workflows. Proficiency with Git, Azure DevOps, and controlled production release processes. Strong data quality, reconciliation, and audit-trail practices. Desirable Skills Experience ...

from the front at the intersection of finance, data engineering, analytics and AI. You'll shape and oversee solutions using data platforms such as Databricks, Microsoft Fabric and Snowflake, combined with AI capability such as Microsoft Foundry, customised workflows and enterprise‐ready agent patterns across data agents, Foundry Agents, Copilot … configuration and testing of solutions across modern data platforms and the wider finance landscape, including ERP (SAP S/4HANA, Oracle), cloud data platforms (Databricks, Microsoft Fabric, Snowflake, Azure), BI tools and existing EPM platforms. Shaping how AI and agentic capabilities are embedded into finance designs, including automated data interrogation ...

product and when a simpler analytical or process solution is more appropriate. Personally build working proofs of concept using tools such as SQL, Python, Databricks, Power BI, AI tooling, and appropriate low-code platforms. Explore and profile data to understand quality, coverage, structure, limitations, and suitability for the intended … problems and converting them into practical, evidence-based solutions. Hands-on ability to interrogate data and build working prototypes using several of SQL, Python, Databricks, Power BI, AI tooling, or low-code tools. Commercial insurance, insurance broking, specialty insurance, claims, placement, portfolio analytics, or underwriting experience. Experience with data mesh ...

making. Core Responsibilities Design and maintain Power BI dashboards and interactive visualisations for enterprise clients. Extract, clean, and model data using Azure Data Factory, Databricks, and SQL Server. Collaborate with engineering and innovation teams to define KPIs, automate reporting, and enhance data quality. Support the integration of AI-powered insights … understand requirements and deliver clear, actionable outputs. Mentor junior team members and contribute to capability development. Technical Stack Core: Power BI DAX SQL Server Databricks Advanced Excel Power Automate Power BI REST API Microsoft Fabric AI integration for BI (Copilot, GPT-based summarisation) What You’ll Bring Professional experience ...

various levels of Data Engineering roles, including 3 years in a technical lead role managing end‐to‐end solutions. Hands‐on experience with Azure Databricks using PySpark, with the ability to undertake cluster capacity planning and workload optimisation. Holds Security Check (SC) clearance OR Eligible for Security Check (SC) clearance … Python scripting, including experience using Python modules for data munging. Up‐to‐date knowledge of data processing technologies and platforms, such as Spark (Databricks). Experience in data modelling to optimise solution performance. Experience using Azure DevOps, with exposure to Continuous Integration and Continuous Delivery/Deployment (CI/ ...

integration and transformation solutions using Azure Data Factory, ensuring scalability, reliability, and adherence to enterprise standards. Design and oversee advanced analytics platforms leveraging Azure Databricks, Azure Synapse Analytics, and Azure ML to enable data-driven decision-making. Define and implement DevOps practices for data pipelines in Azure, ensuring automated deployments … data architecture. Skill Requirements: Architectural leadership in Azure Data Factory with expert-level proficiency in designing complex data integration solutions. Advanced expertise in Azure Databricks, Azure Synapse Analytics, and Azure ML for large-scale analytics and machine learning workloads. In-depth knowledge of DevOps practices for Azure data services, including ...

investment decisions. Lead the modernisation of our data landscape, transitioning from legacy technologies including Oracle, SQL Server, SAS, SSIS and SAP BW to Azure, Databricks and Power BI. Oversee the move to a single-tenancy operating model, ensuring effective planning, governance, migration and business adoption. Sponsor and champion enterprise data … enterprise-wide data strategies within complex, regulated organisations. Experience leading large-scale cloud transformation programmes and legacy-to-cloud migrations. Strong knowledge of Azure, Databricks, Power BI and modern data architecture principles including lakehouse and warehouse platforms. Experience working with legacy technologies such as Oracle, SQL Server, SAS, SSIS ...

approaches* Design and engineer data products and services that integrate seamlessly with business systems and processes, aligned to architectural standards* Develop data products using **Databricks, Power BI**, and other appropriate technologies, applying robust, scalable, and maintainable engineering practices* Build and maintain ingestion, transformation, and load routines to support the organisation … across multidisciplinary teams* Proficiency with **Microsoft Office** tools* General engineering knowledge or experience working in **engineering, construction, or asset-intensive environments**Desirable* Experience using **Databricks** or similar cloud-based data platforms* Familiarity with **data governance frameworks** and working in highly regulated environments (e.g. nuclear, infrastructure, or safety-critical sectors)* Knowledge ...

Python. Design and evolve data models and analytical workloads in ClickHouse, and tune them for sub-second queries. Build incremental, idempotent pipelines on Databricks over billions of rows and tens of terabytes. Keep improving the scale, reliability, freshness, performance and cost efficiency of the platform. Investigate hard performance and reliability … data loaders in Go in production. ClickHouse in production. You know MergeTree schema and sort-key design, materialised views, bulk loads and query tuning. Databricks in production. You have worked with PySpark, Delta Lake and Unity Catalog, designed incremental and idempotent tables, and kept an eye on compute cost. Large ...

leading the team that delivers it, and raising the maturity of data governance across the organization. The future technology stack will focus on Azure, Databricks and Power BI, and a large‐scale transformation of legacy systems is underway. The Data Leader will play a pivotal role in translating the enterprise … each data product delivered to the business. Lead the transition from legacy systems (e.g., Cognos, Oracle, Qlik) to modern cloud‐based platforms (Azure, Databricks and Power BI), including decommissioning plans and managing business continuity throughout. Mature Data Quality capabilities by embedding proactive monitoring, clear ownership and measurable standards, while streamlining ...

forward-thinking, and fit for the future. You’ll bring deep expertise across modern data engineering practices, strong technical solution-design capability, particularly with Databricks, and the leadership experience to empower a high-performing global engineering team. Key Responsibilities Team Leadership: Lead, manage and mentor a team of data engineers … global data function. Qualifications & Experience Experience in data engineering or a related discipline, including a leadership position Strong experience with medallion architecture and Databricks Proficiency with ETL tools, such as Rivery, and ML-Ops frameworks Strong programming skills in Python, Scala, or Java Experience with cloud data platforms and services ...

forward-thinking, and fit for the future. You'll bring deep expertise across modern data engineering practices, strong technical solution-design capability, particularly with Databricks, and the leadership experience to empower a high-performing global engineering team. Key Responsibilities Team Leadership: Lead, manage and mentor a team of data engineers … global data function. Qualifications & Experience Experience in data engineering or a related discipline, including a leadership position Strong experience with medallion architecture and Databricks Proficiency with ETL tools, such as Rivery, and ML-Ops frameworks Strong programming skills in Python, Scala, or Java Experience with cloud data platforms and services ...

build design partner feedback loops with enterprise customers to validate sandboxes, data replay pipelines and governed sharing to external platforms such as Snowflake, Databricks and Power BI. Establish operational quality practices: defined handling of non conforming payloads (quarantine, alerting, retry, reconciliation), monitoring and runbooks in place before handover, and fast … measurable data product metrics. Deep understanding of modern lakehouse architecture, including medallion data tiers, transactional storage engines and change data capture patterns (for example Databricks and Delta Lake). Strong grasp of scientific data modelling, including unstructured to structured transformation, data contracts, schema evolution, ontologies and provenance standards (for example ...

Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro … Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro ...

Data Scientist Work across customer, claims, strategy and underwriting challenges, developing machine learning models and working on GenAI use cases and insight projects to drive business value Take ownership of varied analytical projects and build ...

About The Role Data Analyst (L4) Apprenticeship Trainer Location: Home Based Your Role: As a Data Analytics trainer with QA, you will be at the forefront of data and technical delivery, working with subject matter ...

London is seeking an Enterprise Data Architect to design, implement and maintain data models for our Azure Data Platform, with a focus on the Databricks Lakehouse and Unity Catalog. You will drive data governance, MDM patterns, cost optimisation, and AI-ready data pipelines, collaborating with AI/ML teams ...

experienced Data Engineer to join its Data, Analytics & Reporting team in the UK. You’ll design, build and optimise data pipelines on a Databricks platform hosted on AWS, delivering trusted data for analytics, reporting and data science. You'll work with Data Scientists and Analysts to transform data from clinical ...

Recruitment is seeking a Data Engineer to play a hands-on role building and optimising Azure Databricks pipelines across Bronze, Silver and Gold layers, while integrating new data sources via APIs and system extracts. You will investigate data quality issues, trace anomalies to source systems, and help shape data transformations ...