1 to 25 of 33 Temporary Databricks Jobs

model lifecycle management, and automated validation processes Experience supporting Generative AI solutions, including RAG architectures, vector search, LLM integration, AI orchestration, or agentic workflows Databricks experience, including Unity Catalog, MLflow, Delta Lake, Lakehouse architecture, and AI tooling Experience working within secure, regulated, or government environments Exposure to large-scale enterprise ...

Databricks Technical Lead l Contract | 12 Months | Outside IR35 l Up to £1,000 per day | Remote first, occasional on-site (Midlands & South East) The role Method Resourcing have been asked by one of our consulting partners to find a hands-on Databricks Technical Lead to design and deliver … Azure Databricks platform for a major life sciences organisation replacing its enterprise data and analytics stack. The programme uses AI and LLM tooling to reverse-engineer existing pipelines, business logic and reports into documented, tested code. You'll mentor three senior data engineers, own the technical architecture and stay hands ...

Technical Lead Databricks Engineer (Azure) | Client Facing | Greenfield | Outside IR35 | Remote UK Technical Lead Databricks Engineer required for a greenfield Azure data platform build. There is no legacy estate and no migration. The end client is a newly formed organisation whose service is expected to operate at national scale following … incoming legislation, so the platform must be engineered for very significant growth. Discovery is largely complete. The platform decision has been made: Azure with Databricks, and Microsoft Purview for governance. You will turn the target architecture into a working platform, setting engineering standards, leading the build and staying hands ...

essential. Desirable Experience Experience working with cloud platforms such as Azure, AWS or Google Cloud. Knowledge of modern data technologies including Azure Data Factory, Databricks, Microsoft Fabric, Synapse Analytics, Snowflake or similar platforms. Experience within digital transformation or data modernisation programmes. PRINCE2, AgilePM, PMP or Scrum qualifications. Consultancy or client ...

governance, ethics and responsible AI Eligibility for Enhanced DBS and BPSS clearance Desirable: Experience with PyTorch, TensorFlow, LangGraph, R or Java Experience with Spark, Databricks or similar distributed data platforms, and exposure to MLOps Experience of AWS, Azure or GCP AI/ML services, ideally with vendor certifications ...

regulated environments. Knowledge of DAMA-DMBOK, NIST AI Risk Management Framework, ISO 27001 or UK GDPR. Experience with Microsoft Purview, Microsoft Fabric, Azure ML, Databricks, Collibra or Alation. Exposure to MLOps, AI model monitoring and automated governance processes. Experience working within secure or restricted technology environments. ...

Experience: 6–10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common … Design and implement MDM solutions , including common IDs, Golden Records, entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement ...

master data standards. Define architecture designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR ...

automation testing, with a strong focus on test planning, cloud infrastructure validation, and client interaction. Key Responsibilities Conduct technical testing on AWS services using Databricks, Quantexa, Tableau, and Iron Mountain. Perform manual testing across AWS components, including S3, CloudWatch, VPC, Lambda, Athena (SQL), and others. Understand AWS infrastructure deployment processes ...

Senior Databricks Solutions Architect | Contract | £800–£900 per day | Inside IR35 4 days per week onsite We're looking for a hands-on Senior Databricks Solutions Architect to support a complex, high-performance data platform within a global organisation. You'll design and optimise Spark workloads, build production streaming pipelines … deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows and Unity Catalog Terraform ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop … agile environment. Collaboration With: - Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams. Skills & Experience: - Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.). - Strong SQL and experience with data warehousing (Kimball methodology). - Programming skills in Python, Scala, or PySpark. - Familiarity with Power BI, SharePoint, and data ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop … agile environment. Collaboration With: - Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams. Skills & Experience: - Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.). - Strong SQL and experience with data warehousing (Kimball methodology). - Programming skills in Python, Scala, or PySpark. - Familiarity with Power BI, SharePoint, and data ...

Data Architect (Azure) | Databricks + Purview | Outside IR35 | Remote based, occasional London trips Rate: market rates, outside IR35 Location: Remote, UK. Occasional London attendance Duration: 6 months initial, likely extension Start: Within 2 weeks Databricks Data Architect required for a greenfield Azure data platform build. There is no legacy estate … down the stack as the conversation needs. Responsibilities Own the target data architecture, from conceptual through logical to physical design Design the Databricks Lakehouse, including medallion layers, workspace and environment structure, and cost and performance patterns Define the governance, lineage and cataloguing approach using Unity Catalog and Microsoft Purview Produce ...

certification processes Knowledge of data stewardship and governance processes, including the difference between data stewards and data custodians Technology: We use and promote Azure Databricks, Azure APIM and Redis caches (for performance). Note: This role requires SC clearance. The additional vetting may take longer than a standard onboarding process. ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full ...

knowledge of o9 Solutions or SAP APO/IBP (Kinaxis, Anaplan, or Blue Yonder also considered). Data Understanding: Conceptual knowledge of data flow (Databricks, data pipelines) into planning tools (no coding required). Background: Ideal path from Supply Chain Planner $\rightarrow$ Systems Implementation rightarrow Solution Architect . Project Scope ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity resolution … Design and implement MDM solutions , including common IDs, Golden Records, entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement ...

Experience: 6-10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse click apply for full ...

master/reference data alignment. Assess extraction options from SAP into the Azure data estate, including SAP Datasphere/Business Data Cloud and Databricks, and a supported replacement for the current CDS view/CDC extraction route, covering licensing, capacity consumption, egress cost and supportability. Operational and drill-down reporting … drill-down/drill-through reporting. Experience of SAP Analytics Cloud and of extracting SAP data into a cloud data platform (e.g. SAP Datasphere, Databricks, Azure). Working knowledge of Microsoft enterprise analytics (Microsoft Fabric, Azure data services, Power BI) and of blended, cross-system reporting. Good understanding of Finance ...

experience * Experience designing integration architectures, including APIs, cloud-based technologies and data pipelines * Experience working with data and analytics platforms, such as Microsoft Fabric, Databricks or equivalent technologies * Excellent stakeholder management and communication skills, with the ability to influence technical and business stakeholders and gain agreement on architectural decisions Desirable … processes. * Familiarity with data formats and reporting standards such as XBRL, XML and JSON. * Experience with Azure data services, including Azure Data Lake Storage, Databricks or Azure Data Factory. * Understanding of data governance, quality, security and data lifecycle management. * Experience supporting technology procurement, supplier assessments or large-scale platform modernisation. ...

experience * Experience designing integration architectures, including APIs, cloud-based technologies and data pipelines * Experience working with data and analytics platforms, such as Microsoft Fabric, Databricks or equivalent technologies * Excellent stakeholder management and communication skills, with the ability to influence technical and business stakeholders and gain agreement on architectural decisions Desirable … processes. * Familiarity with data formats and reporting standards such as XBRL, XML and JSON. * Experience with Azure data services, including Azure Data Lake Storage, Databricks or Azure Data Factory. * Understanding of data governance, quality, security and data lifecycle management. * Experience supporting technology procurement, supplier assessments or large-scale platform modernisation. ...

Data Engineer (SC Cleared) - Core Cloud Databricks Rate: £570 per day (Inside IR35) Location: Hybrid - 2 days per week in London Clearance: Active Security Check (SC) clearance essential About the Role We are seeking an experienced Data Engineer with strong Databricks expertise to support a major cloud migration programme … testing of new pipeline technologies through Alpha and Beta phases. You will play a key role in designing and implementing an Alpha deployment of Databricks within the new AWS environment, helping to establish the foundations for modern, scalable data pipeline technology. Key Responsibilities Design and implement an Alpha deployment ...

MicroStrategy Architect Guildford - Hybrid/Remote £600 to £700 per day - Inside IR35 6-month contract We are working with a global financial services organisation looking for an experienced MicroStrategy Architect to play a key ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity resolution ...