51 to 75 of 105 Contract Databricks Jobs

Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business. Location: UK, remote with very occasional visits … plus 10% bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape ...

data engineering, with real ownership of production pipelines Strong SQL and Python, plus hands-on Git Production experience with at least one of Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow or PySpark Cloud-native orchestration and distributed data processing Infrastructure as code (e.g. Terraform) CI/… warehouse and lakehouse Clear communication, with the ability to explain technical decisions to non-technical stakeholders Nice to have Azure, AWS or GCP certifications Databricks, Snowflake or similar certifications Experience leading large-scale data engineering projects What's on offer £60,000 to £75,000 base salary Hybrid working with ...

master data standards. Define architecture designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR ...

automation testing, with a strong focus on test planning, cloud infrastructure validation, and client interaction. Key Responsibilities Conduct technical testing on AWS services using Databricks, Quantexa, Tableau, and Iron Mountain. Perform manual testing across AWS components, including S3, CloudWatch, VPC, Lambda, Athena (SQL), and others. Understand AWS infrastructure deployment processes ...

frameworks. Excellent understanding of statistics, machine learning methodologies, and model evaluation. Experience delivering AI solutions from proof-of-concept through to production. Exposure to Databricks, MLflow, Spark, or similar cloud-based data platforms. Ability to influence senior stakeholders and lead technical strategy Desirable Experience Experience building multi-agent AI systems ...

experience with vector databases and semantic search pipeline design. Experience with Model Context Protocol (MCP). Experience with large-scale data platforms such as Databricks and search engines such as Elasticsearch, in an analytical or AI feature engineering context. Demonstrated ability to design enterprise-grade AI systems with strong ...

Senior Databricks Solutions Architect | Contract | £800–£900 per day | Inside IR35 4 days per week onsite We're looking for a hands-on Senior Databricks Solutions Architect to support a complex, high-performance data platform within a global organisation. You'll design and optimise Spark workloads, build production streaming pipelines … deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows and Unity Catalog Terraform ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop … agile environment. Collaboration With: - Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams. Skills & Experience: - Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.). - Strong SQL and experience with data warehousing (Kimball methodology). - Programming skills in Python, Scala, or PySpark. - Familiarity with Power BI, SharePoint, and data ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop … agile environment. Collaboration With: - Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams. Skills & Experience: - Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.). - Strong SQL and experience with data warehousing (Kimball methodology). - Programming skills in Python, Scala, or PySpark. - Familiarity with Power BI, SharePoint, and data ...

Data Architect (Azure) | Databricks + Purview | Outside IR35 | Remote based, occasional London trips Rate: market rates, outside IR35 Location: Remote, UK. Occasional London attendance Duration: 6 months initial, likely extension Start: Within 2 weeks Databricks Data Architect required for a greenfield Azure data platform build. There is no legacy estate … down the stack as the conversation needs. Responsibilities Own the target data architecture, from conceptual through logical to physical design Design the Databricks Lakehouse, including medallion layers, workspace and environment structure, and cost and performance patterns Define the governance, lineage and cataloguing approach using Unity Catalog and Microsoft Purview Produce ...

enterprise-scale data solutions. The remaining 20% is just as critical: leading people, influencing stakeholders, and shaping how data engineering operates across the organisation. Databricks sits at the heart of our platform - this role requires someone who can deeply leverage the Databricks to enable scalable analytics, data science … Define and enforce data engineering standards, patterns, and best practices across the organisation. Architect and deliver scalable, resilient data solutions across Azure, AWS, and Databricks, ensuring enterprise-grade performance and reliability. Lead complex engineering workstreams - unblocking teams, guiding technical decisions, and ensuring high-quality delivery outcomes. Design and govern enterprise ...

programme, helping build and support secure, scalable Azure infrastructure and platform services. Key Skills: Azure Infrastructure Azure DevOps Terraform and/or Bicep Azure Databricks Platform Engineering CI/CD Pipelines Cloud Automation (PowerShell/Python) Azure Security & Governance As DevOps/Platform Engineer Resp click apply for full ...

certification processes Knowledge of data stewardship and governance processes, including the difference between data stewards and data custodians Technology: We use and promote Azure Databricks, Azure APIM and Redis caches (for performance). Note: This role requires SC clearance. The additional vetting may take longer than a standard onboarding process. ...

bring hands-on experience with LLMs, prompt engineering, retrieval-augmented generation (RAG), Python, SQL and cloud-based data platforms such as Azure, Databricks or Snowflake. Just as importantly, you'll be comfortable working with senior stakeholders, translating business challenges into AI opportunities and demonstrating measurable outcomes that matter ...

with monitoring and observability tools (Grafana, Splunk) and diagnostics platforms (New Relic, Dynatrace). Understanding of containerisation technologies (Docker, Kubernetes) and big data platforms (Databricks). Ability to analyse complex performance issues and provide actionable recommendations. Strong scripting skills (e.g., Python, JavaScript) for test automation and data analysis. Knowledge ...

Azure and GCP to support analytics, AI and operational workloads. Leading cloud transformation initiatives, migrating legacy environments to modern data platforms including Snowflake, Databricks, BigQuery, Synapse, Redshift and other cloud-native technologies. Building Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) for AI and advanced analytics solutions, ensuring they … architecture, including at least 6 years designing cloud-based data platforms using AWS, Azure or GCP. Hands-on expertise with technologies such as Snowflake, Databricks, Synapse, BigQuery, Redshift or similar enterprise data platforms. Strong knowledge of Infrastructure-as-Code, DevOps, CI/CD, networking, security and identity management for modern ...

Cleared Databricks Architect | Remote SR2 is supporting a major public sector data transformation programme seeking experienced Databricks Architects. We're interested in architects with strengths in platform design, data product architecture, or both. The Role You'll help shape an enterprise Databricks environment on AWS, supporting secure platform foundations … platform infrastructure and integration through to data modelling, product standards and self-service analytics. Key Responsibilities Define architecture, reference designs and reusable patterns for Databricks platforms and data products. Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads. Establish standards for data modelling, data contracts ...

junior engineers and progress into technical architecture or leadership roles. Key Responsibilities Design, develop and maintain data pipelines using Azure Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly … technical best practices. About You You'll have: Strong experience with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills ...

from diverse data sources and formats Hands-on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross-functional stakeholders, with strong communication skills for both technical and non-technical audiences Experience applying … support highly scalable data engineering solutions that power our client next-generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with our client technical teams ...

data governance and Master Data Management frameworks, ensuring data quality, integrity and compliance. Architect and deliver modern cloud-based data platforms using Microsoft Fabric, Databricks and Power BI. Take ownership of the Power BI and cloud data platform environments, ensuring they are secure, scalable and fit for purpose. Develop impactful … bring: Proven experience leading Data & Analytics functions and developing high-performing teams. Expert-level knowledge of Power BI, DAX, Power Query, Microsoft Fabric, Databricks, SQL and ETL/data pipeline technologies. Strong experience in data governance, data quality and Master Data Management (MDM). A track record of delivering enterprise ...

**Data Engineer** (Contract) Duration: 6 Months (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Overview The Data ...

maintain cloud infrastructure on AWS using Terraform, including networking, security, compute, storage, and managed services, following infrastructure-as-code best practices Develop and manage Databricks platform capabilities — including workspaces, clusters, policies, jobs, libraries, and integrations — to support production-grade data workloads Build automation around platform provisioning and operations using Python … relevant to cloud data platforms, such as VPC, IAM, S3, EC2/ECS/EKS, RDS, KMS, CloudWatch, and load balancing Working experience with Databricks, including platform administration and/or building and supporting production workloads Proficiency in Python (preferred) or Java, with demonstrated ability to build automation, tooling ...

knowledge of o9 Solutions or SAP APO/IBP (Kinaxis, Anaplan, or Blue Yonder also considered). Data Understanding: Conceptual knowledge of data flow (Databricks, data pipelines) into planning tools (no coding required). Background: Ideal path from Supply Chain Planner $\rightarrow$ Systems Implementation rightarrow Solution Architect . Project Scope ...

Engineering to lead this journey. This is a unique opportunity to build and develop a high-performing team, drive the evolution of our Azure Databricks platform, and create trusted, accessible data products that deliver real value across the Bank. Working with senior stakeholders from across the business, you'll play … inspire the Data Engineering function, fostering a high-performing team culture and engineering excellence. Drive the delivery, adoption and continuous enhancement of the Azure Databricks Enterprise Data Platform. Establish a sustainable in-house data engineering capability, ensuring effective knowledge transfer from strategic partners. Develop scalable and reusable data ingestion, transformation ...

Partner with Finance and business stakeholders to validate methodologies and ensure value estimates are reproducible and operationalised. Build scalable analytical solutions and pipelines using Databricks, Spark, and Python. Establish strong data validation, audit, and reconciliation practices to support decision-making. Required Skills Advanced SQL for large-scale customer, loyalty, payment … transaction analysis. Strong Python skills for statistical modelling, cohort analysis, weighting, matching, and reproducible analytics. Hands-on experience with Databricks, Spark/PySpark, Delta tables, and automated data workflows. Proficiency with Git, Azure DevOps, and controlled production release processes. Strong data quality, reconciliation, and audit-trail practices. Desirable Skills Experience ...