1 to 25 of 78 Databricks Jobs in the South East

Databricks Data Architect - Hybrid - Permanent Job Summary We are looking for a Databricks Data Architect with Databricks certifications to design and implement scalable data platforms using the Databricks Lakehouse architecture. The role involves building modern data pipelines, optimizing data platforms, and enabling analytics and machine learning capabilities across the organization. … Responsibilities Design and implement data architectures on the Databricks Lakehouse Platform Build and optimize ETL/ELT pipelines using Apache Spark and Databricks Implement Delta Lake and medallion architecture (Bronze, Silver, Gold) Ensure data governance, security, and performance optimization Integrate Databricks with cloud platforms and enterprise data sources Collaborate with ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

Data Architect - Databricks £120,000-£125,000 base + benefits London (Hybrid: 2-3 days per week onsite) We're looking for an experienced Data Architect who can shape and deliver large-scale analytics platforms using Databricks and modern Lakehouse principles. This role is ideal for someone who enjoys working … early stages of their data transformation journeys. What You'll Bring Extensive experience designing and delivering end-to-end data platforms using Databricks , with a strong focus on Lakehouse Architecture , Delta Lake, and scalable data engineering patterns. A solid background in data analytics, consulting, or a similar technical discipline. Strong ...

engineering or a similar production-focused role Strong Python (Pandas) and SQL skills Experience building and maintaining data pipelines Hands-on experience with Spark, Databricks or Delta Lake/Lakehouse architectures Familiarity with cloud data platforms, particularly within Azure environments Good understanding of data modelling, storage formats and performance optimisation ...

Data Architect - Databricks - Hybrid (London) - up to £125,000 I am working with a high-growth consultancy at the forefront of modern data engineering and AI. This is a place where architects shape real data strategy, influence enterprise-level decision-making, and build world-class Databricks lakehouse platforms for some … scale, and working directly with clients to bring modern data platforms to life, you will thrive here. You Will Work With Architecting and implementing Databricks Lakehouse solutions across ingestion, processing, storage, governance and analytics Designing scalable, modern data platforms for structured + unstructured data Translating business needs into robust technical ...

pipelines (Azure DevOps, GitHub Actions) specifically tailored for analytics, data science, and trading teams. Hands-on experience deploying apps, data pipelines (Azure Data Factory, Databricks), ML model training environments, event streaming (producers/consumers), and auto-trading solutions. Azure Cloud & IaC Mastery: Deep experience architecting and managing ...

Extract, Load, Transform) Data Modeling Strong Technical Skills Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running ...

data function Essential Skills for the Lead Data Analyst: Strong Power BI expertise including DAX Experience working with Microsoft Fabric Knowledge of Azure Synapse, Databricks, Spark Strong SQL capability for querying, shaping and modelling data Experience building ETL/ELT pipelines and integrating data from APIs, files and databases Experience ...

skills at all levels. Comfortable leading iterative delivery using Agile practices. Exposure to tools such as dbt, Airflow/ADF/Dagster, Snowflake/Databricks/Fabric, and metadata/governance systems is beneficial. Ready to Lead in a Role with Real Influence? If you want ownership, visibility ...

cloud platforms or third-party technologies such as Google PaLM and Vertex AI, Azure OpenAI Services and Azure ML, AWS Bedrock and SageMaker, Dataiku, Databricks, Snowflake Snowpark and Snowflake Cortex, and DataRobot. Experience architecting scalable, high-performance, and cost-optimised AI and ML solutions using serverless technologies, containerised deployments, Kubernetes ...

people development. Desirable experience* Architecture certifications (e.g., TOGAF) or equivalent.* Certifications or hands-on experience with modern Data & AI technologies (e.g., Microsoft Fabric, Snowflake, Databricks).* Experience delivering Data Mesh or similar decentralised data frameworks.* Experience designing data products for insurance.* Understanding of Data Governance and platforms such as Collibra ...

data pipelines across cloud and on-premise source systems. Delivering reliable data ingestion, transformation, and delivery processes using technologies such as Azure Data Factory, Databricks, SSIS, and SQL . Reducing manual interventions through automation and standardisation , including data preparation, feature engineering, and training-data pipelines. Preparing data models and datasets … Python or R for data processing or analytics. Hands-on experience with data integration and ingestion tools such as Azure Data Factory and Databricks . Proven experience in data modelling , data warehousing, and relational database platforms (e.g. MS SQL Server). Experience designing cloud-native and/or on-prem ...

Lead Data Engineer - Databricks Location: Remote UK or hybrid/onsite at one of our clients’ offices Working Pattern: Remote UK/Hybrid or office based Salary: Competitive ARCA Resourcing is proud to be partnered with an innovative and leading retailer that is investing heavily in its data capabilities … mentoring engineers and influencing the direction of a high-impact data platform. The Opportunity The organisation operates a modern data stack built around a Databricks-based lakehouse architecture, alongside a Customer Data Platform (CDP), enterprise analytics tooling, and self-service reporting capabilities. As a Lead Data Engineer, you will oversee ...

needs into data solutions * Experience in fast paced or complex environments * Experience with the wider Microsoft Power Platform is beneficial * Experience with Python, Fabric, Databricks or modern data platforms is a bonus What They Offer * Salary up to 50000 * Fully remote working with access to a Bristol office * Opportunity ...

Commitment to an inclusive team environment where people are recognised and supported. Desired TOGAF or equivalent architecture certification. Certifications/exposure to Microsoft Fabric, Databricks, Snowflake , or similar enterprise data platforms. Experience with Data Mesh or domain-oriented data product operating models. Familiarity with governance platforms: Collibra, Informatica , etc. Experience ...

insights. Solid working knowledge of data integration and modelling, including writing SQL, working with relational databases, and connecting to data sources such as Databricks, data lakes, JSON files, and API-driven services. Experience working confidently across multiple, complex datasets, understanding data lineage, definitions, and limitations, and ensuring outputs are accurate ...

data pipelines , ensuring secure, reliable data ingestion, transformation, delivery, and documentation. Delivering high-quality data flows using tools such as Azure Data Factory, Databricks, SQL, and Python , reducing manual intervention through standardisation and automation. Identifying and implementing improvements in speed, reliability, and scalability, including opportunities to apply AI-supported automation … data processing, transformation, or analytics. Hands-on experience with cloud and on-prem data integration tools such as Azure Data Factory and Databricks . Strong background in data modelling, data warehousing, and relational database environments (e.g., MS SQL Server). Experience designing cloud-native and on-prem data solutions. Exposure ...

Senior Data Engineer – Databricks Location: Remote UK or office based (opportunity to work remotely or be office based depending on your preference) Salary: £50k - £64k plus benefits Type: Full-Time ARCA Resourcing is proud to be partnered with an innovative leading retailer that’s transforming how data powers decision-making. … Senior Data Engineer, you will drive the design and implementation of robust, high-performance data solutions. You will work hands on with Databricks to deliver industrialised pipelines and data science model feeds. You will also mentor junior engineers, champion best practices, and ensure technical excellence across all deliveries. What ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team … Leading Product Increment planning to break down solutions into Features and Epics for incremental delivery. Designing and implementing scalable data solutions on Azure and Databricks within the assigned domain. Ensuring appropriate engineering standards are applied to maintain data quality, performance and reliability. Duties/Responsibilities Work with Product Owners ...

providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional … Leading Product Increment planning to break down solutions into Features and Epics for incremental delivery. Designing and implementing scalable data solutions on Azure and Databricks within the assigned domain. Ensuring appropriate engineering standards are applied to maintain data quality, performance and reliability. Duties/Responsibilities Work with Product Owners ...

with large and complex datasets. Experience building and deploying revenue-generating data science models . Experience with Python and modern data platforms such as Databricks . Knowledge of predictive modelling techniques , including propensity modelling, clustering, survival analysis, and forecasting. Experience translating complex analytics into clear business insights for senior stakeholders. ...

delivering data governance and data cataloguing initiatives end-to-end• Hands-on experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory• Hands-on data engineering experience (Spark/PySpark, Delta Lake)• Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC ...

team Exposure to sectors such as defence, public sector and consumer/retail Familiarity with modern data and AI tooling such as Python, Spark, Databricks, Azure cloud, and Generative AI platforms (experience with specific tools is helpful but not essential) A mix of technical, product and operational experience - comfortable talking ...

predictive modelling techniques. What You Will Bring: 5+ years of SQL experience for querying, cleansing, integrating, and summarizing complex data is essential Experience with Databricks and Python is desirable Proven experience of building, testing, evaluating, and improving revenue-generating data science models Knowledge of propensity modeling techniques and other modeling ...

Data Engineering (Data Bricks, Microsoft Fabric etc) before moving into Product Ownership Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing and optimising scalable cloud infrastructure is highly ...