1 to 25 of 68 Permanent Databricks Jobs in the South East

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

doing Your focus will be on designing, building and owning cloud-native data engineering solutions, including: Leading the development of an enterprise-scale databricks platform using modern data engineering tools and frameworks Building ingestion, transformation and validation pipelines across cloud data sources, APIs and operational systems Translating data architecture into ...

this page. For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

Experience Required Strong experience in a senior or lead data engineering role Deep hands-on experience with Azure data services (e.g. Data Factory, Synapse, Databricks, Azure SQL, ADLS) Proven use of Terraform to provision and manage cloud infrastructure Solid understanding of data modelling, ETL/ELT patterns, and large-scale ...

Microsoft Azure tools and platforms, as well as presenting information to the end user. Your responsibilities: Work with Microsoft Azure Technologies (e.g., Data Factory, Databricks, Synapse) to orchestrate data loading and workflows and manage data pipelines. Maintain, support, and build data warehouses using Azure SQL Technologies Collaborate with analysts ...

practices, with a typical week split between time in the office and home working. Key Responsibilities: Work with Microsoft Azure Technologies (e.g., Data Factory, Databricks, Synapse) to orchestrate data loading and workflows and manage data pipelines. Maintain, support, and build data warehouses using Azure SQL Technologies Collaborate with analysts ...

operations: SQL and Python for data manipulation and analysis Visualization tools such as Power BI/Palantir Foundry Quiver Cloud analytics platforms such as Databricks/Palantir Foundry Git‐based version control and DevOps practices Candidates will stand out if they have: Experience/certifications in Palantir Foundry Experience ...

Looking For Proven experience as a senior developer in backend development Strong skills in Python, SQL and cloud-based AI frameworks (e.g Databricks, azure AI services) Proficient with Azure-based software development including Azure DevOps, Git, CI/CD, Entra ID RBAC and Azure Services Understanding of software architecture, design ...

enabling colleagues. Skills and Experience The successful AI Engineer will have the following skills and experience: Strong Python and SQL experience, ideally with Databricks Experience with ML and LLM tools (e.g., scikit learn, XGBoost, PyTorch, TensorFlow, RAG, APIs) Comfortable with data engineering basics and MLOps practices Experience working with cloud ...

insights. Solid working knowledge of data integration and modelling, including writing SQL, working with relational databases, and connecting to data sources such as Databricks, data lakes, JSON files, and API-driven services. Experience working confidently across multiple, complex datasets, understanding data lineage, definitions, and limitations, and ensuring outputs are accurate ...

data-driven platform used by enterprise customers. You will set technical direction and guide architecture across distributed systems, large-scale data processing (Scala, Spark, Databricks), machine learning pipelines, and cloud-native infrastructure on AWS. A core focus is driving high-quality execution through strong engineering practices including CI/ ...

Understanding of ML Ops vs DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call ...

data pipelines across cloud and on-premise source systems. Delivering reliable data ingestion, transformation, and delivery processes using technologies such as Azure Data Factory, Databricks, SSIS, and SQL . Reducing manual interventions through automation and standardisation , including data preparation, feature engineering, and training-data pipelines. Preparing data models and datasets … Python or R for data processing or analytics. Hands-on experience with data integration and ingestion tools such as Azure Data Factory and Databricks . Proven experience in data modelling , data warehousing, and relational database platforms (e.g. MS SQL Server). Experience designing cloud-native and/or on-prem ...

problem-solving skills, a proactive mindset, and a solid understanding of Agile and Waterfall methodologies. You should be confident working with platforms like Azure, Databricks, and Power BI, and have foundational knowledge of data warehousing and modelling. Certifications such as PMI Agile Fundamentals, BCS Scrum, PRINCE2, or APM are highly ...

Data, Analytics, Cloud, or Digital services. Experience selling consulting or managed services. Understanding of data engineering, analytics and cloud data platforms (e.g., Snowflake, Databricks, Azure, AWS). Strong communication and stakeholder management skills. What is on Offer Competitive salary depending on experience of up to £100,000 Performance related commission ...

Experience: 10+ years' experience in data, analytics, or data engineering roles Broad exposure to modern data engineering tools and architectures (eg Azure Data Factory, Databricks, lakehouse or data warehousing patterns) Background in wealth management, asset management, or broader financial services Proven delivery of enterprise-scale data initiatives across multiple business ...

team Exposure to sectors such as defence, public sector and consumer/retail Familiarity with modern data and AI tooling such as Python, Spark, Databricks, Azure cloud, and Generative AI platforms (experience with specific tools is helpful but not essential) A mix of technical, product and operational experience - comfortable talking ...

Cloud, or Digital services. Proven track record selling consulting or managed services. High-level understanding of data engineering, analytics, and cloud platforms (e.g., Snowflake, Databricks, Azure, AWS). Strong communication and stakeholder management skills. Desirable: Experience with UK enterprise or mid-market clients. Familiarity with pre-sales and offshore delivery ...

5+ years as a Data Engineer or similar role. Strong SQL and data modeling skills. Hands-on experience with cloud data warehouses (Snowflake, BigQuery, Databricks). Proficiency with ELT tools (dbt, Fivetran, Matillion) and orchestration frameworks (Airflow, Prefect). ...

level. Skills and experience Experience using Data pipeline tools Strong experience with SQL and Python Azure Data stack & Azure SQL Hands on experience with Databricks Experienced with data lakes, data integration and data warehousing Insurance experience ideally If this role sounds of interest and you would like to know more ...

Strong expertise across AWS, Azure, and GCP data services. Deep knowledge of data modelling (conceptual, logical, physical) and domain-driven design. Experience with Snowflake, Databricks, BigQuery, Redshift, Synapse or similar platforms. Strong understanding of data governance, security, GDPR, and regulatory frameworks. Certifications – TOGAF/SAFe/Agile Why Join: Fully ...

Azure PaaS components. Key areas: AKS (deployment + management) API Management App Services Azure SQL and MI Functions Networking App Insights Data Factory Databricks Proven experience with Azure DevOps (ADO) Solid understanding of Terraform HELM Flux Powershell/Azure CLI KQL Advantageous: Healthcare or Government related industry experience Understanding ...

British Heart Foundation (BHF), data plays a central role in driving insight, innovation and meaningful impact. As part of our evolving Azure Databricks platform, the Data Engineer will be our product expert contributing to a product that is continuously developing, helping the organisation make better, faster and more informed decisions … support of life saving research. You’ll help drive our highly advanced Azure Databricks platform that delivers fast, reliable insights across the business. You will build and optimise data pipelines, ingest and transform diverse data sources, design new data solutions, and champion emerging technologies, all while focusing on continuous improvement ...

need to have experience with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft … Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark ...

engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder engagement skills ...