1 to 25 of 93 Databricks Jobs in the South East

solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

proficiency in Python for scripting, API integration, and data automation. Cloud Data Platforms: Proven experience architecting and managing modern Cloud Data Warehouses (e.g. Snowflake, Databricks or Azure Synapse). You must understand compute/storage separation and cost optimisation. Data Engineering & ETL/ELT: Experience building robust data pipelines using ...

doing Your focus will be on designing, building and owning cloud-native data engineering solutions, including: Leading the development of an enterprise-scale databricks platform using modern data engineering tools and frameworks Building ingestion, transformation and validation pipelines across cloud data sources, APIs and operational systems Translating data architecture into ...

Code and Kubernetes for container orchestration, ensuring efficient deployments and robust system performance. Working within Azure, you'll integrate advanced analytics platforms like Databricks and build data pipelines using Python and PySpark to support large-scale processing. The position also involves optimising data models, delivering insights through Power ...

continuously improve your skills and knowledge. Profile The Data Engineer will have mastery of data management and processing tools, including Power BI, Data Factory, Databricks, SQL Server, and Oracle. Proficient in SQL and experienced in database administration. Familiarity with cloud platforms such as Azure and AWS. Excellent problem-solving ...

this page. For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

Experience Required Strong experience in a senior or lead data engineering role Deep hands-on experience with Azure data services (e.g. Data Factory, Synapse, Databricks, Azure SQL, ADLS) Proven use of Terraform to provision and manage cloud infrastructure Solid understanding of data modelling, ETL/ELT patterns, and large-scale ...

visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems to the cloud Creating impactful dashboards and reports using Power ...

Fabric and Databricks Data Engineer - Outside IR35 - Hybrid Role OverviewWe're looking for a skilled Fabric & Databricks Engineer to design, build, and maintain scalable analytics and data engineering solutions. You'll work at the core of our data platform, enabling analytics, reporting, and advanced data use cases by leveraging Microsoft … deliver reliable, performant, and secure data pipelines and models. Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Microsoft Fabric and Databricks Build and optimize Lakehouse architectures using Delta Lake principles Ingest, transform, and curate data from multiple sources (APIs, databases, files, streaming) Develop scalable data transformations ...

Microsoft Azure tools and platforms, as well as presenting information to the end user. Your responsibilities: Work with Microsoft Azure Technologies (e.g., Data Factory, Databricks, Synapse) to orchestrate data loading and workflows and manage data pipelines. Maintain, support, and build data warehouses using Azure SQL Technologies Collaborate with analysts ...

practices, with a typical week split between time in the office and home working. Key Responsibilities: Work with Microsoft Azure Technologies (e.g., Data Factory, Databricks, Synapse) to orchestrate data loading and workflows and manage data pipelines. Maintain, support, and build data warehouses using Azure SQL Technologies Collaborate with analysts ...

Looking For Proven experience as a senior developer in backend development Strong skills in Python, SQL and cloud-based AI frameworks (e.g Databricks, azure AI services) Proficient with Azure-based software development including Azure DevOps, Git, CI/CD, Entra ID RBAC and Azure Services Understanding of software architecture, design ...

enabling colleagues. Skills and Experience The successful AI Engineer will have the following skills and experience: Strong Python and SQL experience, ideally with Databricks Experience with ML and LLM tools (e.g., scikit learn, XGBoost, PyTorch, TensorFlow, RAG, APIs) Comfortable with data engineering basics and MLOps practices Experience working with cloud ...

insights. Solid working knowledge of data integration and modelling, including writing SQL, working with relational databases, and connecting to data sources such as Databricks, data lakes, JSON files, and API-driven services. Experience working confidently across multiple, complex datasets, understanding data lineage, definitions, and limitations, and ensuring outputs are accurate ...

data-driven platform used by enterprise customers. You will set technical direction and guide architecture across distributed systems, large-scale data processing (Scala, Spark, Databricks), machine learning pipelines, and cloud-native infrastructure on AWS. A core focus is driving high-quality execution through strong engineering practices including CI/ ...

Data Scientist: Experience with deep learning frameworks advanced modelling techniques Familiarity with MLOps concepts model monitoring deployment pipelines Exposure to tools such as Databricks MLflow feature stores Experience working in Agile product-led delivery environments Understanding of data governance ethics model explainability Relevant professional certifications relating to cloud data platforms ...

Understanding of ML Ops vs DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call ...

data pipelines across cloud and on-premise source systems. Delivering reliable data ingestion, transformation, and delivery processes using technologies such as Azure Data Factory, Databricks, SSIS, and SQL . Reducing manual interventions through automation and standardisation , including data preparation, feature engineering, and training-data pipelines. Preparing data models and datasets … Python or R for data processing or analytics. Hands-on experience with data integration and ingestion tools such as Azure Data Factory and Databricks . Proven experience in data modelling , data warehousing, and relational database platforms (e.g. MS SQL Server). Experience designing cloud-native and/or on-prem ...

problem-solving skills, a proactive mindset, and a solid understanding of Agile and Waterfall methodologies. You should be confident working with platforms like Azure, Databricks, and Power BI, and have foundational knowledge of data warehousing and modelling. Certifications such as PMI Agile Fundamentals, BCS Scrum, PRINCE2, or APM are highly ...

statistics Proven experience in data modelling (relational and dimensional) Advanced SQL and Python skills Experience working with complex, large-scale data environments Experience with Databricks and Snowflake is advantageous Knowledge of Bulk Purchase Annuities (BPA) is beneficial but not essential Experience with data visualisation tools and BI platforms ...

statistics Proven experience in data modelling (relational and dimensional) Advanced SQL and Python skills Experience working with complex, large-scale data environments Experience with Databricks and Snowflake is advantageous Knowledge of Bulk Purchase Annuities (BPA) is beneficial but not essential Experience with data visualisation tools and BI platforms ...

Data, Analytics, Cloud, or Digital services. Experience selling consulting or managed services. Understanding of data engineering, analytics and cloud data platforms (e.g., Snowflake, Databricks, Azure, AWS). Strong communication and stakeholder management skills. What is on Offer Competitive salary depending on experience of up to £100,000 Performance related commission ...

Experience: 10+ years' experience in data, analytics, or data engineering roles Broad exposure to modern data engineering tools and architectures (eg Azure Data Factory, Databricks, lakehouse or data warehousing patterns) Background in wealth management, asset management, or broader financial services Proven delivery of enterprise-scale data initiatives across multiple business ...

team Exposure to sectors such as defence, public sector and consumer/retail Familiarity with modern data and AI tooling such as Python, Spark, Databricks, Azure cloud, and Generative AI platforms (experience with specific tools is helpful but not essential) A mix of technical, product and operational experience - comfortable talking ...