1 to 25 of 63 Databricks Jobs in the South West

role Design, develop, and maintain scalable data pipelines and integration solutions on Azure. Build and optimize ETL/ELT processes using Azure Data Factory, Databricks, and Synapse Analytics. Manage and enhance data lakes, data warehouses, and data storage solutions. Develop and optimize SQL queries, data models, and database objects ...

e.g., SQL, Python, Spark, cloud platforms), with a commitment to code quality and delivery excellence Preferred qualifications, capabilities, and skills Hands-on experience with Databricks for scalable data engineering, analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management ...

Scrum development methodologies. Knowledge of data warehousing using MS SQL Server Tools. Experience with MS Azure technologies such as Azure Data Factory, Synapse Analytics, Databricks, Azure SQL, Azure Data Lake Storage etc. Knowledge of data modelling, architectural principles and big data tools. Experience in diagnosing and troubleshooting complex data engineering ...

GCP. We're interested to hear from Data Architects with experience across the majority of leading vendors including Azure, AWS, Google Cloud Platform, Databricks, Snowflake and more. Additional InformationAssessment process ️ Please note that the interview stages may be subject to change based on the specific requirements of the role. Quick ...

Awareness of modern lakehouse concepts and integration with layered data platforms, including Delta Lake and raw/curated data layers. Exposure to Spark/Databricks and PySpark or Spark SQL for collaborating with data engineering teams and troubleshooting end-to-end data flows. Experience with automated unit/integration testing ...

modelling and reporting. Familiarity with cloud platforms (Azure or AWS), particularly in hybrid data environments. Experience working with data Lakehouse technologies (e.g. Delta Lake, Databricks, or similar platforms). Be able to travel to programme and customer meetings across the UK as required. Security cleared or ability to obtain ...

architectural decisions and help drive best practice across the data function. This is a hands-on role offering exposure to modern technologies including Databricks, SQL, Python and PySpark, with plenty of opportunity to make a visible impact. Key Responsibilities Design, build and optimise scalable data pipelines within Databricks. Develop ...

architectural decisions and help drive best practice across the data function. This is a hands-on role offering exposure to modern technologies including Databricks, SQL, Python and PySpark, with plenty of opportunity to make a visible impact. Key Responsibilities Design, build and optimise scalable data pipelines within Databricks. Develop ...

architectural decisions and help drive best practice across the data function. This is a hands-on role offering exposure to modern technologies including Databricks, SQL, Python and PySpark, with plenty of opportunity to make a visible impact. Key Responsibilities Design, build and optimise scalable data pipelines within Databricks. Develop ...

helpful to have experience/expertise/knowledge in the following: Python AWS Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Why else you'll love it here ...

cloud infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

Azure, Terraform, Kubernetes, CI/CD, Linux, automation, DevSecOps and SRE Data Engineering - Python, SQL, ETL/ELT, modern cloud data platforms, Spark/Databricks and data architecture AI & Machine Learning - ML Engineering, MLOps, Python, model deployment, evaluation, LLM/GenAI and production AI Technical Leadership - Senior/Lead engineering ...

/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). Desirable Skills Working experience in Data Lakehouse environments such as Databricks, Snowflake and/or Microsoft Fabric. Security Clearance Requirements The successful candidate must be eligible for an enhanced Developed Vetted/eDV security clearance. Location ...

work effectively in a collaborative, cross-functional team. Experience with data engineering concepts such as ETL/ELT pipelines or data platforms like Databricks and Azure Data Factory would be an advantage, as would familiarity with event-driven architectures or message queues, experience with scientific, geospatial or time-series data ...

engineering. What we're looking for: 24 years' experience in data engineering Strong SQL, Python and DBT skills Experience with AWS and/or Databricks Experience building ETL/ELT pipelines and data warehouses Knowledge of AWS services such as S3, Lambda and Glue Familiarity with Git and infrastructure ...

model evaluation, monitoring and risk management. Deep hands-on machine learning experience is not required. Exposure to tools such as Microsoft Purview, Collibra, Alation, Databricks, Microsoft Fabric, Azure ML or Power BI governance would also be useful. Experience within Defence, Central Government, hydrography, sonar, geospatial/mapping or offshore industries ...

deployment) Proficient software development experience in one of J ava, Scala, or Python Software development experience withdata-processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools Expert in SQL or SQL extensions for analytical use case Expert understanding of distributed data stores and data processing frameworks ...

solving skills with the ability to work across software, data, cloud, and connected-product teams Desirable Experience with Azure IoT services, Azure Data Explorer, Databricks, containerisation, APIs, or cloud-native application deployment Experience with infrastructure as code, automated testing, observability, logging, or platform monitoring Awareness of MLOps concepts such ...

Advanced LLM Architectures: Cloud expertise (AWS/Azure/GCP); emerging LLM architectures.GenAI Frameworks & Platforms: Proficient with Data & AI platforms (Azure AI, Vertex AI, Databricks, Hugging Face), advanced GenAI frameworks (LangChain, HF Transformers, LlamaIndex) & Agentic architectures (LangGraph, SmolAgents, PydanticAI) Prompt Engineering: Deep prompt engineering & optimization skills for GenAI.Vector ...

data, application, cloud, integration and security.Working knowledge of data architecture concepts – including data modelling, integration, governance, visualisation and migration – and tools such as Databricks, Snowflake or equivalent.An appreciation of how technology can solve complex business problems, and comfortable operating at the intersection of business and technology.Strong written and verbal communication ...

strong partnerships with AWS,Azureand GCP.We'reinterested to hear fromDataArchitects with experience acrossthe majority ofleading vendors including Azure, AWS, Google Cloud Platform,Databricks, Snowflakeand more. Additional information Please note that the interview stages may be subject to change based on the specific requirements of the role. Quick call with ...

design, test, and deploy our data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment ...

Strong stakeholder engagement and communication skills. Experience operating within governance and assurance frameworks. Desirable experience includes: TOGAF and/or ITIL certification. Microsoft Fabric, Databricks or data platform certifications. Experience within nuclear, construction, infrastructure or other highly regulated environments. Knowledge of Information Governance and Records Management. Experience supporting AI, automation ...

platforms, and advanced analytics to enhance decision-making and client outcomes. We partner with leading AI and technology providers including Anthropic, Microsoft, AWS, and Databricks to accelerate innovation and expand platform capabilities. By connecting proprietary data, AI infrastructure, and commercial strategy, the team drives transformation across our client, delivering solutions ...

data, application, cloud, integration and security. Working knowledge of data architecture concepts – including data modelling, integration, governance, visualisation and migration – and tools such as Databricks, Snowflake or equivalent. An appreciation of how technology can solve complex business problems, and comfortable operating at the intersection of business and technology. Strong written ...