1 to 25 of 47 Databricks Jobs in the South West

role Design, develop, and maintain scalable data pipelines and integration solutions on Azure. Build and optimize ETL/ELT processes using Azure Data Factory, Databricks, and Synapse Analytics. Manage and enhance data lakes, data warehouses, and data storage solutions. Develop and optimize SQL queries, data models, and database objects ...

e.g., SQL, Python, Spark, cloud platforms), with a commitment to code quality and delivery excellence Preferred qualifications, capabilities, and skills Hands-on experience with Databricks for scalable data engineering, analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management ...

Awareness of modern lakehouse concepts and integration with layered data platforms, including Delta Lake and raw/curated data layers. Exposure to Spark/Databricks and PySpark or Spark SQL for collaborating with data engineering teams and troubleshooting end-to-end data flows. Experience with automated unit/integration testing ...

modelling and reporting. Familiarity with cloud platforms (Azure or AWS), particularly in hybrid data environments. Experience working with data Lakehouse technologies (e.g. Delta Lake, Databricks, or similar platforms). Be able to travel to programme and customer meetings across the UK as required. Security cleared or ability to obtain ...

/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). Desirable Skills Working experience in Data Lakehouse environments such as Databricks, Snowflake and/or Microsoft Fabric. Security Clearance Requirements The successful candidate must be eligible for an enhanced Developed Vetted/eDV security clearance. Location ...

helpful to have experience/expertise/knowledge in the following: Python AWS Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Why else you'll love it here ...

Azure, Terraform, Kubernetes, CI/CD, Linux, automation, DevSecOps and SRE Data Engineering - Python, SQL, ETL/ELT, modern cloud data platforms, Spark/Databricks and data architecture AI & Machine Learning - ML Engineering, MLOps, Python, model deployment, evaluation, LLM/GenAI and production AI Technical Leadership - Senior/Lead engineering ...

cloud infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

engineering. What we're looking for: 24 years' experience in data engineering Strong SQL, Python and DBT skills Experience with AWS and/or Databricks Experience building ETL/ELT pipelines and data warehouses Knowledge of AWS services such as S3, Lambda and Glue Familiarity with Git and infrastructure ...

work effectively in a collaborative, cross-functional team. Experience with data engineering concepts such as ETL/ELT pipelines or data platforms like Databricks and Azure Data Factory would be an advantage, as would familiarity with event-driven architectures or message queues, experience with scientific, geospatial or time-series data ...

deployment) Proficient software development experience in one of J ava, Scala, or Python Software development experience withdata-processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools Expert in SQL or SQL extensions for analytical use case Expert understanding of distributed data stores and data processing frameworks ...

solving skills with the ability to work across software, data, cloud, and connected-product teams Desirable Experience with Azure IoT services, Azure Data Explorer, Databricks, containerisation, APIs, or cloud-native application deployment Experience with infrastructure as code, automated testing, observability, logging, or platform monitoring Awareness of MLOps concepts such ...

data, application, cloud, integration and security. Working knowledge of data architecture concepts – including data modelling, integration, governance, visualisation and migration – and tools such as Databricks, Snowflake or equivalent. An appreciation of how technology can solve complex business problems, and comfortable operating at the intersection of business and technology. Strong written ...

strong partnerships with AWS,Azureand GCP.We'reinterested to hear fromDataArchitects with experience acrossthe majority ofleading vendors including Azure, AWS, Google Cloud Platform,Databricks, Snowflakeand more. Additional information Please note that the interview stages may be subject to change based on the specific requirements of the role. Quick call with ...

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to ...

design, test, and deploy our data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment ...

Strong stakeholder engagement and communication skills. Experience operating within governance and assurance frameworks. Desirable experience includes: TOGAF and/or ITIL certification. Microsoft Fabric, Databricks or data platform certifications. Experience within nuclear, construction, infrastructure or other highly regulated environments. Knowledge of Information Governance and Records Management. Experience supporting AI, automation ...

platforms, and advanced analytics to enhance decision-making and client outcomes. We partner with leading AI and technology providers including Anthropic, Microsoft, AWS, and Databricks to accelerate innovation and expand platform capabilities. By connecting proprietary data, AI infrastructure, and commercial strategy, the team drives transformation across Moody's, delivering solutions ...

following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such as LangChain, LlamaIndex, CrewAI, AutoGen, and n8n DevSecOps ...

Central Government, Defence or regulated-sector experience. Defence, maritime, hydrographic, sonar, underwater mapping or oil & gas experience. Experience with Microsoft Purview, Azure ML, Databricks, MLflow or Microsoft Fabric . Knowledge of DAMA-DMBOK, NIST AI RMF, ISO 23894, ISO 27001 or UK GDPR . MLOps, model monitoring or AI risk ...

Financial Services or another regulated industry. Strong understanding of data architecture, including data modelling, integration, governance, visualisation and migration. Experience with platforms such as Databricks, Snowflake or equivalent. Experience with an industry platform such as Guidewire, Sapiens, Duck Creek, FNZ, SS&C, Pershing, Salesforce or Microsoft Dynamics would be advantageous. ...

year to the construction site.Principal AccountabilitiesData model development for change control branchExperience in software development, data engineering, data visualisationDevelopment of PowerBI dashboards drawing on databricks conformed data modelAlign business requirements, logic implemented in data model and reporting outputsInterface with wider IT, IIM, IDA stakeholdersSupport upskilling of team and adoption ...

data engineer to shape the Power Plant design through data models and change control, underpinning the project schedule. You will develop PowerBI dashboards using Databricks data, with SQL and Python, and coordinate with IT, IIM and IDA stakeholders. Hybrid onsite and remote work is available. This role requires proactive collaboration ...

z2bz0 years in architecture, engineering, or technical design roles. Knowledge of Azure cloud, networking, security, integration, and DevOps pipelines. Experience with MuleSoft, Databricks, SQL, and enterprise platforms. Understanding of CASB, firewalls, proxies, load balancing. Ability to produce high-quality architecture artefacts. Strong stakeholder engagement and communication skills. Azure Expert certification ...

communication skills Desirable Experience Experience with any of the following would be advantageous: * Angular, React or Vue * Chart.js, D3.js or other data visualisation tools * Databricks, Apache Spark or distributed data processing * Docker, Kubernetes or Cloud Run * Terraform or other infrastructure-as-code technologies * GPU or accelerated computing technologies such ...