1 to 25 of 364 Databricks Jobs in the UK

problem-solving, and communication skills Nice to Have Experience with DevOps and CI/CD pipelines. Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric. Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices. If you’re looking for a Data Engineering position that ...

strong foundation in traditional data engineering skills while being able to adapt to modern tools such as Azure Data Factory, Power BI , and Databricks , with Python as the primary coding language . This role requires hands-on experience with database design, ETL development, data integration, and a passion for data ...

data modelling, and ETL/ELT patterns Familiarity with CI/CD pipelines and source control (e.g., Azure DevOps, Git) Desirable Skills Experience with Databricks and Spark Knowledge of Power BI and analytics workloads Understanding of DevOps and Infrastructure as Code (e.g., ARM, Bicep, Terraform ...

project safety, quality, time, and cost management. Key Responsibilities: Translate business requirements and designs into technical solutions. Develop, test, and deploy data products using Databricks, Power BI, SQL, Python, Scala, and other technologies. Build, optimize, and maintain ETL/ELT pipelines and data flows for batch and streaming processes. Document ...

solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model ...

. Understanding of data modeling concepts and ETL/ELT processes. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Exposure to Databricks or Spark-based environments. Experience with data governance tools and practices. Experience with JavaScript Full-Stack development environments including MongoDB or similar NoSQL databases Knowledge ...

lead technical discussions and provide guidance on data engineering best practices. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Experience with Databricks or Spark-based environments, including optimization strategies. Familiarity with data governance tools and frameworks (e.g., Unity Catalog). Experience with JavaScript Full-Stack development environments ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

proficiency in Python for scripting, API integration, and data automation. Cloud Data Platforms: Proven experience architecting and managing modern Cloud Data Warehouses (e.g. Snowflake, Databricks or Azure Synapse). You must understand compute/storage separation and cost optimisation. Data Engineering & ETL/ELT: Experience building robust data pipelines using ...

Google Cloud Platform or related technologies. • Experience with other cloud platforms (eg AWS, Azure, Snowflake) and data warehouse/lakehouse technologies (eg Redshift, Databricks, Synapse) • Knowledge of distributed big data technologies. • Proficiency in Python. • Familiarity with data governance and compliance frameworks.Your characteristics as a Consultant will include: • Driven by delivering ...

Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse ...

delivery, including automated build and release pipelines (e.g. Azure DevOps). Significant experience developing and optimising complex SQL queries on modern data platforms (e.g. Databricks SQL). Experience programming in object-oriented or functional languages such as Python or Scala. Experience using statistical or analytical languages (e.g. R) to support ...

Services) Microsoft Fabric, and Power BI Experience of IaaS/on-premises equivalents of the above workloads is valid, such as SSIS, SSAS, SSRS Databricks (desirable) Demonstrable experience of working with query languages within these workloads, such as Transact-SQL to a highly proficient level Data transformation expressions in Data ...

best practices - Lead cloud migration and modernization initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm ...

Data technologies (Spark, Hadoop, Kafka). - Strong understanding of API-based integrations. Preferred Skills: - NoSQL experience (MongoDB, DynamoDB). - Snowflake/Redshift/Databricks exposure. - CI/CD for data platforms (GitLab, Terraform, CloudFormation). - Data governance and security frameworks. ...

someone with: Proven experience as a Data Engineer or similar cloud-first data role. Expertise in Microsoft Azure data services (Data Factory, Synapse, Databricks) and Microsoft Fabric. Strong SQL skills for managing large-scale datasets. Experience integrating Microsoft Dynamics 365 data solutions. Knowledge of data modelling, warehousing, and ETL/ ...

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

architecture Integration across databases, cloud platforms, and APIs Query & transformation experience: Advanced T-SQL Power Query (M) and DAX (desirable) Python/PySpark (desirable) Databricks experience (desirable) Required Experience 4+ years' experience delivering data platforms and analytics architectures Proven background in a client-facing data consultancy role Strong ability ...

related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI Platform, Databricks GenAI/BI, Snowflake GenAI, and their relevant services for building and deploying GenAI workloads. Knowledge of market insight, technology trends, and competitor intelligence Experience ...

doing Your focus will be on designing, building and owning cloud-native data engineering solutions, including: Leading the development of an enterprise-scale databricks platform using modern data engineering tools and frameworks Building ingestion, transformation and validation pipelines across cloud data sources, APIs and operational systems Translating data architecture into ...

experience in data engineering roles (midsenior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches ...

data engineering roles (mid-senior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches for data ...

Collaborate with stakeholders and technical teams to translate business needs into data solutions Azure Data Engineer requirements: Hands-on experience with Azure Data Factory, Databricks, and SQL-based databases Strong understanding of data engineering principles, including ELT and data modelling Experience working with CI/CD pipelines, automation, and testing ...

Code and Kubernetes for container orchestration, ensuring efficient deployments and robust system performance. Working within Azure, you'll integrate advanced analytics platforms like Databricks and build data pipelines using Python and PySpark to support large-scale processing. The position also involves optimising data models, delivering insights through Power ...

continuously improve your skills and knowledge. Profile The Data Engineer will have mastery of data management and processing tools, including Power BI, Data Factory, Databricks, SQL Server, and Oracle. Proficient in SQL and experienced in database administration. Familiarity with cloud platforms such as Azure and AWS. Excellent problem-solving ...