1 to 25 of 303 Databricks Jobs in the UK

problem-solving, and communication skills Nice to Have Experience with DevOps and CI/CD pipelines. Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric. Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices. If you’re looking for a Data Engineering position that ...

data modelling, and ETL/ELT patterns Familiarity with CI/CD pipelines and source control (e.g., Azure DevOps, Git) Desirable Skills Experience with Databricks and Spark Knowledge of Power BI and analytics workloads Understanding of DevOps and Infrastructure as Code (e.g., ARM, Bicep, Terraform ...

project safety, quality, time, and cost management. Key Responsibilities: Translate business requirements and designs into technical solutions. Develop, test, and deploy data products using Databricks, Power BI, SQL, Python, Scala, and other technologies. Build, optimize, and maintain ETL/ELT pipelines and data flows for batch and streaming processes. Document ...

solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model ...

lead technical discussions and provide guidance on data engineering best practices. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Experience with Databricks or Spark-based environments, including optimization strategies. Familiarity with data governance tools and frameworks (e.g., Unity Catalog). Experience with JavaScript Full-Stack development environments ...

team members, fostering a strong data culture. Your Profile Essential Skills/Knowledge/Experience Extensive Knowledge Cloud data platforms: Microsoft Fabric, Snowflake, Azure, Databricks Data integration, ETL/ELT, CDC, streaming, APIs, and messaging Data modelling (relational, dimensional, NoSQL) Data governance, security, privacy, and regulatory compliance Power BI, Azure ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

Google Cloud Platform or related technologies. • Experience with other cloud platforms (eg AWS, Azure, Snowflake) and data warehouse/lakehouse technologies (eg Redshift, Databricks, Synapse) • Knowledge of distributed big data technologies. • Proficiency in Python. • Familiarity with data governance and compliance frameworks.Your characteristics as a Consultant will include: • Driven by delivering ...

shape and deliver a refreshed data strategy and modern analytics platform Building reliable, scalable ELT/ETL pipelines into a cloud data warehouse, Snowflake, Databricks, or similar Designing and optimising core data models that are dimensional, analytics-ready, and built to last Creating trusted data products that enable self-service ...

Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse ...

large-scale processing, including ETL/ELT, Python, and Spark Proven experience designing and operating modern cloud data platforms on Azure, including Fabric and Databricks Ability to design and govern secure, scalable, and resilient data architecture and pipelines Experience developing self-service data and AI communities across business and technical ...

someone with: Proven experience as a Data Engineer or similar cloud-first data role. Expertise in Microsoft Azure data services (Data Factory, Synapse, Databricks) and Microsoft Fabric. Strong SQL skills for managing large-scale datasets. Experience integrating Microsoft Dynamics 365 data solutions. Knowledge of data modelling, warehousing, and ETL/ ...

engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats & structures Experience in Databricks, Azure, ADF, Streamlit or alternatives. Excellent technical computing, analysis, design and development skills to a proven professional level. Good understanding of data streaming concepts with ...

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI Platform, Databricks GenAI/BI, Snowflake GenAI, and their relevant services for building and deploying GenAI workloads. Knowledge of market insight, technology trends, and competitor intelligence Experience ...

doing Your focus will be on designing, building and owning cloud-native data engineering solutions, including: Leading the development of an enterprise-scale databricks platform using modern data engineering tools and frameworks Building ingestion, transformation and validation pipelines across cloud data sources, APIs and operational systems Translating data architecture into ...

experience in data engineering roles (midsenior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches ...

Code and Kubernetes for container orchestration, ensuring efficient deployments and robust system performance. Working within Azure, you'll integrate advanced analytics platforms like Databricks and build data pipelines using Python and PySpark to support large-scale processing. The position also involves optimising data models, delivering insights through Power ...

continuously improve your skills and knowledge. Profile The Data Engineer will have mastery of data management and processing tools, including Power BI, Data Factory, Databricks, SQL Server, and Oracle. Proficient in SQL and experienced in database administration. Familiarity with cloud platforms such as Azure and AWS. Excellent problem-solving ...

this page. For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

Experience Required Strong experience in a senior or lead data engineering role Deep hands-on experience with Azure data services (e.g. Data Factory, Synapse, Databricks, Azure SQL, ADLS) Proven use of Terraform to provision and manage cloud infrastructure Solid understanding of data modelling, ETL/ELT patterns, and large-scale ...

Tableau (desirable). Nice to Have Experience with cloud platforms , particularly Microsoft Azure . Knowledge or hands-on experience with Azure Data Factory and Databricks . Experience with risk or trading systems such as Murex or Calypso . Key Focus Areas Strong understanding of banking and capital markets data domains ...

data-driven environment Strong knowledge of data modelling , data processing , integration patterns and database design Hands-on experience with modern cloud data platforms - Azure, Databricks or similar Ability to translate business requirements into scalable, robust data solutions A collaborative communicator with a passion for data, innovation and continuous improvement Technology ...

would be beneficial but is by no means essential. Interested candidates must have experience in a similar role with MS Azure Data Platforms, Synapse, Databricks or other Cloud platforms such as AWS, GCP, Snowfake etc. Key Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components ...

would be beneficial but is by no means essential. Interested candidates must have experience in a similar role with MS Azure Data Platforms, Synapse, Databricks or other Cloud platforms such as AWS, GCP, Snowfake etc. Key Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components ...