1 to 25 of 328 Databricks Jobs in England

strong foundation in traditional data engineering skills while being able to adapt to modern tools such as Azure Data Factory, Power BI , and Databricks , with Python as the primary coding language . This role requires hands-on experience with database design, ETL development, data integration, and a passion for data ...

project safety, quality, time, and cost management. Key Responsibilities: Translate business requirements and designs into technical solutions. Develop, test, and deploy data products using Databricks, Power BI, SQL, Python, Scala, and other technologies. Build, optimize, and maintain ETL/ELT pipelines and data flows for batch and streaming processes. Document ...

solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model ...

lead technical discussions and provide guidance on data engineering best practices. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Experience with Databricks or Spark-based environments, including optimization strategies. Familiarity with data governance tools and frameworks (e.g., Unity Catalog). Experience with JavaScript Full-Stack development environments ...

team members, fostering a strong data culture. Your Profile Essential Skills/Knowledge/Experience Extensive Knowledge Cloud data platforms: Microsoft Fabric, Snowflake, Azure, Databricks Data integration, ETL/ELT, CDC, streaming, APIs, and messaging Data modelling (relational, dimensional, NoSQL) Data governance, security, privacy, and regulatory compliance Power BI, Azure ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

Google Cloud Platform or related technologies. • Experience with other cloud platforms (eg AWS, Azure, Snowflake) and data warehouse/lakehouse technologies (eg Redshift, Databricks, Synapse) • Knowledge of distributed big data technologies. • Proficiency in Python. • Familiarity with data governance and compliance frameworks.Your characteristics as a Consultant will include: • Driven by delivering ...

shape and deliver a refreshed data strategy and modern analytics platform Building reliable, scalable ELT/ETL pipelines into a cloud data warehouse, Snowflake, Databricks, or similar Designing and optimising core data models that are dimensional, analytics-ready, and built to last Creating trusted data products that enable self-service ...

shape and deliver a refreshed data strategy and modern analytics platform Building reliable, scalable ELT/ETL pipelines into a cloud data warehouse, Snowflake, Databricks, or similar Designing and optimising core data models that are dimensional, analytics-ready, and built to last Creating trusted data products that enable self-service ...

shape and deliver a refreshed data strategy and modern analytics platform Building reliable, scalable ELT/ETL pipelines into a cloud data warehouse, Snowflake, Databricks, or similar Designing and optimising core data models that are dimensional, analytics-ready, and built to last Creating trusted data products that enable self-service ...

understanding of statistics and practical machine learning concepts (classification, regression, clustering). Knowledge of big data platforms and cloud-based AI analytics environments (e.g., Databricks, Snowflake, Azure ML, or AWS SageMaker). Ability to present complex issues as simple, compelling, and data-driven narratives, enhanced by AI-supported visualization ...

Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse ...

delivery, including automated build and release pipelines (e.g. Azure DevOps). Significant experience developing and optimising complex SQL queries on modern data platforms (e.g. Databricks SQL). Experience programming in object-oriented or functional languages such as Python or Scala. Experience using statistical or analytical languages (e.g. R) to support ...

Services) Microsoft Fabric, and Power BI Experience of IaaS/on-premises equivalents of the above workloads is valid, such as SSIS, SSAS, SSRS Databricks (desirable) Demonstrable experience of working with query languages within these workloads, such as Transact-SQL to a highly proficient level Data transformation expressions in Data ...

Data technologies (Spark, Hadoop, Kafka). - Strong understanding of API-based integrations. Preferred Skills: - NoSQL experience (MongoDB, DynamoDB). - Snowflake/Redshift/Databricks exposure. - CI/CD for data platforms (GitLab, Terraform, CloudFormation). - Data governance and security frameworks. ...

large-scale processing, including ETL/ELT, Python, and Spark Proven experience designing and operating modern cloud data platforms on Azure, including Fabric and Databricks Ability to design and govern secure, scalable, and resilient data architecture and pipelines Experience developing self-service data and AI communities across business and technical ...

someone with: Proven experience as a Data Engineer or similar cloud-first data role. Expertise in Microsoft Azure data services (Data Factory, Synapse, Databricks) and Microsoft Fabric. Strong SQL skills for managing large-scale datasets. Experience integrating Microsoft Dynamics 365 data solutions. Knowledge of data modelling, warehousing, and ETL/ ...

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI Platform, Databricks GenAI/BI, Snowflake GenAI, and their relevant services for building and deploying GenAI workloads. Knowledge of market insight, technology trends, and competitor intelligence Experience ...

computer science. Proven expertise In using relevant coding languages (Python, SQL etc.), tools (e.g. GIT, CI/CD pipelines, MLFlow etc.) and platforms (Databricks etc.) to deliver data products. Strong problem-solving skills are essential, along with an ability to manage a varied workload. Effective communication skills with ability ...

doing Your focus will be on designing, building and owning cloud-native data engineering solutions, including: Leading the development of an enterprise-scale databricks platform using modern data engineering tools and frameworks Building ingestion, transformation and validation pipelines across cloud data sources, APIs and operational systems Translating data architecture into ...

experience in data engineering roles (midsenior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches ...

Collaborate with stakeholders and technical teams to translate business needs into data solutions Azure Data Engineer requirements: Hands-on experience with Azure Data Factory, Databricks, and SQL-based databases Strong understanding of data engineering principles, including ELT and data modelling Experience working with CI/CD pipelines, automation, and testing ...

this page. For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

Experience Required Strong experience in a senior or lead data engineering role Deep hands-on experience with Azure data services (e.g. Data Factory, Synapse, Databricks, Azure SQL, ADLS) Proven use of Terraform to provision and manage cloud infrastructure Solid understanding of data modelling, ETL/ELT patterns, and large-scale ...