1 to 25 of 462 Databricks Jobs in England

problem-solving, and communication skills Nice to Have Experience with DevOps and CI/CD pipelines. Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric. Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices. If you're looking for a Data Engineering position that ...

problem-solving, and communication skills Nice to Have Experience with DevOps and CI/CD pipelines. Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric. Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices. If you’re looking for a Data Engineering position that ...

solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model ...

. Understanding of data modeling concepts and ETL/ELT processes. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Exposure to Databricks or Spark-based environments. Experience with data governance tools and practices. Experience with JavaScript Full-Stack development environments including MongoDB or similar NoSQL databases Knowledge ...

lead technical discussions and provide guidance on data engineering best practices. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Experience with Databricks or Spark-based environments, including optimization strategies. Familiarity with data governance tools and frameworks (e.g., Unity Catalog). Experience with JavaScript Full-Stack development environments ...

project safety, quality, time, and cost management. Key Responsibilities: Translate business requirements and designs into technical solutions. Develop, test, and deploy data products using Databricks, Power BI, SQL, Python, Scala, and other technologies. Build, optimize, and maintain ETL/ELT pipelines and data flows for batch and streaming processes. Document ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse ...

Google Cloud Platform or related technologies. • Experience with other cloud platforms (eg AWS, Azure, Snowflake) and data warehouse/lakehouse technologies (eg Redshift, Databricks, Synapse) • Knowledge of distributed big data technologies. • Proficiency in Python. • Familiarity with data governance and compliance frameworks.Your characteristics as a Consultant will include: • Driven by delivering ...

development of AI/ML solutions. * MLOps practices: CI/CD, model monitoring, retraining. * Use of open-source and enterprise tools (LangChain, Azure OpenAI, Databricks). * Generative AI features: embeddings, RAG, AI agents. * Clean, testable code with modern engineering practices. * Align with enterprise architecture and governance. * Collaborate with architects ...

bring Strong experience in data engineering, analytics engineering, or applied data science Cloud and data platform exposure, AWS, Azure, GCP, and/or Databricks Python, ideally PySpark, R helpful but not essential End-to-end pipelines, feature engineering, and production ML workflows Familiarity with LLMs, GenAI, or agent-based systems ...

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

workshops. o Integrating ML and AI into dashboard reporting Required o Deep knowledge of modern data architecture. o Experience within Cloud platforms (Azure, AWS, Databricks). o Strong understanding of ETL/ELT, API's and integration patterns. o Strong communication and stakeholder engagement. o 5years+ in data architecture ...

workshops. o Integrating ML and AI into dashboard reporting Required o Deep knowledge of modern data architecture. o Experience within Cloud platforms (Azure, AWS, Databricks). o Strong understanding of ETL/ELT, API's and integration patterns. o Strong communication and stakeholder engagement. o 5years+ in data architecture ...

proficiency in Python for scripting, API integration, and data automation. Cloud Data Platforms: Proven experience architecting and managing modern Cloud Data Warehouses (e.g. Snowflake, Databricks or Azure Synapse). You must understand compute/storage separation and cost optimisation. Data Engineering & ETL/ELT: Experience building robust data pipelines using ...

Collaborate with stakeholders and technical teams to translate business needs into data solutions Azure Data Engineer requirements: Hands-on experience with Azure Data Factory, Databricks, and SQL-based databases Strong understanding of data engineering principles, including ELT and data modelling Experience working with CI/CD pipelines, automation, and testing ...

someone with: Proven experience as a Data Engineer or similar cloud-first data role. Expertise in Microsoft Azure data services (Data Factory, Synapse, Databricks) and Microsoft Fabric. Strong SQL skills for managing large-scale datasets. Experience integrating Microsoft Dynamics 365 data solutions. Knowledge of data modelling, warehousing, and ETL/ ...

JavaScript Machine Learning: TensorFlow, PyTorch, Scikit-learn GenAI/LLMs: OpenAI API, Hugging Face Transformers, LangChain, Langraph, RAG pipelines Data & Analytics: Pandas, NumPy, Spark, Databricks, Hadoop, Vector Databases, Snowflake Model Deployment: MLflow, FastAPI, Flask, Docker, Kubernetes Cloud & Infrastructure: AWS, Azure, GCP CI/CD pipelines (GitLab, Jenkins) Desirable Skills Experience ...

JavaScript Machine Learning: TensorFlow, PyTorch, Scikit-learn GenAI/LLMs: OpenAI API, Hugging Face Transformers, LangChain, Langraph, RAG pipelines Data & Analytics: Pandas, NumPy, Spark, Databricks, Hadoop, Vector Databases, Snowflake Model Deployment: MLflow, FastAPI, Flask, Docker, Kubernetes Cloud & Infrastructure: AWS, Azure, GCP CI/CD pipelines (GitLab, Jenkins) Desirable Skills Experience ...

related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI Platform, Databricks GenAI/BI, Snowflake GenAI, and their relevant services for building and deploying GenAI workloads. Knowledge of market insight, technology trends, and competitor intelligence Experience ...

related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI Platform, Databricks GenAI/BI, Snowflake GenAI, and their relevant services for building and deploying GenAI workloads. Knowledge of market insight, technology trends, and competitor intelligence Experience ...

doing Your focus will be on designing, building and owning cloud-native data engineering solutions, including: Leading the development of an enterprise-scale databricks platform using modern data engineering tools and frameworks Building ingestion, transformation and validation pipelines across cloud data sources, APIs and operational systems Translating data architecture into ...

modelling and data warehousing underpin this expertise Proficient in cloud services and cloud-based data engineering tools , such as AWS, Azure, Microsoft Fabric and Databricks, as well as big data technologies like Hadoop and Spark Skilled in programming languages , including Python, PySpark and Scala, with extensive experience developing robust ...

best practices - Lead cloud migration and modernization initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm ...

best practices - Lead cloud migration and modernization initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm ...