1 to 25 of 111 Permanent Databricks Jobs in London

problem-solving, and communication skills Nice to Have Experience with DevOps and CI/CD pipelines. Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric. Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices. If you’re looking for a Data Engineering position that ...

. Understanding of data modeling concepts and ETL/ELT processes. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Exposure to Databricks or Spark-based environments. Experience with data governance tools and practices. Experience with JavaScript Full-Stack development environments including MongoDB or similar NoSQL databases Knowledge ...

lead technical discussions and provide guidance on data engineering best practices. Ability to troubleshoot and optimize data workflows. Required Knowledge and Skills: Experience with Databricks or Spark-based environments, including optimization strategies. Familiarity with data governance tools and frameworks (e.g., Unity Catalog). Experience with JavaScript Full-Stack development environments ...

automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled ...

development of AI/ML solutions. * MLOps practices: CI/CD, model monitoring, retraining. * Use of open-source and enterprise tools (LangChain, Azure OpenAI, Databricks). * Generative AI features: embeddings, RAG, AI agents. * Clean, testable code with modern engineering practices. * Align with enterprise architecture and governance. * Collaborate with architects ...

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

workshops. o Integrating ML and AI into dashboard reporting Required o Deep knowledge of modern data architecture. o Experience within Cloud platforms (Azure, AWS, Databricks). o Strong understanding of ETL/ELT, API's and integration patterns. o Strong communication and stakeholder engagement. o 5years+ in data architecture ...

JavaScript Machine Learning: TensorFlow, PyTorch, Scikit-learn GenAI/LLMs: OpenAI API, Hugging Face Transformers, LangChain, Langraph, RAG pipelines Data & Analytics: Pandas, NumPy, Spark, Databricks, Hadoop, Vector Databases, Snowflake Model Deployment: MLflow, FastAPI, Flask, Docker, Kubernetes Cloud & Infrastructure: AWS, Azure, GCP CI/CD pipelines (GitLab, Jenkins) Desirable Skills Experience ...

related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI Platform, Databricks GenAI/BI, Snowflake GenAI, and their relevant services for building and deploying GenAI workloads. Knowledge of market insight, technology trends, and competitor intelligence Experience ...

best practices - Lead cloud migration and modernization initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm ...

experience in data engineering roles (midsenior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches ...

best practices - Lead cloud migration and modernization initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm ...

this page. For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

Experience Required Strong experience in a senior or lead data engineering role Deep hands-on experience with Azure data services (e.g. Data Factory, Synapse, Databricks, Azure SQL, ADLS) Proven use of Terraform to provision and manage cloud infrastructure Solid understanding of data modelling, ETL/ELT patterns, and large-scale ...

would be beneficial but is by no means essential. Interested candidates must have experience in a similar role with MS Azure Data Platforms, Synapse, Databricks or other Cloud platforms such as AWS, GCP, Snowfake etc. Key Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components ...

would be beneficial but is by no means essential. Interested candidates must have experience in a similar role with MS Azure Data Platforms, Synapse, Databricks or other Cloud platforms such as AWS, GCP, Snowfake etc. Key Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components ...

Code and Kubernetes for container orchestration, ensuring efficient deployments and robust system performance. Working within Azure, you'll integrate advanced analytics platforms like Databricks and build data pipelines using Python and PySpark to support large-scale processing. The position also involves optimising data models, delivering insights through Power ...

visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems to the cloud Creating impactful dashboards and reports using Power ...

visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems to the cloud Creating impactful dashboards and reports using Power ...

with an emphasis on clarity and reliability Experience working with at least one modern cloud data platform such as GCP, AWS, Azure, Snowflake, or Databricks Experience contributing to data pipelines that run reliably in live production environments A collaborative mindset with clear, thoughtful communication and a willingness to learn from ...

Nice to Have Exposure to data engineering or analytics concepts (ETL, data modelling, analytics engineering) Familiarity with tools such as PySpark, Airflow, dbt, or Databricks Experience working with business systems (ERP, CRM, operational data) Interest in B2B SaaS, data platforms, or AI-enabled products What's On Offer Build ...

ability to explain clearly to non-technical audiences DS background that has moved into AI engineering/LLM product delivery is ideal Bonus: Databricks, Azure, MLOps/CI-CD experience Interested? Please apply below. ...

ability to explain clearly to non-technical audiences DS background that has moved into AI engineering/LLM product delivery is ideal Bonus: Databricks, Azure, MLOps/CI-CD experience Interested? Please apply below. ...

understanding of machine learning fundamentals and data workflows 💬 Strong communication skills and a collaborative mindset ⭐ Big bonus points for: ❄️ Experience with Snowflake 🧱 Experience with Databricks ⚙️ Exposure to ML pipelines, MLOps, or production ML systems If you’re excited about building AI systems, learning fast, and growing your career ...

data-driven platform used by enterprise customers. You will set technical direction and guide architecture across distributed systems, large-scale data processing (Scala, Spark, Databricks), machine learning pipelines, and cloud-native infrastructure on AWS. A core focus is driving high-quality execution through strong engineering practices including CI/ ...