1 to 25 of 147 Databricks Jobs in London

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

have most, if not all the following: Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. ...

solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model ...

Claude, Gemini, Mistral, LLaMA, Cohere Frameworks: LangChain, LlamaIndex, Haystack Tools: GitHub Copilot, Cursor, PromptLayer, Weights & Biases Cloud: Azure ML, AWS SageMaker, Google Vertex AI, Databricks Infra: Python, Docker, Kubernetes, SQL, PyTorch ...

degree in computer science, Engineering, Information Technology, or a related field • Relevant certifications in data engineering or cloud platforms (e.g., AWS, Azure, Google Cloud, Databricks) are a strong plus Technical Skills: • Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL) • Familiarity with data pipeline and workflow management tools ...

experience in data engineering, including designing and developing data pipelines for retrieval/ingestion/presentation/semantics in an Azure environment. Strong ADF, DataBricks, SQL, Python, Power BI Data acquisition from various data sources including Salesforce, API, XML, JSON, Parquet, flat file systems and relational data. Excellent team player ...

experience in data engineering roles (midsenior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches ...

data engineering roles (mid–senior level) Hands-on expertise with Azure data services such as Data Factory, Synapse and Azure SQL Experience using Databricks and Python in data processing workflows Strong SQL skills and practical knowledge of dimensional modelling and warehouse design Familiarity with CI/CD approaches for data ...

building pipelines but designing and building the framework) DevOps MLOps/LLMOps Often work with the following technologies : Azure, AWS, GCP Airflow, dbt, Databricks, Snowflake, etc. GitHub, Azure DevOps and related developer tooling and CI/CD platforms, Terraform or other Infra-as-Code MLflow, AzureML or similar for MLOps ...

Code and Kubernetes for container orchestration, ensuring efficient deployments and robust system performance. Working within Azure, you'll integrate advanced analytics platforms like Databricks and build data pipelines using Python and PySpark to support large-scale processing. The position also involves optimising data models, delivering insights through Power ...

Proficient in SQL and experienced in data modelling within cloud data warehouses.* Familiarity with cloud platforms such as AWS or Azure.* Experience with Python, Databricks, or related data engineering tools beneficial.* Excellent problem-solving and analytical skills, with strong attention to detail.* Strong communication and collaboration abilities, with the ability ...

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics … data-driven decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks ...

Azure SQL Database. ·Experience working with large datasets and complex data pipelines. ·Experience with data architecture design and data pipeline optimization. ·Proven expertise with Databricks, including hands-on implementation experience and certifications. ·Experience with SQL and NoSQL databases. ·Experience with data quality and data governance processes. ·Experience with version control ...

Experience with developing data features and associated transformation procedures on a modern data platform. Examples include (but not limited to) Azure Fabric, AWS Lakeformation, Databricks or Snowflake. Experience automating operations tasks with one or more scripting languages. Due to the nature of the project and the short turnaround required ...

Experience with developing data features and associated transformation procedures on a modern data platform. Examples include (but not limited to) Azure Fabric, AWS Lakeformation, Databricks or Snowflake. Experience automating operations tasks with one or more scripting languages. Due to the nature of the project and the short turnaround required ...

reliability. Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance, security ...

core of their platform. Projects include forecasting, recommendation systems and classification tools. Key Responsibilities Build ML and GenAI solutions in Python, using Databricks, Kafka and AWS Deploy and maintain algorithms in a microservices environment Lead on automation, monitoring, version control and MLOps best practice Support knowledge sharing across ...

core of their platform. Projects include forecasting, recommendation systems and classification tools. Key Responsibilities Build ML and GenAI solutions in Python, using Databricks, Kafka and AWS Deploy and maintain algorithms in a microservices environment Lead on automation, monitoring, version control and MLOps best practice Support knowledge sharing across ...

small, focused team, contributing directly to strategic data initiatives. Candidate Profile: The ideal candidate will have: Significant experience in Data Engineering , particularly with Azure, Databricks, and Delta Lake . Proficiency in Kubernetes, Infrastructure as Code, and Terraform . Strong understanding of Azure DevOps and software engineering best practices. A passion ...

dimensional modelling standards, is essential to the role. Technical experience building and deploying models and reports utilizing the following tools: PySpark Microsoft Fabric or Databricks Power BI Git CI/CD pipelines (Azure DevOps experience preferred) An understanding of the structure and purpose of the Financial Advice and Wealth Management ...

experience with modern ML/AI libraries such as scikit-learn, TensorFlow or PyTorch Familiarity with MLOps , model deployment and cloud platforms such as Databricks, AWS or Azure It would be great if you had: Experience working with customer contact centres , operations, workforce planning or service environments Experience analysing channel ...

Extensive experience in AI/ML algorithms, statistical modeling, and scalable data processing pipelines, with a strong background in modern data platforms (e.g., Snowflake, Databricks), cloud-based technologies, data mesh architectures, and big data ecosystems. Experience with A/B experimentation, data- and metric-driven product development, cloud-native deployment ...

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics … data-driven decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows ...

Experience Strong leadership and relationship-building skills. Experience guiding or managing technical teams. Deep hands-on experience in Data Engineering using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in SQL and Python for ETL/ELT development. Knowledge of data lakes, medallion lakehouse architecture ...

Experience Strong leadership and relationship-building skills. Experience guiding or managing technical teams. Deep hands-on experience in Data Engineering using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in SQL and Python for ETL/ELT development. Knowledge of data lakes, medallion lakehouse architecture ...