Databricks Job Vacancies

701 to 725 of 1,893 Databricks Jobs

Senior Data Engineer (FTC)

City of London, England, United Kingdom
Hybrid / WFH Options
JR United Kingdom
an experienced Azure Data Engineer to play a key role in delivering the next phase of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and optimise scalable data solutions using … Azure cloud technologies. Lead the development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering solutions. Collaborate closely with business stakeholders to ensure alignment with project goals. Maintain detailed documentation and ensure robust testing practices. Plan and manage progress in … Agile sprints alongside project managers and scrum masters. Requirements: Extensive experience in Azure data engineering, with strong expertise in Databricks, Azure SQL, and Data Factory. Deep technical knowledge of SQL Server including stored procedures and complex data transformation logic. Proven experience in designing and delivering data warehousing and dimensional modelling solutions. Excellent collaboration skills with a track record of working More ❯
Posted:

DevOps Engineer -Aure - Outisde IR35 - 6 Month Contract

London, United Kingdom
Wenham Carter
with data engineering teams to design and implement a cloud-based data lake architecture on Azure. Automate data pipeline deployments and integrations using Azure services (e.g., Data Factory, Synapse, Databricks). Ensure high availability, scalability, and security across cloud environments. Monitor infrastructure performance and implement logging, monitoring, and alerting solutions (Azure Monitor, Log Analytics). Collaborate with cross-functional teams … in scripting languages such as PowerShell , Bash , or Python . Experience with CI/CD tools, especially Azure DevOps Pipelines . Familiarity with Azure services: Data Factory, Synapse Analytics, Databricks, Key Vault, Event Hub . Understanding of security best practices and compliance in cloud environments. Excellent troubleshooting, analytical, and communication skills. More ❯
Employment Type: Contract
Rate: Up to £350 per day
Posted:

Machine Learning Operations Engineer

Bristol, Gloucestershire, United Kingdom
Hybrid / WFH Options
Somerset Bridge
for the platform, developing API services, and ensuring the integration of ML models into the live environment. What you'll be responsible for: Develop and maintain API services using Databricks and Azure. Implement and manage Azure Cache (Redis) and Azure Redis. Utilize Databricks Delta Live tables for data processing and analytics. Integrate the platform with Snowflake for data storage and … and deployment. What you'll need: Experience in ML Ops engineering, with a focus on Azure and Databricks. Knowledge of Postgres, Azure Cache (Redis) and Azure Redis. Experience with Databricks Delta Live tables and Snowflake. Experience in Data (Delta) Lake Architecture. Experience with Docker and Azure Container Services. Familiarity with API service development and orchestration. Strong problem-solving skills and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Machine Learning Operations Engineer

Bristol, England, United Kingdom
Hybrid / WFH Options
Somerset Bridge
for the platform, developing API services, and ensuring the integration of ML models into the live environment. What you'll be responsible for: Develop and maintain API services using Databricks and Azure. Implement and manage Azure Cache (Redis) and Azure Redis. Utilize Databricks Delta Live tables for data processing and analytics. Integrate the platform with Snowflake for data storage and … and deployment. What you'll need: Experience in ML Ops engineering, with a focus on Azure and Databricks. Knowledge of Postgres, Azure Cache (Redis) and Azure Redis. Experience with Databricks Delta Live tables and Snowflake. Experience in Data (Delta) Lake Architecture. Experience with Docker and Azure Container Services. Familiarity with API service development and orchestration. Strong problem-solving skills and More ❯
Posted:

Senior Data Engineer

Nottingham, England, United Kingdom
Hybrid / WFH Options
ZipRecruiter
Job Description Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially a … one day a week based in their Nottingham office, negotiable. It is a full-time role, 37 hours per week. Accountabilities: Develop and maintain scalable, efficient data pipelines within Databricks, evolving them as requirements and technologies change. Build and manage an enterprise data model within Databricks. Integrate new data sources into the platform using batch and streaming processes, adhering to … Knowledge and Skills: Extensive experience with Python, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions. Strong understanding of SQL, database design, and data architecture. Experience with Databricks and/or Spark. Knowledge of data governance, data cataloguing, data quality principles, and related tools. Skilled in data extraction, joining, and aggregation tasks, especially with big data and real More ❯
Posted:

Data & AI Engineer

United Kingdom
Hybrid / WFH Options
Cloud Decisions
Responsibilities: Design, build, and optimise Azure-native data solutions for customer projects Develop scalable pipelines across ingestion, transformation, and modelling layers Leverage tools such as Azure Data Factory, Synapse, Databricks, and Azure Storage Work with architects and consultants to shape data solutions that enable AI/ML services Contribute to the development of AI-ready platforms Tech Stack & Skills: Strong … experience across the Azure Data Platform: ADF, Synapse, Azure Data Lake, Fabric Solid working knowledge of Databricks (including Photon, Delta Lake) Proficient in Python, SQL, and PySpark Exposure to Azure AI Foundry, Azure OpenAI, and related Azure AI tooling Comfortable working remotely in a fast-paced, consulting-style environment This is a great opportunity to join a Microsoft Partner who More ❯
Posted:

Azure Data Architect - Hospitality

England, United Kingdom
Hamilton Barnes Associates Limited
body. Produce both high-level and low-level design documentation, following established cloud design patterns and architectural standards. Lead the implementation of Lakehouse architecture using tools such as Azure Databricks, ensuring scalable and efficient data solutions. Design logical and physical data models to support accurate, performant, and user-friendly reporting and analytics. Assess data and analytics tools against project requirements … and delivering Azure-based data solutions, with a minimum of 5 years' hands-on experience in Azure implementations. Strong technical expertise across key Azure services, including Azure Data Factory, Databricks, Data Lake, Delta Lake, Synapse Analytics, Power BI, Key Vault, Automation Account, PowerShell, SQL Database, and broader Big Data platforms. Comprehensive understanding of the Azure ecosystem and its architectural components More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Platform Engineer

Manchester, England, United Kingdom
Hays
Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance … maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar with Cloud security, performance optimisation and monitoring tools (Azure Monitor, Log Analytics More ❯
Posted:

Python Developer - ETRM

London Area, United Kingdom
Vallum Associates
Design, develop, and maintain data transformation solutions using Python. Design, develop and maintain web api solution based on Streamlit. Work with Azure Data Factory (ADF), Data Lake, Snowflake, and Databricks to manage and transform data. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Ensure data quality and integrity throughout the data transformation process. … Design, develop, and maintain robust and scalable applications using Python, Streamlit, and Kafka. Implement and manage data pipelines using Azure Data Factory (ADF), Data Lake, and Snowflake. Work on Databricks for data processing and analytics. Collaborate with cross-functional teams to understand business requirements and deliver high-quality solutions. Ensure seamless integration with trading systems like Allegro, RightAngle, Endur, etc. More ❯
Posted:

Python Developer - ETRM

City of London, London, United Kingdom
Vallum Associates
Design, develop, and maintain data transformation solutions using Python. Design, develop and maintain web api solution based on Streamlit. Work with Azure Data Factory (ADF), Data Lake, Snowflake, and Databricks to manage and transform data. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Ensure data quality and integrity throughout the data transformation process. … Design, develop, and maintain robust and scalable applications using Python, Streamlit, and Kafka. Implement and manage data pipelines using Azure Data Factory (ADF), Data Lake, and Snowflake. Work on Databricks for data processing and analytics. Collaborate with cross-functional teams to understand business requirements and deliver high-quality solutions. Ensure seamless integration with trading systems like Allegro, RightAngle, Endur, etc. More ❯
Posted:

Data Platform Engineer

Manchester, Lancashire, England, United Kingdom
Hays Specialist Recruitment Limited
Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance … maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar with Cloud security, performance optimisation and monitoring tools (Azure Monitor, Log Analytics More ❯
Employment Type: Full-Time
Salary: £55,000 - £60,000 per annum
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Mars
transformation journey where your work will unlock real impact. 🌟 What you'll do Build robust data pipelines using Python, PySpark, and cloud-native tools Engineer scalable data models with Databricks, Delta Lake, and Azure tech Collaborate with analysts, scientists, and fellow engineers to deliver insights Drive agile DevOps practices and continuous improvement Stay curious, keep learning, and help shape our … digital platforms 🧠 What we’re looking for Proven experience as a Data Engineer in cloud environments (Azure ideal) Proficiency in Python, SQL, Spark, Databricks Familiarity with Hadoop, NoSQL, Delta Lake Bonus: Azure Functions, Logic Apps, Django, CI/CD tools 💼 What you’ll get from Mars A competitive salary & bonus Hybrid working with flexibility built in Access to Mars University More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Mars
transformation journey where your work will unlock real impact. 🌟 What you'll do Build robust data pipelines using Python, PySpark, and cloud-native tools Engineer scalable data models with Databricks, Delta Lake, and Azure tech Collaborate with analysts, scientists, and fellow engineers to deliver insights Drive agile DevOps practices and continuous improvement Stay curious, keep learning, and help shape our … digital platforms 🧠 What we’re looking for Proven experience as a Data Engineer in cloud environments (Azure ideal) Proficiency in Python, SQL, Spark, Databricks Familiarity with Hadoop, NoSQL, Delta Lake Bonus: Azure Functions, Logic Apps, Django, CI/CD tools 💼 What you’ll get from Mars A competitive salary & bonus Hybrid working with flexibility built in Access to Mars University More ❯
Posted:

Senior Data Scientist

Liverpool, UK
Tenth Revolution Group
Discretionary bonus scheme And many more Role and Responsibilities Design and deliver data science solutions that drive business outcomes Lead the development of predictive and optimisation models using Python, Databricks, and GCP Enhance the businesses AI and ML capabilities to modernise the data platform Collaborate with stakeholders to understand their goals and ensure analytics work is aligned to practical business … the data science function Requirements Experience in a data science leadership position Expert use of Python, PySpark, and PyTorch Strong experience with AI and ML best practice and development Databricks and GCP experience Strong business and commercial acumen Excellent stakeholder management My client have already began holding interviews for this role. So if you’re interested, get in touch ASAP More ❯
Posted:

Solutions Architect (Data Analytics)

City of London, Greater London, UK
Vallum Associates
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools More ❯
Posted:

Solutions Architect (Data Analytics)

London, England, United Kingdom
ZipRecruiter
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools #J-18808-Ljbffr More ❯
Posted:

Senior Data Engineer

London, England, United Kingdom
Skipton Building Society
our Data Strategy by transitioning from traditional on-premises infrastructure to a cloud-based architecture. Contributing to our cloud-native Data Platform using Microsoft Azure technologies such as Azure Databricks, Azure Data Factory, and dbt. Collaborating with Data Engineers, Analysts, and other colleagues to deliver trusted data solutions that meet organizational needs. Participating in process improvements, innovation, and Agile delivery … ELT solutions. Experience with Enterprise Data Warehouses, data analysis, testing, and release management. Understanding of Agile methodologies, CI/CD tools, and full software development lifecycle. Proficiency with Azure Databricks, Data Factory, Storage, Key Vault, Git, SQL (Spark SQL), and Python (PySpark). Certifications: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900). Curiosity about technology, adaptability, agility, and More ❯
Posted:

Pyspark Data Engineer

London, England, United Kingdom
iO Associates - UK/EU
Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and ensure code quality with Python Coverage. * Collaborate with cross-functional teams and … workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage), and CI/CD pipelines. * Knowledge of More ❯
Posted:

Solutions Architect (Data Analytics)- Presales, RFP creation

London, UK
Vallum Associates
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools Priyanka Sharma Senior Delivery Consultant Office: 02033759240 Email: psharma@vallumassociates.com More ❯
Posted:

Solutions Architect (Data Analytics)- Presales, RFP creation

City of London, London, United Kingdom
Vallum Associates
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools Priyanka Sharma Senior Delivery Consultant Office: 02033759240 Email: psharma@vallumassociates.com More ❯
Posted:

Senior Cloud and Data Architect (Pre Sales)

City of London, London, United Kingdom
Gazelle Global
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF. Preferred Skills : Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools. Note : This is a senior-level, in-house opportunity focused on Data Architecture, Cloud technologies, and More ❯
Posted:

Senior Cloud and Data Architect (Pre Sales)

London Area, United Kingdom
Gazelle Global
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF. Preferred Skills : Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools. Note : This is a senior-level, in-house opportunity focused on Data Architecture, Cloud technologies, and More ❯
Posted:

Data Engineer with Security Clearance

Elkridge, Maryland, United States
Thomas & Moore Strategic Ventures, LLC
degree or equivalent; 10+ years of professional experience; Additional experience will be considered in lieu of a degree - Active TS/SCI with with CI Polygraph - Specialization using the Databricks platform for building, deploying, and managing data and AI solutions - Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL - Experience … with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows - Experience collaborating with data scientists - Familiarity with Advana - Strong Python programming skills - Solid SQL knowledge for querying and data manipulation - Cloud platform experience, such as AWS, Azure, etc. TMSV is an Equal Employment Opportunity/Affirmative Action Employer that treats all employees and applicants equally without discrimination because of More ❯
Employment Type: Permanent
Salary: USD 135,000 Annual
Posted:

Senior Cloud and Data Architect

London, England, United Kingdom
ZipRecruiter
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Azure, Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF. Skills : Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools. Note : This is a senior-level, in-house opportunity focused on Data Architecture, Cloud technologies, and More ❯
Posted:

Senior Cloud and Data Solution Architect

London Area, United Kingdom
Coforge
z2bz0 years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth … Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills: Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools More ❯
Posted:
Databricks
10th Percentile
£45,750
25th Percentile
£57,500
Median
£77,500
75th Percentile
£97,500
90th Percentile
£113,250