23 of 23 Databricks Jobs in Berkshire

based architecture, with curated dimensional models in the gold layer built for analytical use Strong understanding and or use of unity catalog alongside core databricks functionality to drive metadata management Strong understanding of cloud economics, including cost management strategies and optimising solutions for customer needs.Experience with infrastructure as code, proficiency ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

reliability. Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance, security ...

Expert SQL and strong Python or R skills. Proven experience with Tableau/Power BI/Looker/Qlik and modern cloud platforms (Snowflake, Databricks, Spark). Strong understanding of statistical methods, experiment design, and ML/AI concepts (preferred). Experience with call centre or digital support KPIs ...

communicating insights effectively. •Familiarity with MLOps frameworks, CI/CD pipelines, and model deployment. •Good knowledge of cloud-based data platforms (e.g. AWS, Databricks, Azure) •Knowledge of data governance and ethical AI principles. •Excellent communication skills, with the ability to translate technical results into business impact. •The ability to explain ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design … develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations ...

ESRI ArcGIS, Power BI, and FME, Excel. Knowledge of wastewater industry, capability in additional geospatial tools, analytical tools and data management (e.g. Python, SQL, Databricks, Azure Data Factory) will be beneficial. Proven ability to produce detailed management reports. High attention to detail with the ability to understand the wider business ...

Experience working with Python, C#, and Angular. Strong interpersonal, communication, and presentation skills applicable to a wide audience. Experience with PyTorch, Scikit-learn, Go, Databricks, JavaScript, and Azure Pipelines is desirable, but not essential. Experience in leading software engineering efforts for AI-enabled SaaS products is desirable, but not essential. ...

across the entire data ecosystem. Essential tech skills include proficiency in Python, Spark, and Airflow, alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery. Familiarity with data transformation and infrastructure as code tools like dbt, Fivetran, and Terraform is highly beneficial. Experience with one or more major ...

Integration: Collaborate with Technology and Finance teams to align data across platforms, ensuring migrations are executed right first time and leveraging modern tools (e.g., Databricks, Datasphere, Purview). Insight & Reporting Enablement: Partner with BI teams to surface unified, reconciled data models that support both management and statutory reporting. Capability Building ...

working in a fast-paced, collaborative environment with strategic and operational responsibilities. Experience with vendor management and contract oversight. Familiarity with tools such as Databricks, Tecton (or Feast), Seldon, or SageMaker. What can they offer you? Private health and mental wellbeing coverage, including access to counselling and coaching. Salary ...

need to have experience with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft … Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark ...

need to have experience with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft … Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark ...

Develop and deploy advanced analytics, data science, and machine learning solutions across a variety of use cases. Use technologies such as Python, R, Azure, Databricks, SQL, Power BI, and Tableau to extract actionable insights from complex datasets. Contribute to the design and implementation of scalable data science workflows and best … deep learning techniques (e.g., TF-IDF, word embeddings, CNNs, RNNs). Familiarity with generative AI and prompt engineering. Experience with Azure Databricks, MLflow, Azure ML services, Docker, or Kubernetes. Exposure to Agile development environments and software engineering best practices. Experience working in large, complex organisations or regulated industries. Strong working ...

pipelines, architecture, and analytics environments are reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability … using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake ...

Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve … many different sectors. What We're Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices ...

Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve … many different sectors. What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices ...

aligns with long-term objectives. In this Senior Data Engineering role, you'll design, develop, and maintain data platforms using technologies such as Snowflake, Databricks, Synapse/Fabric, and PySpark, ensuring the scalability, security, and performance of all data systems. As the Senior Data Engineer your role will … that support efficient and reliable data processing. Key Responsibilities of the Senior Data Engineer: Solid grasp of modern data engineering concepts and workflows. Strong Databricks experience Familiarity with Azure and related DevOps tools. Strong Python programming capability. Knowledge of data orchestration, pipeline development, and data modelling. Background in connecting data ...

days per week onsite What you'll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance … What you'll need: Proven experience as a Data Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people ...

DataOps Engineer working in Azure-based data platforms, supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies … artifact management, automated testing, and environmental promotion workflows. Expert-level knowledge of Terraform for provisioning Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking ...

Our client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines ...

Senior Data Scientist - Recommender Systems Experience Salaries in the region of £65,000 - £75,000 DoE Hybrid working - 2 days central London office Job Reference J13031 Full UK working rights required/no sponsorship available ...

Director of Consulting, Practice Lead, London, £160k-£220k base dependant on experience, Consulting experience is needed, Snowflake, Databricks, GCP We're hiring a Data Director in London to lead growth, sales and client delivery across complex, high value data engagements. This is a senior leadership role for someone who enjoys ...