1 to 25 of 52 Databricks Jobs in the North of England

Senior Data Engineer Responsibilities: Design, build, and maintain scalable, cloud-based data pipelines using Microsoft technologies such as Azure Data Factory, Azure Synapse, Databricks, and Microsoft Fabric Define and promote best practices around data architecture, governance, security, and quality Develop and optimise ETL/ELT processes to support reporting, analytics ...

consulting environment (or strong desire to develop this) Ambition to move into team leadership/people management Nice to have: Experience with PySpark/Databricks Experience with streaming technologies like Kafka or AWS Kinesis Knowledge of data governance and quality frameworks ...

develop and optimise coding in SQL and python Experience in creating data pipelines using Cloud (preferably Azure Data Factory) Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture Experience in CI/CD pipelines and monitoring Able to work with large datasets and extrapolate conclusions Strong analytical and critical thinking ...

Large-scale streaming and event-driven data platforms Modern data architectures such as medallion and domain-oriented patterns Enterprise data platforms such as Databricks, Snowflake, or equivalent CI/CD pipelines and Infrastructure-as-Code practices Client-facing delivery within regulated and security-conscious environments Engineering teams delivering real-time ...

years designing, implementing and managing cloud-based architectures such as AWS, Azure or GCP, and hands-on experience with modern data solutions like Snowflake, Databricks, BigQuery, Synapse or others.* Certifications & Technical Depth: At least 3 intermediate-level cloud certifications and expertise in cloud-native AI data architectures.* Infrastructure & Automation: Proficiency ...

semantic layers Hands-on dashboard development using Tableau, Power BI, Looker, ThoughtSpot or similar tools Experience with enterprise data platforms such as Snowflake, Databricks or BigQuery Proficiency in Python or similar scripting languages for analytics, automation or data manipulation Experience implementing CI/CD pipelines using Git, automated testing ...

environment (HealthTech, MedTech, or related sectors preferred) Strong SQL and Python (or similar programming languages) Hands-on experience with modern data platforms (e.g. Snowflake, Databricks, BigQuery, Redshift) Experience working with cloud technologies (AWS, Azure, or GCP) Solid understanding of data modelling, warehousing, and pipeline development Experience handling sensitive or regulated ...

distributed systems, microservices, and performance optimisation Experience with CI/CD, Git, and modern software engineering practices Nice to Have Exposure to platforms like Databricks, Snowflake, or BigQuery Experience in consulting or client-facing environments Cloud or data engineering certifications Experience mentoring or supporting junior engineers ...

Teams, and OneDrive Desirable Experience with data governance, standards, or quality frameworks Exposure to modern data platforms such as Fabric, Azure Data Factory, or Databricks Scripting or analytical experience using Python or R Experience supporting organisations moving away from manual or spreadsheet-driven reporting ...

travel between Trust sites Desirable: Knowledge of data governance and data quality frameworks Familiarity with modern data platforms (e.g., Microsoft Fabric, Data Factory, Databricks) Experience supporting digital transformation initiatives Experience with Python or R for data analysis or transformation Experience building deployment pipelines in Microsoft 365 environment We recognise ...

skills AWS or GCP (NOT Azure) Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform BENEFITS The successful Senior Data Engineer will receive the following benefits: Salary between £80,000 - £100,000 - depending on experience HOW TO APPLY Please register your ...

Trees, Random Forests, Neural Nets and Clustering Experience in DevOps and Azure ML, or other MLOps and ML Lifecycle technology stacks, such as AWS, Databricks, Google Cloud, etc. Experience with deploying services in Docker and Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development ...

business stakeholders to understand reporting and insight needs Breaking down ambiguous or complex problems into clear, logical steps Manipulating and preparing data using Python (Databricks environment) Working within existing DevOps code repositories Contributing to a trusted “gold layer” of standardised data Producing insight that feeds into Power BI dashboards Partnering ...

teams, and external partners (Microsoft) to ensure high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 … OneLake governance •Ability to translate business requirements into technical architecture and detailed design. •Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with ...

prepared effectively for reporting use cases * Deliver clear, actionable insights to support business performance Experience Required * Strong experience in Power BI, SQL and Databricks * End-to-end BI experience (data preparation, ETL, visualisation) * Ability to work independently and take ownership of delivery * Strong understanding of data processes and business context ...

link between data and the business. Responsibilities include: Translating business questions into structured data problems Manipulating and preparing data using Python in a Databricks environment Working within shared DevOps code repositories Supporting the creation of high quality, standardised datasets Delivering insights through Power BI dashboards and reports Working closely with ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

providing technical guidance and translating complex information for non-technical stakeholders. Maintain expertise in Pricing and Data Science tools (e.g., WTW Radar, SQL, Python, Databricks) while staying current with market and technological trends to drive innovation and optimise pricing infrastructure. What will help you stand out? Demonstrates excellent numerical ...

more CSPs or third-party vendor technologies, including Google PaLM and Vertex AI, Azure OpenAI Services and AzureML, AWS Bedrock and Sagemaker, Dataiku, Databricks, Snowflake SnowPark and Snowflake Cortex, Data Robot. Experience in architecting scalable, performant & cost optimized AI/ML solutions leveraging; serverless technologies, container/Kubernetes based deployments ...

across multiple locations and time zones Knowledge of AI/ML frameworks: LangChain, Anthropic Claude, AWS Bedrock, GitHub Copilot Experience with modern data platforms: Databricks, Snowflake, dbt Background in DevSecOps or platform engineering £120,000 - £130,000 a year Sounds like you? We at PEXA are ready so if this ...

curation layers Data access and productisation Ability to design for large-scale datasets. Experience supporting cloud migrations Knowledge and experience with Azure & Microsoft Fabric & Databricks would be beneficial Familiarity with event-driven and streaming-first architectures at scale. Strong stakeholder engagement and cross-team collaboration skills. Ability to operate effectively ...

look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester. Responsibilities: Work closely with cross-functional teams to design, develop … implement Databricks solutions. Manage and optimise the performance of Databricks clusters. Collaborate with stakeholders to gather requirements and provide technical guidance. Troubleshoot and resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. ...

implement existing ELT pipelines Skills and Experience: Essential to have 3+ years experience in: SQL Python DBT Cloud techs such as Snowflake, BigQuery or Databricks Dimensional Modelling such as Kimball Desirable to have experience with: CI/CD pipelines Kafka; real-time streaming Snowflake as a data warehouse Interview Process ...

Palantir Foundry or similar data and analytics platforms. Desirable experience on projects involving AWS‐hosted data platforms . Desirable experience working with or alongside Databricks‐based data solutions . Familiarity with healthcare or population health data use cases. Awareness of data standards and interoperability concepts (e.g. FHIR). Experience supporting ...

ownership of cloud provisioning, governance and lifecycle management • Expertise in identity and access management • Solid understanding of Docker, Kubernetes and container orchestration • Experience with Databricks and modern cloud based data platforms • Advanced CI/CD and Git based workflow knowledge • Strong monitoring experience (Grafana, Elastic, Datadog) • A mindset focused ...