16 of 16 Databricks Jobs in South Yorkshire

experience in programming languages such as Python or Java. Experience with the Microsoft Azure ecosystem is essential, including proficiency with Azure Data Factory and Databricks, as these tools are integral to managing data within the UDAL platform. Data Quality and Governance: Experience in implementing data quality controls, data cleansing routines More ❯

will include, but are not limited to: Designing, building, and optimizing high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks, or Microsoft Fabric. Implementing scalable solutions to ingest, store, and transform large datasets, ensuring data quality and availability. Writing clean, efficient, and reusable Python code More ❯

include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and quality across the organization. Write clean, efficient, and More ❯

architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership More ❯

architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership More ❯

to consolidate data from multiple sources into the central data warehouse. Working with a fully cloud-based Azure ecosystem (including Azure Data Factory and Databricks). Exploring opportunities to integrate AI/ML tools to drive innovation and business growth. What’s in It for You: Salary up to More ❯

to consolidate data from multiple sources into the central data warehouse. Working with a fully cloud-based Azure ecosystem (including Azure Data Factory and Databricks). Exploring opportunities to integrate AI/ML tools to drive innovation and business growth. What’s in It for You: Salary up to More ❯

of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change. We are also a Databricks partner and an IBM Gold Partner, specialising in Cognos Analytics and Planning Analytics. With offices in York and Sheffield, and a team based throughout the More ❯

Experience in implementing data governance, including data cataloging, data lineage tracking, and metadata management to ensure data accuracy, accessibility, and compliance. Preferred: Experience with Databricks Understanding of how data platforms interact with marketing and customer engagement platforms. Knowledge of service-oriented architecture, including exposing and consuming data via APIs, streams More ❯

and optimize data models, warehouse solutions, and ETL processes. Work with Scala, Spark, and Java to handle large-scale data processing. Contribute to manual Databricks-like data processing solutions. Requirements: Minimum of 4 years of experience with Scala, Spark, and Java. Strong technical skills and a passion for working with More ❯

and optimize data models, warehouse solutions, and ETL processes. Work with Scala, Spark, and Java to handle large-scale data processing. Contribute to manual Databricks-like data processing solutions. Requirements: Minimum of 4 years of experience with Scala, Spark, and Java. Strong technical skills and a passion for working with More ❯

Manager in reporting, analytics, or data-driven projects. Experience using data and insights to inform product development and knowledge of data platforms (e.g. Salesforce, Databricks). Proven ability to prioritise business requirements and manage cross-functional teams. Experience communicating product updates, milestones, and progress to internal and external partners. Familiarity More ❯

deliver modern data platforms for large organizations. Expect variety – you’ll work across cloud platforms like Azure, AWS, and GCP, leveraging tools such as Databricks, Data Factory, Synapse, Kafka, Glue, Redshift, BigQuery, and more. About You You’re an engineer at heart, with a passion for building efficient, scalable data … computing, and workflow automation. Expertise in Git/version control and DataOps principles. Strong experience with Azure tools, Power BI, or PowerShell. Key Skills : Databricks, Azure Data Factory, Python, SQL, Medallion Architecture, ETL, Git/version control, Azure Synapse, Power BI. #J-18808-Ljbffr More ❯

days/week from Sheffield) We are looking for a Senior Data Engineer with hands-on expertise in SQL/BigQuery migration , Azure Databricks , and Spark SQL , who also brings team leadership experience and thrives in Agile/SAFe/Scrum environments. Key Responsibilities: Lead and contribute to a small … working on a cross-cloud data migration project. Migrate complex BigQuery SQL transformations to Spark SQL on Azure. Build & execute ETL workflows using Azure Databricks and Python. Drive automation of SQL workflows and artefact migration across cloud providers. Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization. More ❯

Social network you want to login/join with: Principal Data and AI Engineer, doncaster col-narrow-left Client: Location: doncaster, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 07.06.2025 Expiry More ❯

Social network you want to login/join with: Principal Data and AI Engineer, sheffield, south yorkshire col-narrow-left Client: Location: sheffield, south yorkshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views More ❯