20 of 20 Databricks Jobs in Sheffield

experience in programming languages such as Python or Java. Experience with the Microsoft Azure ecosystem is essential, including proficiency with Azure Data Factory and Databricks, as these tools are integral to managing data within the UDAL platform. Data Quality and Governance: Experience in implementing data quality controls, data cleansing routines More ❯

include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and quality across the organization. Write clean, efficient, and More ❯

and Experience Degree (BSc, MSc, or PhD) in Computer Science, Mathematics, or a related field. Familiarity with alternative cloud and data platforms such as Databricks, Snowflake, Azure, or AWS. Knowledge of DevOps/DataOps methodologies and experience with CI/CD pipelines. Understanding of monitoring, logging, and troubleshooting in cloud More ❯

organisations, through e.g. the RFI/RFP process, as preferred bidder, documented bids and face to face presentations. Experience of data science platforms (e.g. Databricks, Dataiku, AzureML, SageMaker) and machine learning frameworks (e.g. Keras, Tensorflow, PyTorch, scikit-learn) Cloud platforms – demonstrable experience of building and deploying solutions to Cloud (e.g. More ❯

systems Qualifications & Skills: x5 + experience with Python programming for data engineering tasks Strong proficiency in SQL and database management Hands-on experience with Databricks and Apache Spark Familiarity with Azure cloud platform and related services Knowledge of data security best practices and compliance standards Excellent problem-solving and communication More ❯

architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership More ❯

challenges and craft tailored solutions using Microsoft Fabric. Lead the design of cutting-edge data architectures that integrate tools like Azure Synapse, Data Factory, Databricks, and Power BI. Drive end-to-end solution delivery—from concept to deployment—ensuring performance, scalability, and seamless integration. Build intelligent data models and pipelines More ❯

to consolidate data from multiple sources into the central data warehouse. Working with a fully cloud-based Azure ecosystem (including Azure Data Factory and Databricks). Exploring opportunities to integrate AI/ML tools to drive innovation and business growth. What’s in It for You: Salary up to More ❯

of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change. We are also a Databricks partner and an IBM Gold Partner, specialising in Cognos Analytics and Planning Analytics. With offices in York and Sheffield, and a team based throughout the More ❯

on experience with ML frameworks (PyTorch, TensorFlow, Keras). Proficiency in Python and C/C++. Experience with scalable data tools (e.g., PySpark, Kubernetes, Databricks, Apache Arrow). Proven ability to manage GPU-intensive data processing jobs. 4+ years of applied research or industry experience. Creative problem-solver with a More ❯

and optimize data models, warehouse solutions, and ETL processes. Work with Scala, Spark, and Java to handle large-scale data processing. Contribute to manual Databricks-like data processing solutions. Requirements: Minimum of 4 years of experience with Scala, Spark, and Java. Strong technical skills and a passion for working with More ❯

Manager in reporting, analytics, or data-driven projects. Experience using data and insights to inform product development and knowledge of data platforms (e.g. Salesforce, Databricks). Proven ability to prioritise business requirements and manage cross-functional teams. Experience communicating product updates, milestones, and progress to internal and external partners. Familiarity More ❯

deliver modern data platforms for large organizations. Expect variety – you’ll work across cloud platforms like Azure, AWS, and GCP, leveraging tools such as Databricks, Data Factory, Synapse, Kafka, Glue, Redshift, BigQuery, and more. About You You’re an engineer at heart, with a passion for building efficient, scalable data … computing, and workflow automation. Expertise in Git/version control and DataOps principles. Strong experience with Azure tools, Power BI, or PowerShell. Key Skills : Databricks, Azure Data Factory, Python, SQL, Medallion Architecture, ETL, Git/version control, Azure Synapse, Power BI. #J-18808-Ljbffr More ❯

days/week from Sheffield) We are looking for a Senior Data Engineer with hands-on expertise in SQL/BigQuery migration , Azure Databricks , and Spark SQL , who also brings team leadership experience and thrives in Agile/SAFe/Scrum environments. Key Responsibilities: Lead and contribute to a small … working on a cross-cloud data migration project. Migrate complex BigQuery SQL transformations to Spark SQL on Azure. Build & execute ETL workflows using Azure Databricks and Python. Drive automation of SQL workflows and artefact migration across cloud providers. Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization. More ❯

Social network you want to login/join with: Software Tech Lead - Python, Databricks, Cloud, sheffield, south yorkshire col-narrow-left Client: IC Resources Location: sheffield, south yorkshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 04.06.2025 Expiry Date: 19.07.2025 col … projects, ensuring alignment with broader company objectives and vision. Extensive hands-on software engineering background, primarily based around their core data capabilities of Python, Databricks, AWS, Azure. Ideally, you will have a background of working within data analytics/data intelligence organisations. Strong experience designing, building, and supporting infrastructure in More ❯

/Dependent visa (No Visa sponsorship) We are looking for a Senior Data Engineer with hands-on expertise in SQL/BigQuery migration , Azure Databricks , and Spark SQL , who also brings team leadership experience and thrives in Agile/SAFe/Scrum environments. Key Responsibilities: Lead and contribute to a … working on a cross-cloud data migration project. Migrate complex BigQuery SQL transformations to Spark SQL on Azure. Build & execute ETL workflows using Azure Databricks and Python. Drive automation of SQL workflows and artefact migration across cloud providers. Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization. More ❯

experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark … spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools #J-18808-Ljbffr More ❯

Social network you want to login/join with: Principal Data and AI Engineer, sheffield, south yorkshire col-narrow-left Client: Location: sheffield, south yorkshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views More ❯

an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks an advantage. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In this lead role … an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks an advantage. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In this lead role … skills and experience please send your CV for a full brief. Desired Skills and Experience Lead Data Engineer Hands-on ETL SQL Data Warehousing Databricks #J-18808-Ljbffr More ❯

Single source of truth) Location: Remote Duration: 6months Start Date: ASAP We’re looking for an experienced Project Manager to lead a high-impact Databricks migration project, consolidating data from multiple platforms into a single source of truth. This is a critical programme for our business, and we need someone … hit the ground running. What you’ll be doing: Leading the end-to-end migration of a number of data platforms to our new Databricks platform, working with multiple data teams and stakeholders. Managing timelines, risks, and dependencies across different data sources and platforms. Ensuring clear communication and alignment across … business teams. Delivering a robust, scalable single data environment that underpins strategic decision-making. Proven experience delivering data migration or modernisation projects, ideally involving Databricks or similar cloud-based platforms. Strong project management skills – you’re comfortable owning delivery and keeping complex programmes on track. Ability to engage technical and More ❯