13 of 13 PySpark Jobs in Yorkshire

technical architecture and detailed design. •Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with DQ frameworks, validation rules and reconciliation logic. •Ability ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, youll be someone ...

architecture assessment, discovery, or technical review work Hands-on expertise with Azure data platforms (Databricks, Synapse, Fabric) Strong programming skills in SQL, Python, and PySpark Knowledge of streaming technologies (Kafka, Azure Event Hubs) ETL experience using Azure Data Factory Strong stakeholder management skills, including experience working with senior leadership ...

data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance … Leverage AI-assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric & Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack What's on Offer: Salary: £70,000 Excellent benefits & annual leave package Strong progression & development ...

deploying the Lakehouse platform in Azure. Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutions Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory. Creating and maintaining CI/CD pipelines and automated testing frameworks. Developing APIs to support integration Implementing monitoring … logging and alerting for platform reliability. YOUR SKILLS AND EXPERIENCE: Deep expertise in Databricks, PySpark, Python and SQL. Proven experience designing and delivering Lakehouse solutions. Strong DevOps capabilities, including CI/CD and automated testing. Experience with Infrastructure as Code and cloud automation. Familiarity with monitoring, logging and alerting ...

Databricks * Azure * Cloud Migration * PySpark * Lakehouse * Teradata Modernisation We're building a bench of top-tier Databricks and Cloud Data Engineering contractors for a series of high-impact transformation programmes across multiple UK clients. If you specialise in cloud migration, Databricks engineering, and modern data platform builds , there … involved in: Migrating enterprise data workloads from Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading ...

Databricks * Azure * Cloud Migration * PySpark * Lakehouse * Teradata Modernisation We're building a bench of top-tier Databricks and Cloud Data Engineering contractors for a series of high-impact transformation programmes across multiple UK clients. If you specialise in cloud migration, Databricks engineering, and modern data platform builds , there … involved in: Migrating enterprise data workloads from Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading ...

Databricks * Azure * Cloud Migration * PySpark * Lakehouse * Teradata Modernisation We're building a bench of top-tier Databricks and Cloud Data Engineering contractors for a series of high-impact transformation programmes across multiple UK clients. If you specialise in cloud migration, Databricks engineering, and modern data platform builds , there … involved in: Migrating enterprise data workloads from Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading ...

Databricks * Azure * Cloud Migration * PySpark * Lakehouse * Teradata Modernisation We're building a bench of top-tier Databricks and Cloud Data Engineering contractors for a series of high-impact transformation programmes across multiple UK clients. If you specialise in cloud migration, Databricks engineering, and modern data platform builds , there … involved in: Migrating enterprise data workloads from Teradata and other legacy systems into Databricks on Azure Designing and building high-performance PySpark pipelines , Delta Lake tables, and medallion architectures Developing scalable ETL/ELT workflows and optimising existing pipelines Implementing Unity Catalog , governance frameworks, and platform standards Leading ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...