PySpark Jobs in Leeds

3 of 3 PySpark Jobs in Leeds

Principal Data Engineer/Architect

Leeds, West Yorkshire, England, United Kingdom
Hays Specialist Recruitment Limited
decisions.Essential Skills Include: Proven leadership and mentoring experience in senior data engineering roles Expertise in Azure Data Factory, Azure Databricks, and lakehouse architecture Strong programming skills (Python, T-SQL, PySpark) and test-driven development Deep understanding of data security, compliance, and tools like Microsoft Purview Excellent communication and stakeholder management skills Experience with containerisation and orchestration (e.g., Kubernetes, Azure More ❯
Employment Type: Full-Time
Salary: £70,000 - £90,000 per annum
Posted:

Senior Data Engineer

Leeds, West Yorkshire, Yorkshire, United Kingdom
WRK DIGITAL LTD
Supportingbestpracticesin datagovernance,securityandarchitecture . Buildingandoptimisingpipelinesacrosscloudandon-premiseenvironments. Collaboratingwithstakeholders,engineers,andanalyststodeliverintegratedsolutions. Ensuringconsistencyacrosstransactionalandanalyticaldatasystems. Contributingtothedevelopmentof datalakes,datawarehouses,anddistributedstorageenvironments . Mentoringjuniorengineers,embeddingbestpracticeacrosstheteam. Whatwerelookingfor 5+yearsexperiencein DataEngineering ,withstrongexpertisein Azuredataservicesand/orMicrosoftFabric . Proventrackrecorddesigningscalableplatformsandmanaginglargecloud-basedecosystems. Proficiencyin Python,PySpark,SQL,NoSQL andframeworkssuchas Databricks . Solidexperiencewith ETL/ELTdesign,orchestrationandoptimisation . Knowledgeof datagovernance,privacyregulations,andsecuritybestpractices . Strongexperienceintegratingrelational,NoSQL,andstreamingdatasources. CompetenceinCI/CDpipelinesandGit-basedworkflows. Experiencewithmodernarchitecturesincluding datamesh,event-drivenprocessing,andstreamingplatforms(Kafka More ❯
Employment Type: Permanent
Salary: £85,000
Posted:

Lead Data Engineer Databricks - Leeds

Leeds, West Yorkshire, England, United Kingdom
Noir
Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our … modern data platform using cutting-edge technologies, architecting big data solutions and developing complex enterprise data ETL and ML pipelines and projections. The successful candidate will have strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No … Benefits To apply for this position please send your CV to Nathan Warner at Noir Consulting. (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data More ❯
Employment Type: Full-Time
Salary: £55,000 - £70,000 per annum
Posted:
PySpark
Leeds
10th Percentile
£57,160
25th Percentile
£60,050
Median
£67,117
75th Percentile
£76,433
90th Percentile
£80,673