10 of 10 Remote/Hybrid PySpark Jobs in Yorkshire

Databricks Data Engineer

Hiring Organisation
EXL Service
Location
Leeds, Yorkshire, United Kingdom
Employment Type
Permanent Contract, Hybrid
ideally in enterprise-scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. ...

Consultant

Location
Leeds, England, United Kingdom
3+ years with strong Foundry depth). Proven, hands‐on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. ...

Lead Data Engineer

Hiring Organisation
ITSS Recruitment Ltd
Location
Leeds, Yorkshire, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£85,000
Data Engineer Key skills: * Microsoft Fabric * Azure Cloud Technologies * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Analytics Solutions Consultant

Hiring Organisation
Source & Connect
Location
Leeds, West Yorkshire, United Kingdom
Employment Type
Permanent
Salary
£45000 - £60000/annum
cost management. Build strong client relationships and provide trusted advice. Skills & Experience Essential Commercial Microsoft Fabric experience. Strong Power BI, SQL and Python/PySpark skills. Experience delivering client-facing analytics projects. Excellent communication and stakeholder management skills. Ability to lead workshops and gather business requirements. Desirable ...

Frontend Developer

Hiring Organisation
Peregrine International Ltd
Location
Leeds, United Kingdom
Employment Type
Permanent Contract, Full Time, Hybrid
promoting engineering best practices Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis ...

Databricks Consultant & Lakehouse Data Engineer (Remote)

Location
Leeds, England, United Kingdom
clients to gather requirements, embed CI/CD and IaC, and deliver cloud data solutions across Azure and AWS. Strong communication and hands-on PySpark/SQL are essential. #J-18808-Ljbffr ...

Hybrid Cloud Data Pipeline Engineer for Migrations

Location
Leeds, England, United Kingdom
platform, owning data processing from ingestion to delivery. You’ll collaborate with the migration team and leverage Azure/AWS/GCP, Spark/PySpark, dbt, SQL and Python to ensure completeness, accuracy and auditable data lineage across the platform. #J-18808-Ljbffr ...

Senior Data Engineer

Location
Leeds, England, United Kingdom
from multiple sources. Transform source extracts into consistent structures for migration to a single platform. Develop maintainable ingestion and transformation code using SQL, Python, PySpark and dbt. Implement automated checks that establish completeness and accuracy throughout the migration. Monitor, diagnose and recover failed or incomplete data processing. Maintain auditable … data processing in a structured migration environment. Hands‐on experience building and operating data pipelines on Azure, AWS or Google Cloud. Experience with Spark, PySpark, Databricks or comparable distributed processing technologies. Experience building modular, tested and documented transformations using dbt or an equivalent approach. Strong SQL and Python skills ...

Data Engineer

Location
Leeds, England, United Kingdom
from multiple sources. Transform source extracts into consistent structures for migration to a single platform. Develop maintainable ingestion and transformation code using SQL, Python, PySpark and dbt. Implement automated checks that establish completeness and accuracy throughout the migration. Monitor, diagnose and recover failed or incomplete data processing. Maintain auditable … data processing in a structured migration environment. Hands-on experience building and operating data pipelines on Azure, AWS or Google Cloud. Experience with Spark, PySpark, Databricks or comparable distributed processing technologies. Experience building modular, tested and documented transformations using dbt or an equivalent approach. Strong SQL and Python skills ...

Databricks Consultant

Location
Leeds, England, United Kingdom
influence delivery standards and contribute to reusable frameworks and accelerators. What You’ll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/… team Modernising legacy data platforms to unlock more value from client data estates What You’ll Bring Commercial Databricks delivery experience Strong hands-on PySpark and SQL Solid grounding in data engineering, data modelling and Lakehouse architecture Experience on Azure and/or AWS Source control, CI/ ...