12 of 12 PySpark Jobs in West Yorkshire

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. ...

Generation), Serverless, DWH models, Data Mesh, Data Fabric, Medallion and Data Products. Hands on mindset : Fluent in the language of data, whether SQL, Python, PySpark, R or Scala. Open formats including Parquet, Iceberg and JSON. Agile Ways of Working Run and contribute to agile ceremonies, helping to shape ...

Data Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Implement automated testing, CI/CD patterns + deployment best practices for Foundry-based data assets. Technical Environment: Data Engineering, Palantir Foundry, Python, SQL, PySpark, Spark SQL + Cloud (AWS, Azure, GCP), CI/CD, Git based workflows. Benefits: £75,000 - £80,000 (DOE) + Remote/Hybrid Working ...

Building and maintaining scalable data pipelines, pulling data in from core business systems and third-party sources. Designing and developing data solutions with Python, PySpark, SQL, notebooks and dataflows across a modern medallion architecture (Bronze, Silver, Gold). Creating and optimising data models that power high-quality Power … future analytics, AI and machine learning capability. Candidate Essential Experience, Qualifications and Skills Commercial data engineering experience (4+ years) SQL (4+ years) Python and PySpark (3+ years) Microsoft Fabric or an equivalent Azure data platform (2+ years) Medallion/layered lakehouse architecture (2+ years) Dimensional data modelling for analytics ...

Data Engineer (Databricks) Leeds (Hybrid) 6 Month Contract £500-550/day (Inside IR35) Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience. 6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026. Hybrid Working Model - primarily working from home with ...

teamWhat could set you apartExperience in the use of credit bureau dataExperience using Google Cloud Platform and/or Google Cloud Engineer qualificationsExperience of PySpark, BigQuery, Git and any/all of: DataFlow, DataProc, Airflow (or equivalents)We believe great things happen when teams connect. Our schedule is built ...

Data Engineer (Databricks) Leeds (Hybrid) 6 Month Contract £500-550/day (Inside IR35) Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience. 6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026. Hybrid Working Model - primarily working from home with … month. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark + SQL skills. Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS. Keeping scheduled data processing reliable, resolve ...

2026. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark and SQL skills. Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS. Keeping scheduled data processing reliable, resolve … understanding of role-based access, KMS encryption + diagnosing data access failures. Owning incidents from investigation through recovery and closure. Diagnosing issues in Python, PySpark, SQL, Databricks jobs and AWS integrations + providing clear progress updates and timely escalation. Working knowledge of Git, code reviews, CI/ ...

Remote - United Kingdom JOB ID: FEQ427R333 Location: The customer is based in Leeds or Manchester, United Kingdom Industry: Enterprise Retail or CPG (UKI Enterprise) - The customer is based in Leeds. You will be visiting the ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

DWP. You will work with modern AWS technologies to develop scalable data solutions powering reporting, analytics and strategic decision-making. You will build PySpark-based ETL pipelines on EMR, Lambda and EC2, collaborating with stakeholders to translate reporting requirements into robust data solutions. Hybrid working model with time split ...