7 of 7 PySpark Jobs in the Thames Valley

understanding of data strategy and management, including data governance, data quality, security and compliance Advanced SQL skills, with hands-on experience using Python and PySpark Broad, practical experience across Azure data services and supporting Azure infrastructure Experience with Infrastructure-as-Code (Terraform or Bicep) and CI/CD pipelines ...

services such as Synapse, Data Factory, Databricks or Fabric Strong SQL skills with experience building optimised, complex queries Proficiency in Python and/or PySpark for data transformation and automation Strong experience with Power BI and modern data modelling techniques Demonstrable experience leading data engineering initiatives or projects Excellent ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

analysis using tools like Power BI and Excel or similar. Knowledge and capability in a wide variety of additional analytical tools (e.g. SQL, Python, PySpark, Databricks and Azure). Able to support the development and technical progression of others within the team. Several years of relevant business or technical ...

optimize Lakehouse architectures using Delta Lake principles Ingest, transform, and curate data from multiple sources (APIs, databases, files, streaming) Develop scalable data transformations using PySpark and Spark SQL Implement data models optimized for analytics and reporting (e.g. star schemas) Monitor, troubleshoot, and optimize performance and cost of data workloads … practices Required Skills & Experience Strong experience with Microsoft Fabric (Lakehouse, Pipelines, Notebooks, Dataflows, OneLake) Hands-on experience with Databricks in production environments Proficiency in PySpark and SQL Solid understanding of data engineering concepts (ETL/ELT, orchestration, partitioning) Experience working with Delta Lake Familiarity with cloud platforms (Azure preferred ...

with key AWS data services including Lake Formation, Glue, Athena, S3, IAM, and KMS . Extensive experience with Terraform , GitHub Actions , and Spark/PySpark is essential. Key Responsibilities: Architect end to end AWS data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark). Design multi account data … governance, security, and access models. Develop scalable ETL/ELT pipelines using Python & PySpark . Implement IaC using Terraform and CI/CD using GitHub Actions . Optimize data pipelines for performance, quality, and cost. Collaborate with security, data science, and analytics teams. Must-Have Skills: 10+ years experience ...

with key AWS data services including Lake Formation, Glue, Athena, S3, IAM, and KMS . Extensive experience with Terraform , GitHub Actions , and Spark/PySpark is essential. Key Responsibilities: Architect end to end AWS data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark). Design multi account data … governance, security, and access models. Develop scalable ETL/ELT pipelines using Python & PySpark . Implement IaC using Terraform and CI/CD using GitHub Actions . Optimize data pipelines for performance, quality, and cost. Collaborate with security, data science, and analytics teams. Must-Have Skills: 10 years experience ...