10 of 10 PySpark Jobs in the Thames Valley

understanding of data strategy and management, including data governance, data quality, security and compliance Advanced SQL skills, with hands-on experience using Python and PySpark Broad, practical experience across Azure data services and supporting Azure infrastructure Experience with Infrastructure-as-Code (Terraform or Bicep) and CI/CD pipelines ...

services such as Synapse, Data Factory, Databricks or Fabric Strong SQL skills with experience building optimised, complex queries Proficiency in Python and/or PySpark for data transformation and automation Strong experience with Power BI and modern data modelling techniques Demonstrable experience leading data engineering initiatives or projects Excellent ...

experience with cloud-based data platforms (Azure, AWS, SQL, Snowflake, Springserv); Microsoft Fabric experience is a strong plus Strong proficiency in Spark SQL and PySpark, including complex transformations Experience building ETL/ELT pipelines using tools such as Azure Data Factory or equivalent Ability to write efficient, reusable scripts ...

team supporting Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions Direct contact with customers/end-users on the phone ...

Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What ...

extend AI-enabled workflows as part of the core product (e.g. decision support, automation, insight generation) Develop and maintain data pipelines using Python, PySpark, SQL, and distributed systems Make pragmatic engineering decisions that balance short-term delivery with long-term product quality Contribute to technical and architectural discussions ...

building and operating machine learning models. Experience in multiple technologies and frameworks required such as Azure Databricks, Azure ML, MLFlow, GIT, Python and PySpark and microservices. Strong understanding of software development, DevOps, MLOps and Agentic Ops practices and microservices. Excellent communication and collaboration skills. About ...

Senior Data Engineer Data Pipelines | Python | PySpark | AWS | AWS Glue | London Location: London (hybrid - 2 days onsite per week) Salary: Up to £85K + Benefits We're working with a tech-driven organisation looking to hire an experienced Data Engineer to help design and scale cloud-based data platforms ...

properly, you'll fit right in. You'll Work With Azure Data Factory, Data Lake, Key Vault, Azure Functions Databricks, Delta Lake, Unity Catalog, PySpark, Spark SQL Medallion architecture, Lakehouse patterns, distributed compute CI/CD pipelines using Azure DevOps Cross‐functional teams in underwriting, actuarial, delegated authority, exposure … have: Strong hands‐on experience with Azure Data Services and Databricks Solid understanding of Delta Lake, Medallion architecture and Lakehouse patterns Proficiency in Python, PySpark and Spark SQL Experience building CI/CD pipelines using Azure DevOps Knowledge of data governance, lineage, access controls and FinOps Confident communication skills ...

with key AWS data services including Lake Formation, Glue, Athena, S3, IAM, and KMS . Extensive experience with Terraform , GitHub Actions , and Spark/PySpark is essential. Key Responsibilities: Architect end to end AWS data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark). Design multi account data … governance, security, and access models. Develop scalable ETL/ELT pipelines using Python & PySpark . Implement IaC using Terraform and CI/CD using GitHub Actions . Optimize data pipelines for performance, quality, and cost. Collaborate with security, data science, and analytics teams. Must-Have Skills: 10+ years experience ...