26 to 27 of 27 PySpark Jobs in the South East

Lakehouse solutions across cloud environments. Responsibilities: Design, build, and maintain data pipelines using Databricks (Spark, Delta Lake). Develop batch and streaming workloads using PySpark/Spark SQL. Implement data ingestion, transformation, and orchestration pipelines. Optimise Databricks workloads for performance, reliability, and cost. Integrate Databricks with cloud-native services … across Azure, AWS, or GCP. Skills: Strong hands-on expertise with Databricks in production environments. Advanced PySpark and Spark SQL development experience. Experience building lakehouse architectures using Delta Lake. Strong cloud experience in Azure (preferred), AWS, or GCP. Experience with orchestration tools (ADF, Airflow, dbt, or similar). Certifications ...

building common functionality for distributed product teams. Early work will focus on: Abstracting existing codebases into shared Python libraries Developing data-driven solutions using PySpark and DataFrames Building and extending Python-based microservices using Azure Functions Creating scalable, reusable services that solve common challenges across teams Beyond the initial … essential, as youll be working closely with engineers and technical leads across five time zones . Essential skills Strong commercial experience with Python PySpark and data-frame based processing Solid SQL capability Experience working with Azure infrastructure Good understanding of containers, microservices, and functional design patterns Comfortable working ...