1 to 25 of 58 Remote/Hybrid PySpark Jobs in the UK

public sector or government data environment. Skills required: Azure Data Factory (ADF) for orchestration and data movement Lakehouses, Data Pipelines, Dataflows Gen2, Fabric Notebooks) PySpark, SQL, and Python for large-scale data transformation Delta Lake, Apache Spark, and OneLake architecture Good knowledge of Microsoft Purview for data governance, cataloguing ...

working with flexibility and autonomy Key Experience Deep end-to-end experience delivering enterprise Databricks analytics solutions Expertise in Lakehouse Architecture, Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala ...

team supporting Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions Direct contact with customers/end-users on the phone ...

backgrounds. The technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake ...

automation and optimization of data workflows Requirements: Experience in data engineering and pipeline development Strong expertise in Azure (Synapse, Data Lake) Proficiency in Python, PySpark, and T-SQL Knowledge of data warehousing, CDC, and incremental processing Familiarity with modern data architectures (e.g., medallion) Preferred Experience with Azure DevOps/ ...

Hands-on experience building ETL/ELT pipelines in a cloud environment Strong SQL skills and experience with data modelling Experience working with Databricks ( PySpark/SQL) and Azure data services Familiarity with Git and CI/CD approaches for data engineering A collaborative approach and attention to detail ...

Hands-on experience building ETL/ELT pipelines in a cloud environment Strong SQL skills and experience with data modelling Experience working with Databricks (PySpark/SQL) and Azure data services Familiarity with Git and CI/CD approaches for data engineering A collaborative approach and attention to detail ...

with various databases e.g. MS SQL, Azure Cosmos DB. Skilled at optimizing large and more complicated SQL statements. Proficiency in Python and experience with PySpark Experience of REST API standards. Proficiency in writing clean, readable, and secure code for Azure backend services, i.e. functions, utility functions etc. Experience ...

modern data platform development. Deep hands-on experience with Microsoft Fabric, including Lakehouse, Data Warehouse, OneLake, Pipelines and Data Factory. Strong SQL, Spark/PySpark and data modelling capability across analytical and operational datasets. Proven experience delivering complex end-to-end data platforms in Azure or Fabric environments. Strong ...

agile environment What we need Strong experience as a Data Engineer in Azure environments Strong hands-on experience with: Azure Data Factory Databricks/PySpark SQL Server/T-SQL Experience building production-grade data pipelines and data models Exposure to identity/access/security data Understanding ...

data warehousing, big data platforms (e.g., Hadoop), data streaming (e.g., AWS, GCP, Azure). Programming Skills: Programming skills in languages like Python (NumPy, pandas, PySpark), Java (Core Spark with Java, functional interface, collections), or Scala with experience in automation and scripting. Compliance: Experience with data governance, data security ...

experience: Strong hands-on experience as a data engineer, with a track record of leading complex technical delivery. Advanced proficiency in Databricks (Delta Lake, PySpark, workflows). Strong Python and SQL skills. Experience with Azure cloud services. Demonstrable ability to mentor and upskill less experienced engineers. Desirable: Experience with ...

Customer Experience, Finance and Operations can trust. Responsibilities Build, optimise and operate ELT/ETL pipelines into our data platform using SQL and Python (PySpark), with a focus on reliability, performance and maintainability. Develop and maintain core data models (curated layers, dimensional models, shared definitions) that enable consistent ...

Data Warehouse capabilities. Design, manage, and optimise data storage within OneLake , ensuring well-governed, well-structured, and shareable data assets. Develop scalable Spark (PySpark/Spark SQL) data transformations through Fabric notebooks to support high-volume processing. Create, orchestrate, and monitor robust data ingestion and transformation pipelines using Fabric ...

sizing Fabric initiatives, including capacity needs, effort estimates, infrastructure requirements, team resourcing, and delivery timelines. Extensive knowledge in data modelling, DAX, Python/PySpark, SQL/KQL. Proven record of technical leadership and effective stakeholder engagement. Lead architectural design, capacity planning, and performance optimisation efforts. Implement governance, security ...

production. Key skills and experience: Strong experience as a Data Engineer Advanced Python and SQL skills Experience with cloud platforms (AWS preferred) Proficiency in PySpark and/or Pandas Familiarity with data quality tools (e.g., Great Expectations) Experience with infrastructure as code (Terraform or CloudFormation) Understanding of modern development ...

TensorFlow Serving, TorchServe). Familiarity with ML lifecycle tools such as MLflow, Kubeflow, or Azure ML Pipelines. Experience working with distributed data processing (e.g., PySpark) and SQL. Understanding of software engineering best practices, including version control (Git). Knowledge of CI/CD principles in ML environments. Experience with ...

RBAC and governance controls across Azure services Tech stack Azure Azure Databricks Terraform Azure DevOps/CI/CD Python SQL Apache Spark/PySpark Entra ID/RBAC/governance Networking/platform security/automation What were looking for Strong experience in Azure platform engineering Strong hands ...

meet enterprise clients (typically 1–2 short trips per quarter) Desirable Experience working with B2B data platforms or analytics products Experience with Spark SQL, PySpark or distributed data systems Experience with large-scale data tooling (e.g. Spark, Hive, Databricks) Cloud experience (AWS – S3, EMR etc.) Exposure to LLMs, generative ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

Experience in these areas would also be helpful: Cloud Platforms: Experience with cloud data services (e.g. AWS Redshift) Additional data related programming skills (Python, PySpark) Full time - 35 Hours About us In 2025, Coventry Building Society purchased The Co-operative Bank. Bringing together our purpose-led building society with ...

Experience in these areas would also be helpful: Cloud Platforms: Experience with cloud data services (e.g. AWS Redshift) Additional data related programming skills (Python, PySpark) Full time - 35 Hours About us In 2025, Coventry Building Society purchased The Co-operative Bank. Bringing together our purpose-led building society with ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...