16 of 16 Remote/Hybrid Contract PySpark Jobs

Essential Strong experience with Azure Databricks Infrastructure as Code using Terraform DevOps practices and CI/CD pipelines Git and peer review workflows Python, PySpark, and SQL Cloud operations within Azure To apply for this role please submit your CV or contact Dillon Blackburn on or at . Tenth ...

design and ETL logic. DevOps: Hands-on experience with Azure DevOps , CI/CD pipelines, and Key Vault. Bonus: Experience with Azure Databricks or PySpark is highly desirable. Randstad Technologies is acting as an Employment Business in relation to this vacancy. ...

integration. Proficiency with Databricks for data processing and analytics. Working knowledge of NodeJS would be an added advantage. Solid programming skills in Python , PySpark, Spark . Candidate must be adept at working with large-scale datasets , S3 , Python , and data cataloguing tools . Familiarity with data engineering best practices ...

CDF. High technical proficiency with Cosmos DB SDKs (e.g., .NET, Java, Python, Node.js) Thorough understanding of Spark distributed computing concepts. High technical proficiency in PySpark and Spark Concepts. Experience with concurrency patterns, CLR, and scalable application design. Deep understanding of Azure services including Azure Functions, App Services ...

Lead Data Engineer - Pyspark/AWS/Python/SAS - Financial Sector As a Lead PySpark Engineer, you will design, develop, and fix complex data processing solutions using PySpark on AWS. You will work hands-on with code, modernising legacy data workflows and supporting large-scale … PySpark migrations. The role requires strong engineering discipline, deep data understanding, and the ability to deliver production-ready data pipelines in a financial services environment. Essential Skills PySpark & Data Engineering Minimum 5+ years of hands-on PySpark experience. SAS to Pyspark migration experience Proven ability ...

Experience Strong hands-on experience with Azure Cosmos DB Query optimisation and throughput management expertise Experience with Cosmos DB Change Data Feed (CDF) Strong PySpark and Spark distributed computing knowledge Experience integrating Spark with Cosmos CDF High proficiency with Cosmos DB SDKs (.NET, Java, Python, Node.js) Deep understanding ...

leadership role. Hands-on expertise in the development of a data Lakehouse within the Microsoft Fabric or Databricks data platforms. Significant experience with PySpark and Spark-based data processing. Deep understanding of data warehouse design principles, Lakehouse architectures, including medallion (Bronze/Silver/Gold) patterns. Experience integrating data ...

leadership role. Hands-on expertise in the development of a data Lakehouse within the Microsoft Fabric or Databricks data platforms. Significant experience with PySpark and Spark-based data processing. Deep understanding of data warehouse design principles, Lakehouse architectures, including medallion (Bronze/Silver/Gold) patterns. Experience integrating data ...

across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing ...

reporting, and downstream data services across the organisation. Key Responsibilities Design, build, and maintain data pipelines using Databricks Develop ETL/ELT processes with PySpark and Spark SQL Transform and model structured and semi-structured datasets Improve performance, reliability, and cost efficiency of data workloads Ensure compliance with data … Skills & Experience Active SC Clearance - mandatory and non-negotiable Strong hands-on experience with Databricks in production environments Expert knowledge of Apache Spark , including PySpark and Spark SQL Proficiency with Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure acceptable) Understanding of data lake ...

Lead PySpark Engineer (Cloud Migration) Role Type: 5-Month Contract Location: Remote (UK-Based) Experience Level: Lead/Senior (5+ years PySpark) Role Overview We are seeking a Lead PySpark Engineer to drive a large-scale data modernisation project, transitioning legacy data workflows into a high-performance … cloud environment. This is a hands-on technical role focused on converting legacy SAS code into production-ready PySpark pipelines within a complex financial services landscape. Key Responsibilities Code Conversion: Lead the end-to-end migration of SAS code (Base SAS, Macros, DI Studio) to PySpark using automated ...

Defining and enforcing engineering standards across code quality, testing, CI/CD, IaC, and observability Building and optimising ELT/ETL pipelines using Glue (PySpark) , Lambda, Step Functions, and event-driven patterns Championing security-by-design in collaboration with security and assurance teams (IAM, KMS, encryption, auditability) Implementing … across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark) and SQL skills Experience implementing CI/CD pipelines and Infrastructure ...

reporting and analytics needs. Our client is looking for experience of working on a Fabric Lakehouse project - someone who has completed a Lakehouse with PySpark project rather than part way through. PySpark ETL experience is needed to manage the complexity of loading data from multiple ERPs from different … development management skills. Strong experience in designing and building enterprise data warehouses or data platforms in a leadership role. Completed a Lakehouse with PySpark project. PySpark ETL experience. Hands-on expertise in the development of a data Lakehouse within the Microsoft Fabric or Databricks data platforms. Significant experience ...

reporting and analytics needs. Our client is looking for experience of working on a Fabric Lakehouse project - someone who has completed a Lakehouse with PySpark project rather than part way through. PySpark ETL experience is needed to manage the complexity of loading data from multiple ERPs from different … development management skills. Strong experience in designing and building enterprise data warehouses or data platforms in a leadership role. Completed a Lakehouse with PySpark project. PySpark ETL experience. Hands-on expertise in the development of a data Lakehouse within the Microsoft Fabric or Databricks data platforms. Significant experience ...

reporting and analytics needs. Our client is looking for experience of working on a Fabric Lakehouse project - someone who has completed a Lakehouse with PySpark project rather than part way through. PySpark ETL experience is needed to manage the complexity of loading data from multiple ERPs from different … development management skills. Strong experience in designing and building enterprise data warehouses or data platforms in a leadership role. Completed a Lakehouse with PySpark project. PySpark ETL experience. Hands-on expertise in the development of a data Lakehouse within the Microsoft Fabric or Databricks data platforms. Significant experience ...

proven background and experience of full cycle development of a corporate, Microsoft based Data Warehouse. Desired skills: Design, Build, Test, Azure, Fabric Lakehouse, Spark, PySpark We are looking to recruit a high-calibre resource, so the client is happy to consider candidates from both a contract and permanent background. … your most recent CV to be considered for telephone screening. SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC/SPARK/PYSPARK/LEAD/MANAGER/HOME/REMOTE/MIDLANDS/BIRMINGHAM/SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC ...