3 of 3 Contract PySpark Jobs in the West Midlands

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Experience: Azure Databricks Python Financial Services sector ...

commercial or Agile environment.To be successful in this role it’s essential that you will: Have significant experience of AWS , Python, SQL, Git and PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation ...

Data Engineers. What You Bring: Extensive hands-on experience with Databricks and Synapse. Strong proficiency in Azure DevOps. Solid knowledge of SQL and PySpark within a Databricks environment. Experience using Databricks in a federated cloud setting. Proven leadership experience with small engineering teams. Skills in configuration management and documentation. ...