2 of 2 Permanent PySpark Jobs in Hertfordshire

management (Metadata Driven Ingestion). Good working experience of database technologies and database integration, such as SQL, Postgres, MySQL or Oracle. Experience in Python (PySpark) Experience in working with DevOps capabilities like version control, automated builds, testing and release management capabilities using Microsoft DevOps and Git repositories. Good numerical … technology roles, such as architecture, operations, and design related disciplines. At least three years of experience in Azure (Azure Synapse, Azure Databricks, Fabric, PySpark). Comprehensive experience with data modelling Experience across a range of other IT functional disciplines will be of benefit, including: Data Platform tools CI/ ...

small team of data engineers and own work end to end: talking to stakeholders, designing models, building and testing pipelines in Python and PySpark, and supporting BI. It's essentially remote, and the platform will grow from one business to the whole group, so there's plenty … conceptual, logical and physical data models for the new platform Building metadata-driven pipelines across Azure Synapse, Data Factory and PostgreSQL using Python and PySpark Migrating data from legacy reporting solutions onto the platform while protecting data integrity Releasing code through Azure DevOps and Git, and keeping documentation ...