Senior Data Platform Engineer - Compliance Assurance
- Hiring Organisation
- Pontoon
- Location
- Chester, Cheshire, United Kingdom
- Employment Type
- Contract
with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs, including authentication, pagination, rate limiting and error handling. Understanding of data reconciliation, data quality validation, exception handling and audit evidence. Experience using Git, automated … generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls ...