Data Engineer
- Hiring Organisation
- Searchability NS&D
- Location
- City of London, London, United Kingdom
Develop database schemas and data models. Integrate and enrich data from multiple sources, ensuring quality and consistency. Design and implement ETL processes (e.g. using NiFi). Write clean, secure, test-driven code that is reusable by default. Maintain and enhance data ingestion and storage architectures. Investigate and resolve data … security controls. Monitor, maintain and optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services Palantir Foundry Stakeholder Engagement ...