Data Engineer (Data Vault 2.0)

Job Description: Data Engineer

We are looking for a forward thinking Data Engineer to build a robust Vault 2.0 architecture on Snowflake, to better serve and deliver valuable data products to our customers (internal and end-client).

Key Responsibilities:

Data Vault 2.0 Implementation:

• Design and implement Data Vault 2.0 architecture on the Snowflake data platform.
• Develop and maintain hubs, links, and satellites in the Data Vault 2.0 model.

Data Integration:

• Build robust and scalable data pipelines to ingest and process data from various sources (eg, databases, APIs, streaming platforms).
• Implement ETL/ELT processes to ensure efficient data loading, transformation, and storage.

Data Marts:

• Design and build data marts to support Business Intelligence and analytical requirements.
• Collaborate with business stakeholders to understand data needs and deliver tailored data products.

Performance Optimization:

• Optimize data models, queries, and storage solutions for performance and cost efficiency.
• Monitor and troubleshoot performance issues in data pipelines and data warehouses.

Collaboration & Communication:

• Work closely with analysts, and business stakeholders to gather requirements and deliver data solutions.

Documentation & Standards:

• Create and maintain comprehensive documentation- we use confluence
• Adhere to industry best practices and company standards for data engineering and governance.

Required Skills and Qualifications
Technical Expertise:

• Proven experience with Data Vault 2.0 methodology.
• Hands-on experience with Snowflake data platform.
• Proficiency in SQL and ETL/ELT processes.
• Experience with data streaming technologies (eg, Kafka, Kinesis).

Programming & Tools:

• Strong programming skills in Python, Java, or similar languages.
• DBT hands on experience would be preferred.