Senior Data Engineer
Job Type - 1 year fixed term contract with an extension possibility
Join a dynamic team shaping the future of financial services by building and maintaining modern data platforms. This role involves collaborating with business and technology partners to deliver impactful solutions, leveraging cutting-edge tools and technologies. You will contribute to the architectural design, development, and maintenance of data platforms, ensuring performance, stability, and alignment with business needs.
Key Responsibilities:
• Architect and Develop: Contribute to the platform’s architectural design and build integration, modeling, data persistence, and analytical systems.
• Data Pipelines: Implement, maintain, and test robust data pipelines.
• Metadata Management: Develop and manage metadata processes and tools.
• Performance Monitoring: Ensure the stability and performance of data pipelines.
• Data Quality: Implement tools for data curation, metadata management, and quality assurance.
• Collaboration: Engage with business and technology teams to align the platform with organizational goals.
Preferred Technical Skills:
• Programming: 10+ years of experience in Java and Python development.
• Cloud Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).
• Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.
• Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.
• Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.
• Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.
• RDBMS: Knowledge of PostgreSQL is a plus.
• Industry Experience: Proven experience building enterprise-wide data and analytics systems, preferably in financial services or asset management.