AWS Cloud Developer with Data Engineering Skills
Job Description: As an AWS Cloud Developer with Data Engineering skills, you will be responsible for designing, developing, and maintaining scalable data solutions on the AWS platform. You will work closely with cross-functional teams to ensure seamless integration and optimal performance of our data engineering projects.
Key Responsibilities:
- Design, develop, and implement data pipelines and ETL processes using AWS services.
- Collaborate directly with our FinOps teams and market units across the organization to understand data requirements and deliver solutions that meet business needs.
- Optimize and manage data storage solutions using AWS services such as S3, RDS, and NoSQL databases.
- Ensure data quality, integrity, and security across all data engineering projects.
- Monitor and troubleshoot data workflows to ensure high availability and performance.
- Design and build advanced and interactive dashboards using tools such as AWS QuickSight and Power BI.
- Knowledge of DevOps practices and CI/CD pipelines.
- Stay updated with the latest AWS technologies and best practices to continuously improve our data infrastructure.
- Create and oversee a cloud billing dashboard to track, manage and optimize cloud costs and Reserved Instance purchases
- Build a dashboard that provides secure self-service capabilities to all teams on cloud spend
- Solve technical problems and create viable tooling
- Design and implement shared services in cloud infrastructure.
- Use best appropriate infrastructure automation tools to provision cloud infrastructure components
- Attend important Agile events and finish assigned work packages/tasks
- Ensure smooth handover of project deliverables to internal and external customers
- Actively contributing to internal projects such as tooling and documentation
- Mentor new team member
- Promote the use of automation to solve technical challenges.
Skills:
- Bachelor's degree in computer science, Information Technology, or a related field.
- Proven experience as a Cloud Developer or Data Engineer, with a focus on AWS.
- Strong proficiency in AWS services such as EKS, EC2, S3, Lambda, Glue.
- Solid understanding of data modelling, ETL processes, and data warehousing concepts.
- Strong proficiency in Python
- Familiarity with infrastructure as code tools like CloudFormation or Terraform.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Experience in building and utilizing REST APIs.
- Experience building and running Kubernetes Background Tasks with Batch-Jobs.
- Hands-on experience with GitHub Action
Preferred Qualifications:
- AWS Certified DevOps Engineer - Professional and or AWS Certified Data Engineer - Associate
- Knowledge of DevOps practices and CI/CD pipelines.
- Knowledge in using Flask framework to create dynamic websites, APIs or microservices is a plus.
NOTE: Hybrid role (2 or 3 days onsite per week)