Snowflake/Dataops Data Engineer Technical Lead

Job Title:Snowflake/Dataops Data Engineer Technical Lead

Department: Delivery

Reporting to: Professional Services Manager

About the role

We are looking for a Client Technical Lead to join our delivery team ensure the technical standards and project approach are implemented in the best possible way.

You will be providing daily supervision and mentoring of one or more the technical project team(s). This includes reviewing, maintaining or creating a System Architecture and maintaining close relationships with the Project Manager and Business Development and Account Manager.

You will be contributing to Agile User-Story and Task grooming, estimations and sprint planning, technical delivery and retrospective reviews both commonly with and without direct Customer involvement.

You will be drawing upon and contributing to Datalytyx General and Technology specific Delivery Guides to ensure that best practices approaches are maintained and common project dangers are avoided.

You will be working within the 2-week sprints to get the best work from yourself and the technical team members and be committed to completing shared multi-client sprint deliverables.

You will be proactively working to know your client’s business and technical needs and be looking for potential additional scope and opportunities that can become future opportunities to make Datalytyx and our Customers successful in our shared relationship.

You spot potential engagement issues or blockers early on in planning and sprint execution and help our Project Manager(s) define mitigation steps to ensure joint delivery success.

You’ll pro-actively work to build up knowledge of the business, including how our commercial and production teams work. Of course to get to know your colleagues and customers well, you’ll occasionally travel between our two offices and to customer sites.

Who are we looking for

We are looking for someone who is keen to join the team and learn about what we do. Someone comfortable working with technical staff and customer staff and be confident gathering and representing technical requirements and our resulting deliverables.

You will be someone who thrives on working as part of a team to continuously improve quality, demonstrate an eye for detail and be a completer-finisher.

We are looking for someone who the technical team can rely upon, demonstrates a positive can-do attitude.

You might be a technical consultant who can grow within the role on simple client projects and learn demonstrate the above attributes on a daily basis.

You will have a keen eye for the technology used and shape of a client engagement. You will be able to spot potential “broken windows” early on in client technical engagements. You enjoy making a difference to the products and integrations our customers are using.

You will have a solid grounding in Computer Science, either from a formal education background or through experience in your career. You will have experience of Big Data Cloud technology, cloud and project/issue tracking systems (we use Jira).

What you’ll be doing

• Working with DataOps.live and Snowflake to deliver amazing analytic data solutions
• Work on agile projects, looking to deliver business value fast
• Reviewing, maintaining or creating a System Architecture
• Evangelise and contribute to Snowflake, Dataops, DBT best practice
• Daily supervision and mentoring of one or more the technical project team(s)
• Contribute and participate in 4-eyes code promotion reviews of GIT Merge Requests
• Identifying and tracking Tasks to manage and resolve technical debt in the solution
• Maintaining close relationships with the Project Manager and Business Development and Account Manager
• Contributing to Agile User-Story and Task backlog grooming
• Participate and lead Team estimations
• Sprint planning
• Retrospective reviews

Working with the Technical Data Engineers Technical Team deliverables and leading by example:

• Creating project from templates and implementing 4-layer modern data architecture ELT data solutions
• Deliver CI/CD data pipelines, implementing a layered ELT data architecture
• Ingesting data from external sources such as Relational Databases, files, Kafka and other sources
• Writing data processing routines with languages such as python
• Collaborate with data source Subject Matter Experts (SME) to discover and understand the data
• Model and transform data using SQL and DBT
• Collaborate with colleagues in peer code reviews and pair programming sessions
• Creating example dashboards using visualisation/BI tools to enable customers to enhance and self-serve further visualisations
• Support and enable Data Science team(s)
• Review and resolve data pipeline failures and data test failures
• Optimise and improve data pipelines
• Utilise Snowflake best practices and features to optimise credit usage and performance
• Work with Data Consumers to optimise queries and improve consumption of data

Technical skills

• A background in SQL and principles of data warehousing
• Snowflake design and engineering experience or certification in Snowpro Core
• Experience in data modelling and ELT
• Analytical and Structured approach to work
• A team player able to perform peer code reviews and provide constructive mentoring
• 5 years’ experience within Data & Analytics and DBT
• Desirable
• Experience of ETL design and dev, including Test-Driven development
• Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modelling)
• Experience of programming languages including Object-Oriented language (.Net. Java, C, Python)
• GIT experience
• Good knowledge of DevOps / DataOps principles with working knowledge of Docker and Linux
• Hands on experience with DBT
• Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning
• Expertise in deploying Snowflake features such as data sharing
• Experience with data security and data access controls and design
• Experience with AWS or Azure data storage and management technologies such as S3 and ADLS
• A track record of achievement and recognition within the IT industry as evidenced by significant promotion since leaving University
• A strong academic track record including the achievement of a good honours degree or equivalent
• Certification in Snowpro Advanced Architect or Snowpro Advanced Data Engineer