Founding Engineer

What our client is building

Our client is building the LLM platform that will power tomorrow's AI-first companies.

A single platform that allows any LLM user to integrate, scale, secure and optimize their LLM inference across 200+ providers in a few clicks.

A highly scalable, reliable and secure infrastructure that exposes simple, OpenAI-compatible APIs, that every product or tool can use. The API allows access to any of the LLM providers, taking care of API compatibility while adding telemetry, analytics, load balancing, MCP integrations, prompt management, data loss protection and much more out of the box.

Why join this opportunity

This is an opportunity to build a novel infrastructure product that will be the backbone for the best AI products, and power the next AI coding assistants, agent orchestration systems or any other AI-based solution.

Work directly with the founders to influence the company's direction and make a tangible impact. For those looking to build their own startup someday or thrive in the dynamic environment of a fast-growing company, this is the ideal place to accelerate impact and growth.

A generous TC package with significant equity is offered.

Technical stack

The team runs a pragmatic micro-service architecture:

• Kubernetes
• Core LLM gateway in Go
• Auxiliary and ML/AI services in Python
• Different SQL DBs
• Distributed caches

This list is expected to evolve. Most probably, the successful candidate will be the one redefining and building it.

What they're looking for

• 5+ years of experience building backend services using a compiled language (preferably Golang)
• Ability to discuss best practices in the language and frameworks used before
• Understanding of concurrency and prior experience using it
• Experience with different types of caches and databases and knowledge of how to choose and use them correctly
• Ability to design both scalable and pragmatic architectures, depending on the product's stage and actual needs
• Understanding of tradeoffs between quality, speed and completeness, and knowledge that building a minimal product is not the same as building a broken one
• Demonstrated ability to learn new technologies independently and eagerness to do so again