Member of Technical Staff

🚀 Member of Technical Staff (Software Engineer / Product Engineer) 🚀

AI Evaluation & Data Infrastructure Company (Stealth Stage)

📍London | Full-time, On-site.

đź’¸ Very Competitive + up to 0.5% equity (depending on level).

Omnis Partners is partnering with an early-stage stealth AI infrastructure company building a critical layer in the AI ecosystem the systems that determine how frontier models are evaluated, trusted, and continuously improved in real-world environments.

This isn’t a model-building role. Instead, the focus is on the infrastructure behind model performance: defining evaluation standards, generating high-quality structured datasets, and enabling robust testing across high-impact domains like finance, healthcare, and law.

At its core, the company is creating a “truth layer” for AI, combining structured evaluation environments, expert-driven annotation workflows, and tooling that makes model behaviour measurable, consistent, and improvable over time.

⚙️ The Role

As a Member of Technical Staff, you’ll own and evolve the internal platform that underpins the company’s entire data and evaluation engine.

You’ll be building the systems that enable small teams of engineers and domain experts to create high-quality structured data at scale, including workflow orchestration, annotation interfaces, review pipelines, and data validation frameworks.

This is a highly hands-on role with strong product ownership. You’ll work directly with founders and domain specialists to translate complex, often manual processes into scalable, reliable software systems.

Expect real ownership across the stack, with influence over both architecture and product direction from day one.

🧩 What You’ll Do

• Build and own the end-to-end workflow platform for data creation and model evaluation.

• Design systems for task distribution, expert routing, review loops, and quality assurance.

• Develop pipelines leveraging LLMs for assisted annotation and automated validation.

• Transform manual, real-world workflows into scalable internal products.

• Work closely with founders and subject-matter experts on product direction.

• Help shape engineering standards, architecture, and tooling as the company grows.

🧠 What They’re Looking For

This is a high-ownership environment where shipping matters more than titles or credentials.

They’re looking for engineers who:

• Have owned and delivered complex systems end-to-end.

• Are comfortable operating in ambiguity without fully defined requirements.

• Can move fluidly across frontend, backend, and data infrastructure.

• Already incorporate AI tools into their development workflow.

• Enjoy close collaboration with users and fast iteration cycles.

Aligned candidates often come from:

• Early-stage startups or founding engineering teams.

• Product-focused full-stack engineering roles with strong systems thinking.

• Infrastructure-heavy or platform engineering environments.

• Experience building internal tools, workflow systems, or data platforms.

• Exposure to LLMs, evaluation frameworks, or AI-driven products is a strong plus.

For the right person, this is a ground-floor opportunity to help build a category-defining company at the centre of AI evaluation and infrastructure.

Job Details

Company
Omnis Partners
Location
City of London, London, United Kingdom
Posted