Senior Applied ML Engineer, Evals & Data

About the role

We’re building the future of storytelling and video editing. We’re a small team that moves fast and builds things we’re proud of. We care obsessively about taste: in design, in product, in every detail.

Key responsibilities

• Define quality standards and build trusted evaluation datasets from real product usage.
• Build offline and online evaluations, including automated checks and human review.
• Analyze model and agent failure patterns, then improve quality through better data, evaluation methods, model selection, and fine‑tuning where useful.
• Add regression checks and release gates while tracking quality, latency, and cost.
• Solve hard problems related to AI agent quality and product impact.

Required profile

• Experience shipping and operating an LLM or agent system used by real customers.
• Strong software engineering skills in TypeScript or Python, with the ability to work across both.
• Experience building evaluations, datasets, experiments, or AI quality systems.
• Strong product judgment and the ability to turn unclear quality problems into measurable improvements.
• No PhD required; evidence of building reliable AI products matters more than formal credentials.

Required skills

• TypeScript
• Python

What we offer

• Competitive salary and founding‑team equity.
• Unlimited tokens across every AI model for unrestricted experimentation.
• A healthy budget for AI tools and any peripherals needed to do your best work.