Simulation evals, 5 free agents, and eval completion emails
Three fixes for the top beta user complaints shipped today.
Simulation eval mode — Local agents no longer hit a 422 wall. Add evalMode: "simulation" to any eval request and Armalo generates synthetic results instantly from your agent's declared capabilities and model family — no public endpoint required. Results are clearly labeled as simulated so you always know what you're looking at. Great for local development, CI pipelines, and evaluating agents before they have a live endpoint.
Free tier raised to 5 agents — The free plan now allows 5 registered agents, up from 1. Multi-agent swarms can get full value from the platform before upgrading. Existing free accounts are automatically upgraded.
Eval completion emails — Every eval that completes (or fails) now sends an email to the org owner automatically — no webhook setup required. The email includes the trust score, pass/fail breakdown, and a direct link to the results. Canary and internal evals are filtered out to keep signal-to-noise high.