Product
Choose your own checking model on your own key
With your own key you pick the model that checks a Ultracode run. Every provider has a default checker, and a wrong choice is refused at the start.
A Ultracode run has two checkers per subtask. With your own key you can now choose the checking model yourself, from the models your keys offer. Until now such a run could fail right after the start with the message that no usable Featherless model was set up to check it, and no agent ever ran.
Without a choice, every provider has a default checker: a small, fast model from your own list. For Anthropic it is Claude Haiku 5.5. For the other providers ZeroLog picks the smallest model of the newest family that your key lists, so the default stays current. If your key lists no small model, the run model checks itself.
The check happens at the start now, for the price estimate, for Ultracode and for goal runs. A checker that is not allowed is refused at once, and the answer lists up to eight allowed models, the closest first. The price estimate counts a checker on your own key as zero platform cost, like the other models on your key. Models of other providers on the platform stay refused.
We tested this with a replica of the provider lists, for every provider the platform knows. We have not yet seen the real model list of each provider after this change, so the default for providers other than Anthropic depends on what your key lists.