Budget governor
The governor is a monthly guard that the operator of ZeroLog sets, not you. It adds up what the whole service spends on models this month. Once that total passes a threshold of the monthly budget, paid requests move to a cheaper model, so chats keep going instead of stopping outright. It is off until the operator turns it on and sets a monthly budget. The cheaper model is the one the operator named, or else the cheapest one available.
Diagram as text
- A paid request arrives for the model you picked. Free models are not touched.
- If the operator switched on a hard stop and the monthly budget is used up, the request is refused.
- Otherwise the governor compares the whole service's model spend this month with the threshold of the monthly budget.
- Below the threshold, the model you picked answers.
- Past it, a cheaper model answers instead (the one the operator named, or else the cheapest available) and the chat carries on.
- Each downgrade is logged with the reason.
Past the monthly threshold
The model you picked
A cheaper model
-
From then on, paid requests are answered by a cheaper model, and the chat carries on.
-
Refusing the request. The downgrade happens instead of this, unless the operator has also switched on a hard stop at the full budget.
Every downgrade leaves a line
The governor writes down each downgrade with the reason behind it. So when an answer comes back looking different from the one you expected, there is a line that explains it.
What it does not do
It does not watch a single run or measure how fast a run spends, and you cannot set or see it from your account. Your own limit is your credit: at zero, paid models stop. See Spend limits.
How unattended runs behave: /goal and /ultracode.