Repository navigation
When one agent exceeds its token plan: supervising a manager–specialist–QA workflow #8406
Sinaps Studio (sinapsstudio)
started this conversation in
Show and tell
Replies: 1 comment
|
I'd intervene on lack of progress toward an acceptance criterion, and treat role variance only as the prompt to look. A specialist at 78,885 against a 50k estimate is fine if each extra turn is closing a failing check, and a problem if the last several turns haven't changed which checks pass. Before authorising another attempt, I'd want the manager to show: which acceptance criteria were failing when the overrun began, which are failing now, what the specialist changed between attempts, and a stated cap for the next attempt with what happens when it's hit. Remaining project budget is the weakest of the three signals, because under-spend in other roles can hide one runaway assignment until late in the run. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
A specialist was allocated roughly 50k tokens in the work plan. Its recorded usage is already 78,885. The project total still looks below the overall estimate. Which signal should trigger intervention?
Here is the workflow view in Sinaps Studio, a Windows workspace with its own Squad runtime:
The plan assigns a manager, specialists and QA, with a provider/model, effort level and token estimate for each role. A human can inspect the plan and request changes before execution; the manager coordinates the work and final review. During the run, recorded usage helps identify which assignment needs attention. RAG sources and access for individual agents are configured separately.
What the screenshot establishes: one specialist has exceeded its estimate in a partial run. It does not establish a final cost, savings, or a successfully completed project. Role estimates are planning figures. Runtime token quotas and cost policies are separate controls, checked around model calls; calls already in flight can overshoot a threshold.
For a long-running team, would you review on role variance, remaining project budget, or lack of progress toward an acceptance criterion? What would the manager need to show before you authorised another attempt?
Windows x64; 30-day evaluation without a credit card. Model/API access and compute are separate. Product details.
Affiliation: SinapsData / the product account.
All reactions