gstack 1.91.185.0 repairs three flaky paid eval cases

1 hour ago

gstack 1.91.185.0 repairs three flaky paid eval cases: the plan design focus check now accepts "4/10 on design", the design floor case stops stalling to its 610 s timeout, and the docs sync rule moves to where the agent reads it. No threshold, budget, timeout or trial count changed. Release notes: https://github.com/garrytan/gstack/blob/main/CHANGELOG.md#1911850---2026-10-23 Commits: https://github.com/garrytan/gstack/commits/main

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Three cases
  2. 0:12Rating
  3. 0:27Timeout
  4. 0:42Docs sync
  5. 0:57Gate
Show transcript

Three cases

gstack logo

gstack 1.91.185.0 repairs three flaky paid eval cases

plan-design-with-ui-scope plan-design-finding-floor ship-docsync-completion
ThreeRatingTimeoutDocs syncGate
garrytan/gstack · CHANGELOG.md · 1.91.185.0

gstack's newest release repairs three paid eval cases that kept failing at random: two for plan design review, one with a ten-minute stall, and one for the ship docs sync.

Rating

“4/10 on design” now counts as a design rating

focus check wanteddesign completenessany design score out of 10
A rating split from “design” across sentences is still refused.
ThreeRatingTimeoutDocs syncGate
garrytan/gstack · CHANGELOG.md · 1.91.185.0

Opus 5.5 rated a plan four out of ten on design, and the focus check failed it for leaving out the words design completeness. Any sentence that scores the design out of ten now counts.

Timeout

The design floor case stops stalling until its 610 s timeout

Create menu, title scrolled off unanswered
Step 0D focus menu, new wording unanswered
both, matched by structure answered
ThreeRatingTimeoutDocs syncGate
garrytan/gstack · CHANGELOG.md · 1.91.185.0

The design floor case sat until its ten-minute timeout at two menus: a Create menu whose title had scrolled away, and a focus menu worded differently. Both are now recognized by their structure, and answered.

Docs sync

The docs sync rule moves to where the agent reads it

“each as its own Bash call, with nothing joined before or after it … a --help is no exception”
ThreeRatingTimeoutDocs syncGate
garrytan/gstack · CHANGELOG.md · 1.91.185.0

Twice, the agent tacked a help flag onto its first line of reads, which the fixture forbids. The own-call rule now sits in the sentence that introduces those commands, not after them.

Gate

No threshold, budget, timeout or trial count changed

CHANGELOG.md1.91.185.0 · Gate integrity
Do you run /plan-design-review before you build a UI?
ThreeRatingTimeoutDocs syncGate
garrytan/gstack · CHANGELOG.md · 1.91.185.0

Two checks now accept more: the design rating and the focus menu. No threshold, budget, timeout or trial count changed. Do you run /plan-design-review before you build a UI?