gstack 1.91.144.0 now tests every skill change on Claude Opus 5.5, at a third of Fable's cost

2 hours ago

gstack 1.91.144.0: the paid PR gate now tests every skill change on Claude Opus 5.5 instead of Fable 5.1. The first full Opus gate went 132/132 green at about a third of Fable's cost; the judge stays Fable 5.1 and Opus pass rates start a new series. Release notes: https://github.com/garrytan/gstack/blob/main/CHANGELOG.md#1911440---2026-10-18 Changelog: https://github.com/garrytan/gstack/blob/main/CHANGELOG.md Commits: https://github.com/garrytan/gstack/commits/main

Ask

Ask about this presentation

Answers are generated from this presentation.

Chapters

  1. 0:00Opus 5.5
  2. 0:14Cost
  3. 0:28Grading
  4. 0:40Opus wording
  5. 0:55Your runs
Show transcript

Opus 5.5

gstack logo

gstack now tests every skill change on Claude Opus 5.5

Fable 5.1
model under test before
Opus 5.5
model under test now
132 / 132
cases green on the first full Opus gate
Opus 5.5CostGradingOpus wordingYour runs
garrytan/gstack · CHANGELOG.md

gstack's paid pull request gate now tests every skill change on Claude Opus 5.5 instead of Fable 5.1. The first full Opus gate passed all a hundred and thirty-two of its cases.

Cost

A full gate costs about a third of Fable’s

$32.33
first full Opus 5.5 gate
$93.16
Fable 5.1 mean, ten full gates
Session time 11,859 s → 6,159 s. The Claude CLI runs Opus 5.5 at medium effort by default, Fable at high.
Opus 5.5CostGradingOpus wordingYour runs
garrytan/gstack · CHANGELOG.md

A full gate now costs about a third as much, thirty-two dollars against Fable's ninety-three. Sessions take about half the time, with Opus at medium effort by default and Fable at high.

Grading

The judge stays Fable 5.1

Judge stays Fable 5.1: the calibration fixtures are keyed to it
New series Opus trials carry harness version 6, Fable trials 5, so pass rates never pool
Unchanged thresholds, trial counts, case kinds. Warmup and distill stay on Haiku.
Opus 5.5CostGradingOpus wordingYour runs
garrytan/gstack · CHANGELOG.md

Grading stays put. The judge is still Fable 5.1, because its calibration is keyed to it. Opus results start a new pass rate series, so they never mix with Fable's.

Opus wording

The gate now understands how Opus phrases things

/ship “integrate the hook yourself” counts as reporting manual setup
/investigate a continue-or-abort question in its own words is recognized by its two options
Permission dialogs one left unanswered fails within 20 s, named, instead of a 600 s timeout
Opus 5.5CostGradingOpus wordingYour runs
garrytan/gstack · CHANGELOG.md

The checks also learned how Opus talks. Saying integrate the hook yourself now counts as manual setup, and a continue or abort question is recognized by its options. An unanswered permission dialog fails within twenty seconds.

Your runs

Need Fable for one run? The changelog covers it

CHANGELOG.mdgstack release notes, “If you…”
Which model do your gstack skills run on: Opus 5.5 or Fable 5.1?
Opus 5.5CostGradingOpus wordingYour runs
garrytan/gstack · CHANGELOG.md

Need Fable for a single run, or comparing pass rates across the switch? The changelog covers both. Which model do your gstack skills run on, Opus 5.5 or Fable 5.1?