Superpowers’ brainstorming skill now asks whether you want to pick the platform, or leave it to the agent

1 month ago

Superpowers’ brainstorming skill now finds out early which choices about how a project gets made (platform, language, libraries, medium) you want to make yourself, and states any defaults it picks out loud. Merged to the dev branch; measured in Claude Code, inconclusive on Codex. https://github.com/obra/superpowers/pull/2482

Ask about this presentation

Chapters

  1. 0:00Superpowers’ brainstorming skill now asks whether you want to pick the platform, or leave it to the agent
  2. 0:19Asked to design an iOS app, brainstorming built a web app
  3. 0:34A clean Codex session on dev made the same mistake
  4. 0:46A new “How it gets made” step asks early who owns each choice
  5. 0:57What it does next depends on who it’s working with
  6. 1:09A default the agent picks goes in the design as its own call
  7. 1:21The same step covers a painting or a cake
  8. 1:33In Claude Code, every hobbyist run now offered a say before choosing
  9. 1:47On Codex, the results are inconclusive
  10. 1:59It still guesses the kitchen equipment before planning a cake
  11. 2:12The change is on the dev branch, after release 6.4.2
Show transcript
  1. Superpowers changed its brainstorming skill on October 9. Before, someone asked for an iOS app and got a web app, because the agent picked the platform without asking. Now it asks first: do you want to pick the platform, language and libraries yourself, or should the agent pick them and tell you what it chose?

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    Before: asked for an iOS app, it designed a web app without asking.
    Now it asks first: do you pick the platform, language and libraries, or does the agent pick and tell you?
    skills/brainstorming/SKILL.md · obra/superpowers PR #2482
  2. Drew asked Codex, running Superpowers 6.4.2, to design an iOS app for managing OCD. Brainstorming never asked about platform. The design was a web app with a home-screen icon. Drew wanted a native app.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    what Drew wanted
    a native iOS app
    what the design was built to
    a web app with a home-screen icon
    Codex desktop app · GPT-6.1-Sol · Superpowers 6.4.2
    PR #2482 body · “What problem are you trying to solve?”
  3. In a fresh Codex session, brainstorming talked through the experience for three turns. Then it announced a phone-friendly prototype, and built a web app without ever bringing up platform.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    after three turns about the experience
    “I’ll build a phone-friendly prototype”
    It built a web app and never raised platform.
    PR #2482 body · reproduction on the dev branch
  4. Every project rests on choices like platform, language and libraries. Early on, the agent now asks which of those you want to make, which you're handing over, and what you already have.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    which choices you want to make
    which you’re handing to the agent
    what you already have to work with
    For an app: platform, programming language, libraries
    skills/brainstorming/SKILL.md · “How it gets made”
  5. Some users have firm views on their stack, and novices want the agent to decide. It talks it through with the first, picks defaults out loud for the second, and builds on an existing project's stack.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    strong views or skills talk it through
    counting on the agent sensible defaults, said plainly
    existing work build on what it already uses
    skills/brainstorming/SKILL.md · “How it gets made”
  6. A choice the agent makes goes in the design as its call, never as something you agreed to. Filling in defaults used to be a red flag. Now it's fine, if the agent says them out loud.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    Red Flags table · “I’ll fill in sensible defaults”
    Those defaults are your preferences. Ask, or ask whether they want you to choose.
    Good. Say them out loud. A default they never heard is one they couldn’t reject.
    skills/brainstorming/SKILL.md · Red Flags table, PR #2482 diff
  7. Brainstorming gets used outside software too. The first draft only covered technology. The merged version says medium, tools, materials and resources, so it applies to a painting or a cake.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    technology
    medium, tools, materials and resources
    PR #2482 commit “generalize technology guidance to how it gets made”
  8. In Claude Code with Claude Opus 5.5, tested against simulated people, every hobbyist run asked whether they wanted a say, then stated defaults. On an existing Flask app, all three runs named the stack.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    simulated person, 3 runs each before after
    hobbyist, doesn’t care about the stack 1 of 3 asked 3 of 3
    non-technical, existing Flask app 2 of 3 named it 3 of 3
    technical, wants native SwiftUI 3 of 3 asked 3 of 3
    PR #2482 body · Claude Code 2.1.295, Claude Opus 5.5
  9. On Codex, where Drew's failure happened, the authors don't claim an improvement. Most runs stalled on approval prompts. They report no regression, and hand testing on Codex comes next.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    Most runs timed out at approval prompts the simulated person couldn’t answer.
    Several runs in both versions built a React app on the first turn.
    PR #2482 body · Codex CLI 0.162.0, GPT-6.1-Sol
  10. One gap remains. Planning a scaled-up cake, the agent still assumed which pans the baker owned and let the baker correct it. The assumption was said out loud, and silent choices were Drew's failure.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    scaling a recipe from 8 to 25, one 9-inch pan
    stated its pan assumptions · the baker corrected them
    PR #2482 body · “Known gap”
  11. It's on the dev branch, so the latest release, 6.4.2, still has the old wording. The full results are in pull request 2482 in the Superpowers repository.

    Slide text
    github.com/obra/superpowers · brainstorming merged Oct 9, 2026 · dev branch
    main and v6.4.2 still carry the old wording measured in Claude Code · inconclusive on Codex
    github.com/obra/superpowers/pull/2482
    PR #2482 · obra/superpowers

What happened in AI today, in your inbox

One short email each evening. Read it and you’re caught up.

Built with ❤️ in New York