GPT-6 Astra reads raw weights only on tiny networks, and Postman installs itself into Codex

3 hours ago

GPT-6 Astra's weight-space programming reads raw weights only on small networks, and its Qwen math fix needed Python; Qwen 3.8 27B on a laptop passes the paper's no-tools test too. Also from Tuesday's Hacker News front page: Stockfish on a 1995 Pentium Pro, Codex's training setting turning itself back on, and Postman installing plugins into Codex and Claude Code. The 'Astra can read and write weights to improve Qwen' post is misleading, by Matthew Honnibal https://honnibal.dev/blog/astra-read-write-misleading Discussion: https://news.ycombinator.com/item?id=50351111 x313 on the Qwen fix as a standard steering project: https://news.ycombinator.com/item?id=50353792 Qwen 3.8 27B on my laptop can interpret model weights, too, by Simon Willison https://simonwillison.net/2026/Nov/3/qwen-can-interpret-model-weights/ Discussion: https://news.ycombinator.com/item?id=50355251 Could a modern chess engine on a Pentium have defeated Kasparov in 1996? by Nicholas Carlini https://nicholas.carlini.com/writing/2026/algorithmic-improvements-chess.html Discussion: https://news.ycombinator.com/item?id=50349276 k2052 on beating the Pentium: https://news.ycombinator.com/item?id=50358059 OpenAI seems to be silently re-enabling model training on Codex chats https://news.ycombinator.com/item?id=50352757 chriskanan on the setting coming back on: https://news.ycombinator.com/item?id=50356642 The setting: https://chatgpt.com/settings/data-controls Postman silently auto-installs AI plugins into Codex and Claude Code https://github.com/postmanlabs/postman-app-support/issues/14370 Discussion: https://news.ycombinator.com/item?id=50354960 The front page that day: https://news.ycombinator.com/front?day=2026-11-03

Ask about this presentation

Chapters

  1. 0:00Astra reads raw weights
  2. 0:33The Qwen math fix
  3. 1:07Qwen 3.8 on a laptop
  4. 1:37Stockfish on a Pentium Pro
  5. 2:10Codex training setting
  6. 2:40Postman installs itself into Codex
Show transcript
  1. On Tuesday's Hacker News front page, the lead story was GPT-6 Astra, and how much of a network it can really edit by reading its weights. A paper called Sparks of Weight-Space Programming has Astra look at a network's raw numbers, with no tools, and say what it was trained to do. Matthew Honnibal, who wrote spaCy, sorted every experiment in it. The no-tools setting only covers small networks, up to about 170,000 weights. Every test on a real language model has Astra writing Python.

    Slide text

    GPT-6 Astra reads raw weights only on tiny networks

    Raw weights, no tools
    Networks of 17K to 172K weights: name the game, name the shape, fix a stuck car policy
    Python, and runs the model
    Every experiment on a real language model: Qwen3.5 0.8B, Gemma 3 270M
  2. The headline result is a fix for Qwen3.5 0.8B, which got stuck in reasoning loops. Astra edited a tiny fraction of its weights, and the model went from solving about one math problem in thirteen to nearly half. To get there it wrote code and ran Qwen on up to fifty batches of practice problems. Honnibal calls that work a human machine learning engineer could do. x313, who works in interpretability research, puts it at four to eight hours by hand.

    Slide text

    Astra stops Qwen3.5 0.8B looping, and its math jumps

    7.9% → 48.1%
    MATH-500 · 0.016% of weights edited · up to 50 practice batches

    The method is the standard intro-level interpretability project, four to eight hours for a human who knows LLM internals.

    x313, paraphrased
  3. The no-tools test is one you can run yourself. Simon Willison fed the paper's game prompts to Qwen 3.8 27B, a 17 gigabyte model, in LM Studio on his laptop. The prompts are on GitHub, and they need a long context window. From the weights alone, Qwen named Pac-Man, Pong and Breakout, taking close to an hour for each one, and it missed Freeway. Willison thinks a patient person with a pencil and paper could get there too.

    Slide text

    Qwen 3.8 27B names three games from raw weights on a laptop

    $ llm -f …/exp1_which_game/runs/pacman/prompt.txt \ -m lmstudio/qwen/qwen3.8-27b
    Pac-Man✓ Pong✓ Breakout✓ Freeway✗
  4. Nicholas Carlini ported Stockfish to a 200 megahertz Pentium Pro from 1995, with 64 megabytes of RAM. Tuned for that chip, it plays far above Kasparov, by a margin where it should score better than nine games in ten. So a desktop of that era could have beaten him without Deep Blue's custom chess chips, and most of the gain since then came from better software. The machine is online and you can play it. k2052, an expert-level club player, reports finding a line that beats it.

    Slide text

    Stockfish on a 1995 Pentium Pro outplays Kasparov's 1996 level

    Stockfish port, 200 MHz Pentium Pro
    ≈3300
    Garry Kasparov, 1996
    ≈2800
    Deep Blue
    ≈2700

    An expert-level player found a line that beats it, and engine ratings don't map onto human ones.

    k2052, paraphrased
  5. If you turned off training on your Codex chats, check that it is still off. One company had everyone disable data sharing to keep its code away from the labs, and several of its engineers found the setting, Improve the model for everyone, switched back on in ChatGPT's data controls. chriskanan had asked twice for training to be disabled, and both requests were granted, and found it on again. OpenAI's privacy portal has a second switch for the same thing.

    Slide text

    Codex users find model training switched back on

    Improve the model for everyone
    chatgpt.com/settings/data-controls

    Two past requests to disable training, both granted, and it was enabled again.

    chriskanan, paraphrased
  6. The Postman desktop app installs plugins into Codex and Claude Code when an existing, signed-in user opens it, along with the Postman CLI. indicava found a startup hook that tells Codex to load a Postman skill before any non-trivial API task, and installer code that tries to approve that hook on its own. A second user saw the same install on a newer build. If I needed an API client this week, I'd use Bruno, because it keeps your requests as plain files in your git repo.

    Slide text

    Postman installs itself into Codex and Claude Code

    Codex
    Postman plugin, a startup hook, and the installer approving that hook
    Claude Code
    Postman plugin enabled at user scope
    ~/.local/bin
    The Postman CLI
    Bruno keeps your requests as files in git

What happened in AI today, in your inbox

One short email each evening. Read it and you’re caught up.

Built with ❤️ in New York