Looking Ahead makes Wan video models more physically plausible, with generation unchanged

3 weeks ago

Looking Ahead adds Future Chunk Prediction to autoregressive video model training: small side branches predict chunks one to five steps ahead, then get dropped at inference. On Physics-IQ Verified, Wan 2.1 1.3B and Wan 2.2 5B score about a tenth higher with the same data and budget. Gao et al., Nanjing University, ARC Lab at Tencent IEG and Zhejiang University; arXiv 2610.29989v1, submitted 21 October 2026. Paper: https://arxiv.org/abs/2610.29989 Code: https://github.com/TencentARC/Looking-Ahead Weights: https://huggingface.co/TencentARC/Looking-Ahead

Ask about this presentation

Chapters

  1. 0:00Looking Ahead
  2. 0:14Teacher forcing leaves a shortcut
  3. 0:28Side branches predict further ahead
  4. 0:41Dominoes and melting ice
  5. 0:55Higher physics scores at both sizes
  6. 1:13What the branches must not see
  7. 1:26About half the training compute
  8. 1:41What is still untested
  9. 1:56Code and weights
Show transcript
  1. Video models that build a clip chunk by chunk get physics right more often when training also makes them predict further ahead. The method is Future Chunk Prediction, and generation runs exactly as before.

    Slide text
    AI Papers

    Looking Ahead makes Wan video models more physically plausible, with generation unchanged

    Ruopeng Gao, Yukun Huang, Limin Wang and colleagues · Nanjing University, ARC Lab at Tencent IEG, Zhejiang University

    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · submitted 21 Oct 2026
  2. These models train with teacher forcing. The model always sees the real chunks right before the one it denoises. Those look nearly identical, so it can copy them and learn little about change.

    Slide text
    01 02 03 The method

    Neighbouring chunks look almost the same, so copying them passes training

    Teacher forcing the real previous chunks are always in view while the next one is denoised
    Local continuity enough to recover the next chunk, with little pressure to learn how the scene evolves
    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · Sections 1 and 4.1
  3. Future Chunk Prediction adds small side branches. Each predicts a chunk one to five steps ahead from the current chunk alone. They get no prompt and no chunks in between. Generation drops them.

    Slide text
    01 02 03 The method

    Small side branches predict chunks one to five steps ahead

    k−1
    k
    →
    k+1
    k+2
    k+3
    k+4
    k+5
    Current chunk only no text prompt and no chunks in between
    Removed at inference the same generator, at the same cost
    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · Section 4, Figure 1, Table 5
  4. Plain teacher forcing is on top, Future Chunk Prediction underneath. The baseline's dominoes collapse in the middle, while the new model topples them along the line. Only the new model shows melting ice raising the water.

    Slide text
    01 02 03 The results

    Dominoes fall along the line, and melting ice raises the water

    teacher forcing, top row Future Chunk Prediction, bottom row
    Domino scene: the teacher-forcing video collapses in the centre, the FCP video topples along the line

    Baseline collapses in the centre

    Ice in a glass: the FCP video shows the water level rising as the ice melts

    Water level rises only in the bottom row

    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · Figure 3, Wan 2.2 5B
  5. Physics-IQ Verified scores a generated clip against a real recording of the same experiment. With the same data and budget, both model sizes score roughly a tenth higher. The 5 billion parameter model edges past Wan 2.2 at 14 billion.

    Slide text
    01 02 03 The results

    Same data and budget, closer to the real recordings

    teacher forcing + Future Chunk Prediction
    Wan 2.1 1.3B · image to video
    27.6
    30.9
    Wan 2.2 5B · image to video
    30.4
    33.8
    Wan 2.2 5B · video to video
    40.6
    44.4

    Across models trained on different data, the 5B model's 33.8 sits above Wan 2.2 14B (32.2) and HunyuanVideo 1.5 (33.4).

    Physics-IQ Verified, 198 scenes, mean of 4 seeds · Gao et al. · arXiv 2610.29989v1 · Tables 1, 2, 4
  6. The branches only help when they can't peek. Chained, each branch sees the last one's guess, and the 5 billion parameter model barely improved. Giving them the text prompt also lowered the score.

    Slide text
    01 02 03 The results

    The gain depends on what the branches cannot see

    Chained branches at 5B, a marginal image-to-video gain, no video-to-video gain
    Parallel branches better than chained at both sizes
    Text prompt in the branches lowered the score at 1.3B
    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · Section 5.5, Tables 2 and 4, Figure 2
  7. Next Forcing, the closest related method, predicts from the whole history. Using only the current chunk reaches the same physics score with roughly half the training compute. At equal compute it still beats teacher forcing.

    Slide text
    01 02 03 The results

    Predicting from the current chunk alone needs far less training compute

    −42.6% training compute to reach a Physics-IQ score of 29
    −50.7% to reach 30, against branches that see the whole history

    At comparable compute it also scores above plain teacher forcing.

    Wan 2.1 1.3B · Gao et al. · Looking Ahead · arXiv 2610.29989v1 · Figure 4, Section 5.5
  8. Both test models start from pretrained Wan checkpoints and make five-second clips. Bigger models and longer videos are untested. Gains on three benchmarks judged by vision-language models are small. Some training data is private.

    Slide text
    01 02 03 The limits

    Tested on two Wan models and five-second clips

    Untested larger models, longer videos, training from scratch
    Small gains on WorldModelBench, PAI-Bench-G and PhyGround, judged by vision-language models
    Internal data part of the training set stays private, so an exact rerun isn’t possible
    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · Table 3, Appendix C.3, Reproducibility statement
  9. The code and four checkpoints, both Wan sizes with and without Future Chunk Prediction, are out under Apache 2.0. If you train a chunk-by-chunk video model, which one would you try this on?

    Slide text
    01 02 03 The limits

    Looking Ahead

    Paper arxiv.org/abs/2610.29989
    Code github.com/TencentARC/Looking-Ahead
    Weights huggingface.co/TencentARC/Looking-Ahead

    Which chunk-by-chunk video model would you train with Future Chunk Prediction?

    Gao et al. · Looking Ahead · arXiv 2610.29989v1 · code and weights Apache-2.0

What happened in AI today, in your inbox

One short email each evening. Read it and you’re caught up.

Built with ❤️ in New York