Interesting paper to improve recurrent reasoning.

Looped models are great because you get more reasoning out of a model without adding parameters.

So this work proposes a looped architecture with a new training method.

The authors report wins over prior looped models on five of six reasoning benchmarks.

More details from the paper:

Looped models reason by updating a hidden state again and again at inference time. The hard part is training. Gradients usually flow through only the last one or two updates, so the early updates never learn to set up the later ones.

Looped flows train the recurrence with local denoising objectives, the way flow models are trained. Noise levels decrease step by step and share the same noise sample, which ties each update to the next.

At inference the model follows a probability flow. A finer time grid spends more compute, and different starting noise can produce different valid answers on tasks with more than one solution.

Paper: https://t.co/nmEsktuS8f

Chat with Paper: https://t.co/gKcJTZ3LGS