NCM: A New Approach to AI Language Generation

Next-Concept Modeling (NCM) is a language modeling architecture introduced by researchers from Hazy Research at Stanford University. It proposes a significant shift in how AI models generate text.

Instead of producing one word or token after another, as traditional autoregressive LLMs do, NCM constructs a hierarchical representation of the response, starting with an abstract structure and progressively refining its details.

The central idea is to generate a global representation of the response first, then refine it in parallel, rather than constructing the response sequentially, token by token.