EPFL's LAW Beats Discrete Diffusion Baselines by Carrying Soft Token States
A new continuous language model called LAW ditches discrete token sampling between steps, propagating expected embeddings instead and outperforming diffusion baselines on reasoning tasks.
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read
A new continuous language model called LAW ditches discrete token sampling between steps, propagating expected embeddings instead and outperforming diffusion baselines on reasoning tasks.
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.
