hermes-ai.net

Read docs →
HermesHermes Agent Docs
Back to News

Tsinghua's SMELT Cuts AI Training Costs 18% by Looping Layers Twice

New scaling laws show that looping the middle half of a Mixture-of-Experts model twice saves up to 18% of training compute at matched budgets.

Tsinghua's SMELT Cuts AI Training Costs 18% by Looping Layers Twice
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read

New scaling laws show that looping the middle half of a Mixture-of-Experts model twice saves up to 18% of training compute at matched budgets.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report