hermes-ai.net

Read docs →
HermesHermes Agent Docs
Back to News

CUHK's NoRA Fixes LoRA's Hidden Gradient Gap With one Line

A one-line change to LoRA's initialization closes the gradient gap with full fine-tuning, boosting speed and stability with zero extra parameters.

CUHK's NoRA Fixes LoRA's Hidden Gradient Gap With one Line
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read

A one-line change to LoRA's initialization closes the gradient gap with full fine-tuning, boosting speed and stability with zero extra parameters.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report