hermes-ai.net

Read docs →
HermesHermes Agent Docs
Back to News

SparkLLM's Spark-X2.5 Packs 1M-Token Context Into a Tiny 4B Model

A compact 4B open-source model with hybrid sliding-window attention, native 1M-token context, and agent-focused benchmarks that top comparable small models.

SparkLLM's Spark-X2.5 Packs 1M-Token Context Into a Tiny 4B Model
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read

A compact 4B open-source model with hybrid sliding-window attention, native 1M-token context, and agent-focused benchmarks that top comparable small models.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report