Eric Zhang

Verified

Original post / EN

Inspired by @typesafeai , here is a Jev-compatible public API to play with It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s. https://t.co/bbRh4yAPAB https://t.co/misKQE8n8f

views: 109,7 mil
likes: 873
saves: 821
reposts: 50

Ver original ↗

Links and projects

github.comGitHub - ekzhang/openjev-sglang: Jev-compatible API endpoint based on open models (prefill-only) ↗Jev-compatible API endpoint based on open models (prefill-only) - ekzhang/openjev-sglang

Fonte

This independent archive preserves a public post with attribution. Text, media, account details and trademarks belong to their respective owners.