Alex Stone

Localized reading

TYPESAFE는 텍스트를 생성하지 않는 모델을 출시하여 에이전트 루프의 비용 수준을 무너뜨렸습니다. jev는 시스템 1개 모델이라고 부르는 것입니다. 상태와 일련의 질문을 보내면 입력된 답변이 반환됩니다.

Original post / EN

TYPESAFE RELEASED A MODEL THAT DOESN'T GENERATE TEXT, AND IT BREAKS THE COST FLOOR OF THE AGENT LOOP jev is what they call a system one model. you send it a state and a set of questions, it returns typed answers with probabilities. no tokens, no sampling, no sequential decoding. route → decide → guard → run tool → observe → done? they report 20-200x faster inference and 40-400x lower cost than comparable llms on classification tasks. every question in a request is evaluated in parallel, so adding questions barely moves latency. in a two-turn loop that means eight decisions. the two that need a plan still go to a chat model. the other six - pick a model, screen a tool call, check if the task is done - cost 0.06s combined. the takeaway is simple: stop paying generation prices for choices. most of what an agent decides is a pick, a score or a yes/no.