Starchild: Routage des prompts de Starchild

Localized reading

Routage des prompts de Starchild

Original post / EN

Starchild just became the first professional-grade app to integrate Jev from @typesafeai We use Jev to help route to LLMs which gave a 20x decrease in cost and 6x increase in speed for prompt classification Here it is classifying prompts in real-time (avg time was 140ms)