Pratim Bhosale: Von Sprachabsicht zu Tool-Aufrufen

Localized reading

Von Sprachabsicht zu Tool-Aufrufen

Original post / EN

Played around with @typesafeai Jev today, mostly to understand what it does for tool calling. Instead of an LLM deciding what to do, I substituted that part with Jev. My learning is that we will be able to make the agent act before the user finishes the sentence. So far, we've used different LLM combinations (non-thinking + thinking ) plus state machine setups to get the right experience for the end user. TLDR is to understand more about how voice agents can run decisions on partials instead of waiting for the end of the turn, with lower costs.