Generated Computers' Locals Triples AI Agent Throughput on Apple Silicon
Locals is a new Apache 2.0 local inference server for Apple Silicon, built for agents not chat. Hits up to 3x mlx-lm throughput with 8 concurrent requests on Qwen3.5-4B. Based on the paper Breaking the Space Barrier , moving grammar checks onto the GPU.




















