Groat: A Proxy That Tries to Spend Your LLM Budget Like It's Its Own
Most LLM proxies show you the bill. Groat, a self-hosted Rust proxy, tries to shrink it -four levers, ordered by how much you should trust them, plus two research-stage ideas borrowed from OS scheduling.