Sam Witteveen demonstrates building a local model router that intelligently routes tasks to either local or cloud-based LLMs. The system categorizes requests, evaluates difficulty, and detects private information to optimize performance, token usage, and data security while utilizing Jev or open-source alternatives as a decision-making layer.
OpenAI releases GPT-6 Sol and Luna models
OpenAI is expanding its lineup of AI models with the new GPT-6 Sol and GPT-6 Luna, mid-priced and lower tier models designed to serve as enterprise workhorses for common tasks requiring less intelligence — and both are priced at half or less the costs of their predecessors when accessed over OpenAI's application programming interface (API).
Anthropic releases Opus 5.5 with lower prices
Anthropic’s newest model, Opus 5.5, was released on Tuesday, setting a new state-of-the-art in coding and knowledge work performance, according to the company. Opus is the most capable and expensive tier in Anthropic’s three-tier Claude lineup; Sonnet sits in the middle, while Haiku is the fastest and cheapest. Notably, Anthropic says, the release outpaces the larger Fable model in many benchmarks and succeeded in a number of informal tasks that Fable failed to complete.
Xiaomi has released and open-sourced MiMo-V2.6 Pro and Flash, two omnimodal models now available in AI Studio, MiMo apps, its API and OpenRouter.
Sam Witteveen explores Jev, a new system one model designed for fast, non-autoregressive classification tasks in software. By moving away from traditional chat interfaces and long-form text generation, this approach offers a function-call-like method for decision-making that prioritizes speed and efficiency over complex reasoning chains.
On Thursday, PrismML released Bonsai 2 27B, its latest in a family of models, which compresses Qwen3.8 27B, a widely used open source model from Alibaba, down to 5.9 GB. That’s small enough to fit on a PC and, possibly, a high-end smartphone. It’s a 9x to 10x reduction in memory versus the original.
Canadian AI startup Cohere says it can do enterprises one better, assuring them their data remains private and off-limits to itself and cloud providers using Model Vault, the single-tenant inference product it already sells, and a technique called confidential computing.