Microsoft’s “1‑bit” AI Model Runs On A CPU Only
Researchers at Microsoft's General Artificial Intelligence group have released a new neural network model that works with just three distinct weight values: -1, 0, or 1. The new model's "ternary" architecture reduces overall complexity and "substantial advantages in computational efficiency," the researchers write, allowing it to run effectively on a simple desktop CPU.
You can try this model out now by downloading LM Studio to your computer and adding the model.