Bonsai 27B and Inkling Test the Limits of Open Weights
Two new open-weight models point in opposite directions: Bonsai brings a 27B model toward phones, while Inkling targets customization at data-center scale.
Tag
#on-device-ai
Apple M5 Max Makes 70B Parameter LLMs a Laptop Reality
The new MacBook Pro with M5 Max can run large language models entirely on-device, keeping your AI interactions private and offline
Qwen 3.5 Small Models: Run Vision AI on Your Laptop Without Sending Data to the Cloud
Alibaba's new 0.8B to 9B parameter models deliver GPT-class multimodal performance on consumer hardware, with the 9B variant outperforming 13x larger models