Daily Tokens
November 12, 2026

AI daily use case · November 12, 2026

Running small open models locally on your own machine

People are running small open-weight models directly on laptops and desktops for private, offline tasks. Recent releases include a 0.8B on-device model built for function calling and personal-assistant tool use, a Qwen-family model that builders claim handles complex multi-instruction prompts at small active sizes, and quantized Qwen variants aimed at running larger models on Macs. Local meeting tools such as Yogurt show the same pattern in a finished app, with transcripts and summaries staying on the device. The appeal is privacy, no per-token cost and offline use, as small models get good enough for real tasks.

Go deeper

More from AI on Thursday, November 12