AI daily use case · November 12, 2026
Running small open models locally on your own machine
People are running small open-weight models directly on laptops and desktops for private, offline tasks. Recent releases include a 0.8B on-device model built for function calling and personal-assistant tool use, a Qwen-family model that builders claim handles complex multi-instruction prompts at small active sizes, and quantized Qwen variants aimed at running larger models on Macs. Local meeting tools such as Yogurt show the same pattern in a finished app, with transcripts and summaries staying on the device. The appeal is privacy, no per-token cost and offline use, as small models get good enough for real tasks.
Go deeper
- r/LocalLLaMAqwen3.8-flash shows us a glimpse of whats possible for smaller hardware
- r/LocalLLaMAKQuant - new quantization technique, 3.7× better quants for Qwen Flash Next 180B, Qwen 27B, 35B, 9B (measured in KL-divergence reduction) (MLX)
- r/LocalLLaMAqvac/BotPsy-0.8B · Hugging Face - On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model
- Hacker News: Show HNShow HN: Yogurt – Free, private, open-source alternative to Granola
- r/LocalLLaMAEdge0/Edge0-145B-q3k · Hugging Face