local-ai-models
Latest stories covering local-ai-models, with summaries and links to related coverage.
3 articles · page 1 of 1
Connected topics
Odysseus – self-hosted AI workspace
tool
7 min read
Odysseus is a self-hosted AI workspace designed to replicate the UI experience of ChatGPT and Claude while prioritizing local and privacy-first operations. Users can easily chat with any local model or API, including vLLM, llama.cpp, Ollama, OpenRouter, and OpenAI.
1-Bit Bonsai Image 4B Image Generation for Local Devices
tool
6 min read
Bonsai Image 4B is a family of compact image-generation models designed for high-quality diffusion inference on local devices, including laptops and phones. The 1-bit variant utilizes binary transformer weights with an FP16 scaling factor, achieving maximum compression with 1.125 effective bits per weight.
I ran Gemma 4 as a local model in Codex CLI
tool
7 min read
Gemma 4 was tested as a local model in Codex CLI to determine its viability as a replacement for cloud models in coding tasks. The testing involved using a 24 GB M4 Pro MacBook Pro to evaluate Gemma 4's local tool calling capabilities.