Story
My local model setup on an M4 Pro Mac Mini
1 report
1 website
1 discussion
Latest report
Overview
I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM. It handles everything from my Hermes agent backend to quick chat queries on my phone. The whole thing takes about 30 minutes to set up. Here is the stack: - Qwen3.6-35B-A3B-OptiQ-4bit: my main model for anything that needs reasoning or depth - Gemma-4-E4B-it-OptiQ-4bit: lightweight model for simple chats, formatting, and other routi...
Summary from lws.io.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · lws.io
Historical count: 14 · 14 saved in sample · Historical sample
Awaiting analysis