My local model setup on an M4 Pro Mac Mini

I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM. It handles everything from my Hermes agent backend to quick chat queries on my phone. The whole thing takes about 30 minutes to set up. Here is the stack: - Qwen3.6-35B-A3B-OptiQ-4bit: my main model for anything that needs reasoning or depth - Gemma-4-E4B-it-OptiQ-4bit: lightweight model for simple chats, formatting, and other routi...