Running a 28.9M parameter LLM on an $8 microcontroller
A 28.9 million parameter language model generates text on the ESP32-S3 microcontroller, which costs about $8. The model operates entirely on the chip without server communication, displaying output on a small screen at approximately 9 tokens per second.
github.com
3 min
5h ago
Running a 28.9M parameter LLM on an $8 microcontroller
A 28.9 million parameter language model generates text on the ESP32-S3 microcontroller, which costs about $8. The model operates entirely on the chip without server communication, displaying output on a small screen at approximately 9 tokens per second.
github.com
3 min
5h ago
Running a 28.9M parameter LLM on an $8 microcontroller
A 28.9 million parameter language model generates text on the ESP32-S3 microcontroller, which costs about $8. The model operates entirely on the chip without server communication, displaying output on a small screen at approximately 9 tokens per second.
github.com
3 min
5h ago
No more articles to load