taalas
Latest stories covering taalas, with summaries and links to related coverage.
1 articles · page 1 of 1
Connected topics
How Taalas “prints” LLM onto a chip?
tool
4 min read
Taalas has released an ASIC chip that runs Llama 3.1 8B with an inference rate of 17,000 tokens per second, equivalent to writing approximately 30 A4-sized pages in one second. The chip is claimed to be 10 times cheaper in ownership costs and 10 times more energy-efficient than GPU-based inference systems, while also being 10 times faster than current state-of-the-art inference solutions.