← All topics
bittorrent
Latest stories covering bittorrent, with summaries and links to related coverage.
1 stories · 1 reports · page 1 of 1
Connected topics
Petals: Run LLMs at home, BitTorrent-style
tool
1 min read
Petals allows users to run large language models at home using a BitTorrent-style network to share model parts. It supports models like Llama 3.1, Mixtral, Falcon, and BLOOM, enabling fine-tuning and single-batch inference speeds of up to 6 tokens/sec for Llama 2 and 4 tokens/sec for Falcon.