hardware-optimization
Latest stories covering hardware-optimization, with summaries and links to related coverage.
3 articles · page 1 of 1
Connected topics
I put a datacenter GPU in my gaming PC
tool
14 min read
A datacenter GPU was installed in a gaming PC using an adapter, providing a total of 32GB of VRAM across two GPUs. This setup allows for running a 27 billion parameter model at 32 tokens.
AlphaEvolve: Gemini-powered coding agent scaling impact across fields
tool
4 min read
AlphaEvolve has transitioned from pilot testing to a core component of AI infrastructure, optimizing TPU design and discovering efficient cache replacement policies in two days. It is focused on enhancing the lowest levels of hardware supporting AI systems.
Right-sizes LLM models to your system's RAM, CPU, and GPU
tool
15 min read
llmfit is a terminal tool that optimizes large language models (LLMs) for specific hardware configurations, assessing RAM, CPU, and GPU capabilities. It features an interactive TUI and classic CLI mode, supports multi-GPU setups, and provides dynamic quantization selection and speed estimation.