A datacenter GPU was installed in a gaming PC using an adapter, providing a total of 32GB of VRAM across two GPUs. This setup allows for running a 27 billion parameter model at 32 tokens.

AlphaEvolve has transitioned from pilot testing to a core component of AI infrastructure, optimizing TPU design and discovering efficient cache replacement policies in two days. It is focused on enhancing the lowest levels of hardware supporting AI systems.

llmfit is a terminal tool that optimizes large language models (LLMs) for specific hardware configurations, assessing RAM, CPU, and GPU capabilities. It features an interactive TUI and classic CLI mode, supports multi-GPU setups, and provides dynamic quantization selection and speed estimation.