Nvidia is proposing a beast of a CPU system for Windows PCs. It has 128 GB of shared memory and comes with up to 6,144 state-of-the-art CUDA cores. CPU wise, the chip has 10 performance cores and 10 efficiency cores. The performance cores are based on the Cortex-X925. These Bạn mới làm quen với X ư? Đăng ký ngay để nhận dòng thời gian cá nhân hóa của riêng bạn!

Lucebox is an optimization hub for hand-tuned LLM inference, specifically designed for individual consumer hardware. It features kernels, speculative decoding, and quantization tailored for each target, with the first megakernel for hybrid DeltaNet/Attention LLMs achieving 1.87 tokens per joule on a 2020 GPU.

BarraCUDA is an open-source CUDA compiler designed for AMD GPUs, capable of compiling .cu files directly to GFX11 machine code and generating ELF .hsaco binaries. The compiler, written in 15,000 lines of C99, has no LLVM dependency and aims to support additional architectures in the future.