hardware-architecture
Latest stories covering hardware-architecture, with summaries and links to related coverage.
3 articles · page 1 of 1
Connected topics
Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
research
13 min read
Ultrafast inference and online learning can be achieved using hardware architectures designed for Kolmogorov-Arnold Networks (KAN) on FPGAs. The research focuses on optimizing these architectures to enhance machine learning performance.
447 TB/cm² at zero retention energy – atomic-scale memory on fluorographane
research
1 min read
A new memory architecture using single-layer fluorographane can achieve 447 terabytes per square centimeter with zero retention energy. This innovation aims to address the widening gap between processor throughput and memory bandwidth, exacerbated by increased AI demand and a NAND flash supply crisis.
David Patterson: Challenges and Research Directions for LLM Inference Hardware
2 min read
Large Language Model (LLM) inference faces significant challenges primarily related to memory and interconnect issues rather than compute power. The autoregressive Decode phase of Transformer models distinguishes LLM inference from training, complicating the process.