model-inference
Latest stories covering model-inference, with summaries and links to related coverage.
2 articles · page 1 of 1
Connected topics
Popping the GPU Bubble
research
15 min read
GPUs often remain idle during AI model inference due to delays in receiving instructions from the CPU, leading to a phenomenon known as the GPU bubble. Optimizing communication between the CPU and GPU can enhance the efficiency and speed of AI model execution.
Cloudflare's AI Platform: an inference layer designed for agents
tool
7 min read
Cloudflare's AI platform provides an inference layer that facilitates the integration of multiple AI models for various tasks in agentic coding. This allows users to access different models tailored for specific functions, such as message classification, action planning, and task execution.