decision-models
Latest stories covering decision-models, with summaries and links to related coverage.
1 articles · page 1 of 1
Connected topics
Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console
tool
5 min read
PS5LM is a homebrew application that runs GGUF language and decision models locally on jailbroken PlayStation 5 consoles using llama.cpp’s Vulkan backend and the console’s RDNA 2 GPU. It turns the PS5 into a private network model server without requiring a PC, cloud service or account while running. Devices on the local network can access OpenAI-compatible /v1/chat/completions and Anthropic-compatible /v1/messages endpoints at the console’s port 8081; Claude Code can use the Anthropic-compatible API. The application assigns up to 11.4 GB of shared PS5 memory to a model and its context, selects a context length and cache that fit available memory, and can download supported GGUF files from Hugging Face. Listed PS5 Slim performance includes 207 tokens per second for Qwen 3.5 0.8B Q4_K_M, 55 tokens per second for Qwen 3.5 9B Q4_K_M, and about 20 tokens per second with a 64,000-token context for Qwen 3.8 27B UD-Q2_K_XL. PS5LM also supports GGUF decision models with llama.cpp decision metadata, including d1, Clef and OpenJev models. These models serve TypeSafe’s /v1/systemone API for typed choices, scores and yes-or-no responses about text and images. PS5LM requires a PS5 on firmware 7.00 through 13.60 with a jailbreak and specified homebrew payloads, including kstuff-lite, etaHEN and ShadowMountPlus.