Recreating Minecraft Is Not a Benchmark

GPT Astra released a couple of days ago and, inevitably, within the hour my entire feed was the same five things: recreating Minecraft in one prompt, painting themselves in MS Paint, the pelican riding a bicycle as an SVG, a ball bouncing in a rotating box with believable gravity, and an SVG game controller. On paper these look like harder, more visual problems for a model to solve, there’s a reas...