Themata.AI
Follow coverage
Themata.AI
← All topics

Energy efficiency

Source reports covering Energy efficiency. Stories will appear when analysis and community reactions are ready.

8 reports · page 1 of 1

Browse reports ↓Search this topic

Connected topics are temporarily unavailable. You can still browse stories below.

Source reports

  • Why harnesses matter for energy (and token) efficiency

    research

    15 min read

    Neuralwatt found that the software harnesses used by AI agents can materially affect GPU energy consumption by determining whether long prompts reuse a model server’s key-value cache. Across customer traffic from September 8 to October 7, 2026, major clients had 1.6% to 11.1% uncached input. A session with 92% cached input requires about 2.7 times as much prompt-processing work as one with 97% cached input, despite both using the same model and conversation. For comparable 50,000-token requests measured October 1–7, mostly uncached prompts used roughly twice the energy of fully cached prompts; GLM-5.3 used about 2.5 times as much. In sessions exceeding 128,000 tokens, about three turns per 1,000 re-read more than half the prompt, and those turns represented 75% of re-read tokens at that depth. Each re-read about 230,000 tokens on average, roughly the prefill work of 600 normal turns. Neuralwatt’s lab tests attributed all observed cache breaks to harnesses editing earlier prompt content. Changes to reasoning effort, tool lists, dates, skills, reminders and compaction can force servers to recompute prompts from the first altered token. Neuralwatt recommends append-only prompt histories, stable system prompts and tool lists, and settling settings before sessions become long.

    Caching strategiesAI optimizationDeveloper tools
  • Should you wash your solar panels?

    research

    4 min read

    Cleaning solar panels can result in a 2%-5% increase in power output. Dust accumulation over time can significantly impact the efficiency of solar energy generation.

  • What's slowing down the AI buildout

    news

    23 min read

    America has sufficient electricity to power its data centers, but the challenge lies in delivering it to the necessary locations. A major project, Stargate, is being developed in Abilene, Texas, as part of a larger initiative by OpenAI and Softbank.

  • Un-0: Generating Images with Coupled Oscillators

    tool

    27 min read

    Un-0 is an image generator that utilizes a simulated system of coupled oscillators, representing a new type of physical computing substrate. It achieves an FID score of 6.74 on ImageNet 64×64, demonstrating competitive performance in image generation.

  • 245TB Micron 6600 ION Data Center SSD Now Shipping

    news

    7 min read

    Micron Technology is now shipping the 245TB Micron® 6600 ION SSD, the highest capacity commercially available SSD. This drive enhances rack-scale storage density and offers improved energy efficiency compared to traditional hard drives.

  • Are Data Centers Sitting On A Goldmine Of Wasted Energy?

    news

    2 min read

    Data centers consume vast amounts of energy to support increasing digital services and computing power, resulting in significant heat emissions. For example, Equinix, based in California, is the world's largest data center operator and contributes to local temperature increases due to heat generated.

  • Mother of All Grease Fires (1994)

    news

    3 min read

    The office building in Palo Alto requires approximately one megawatt (1 million watts) of electricity to operate. Its location is surrounded by restaurants and hotels.

  • Human Existence Is Just as Wasteful as AI Data Centers, Sam Altman Suggests

    opinion

    3 min read

    Sam Altman argued that human upbringing may be less energy-efficient than AI training during the AI Impact Summit in India. He advocated for a rapid shift to nuclear, wind, and solar energy sources in response to criticism of his comparison between human value and data center efficiency.

Explore all topics →