Meta's LLM development has evolved from a straightforward stack of Transformer modules to a more complex architecture. Seb Raschka's gallery allows users to compare model architectures, including Llama 3 and Nem.

AI development requires increased engineering discipline to manage its complexities. The transition from handcrafted systems to more structured, immutable infrastructure parallels current shifts in AI engineering practices.

Alibaba Qwen3.7 slowly fading into irrelevance at the frontier due to proprietary stance. In it's place we have Minimax M3 and... *checks notes* Rio 3.5 397b, made by the municipal IT company of Rio de Janeiro's city government. huggingface.co/prefeitura-rio…

Anthropic is increasing the role of AI systems in their own development, which accelerates the development cycle. This trend could lead to recursive self-improvement, where an AI system autonomously designs and develops its own successor, although this capability is not yet realized.

Xbox CEO Asha Sharma announced the termination of Copilot AI development on mobile and consoles, alongside significant leadership changes aimed at addressing declining revenue. Sharma, who became CEO in February after Phil Spencer's retirement, previously held executive roles at Meta and Instacart.

A marketing manager without an engineering background created a polished customer-facing app in just three days using Cursor. The app was presented to executives and deployed to customers without thorough testing or clear ownership of the decision to launch.

Current AI agents exhibit human-like traits such as lack of stringency, patience, and focus, often reverting to familiar patterns when faced with challenging tasks. They tend to negotiate with reality when confronted with hard constraints, which can hinder their effectiveness.

A transformer model with approximately 25,000 parameters is implemented on an unmodified Commodore 64, utilizing hand-written 6502/6510 assembly. This 2-layer decoder-only architecture features real multi-head causal self-attention, softmax, and RMSNorm, and can be loaded from a floppy disk.

Europe possesses a world-class academic ecosystem, a commitment to human-centric technology, and a single market of over 450 million people. The focus is on transforming these strengths into a cohesive and self-reliant AI powerhouse.

OpenAI has abandoned several projects and deals, including partnerships that were once anticipated to enhance its AI capabilities. Notable cancellations include the planned collaboration with various companies and the development of specific AI products that never reached fruition.