AI Post Transformers

This October 15, 2025 collaboration between Meta, UT Austin, UCL, UC Berkeley, Harvard University, and Periodic Labs details a systematic study on scaling compute for reinforcement learning (RL) in large language models (LLMs), aiming to bring predictability to the RL training phase. The authors introduce a principled framework that uses a sigmoidal curve to model the relationship between compute...

These sources and patent discuss SanDisk's development of High Bandwidth Flash (HBF), a technology designed to address the significant memory and bandwidth demands of artificial intelligence models, particularly at the edge, such as on smartphones. The first article details a presentation by SanDisk's Alper Ilkbahar, who introduced HBF as a NAND-based memory solution that mimics High Ban...

This April 2021 academic paper from NVIDIA discusses the challenge of designing converged GPUs that efficiently handle the diverging architectural demands of High Performance Computing (HPC), which uses higher precision arithmetic, and Deep Learning (DL), which increasingly uses low precision math. The authors propose a new architecture called a Composable On-PAckage GPU (COPA-GPU), which uses mul...

The sources detail a novel method called MHA2MLA (Multi-Head Attention to Multi-Head Latent Attention), which efficiently adapts pre-trained large language models (LLMs) to the memory-saving Multi-head Latent Attention (MLA) architecture without requiring full retraining. This framework achieves significant Key-Value (KV) cache compression (up to 96.87% reduction in Llama2-7B) through two main com...

The October 9, 2025 paper details the architecture, training, and evaluation of UniVideo, a unified multimodal generative system capable of handling a wide array of image and video tasks. UniVideo integrates a frozen Multimodal Large Language Model (MLLM) for understanding complex instructions and a multimodal Diffusion Transformer (MMDiT) for generation, connected by a trainable MLP. The system i...

The October 9, 2025 paper from Tencent Youtu Lab introduces Training-Free Group Relative Policy Optimization (Training-Free GRPO), a novel method designed to enhance the performance of Large Language Model (LLM) agents without requiring expensive parameter updates or fine-tuning. This approach, rooted in reinforcement learning principles, shifts policy optimization from the parameter space to the...

The provided texts are excerpts from a RAND Corporation research report titled "Securing AI Model Weights: Preventing Theft and Misuse of Frontier Models," which focuses on the critical need to protect the learnable parameters—or weights—of advanced artificial intelligence models. The report identifies numerous attack vectors, spanning cybercrime to top-tier nation-state operations, and...

These sources collectively discuss advancements in scalable, efficient, and secure machine learning (ML) data systems, often within the context of large-scale datacenter deployments. Several papers address the performance and security trade-offs of using Confidential Computing (CC) and Trusted Execution Environments (TEEs) for large language models (LLMs) and database systems, including utilizing...

The October 6, 2025 paper introduces Multi-Agent Tool-Integrated Policy Optimization (MATPO), a novel reinforcement learning framework designed to improve the performance of large language models (LLMs) in complex, knowledge-intensive tasks. MATPO addresses the limitations of single-agent systems, such as context length and noisy tool outputs, by adopting a multi-agent architecture that includes a...

The provided sources are a collection of Google Cloud documentation and blog excerpts detailing the features and implementation of Confidential Computing services, particularly focusing on Confidential Virtual Machines (VMs) and Confidential Google Kubernetes Engine (GKE) Nodes, especially for AI and ML workloads. The documentation explains that these confidential instances utilize hardware-based...

These sources provide an extensive overview of AWS Nitro Enclaves, an isolated compute environment designed to protect highly sensitive data within Amazon EC2 instances. The AWS material emphasizes that the underlying AWS Nitro System is a foundational security innovation that ensures no Amazon employee can access customer workloads or data, fulfilling the core principle of secure AI infrastructur...

These sources, an announcement from Anthropic and a technical whitepaper co-authored with Pattern Labs, provide an overview of Confidential Inference, a system designed to ensure cryptographically guaranteed security for both proprietary AI model weights and sensitive user data during processing. Confidential Inference leverages Trusted Execution Environments (TEEs), which are hardware-based secur...

This October 6, 2025 paper from Alexia Jolicoeur-Martineau at Samsung SAIL Montréal, provides an overview and detailed comparison of two recurrent reasoning models: the Hierarchical Reasoning Model (HRM) and the proposed Tiny Recursive Model (TRM). HRM is a complex, biologically-inspired approach that uses two small neural networks and deep supervision to outperform Large Language Models (LLMs) on...

On October 6, 2925 Anthropic introduces Petri (Parallel Exploration Tool for Risky Interactions), an open-source framework developed for automated auditing to accelerate AI safety research. Petri uses AI-driven auditor agents to interact with and test the behavior of target language models across diverse, multi-turn scenarios, automating the process of environment simulation and initial transcript...

This October 5 2025 paper presents the first mechanistic explanation for a persistent training instability experienced when using low-precision arithmetic (specifically BF16) with the Flash Attention algorithm in transformer models. The paper identifies the core problem as a "catastrophic loss explosion" caused by two interacting phenomena: the emergence of similar low-rank representatio...

This October 10, 2025 joint collaboration between Meta Superintelligence Labs, FAIR at Meta, and The Ohio State University academic paper proposes and evaluates a training paradigm called "early experience" for language agents to bridge the gap between Imitation Learning (IL) and Reinforcement Learning (RL), especially in environments lacking reliable rewards. The core idea is to generat...

This September 30, 2025 paper detail research into Brain Dynamics Hypothesis (BDH) models, particularly the BDH-GPU architecture, which proposes a biologically-inspired alternative to the standard Transformer model for language processing and reasoning. The core idea is to create AI systems that generalize reasoning like humans by modeling intelligence as the emergence of reasoning from neuron-to-...

The October 2, 2025 technical report from Tencent AI Lab introduces CLUE (Clustering and Experience-based Verification), a novel, non-parametric method for assessing the correctness of solutions generated by Large Language Models (LLMs). The authors argue that a solution's quality is geometrically encoded in the LLM's internal hidden state trajectories, specifically using the activation...

The October 6, 2025 paper introduces Agentic Context Engineering (ACE), a novel framework designed to enhance the performance of Large Language Models (LLMs) in complex applications like agents and domain-specific reasoning by evolving their context, or "playbook." ACE addresses two key limitations of prior context adaptation methods: brevity bias (the loss of detailed domain knowledge f...

The October 7, 2025 joint collaboration between Stanford University, Texas A&M University, UC San Diego, & Lambda paper introduces AGENTFLOW, a novel agentic system designed to enhance the reasoning capabilities of Large Language Models (LLMs) by decomposing complex tasks into a multi-turn Markov Decision Process (MDP). This system utilizes specialized, collaborating modules—an Action Plan...

This June 2025 paper introduces a novel methodology called Test-Time Reinforcement Learning (TTRL), which enables Large Language Models (LLMs) to improve their performance on reasoning tasks using unlabeled test data. The core innovation addresses the challenge of reward estimation without ground-truth labels by employing Test-Time Scaling (TTS) practices, specifically majority voting, to generate...

The September 2025 paper introduces ReasoningBank, a novel memory framework designed to enhance Large Language Model (LLM) agents by distilling and utilizing abstract reasoning patterns from both successful and failed task trajectories. Unlike previous approaches that focus only on raw interactions or successful workflows, ReasoningBank stores structured memory items—including titles, descriptions...

The October 2025 paper introduces the Reactive Transformer (RxT), a novel neural network architecture designed by Adam Filipek and Reactive AI to overcome the scaling and latency issues of current Large Language Models (LLMs) in long-form conversations. Unlike traditional stateless LLMs, which suffer from quadratic computational complexity by reprocessing the entire conversation history, RxT adopt...

The October 2025 academic paper introduces RECAP (Robust Safety Alignment via Counter-Aligned Prefilling), a novel reinforcement learning (RL) method designed to improve the safety and robustness of large reasoning models (LRMs). The core problem addressed is the brittleness of LRMs, which are easily biased by flawed chain-of-thought (CoT) reasoning injected into their thought process, leading to...

The October 2025 paper introduces Paris, a novel open-weight diffusion model for text-to-image generation that was trained using a completely decentralized methodology without requiring any communication between its expert components. This approach overcomes the need for expensive, specialized hardware clusters and synchronized gradient updates, which are typically required for training large-scal...