AI Post Transformers

These sources explore advanced techniques for accelerating Large Language Model (LLM) inference through speculative decoding, a process where smaller "draft" models predict tokens for a larger "target" model to verify in parallel. A primary focus is Multi-Draft Speculative Decoding (MDSD), which uses multiple draft sequences to increase the probability of acceptance and reduce...

MEDUSA is a novel framework introduced on June 24 2024 designed to accelerate Large Language Model (LLM) inference by overcoming the delays caused by sequential token generation. Instead of relying on a separate draft model like traditional speculative decoding, it incorporates multiple decoding heads that predict several subsequent tokens simultaneously. These predictions are organized into a tre...

The February 12.2026 research from the University of Virginia and Google introduces the deep-thinking ratio (DTR), a novel metric designed to measure the true reasoning effort of large language models by analyzing internal token stabilization. While traditional metrics like token count often fail to predict accuracy due to "overthinking," DTR tracks how many layers a model requires befor...

Researchers from METR introduce a novel framework for evaluating AI progress by measuring a model's time horizon, defined as the length of a task a human can complete that an AI can perform with 50% reliability. Traditional benchmarks often fail because they saturate quickly or focus on static knowledge, whereas this approach uses economically valuable tasks in fields like software engineerin...

The September 26 2025 research paper introduces FastGRPO, a high-efficiency framework designed to accelerate the training of large language models using Group Relative Policy Optimization. The authors identify that the generation phase is the primary bottleneck in reinforcement learning, accounting for over 90% of total training time. To solve this, they implement concurrency-aware speculative dec...

This research collaboration between King’s College London, Google DeepMind on a research paper published on February 19, 2026 introduces a novel framework for evaluating the collective behavior of large language model (LLM) agents within complex social dilemmas. By prompting models to generate high-level algorithmic strategies rather than individual actions, the authors successfully simulated inte...

Researchers introduced on May 2024 self-speculative decoding, a novel "plug-and-play" inference scheme designed to accelerate Large Language Models (LLMs) without requiring auxiliary models or extra memory. This method utilizes a two-stage process where a faster, lower-quality draft is generated by selectively skipping intermediate layers of the original model. These draft tokens are the...

These sources detail advanced reinforcement learning frameworks designed to improve how quadruped robots navigate difficult, real-world environments. The first source introduces a single-stage teacher-student method that utilizes skeleton information and a system-response model to achieve more natural, stable movement. The second source proposes ZSL-RPPO, a zero-shot learning architecture that eli...

The provided sources explore advanced techniques for optimizing large language model (LLM) inference, specifically by addressing the memory bottlenecks of the Key-Value (KV) cache. KVQuant introduces a high-precision quantization framework that utilizes per-channel scaling, non-uniform datatypes, and sparse outlier handling to compress activations to sub-4-bit precision with minimal accuracy loss....

The Deepmind February 3, 2023 paper "Accelerating Large Language Model Decoding with Speculative Sampling introduced speculative sampling, a novel algorithm designed to increase the speed of Large Language Model (LLM) decoding without altering the final output. The researchers utilize a smaller, faster draft model to predict multiple potential tokens, which are then verified in parallel by a...

The January 26, 2026 Stanford research paper introduces Agentic Plan Caching (APC), a novel framework designed to reduce the high operational costs of Large Language Model (LLM) agents. Traditional caching methods often fail because agent workflows are highly dynamic and dependent on external environments, making simple input-output storage ineffective. The APC framework solves this by extracting...

This February 2026 research paper introduces Bidaw, a novel system designed to optimize the performance of interactive Large Language Model (LLM) serving. The authors address inefficiencies in existing key–value (KV) caching methods, where the separation of computational engines and storage layers leads to high latency and redundant data processing. Bidaw implements bidirectional awareness, allowi...

This FAST26 February 24, 2026 paper introduces CacheSlide, an innovative system designed to accelerate Large Language Model (LLM) serving by improving KV cache reuse. The researchers identify that complex agent-based workflows often cause positional misalignment, where cached data becomes unusable when text segments shift in absolute position. To resolve this, they propose Relative-Position-Depend...

The February 3, 2026 research paper in collaboration between the National University of Singapore, USTC, University of Toronto and the Sea AI Lab introduces Cortex, a specialized caching system designed to address high latency and financial costs in LLM agent applications. Unlike standard models, agents frequently perform repetitive external data retrievals that lead to significant delays and expe...

The January 29, 2026 research collaboration between Stanford University, SambaNova Systems, Inc and UC Berkeley introduce ACE (Agentic Context Engineering), a novel framework designed to improve how large language models learn and adapt through context rather than weight updates. Unlike traditional methods that suffer from brevity bias or context collapse by summarizing information too aggressivel...

The global AI agents market is experiencing explosive growth, with projections suggesting it could reach nearly $183 billion by 2033. This surge is fueled by a transition from simple bots to autonomous systems capable of executing complex, multi-step workflows across sectors like finance, healthcare, and retail. North America currently leads the industry, supported by heavy investments from tech g...

This December 2025 research introduces Contextual Sample Efficiency (CSE), a novel algorithm designed to improve zero-shot generalization in reinforcement learning using minimal training data. Standard methods often require expensive, diverse simulations to prepare agents for new environments, but this approach leverages linear approximations of environmental dynamics to bypass extensive sampling....

Leading researchers propose a shift away from agentic AI, which autonomously pursues goals and poses catastrophic risks such as deception and loss of human control. To mitigate these dangers, they introduce the concept of Scientist AI, a non-agentic framework designed for understanding the world rather than acting within it. This system utilizes a probabilistic world model to generate causal theor...

The 2025 research introduces PPDS, an innovative dialogue system designed to solve character inconsistency in open-domain AI conversations. Researchers developed a persona extraction model based on the T5 architecture to automatically build a massive, diverse dataset from millions of social media comments. The primary dialogue engine utilizes a unified Transformer (UniLM) backbone, which efficient...

This December 2025 paper introduces SGI-Bench, a comprehensive framework designed to evaluate the capabilities of autonomous scientific agents across diverse research workflows. The benchmark spans multiple disciplines, including chemistry, materials science, and astronomy, by challenging models with tasks like experimental design, numerical modeling, and data interpretation. Through a series of s...

This 2022 paper introduces Persona-Adaptive Attention (PAA), a specialized framework designed to improve dialogue systems by better integrating persona descriptions and conversational history. The researchers address the challenge of balancing these two information sources by using a weighting and masking mechanism that dynamically prioritizes relevant details while filtering out redundant data. T...

The 2023 researchers introduce PersonaPKT, a novel framework designed to create personalized dialogue agents that maintain a consistent personality without needing explicit, private user descriptions. By utilizing parameter-efficient transfer learning, the system represents individual personas as continuous vectors or "prefixes," which adds less than 0.1% of new trainable parameters to a...

Researchers have developed an automated pipeline to identify persona vectors, which are linear directions in a language model's activation space that correspond to specific personality traits like evil, sycophancy, or hallucination. These vectors allow developers to monitor and control a model's behavior during both deployment and training by projecting internal states onto these identif...

This research article introduces a computational analysis pipeline designed to identify objective electrophysiological biomarkers for schizophrenia and bipolar disorder. By utilizing multi-electrode array recordings from patient-derived cerebral organoids and two-dimensional neurons, the study establishes a method for distinguishing psychiatric conditions through neural network dynamics. The resea...

This July 2025 research article investigates the use of Large Language Model (LLM) embeddings to predict Big Five personality traits using data from Reddit. The study demonstrates that custom-trained deep learning models using these embeddings significantly outperform zero-shot inference and traditional linguistic feature engineering. Through psychometric validation, the authors confirm that these...