AI Post Transformers

This August 2025 paper from Arizona State University's Data Mining and Machine Learning Lab investigates whether Chain-of-Thought (CoT) reasoning in Large Language Models (LLMs) represents genuine inference or merely superficial pattern matching. The authors hypothesize that CoT effectiveness is bounded by the training data's distribution, proposing that LLMs generate reasoning paths by...

This document explores the challenges associated with training deep feedforward neural networks, specifically investigating why standard gradient descent with random initialization performs poorly. The authors examine the impact of various non-linear activation functions, like sigmoid, hyperbolic tangent, and a new softsign function, on network performance and the issue of unit saturation. They fu...

This reviews the paper which introduced ZeRO-Offload, a novel technology designed to democratize large-scale deep learning model training by making it accessible even with limited GPU resources. It achieves this by strategically offloading data and computations to the CPU, thereby significantly increasing the size of models that can be trained on a single GPU—up to 13 billion parameters. The paper...

This document introduces PagedAttention, an innovative attention algorithm, and vLLM, a high-throughput serving system for large language models (LLMs). The core problem addressed is the inefficient memory management of Key-Value (KV) cache in existing LLM serving systems, leading to significant memory waste and limited batch sizes. Inspired by operating system virtual memory and paging techniques...

The provided text describes TierTrain: Proactive Memory Tiering for CPU-Based DNN Training, a paper presented at the International Symposium on Memory Management (ISMM 2025), co-located with PLDI 2025 in Seoul, South Korea. Authored by researchers from Intel Labs, the paper introduces TierTrain, a novel memory tiering solution designed to optimize Deep Neural Network (DNN) training on CPUs. This s...

The provided sources discuss advancements in large language models (LLMs), specifically focusing on test-time compute scaling to enhance reasoning performance. One paper introduces s1-32B, an open-source model trained on a small, curated dataset of 1,000 reasoning problems, and its novel technique called budget forcing. This method controls the model's "thinking time" to improve acc...

This document provides a comprehensive overview of differentiable programming, a paradigm enabling gradient-based optimization of computer programs, even those with complex control flows and data structures. It explores the fundamental concepts from automatic differentiation, including Jacobian and Hessian matrices, to the mathematical representation of programs as computation graphs and chains, e...

The research introduces Teraio, a novel framework designed to enhance the cost-efficiency and performance of large language model (LLM) training. This framework addresses the significant memory demands of LLMs by intelligently offloading inactive tensors from expensive GPU memory to more affordable PCIe-based solid-state drives (SSDs) and host memory. Teraio employs a lifetime-aware tensor offload...

The sources discuss Mixture-of-Experts (MoE) models, a type of neural network that selectively activates different parameters for incoming data, offering a high parameter count at a constant computational cost. One paper introduces "MoE-Infinity," an offloading-efficient system designed to serve these memory-intensive models, particularly for users with limited GPU resources. It addresse...

The provided academic paper investigates Shared Virtual Memory (SVM), a technology that integrates GPU memory into host virtual memory systems to improve programming portability and productivity for GPU accelerators. While Unified Memory (UM) aims for transparent data migration, the authors identify that current UM technologies often cause significant performance loss. This research examines the S...

This reviews the public second edition book by Richard Sutton and Andrew Barton on "Reinforcement learning". This document serves as an expanded second edition of a book on reinforcement learning (RL), significantly updating the prior version from 1979. It organizes RL concepts into three main parts: tabular solution methods, function approximation for larger problems, and the interdisci...

The source introduces Reinforcement Pre-Training (RPT), a novel approach that redefines next-token prediction in large language models (LLMs) as a verifiable reasoning task. Unlike traditional methods relying on costly human feedback or limited annotated data, RPT uses reinforcement learning (RL) with intrinsic, rule-based rewards derived directly from the pre-training corpus. This method incentiv...

Thus paper introduces PartitionedVC, an innovative external memory graph analytics framework designed to enhance the processing of large graphs that exceed main memory capacity, especially when utilizing SSDs. The core of PartitionedVC's improvement over existing systems like GraphChi lies in its use of a compressed sparse row (CSR) based graph storage for efficiently loading only active vert...

This paper introduces a multi-agent debate framework designed to enhance the factuality and reasoning capabilities of large language models (LLMs). The core idea involves multiple instances of an LLM proposing and critiquing solutions in iterative rounds until a consensus is reached. The authors demonstrate that this "society of minds" approach significantly improves performance across v...

67 authors were involved in this research! This source is an academic paper titled "PaLM: Scaling Language Modeling with Pathways," authored by Aakanksha Chowdhery and numerous collaborators. It details the development and capabilities of PaLM (Pathways Language Model), a 540-billion parameter Transformer language model trained on 6144 TPU v4 chips using a new ML system called Pathways....

We review MUVERA, a novel algorithm designed to significantly improve the efficiency of multi-vector information retrieval. Traditional information retrieval often uses single-vector embeddings, which are computationally fast but less accurate than multi-vector models like ColBERT. While multi-vector models offer enhanced accuracy by representing data points with sets of embeddings, their complex...

We review data from the Windows Experience Blog which introduces a new era of Windows experiences, heavily integrated with Artificial Intelligence. The blog focuses on Mu, a compact, efficient language model designed for on-device performance on Copilot+ PCs, specifically highlighting its role in powering an AI agent within Windows Settings to enable natural language interaction for system adjustm...

This academic paper introduces movement pruning, a novel method for reducing the size of large pre-trained language models like BERT during fine-tuning. Unlike traditional magnitude pruning which removes weights based on their absolute values, movement pruning prioritizes weights that change significantly during the fine-tuning process, demonstrating superior performance in high-sparsity scenarios...

This paper introduces Mistral 7B, a new 7-billion-parameter language model designed for both superior performance and efficiency. The paper highlights how Mistral 7B outperforms larger existing models like Llama 2 (13B) and Llama 1 (34B) in various benchmarks, including reasoning, mathematics, and code generation, while maintaining efficient inference. This is achieved through architectural innova...

The source introduces MetaScale, a novel framework designed to enhance Large Language Models' (LLMs) complex reasoning capabilities during inference. Unlike traditional approaches that rely on fixed reasoning patterns, MetaScale enables LLMs to adaptively select and refine cognitive strategies, termed "meta-thoughts," for each task. It initializes a diverse pool of these strategies,...

Double paper review for modern quantization techniques. These two academic papers address the crucial challenge of quantizing Large Language Models (LLMs) to reduce their computational and storage demands while preserving accuracy. The first source, "Post Training Quantization of Large Language Models with Microscaling Formats," investigates combining SmoothQuant, AWQ, and GPTQ post-trai...

This academic paper explores how language models utilize long input contexts, focusing on their ability to identify and retrieve relevant information. The authors conducted experiments using multi-document question answering and key-value retrieval tasks, varying the position of crucial data within the input. Their findings reveal a "U-shaped" performance curve, indicating that models ar...

The research paper introduces MEGABYTE, a novel multi-scale transformer architecture designed to efficiently process exceptionally long sequences, exceeding one million bytes. Unlike traditional transformers that struggle with long sequences due to quadratic self-attention costs and large feedforward layers, MEGABYTE segments data into "patches" and employs a local submodel within each p...

Nine different sources on Mamba are reviewed, including the paper that introduced it. The provided sources explore Mamba, a linear recurrent neural network (RNN) architecture, and its integration with Transformers to create hybrid models for large language models (LLMs). A key focus is on Mamba's efficiency and long-context handling compared to Transformers' memory and computational dema...

This reviews the paper which introduces Low-Rank Adaptation (LoRA), a novel method designed to efficiently adapt large language models for specific downstream tasks. Traditional fine-tuning, which retrains all model parameters, becomes prohibitively expensive for models like GPT-3 with billions of parameters. LoRA addresses this by freezing the pre-trained weights and injecting small, trainable ra...