LlamaCast

🤔 Thinking LLMs: General Instruction Following with Thought Generation This research paper explores the concept of "Thinking LLMs," or large language models that can generate internal thoughts before responding to user prompts. The authors propose a training method called Thought Preference Optimization (TPO) which uses an iterative process to encourage LLMs to develop thinking abilities. TPO lev...

🔋 Addition is All You Need for Energy-efficient Language Models This research paper introduces a novel algorithm called Linear-Complexity Multiplication (L-Mul) that aims to make language models more energy-efficient. L-Mul replaces computationally expensive floating-point multiplications with integer addition operations, significantly reducing energy consumption. The authors demonstrate that L-M...

🤖 MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering The paper introduces MLE-bench, a benchmark designed to evaluate AI agents' ability to perform machine learning engineering tasks. The benchmark comprises 75 Kaggle competitions, each requiring agents to solve real-world problems involving data preparation, model training, and code debugging. Researchers evaluated sev...

📈 Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG This paper explores the challenges and opportunities of using long-context language models (LLMs) in retrieval-augmented generation (RAG) systems. While increasing the number of retrieved passages initially improves performance, the authors find that it eventually degrades due to the introduction of irrelevant information,...

📊 GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models The paper investigates the mathematical reasoning abilities of large language models (LLMs). The authors created a new benchmark, GSM-Symbolic, to test LLMs' performance in a more reliable way. The results show that LLMs perform poorly and inconsistently across different versions of the same question,...

😶 Anti-Social Behavior and Persuasion Ability of LLMs This study explores the behavior of Large Language Models (LLMs) in a simulated prison environment, inspired by the Stanford Prison Experiment. It focuses on two key aspects: persuasion, where a prisoner tries to convince a guard to grant more yard time or help escape, and anti-social behavior, such as toxicity and violence. The analysis revea...

🎧 Differential Transformer The paper introduces the Differential Transformer, a new architecture for large language models (LLMs) that aims to improve their ability to focus on relevant information within long sequences. It achieves this by introducing a differential attention mechanism which calculates attention scores as the difference between two separate softmax attention maps, effectively ca...

🛠 ToolGen: Unified Tool Retrieval and Calling via Generation This research paper introduces ToolGen, a novel framework that enables LLMs to directly access and utilize external tools by representing each tool as a unique token within the model's vocabulary. ToolGen addresses the limitations of traditional tool retrieval methods, which often rely on separate retrieval mechanisms and are constrained...

👨‍🔧 Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Experts This research proposes LangGPT, a structural prompt framework for designing prompts to instruct Large Language Models (LLMs). This framework, inspired by programming languages, provides a systematic and reusable method for creating prompts that are easier for non-AI experts to understand and use. The aut...

🎞 Movie Gen: A Cast of Media Foundation Models Meta AI researchers have introduced Movie Gen, a suite of foundation models capable of generating high-quality video and audio. Movie Gen models can synthesize videos based on text prompts, personalize videos using a user’s image, precisely edit videos with text instructions, and generate synchronized audio for videos. The research paper details the m...

🕵️‍♀️ LLMs Know More Than They Show This research examines the inner workings of large language models (LLMs) to understand and reduce their tendency to generate false information, known as "hallucinations." The authors find that LLMs internally encode information about the truthfulness of their outputs, with these signals concentrated in tokens related to exact answers. However, these truth signa...

🔁 Were RNNs All We Needed? The paper "Were RNNs All We Needed?" examines the efficiency of traditional recurrent neural networks (RNNs), specifically LSTMs and GRUs, for long sequences. The authors demonstrate that by removing hidden state dependencies from their input, forget, and update gates, LSTMs and GRUs can be trained efficiently using the parallel prefix scan algorithm, resulting in signi...

📱 Small Language Models: Survey, Measurements, and Insights This research paper reviews small language models (SLMs), which are optimized for use on devices with limited resources, such as smartphones. It covers recent advancements in SLM architectures, training datasets, and algorithms, and benchmarks their performance on tasks like commonsense reasoning, problem-solving, and mathematics. The pa...

💊 A Preliminary Study of o1 in Medicine The research paper focuses on the performance of a new large language model (LLM) called o1 in the medical domain. o1 was trained with an internalized chain-of-thought technique using reinforcement learning strategies, which enhances its reasoning abilities. The paper evaluates o1 across three key aspects: understanding, reasoning, and multilinguality, usin...

📑 RAG and Beyond This paper provides a comprehensive survey of the current state of data-augmented Large Language Models (LLMs), focusing on Retrieval-Augmented Generation (RAG) and beyond. The authors classify different types of queries that utilize external data into four levels based on their complexity: explicit fact queries, implicit fact queries, interpretable rationale queries, and hidden...

🔓 Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models This research paper introduces Molmo, a new family of vision-language models (VLMs) that surpasses existing open-weight models in performance while maintaining open weights, data, and code. The key innovation is the collection of a large, detailed image caption dataset using speech-based descriptions, avoiding re...

🔄 Self-Taught Evaluators This research paper explores the development of self-taught language model evaluators. Instead of relying on costly human annotations, this approach utilizes synthetic data generated by the model itself. The method iteratively trains an LLM-as-a-Judge by creating contrasting response pairs, generating reasoning traces, and fine-tuning the model on this synthetic data. The...

⚠️ Larger and more instructable language models become less reliable This research paper from Nature explores the relationship between the size and instructability of large language models (LLMs) and their reliability. The study finds that while larger, more instructable LLMs tend to perform better on complex tasks, they become less reliable in handling simple tasks, often producing plausible but...

💭 Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in LLMs This research paper introduces Logic-of-Thought (LoT), a novel prompting method designed to enhance logical reasoning in large language models. LoT extracts propositions and logical relations from input text, expands them using logical rules, and reintegrates this information into the original prompt. Unlike existing tec...

🟢 Moshi: a speech-text foundation model for real-time dialogue The paper discusses a new multimodal foundation model called Moshi designed for real-time, full-duplex spoken dialogue. This model uses a text-based LLM called Helium to provide reasoning abilities and a neural audio codec called Mimi to encode audio into tokens. Moshi is innovative because it can handle overlapping speech and model b...

🔑 Jailbreaking Large Language Models with Symbolic Mathematics This research paper investigates a new vulnerability in AI safety mechanisms by introducing MathPrompt, a technique that utilizes symbolic mathematics to bypass LLM safety measures. The paper demonstrates that encoding harmful natural language prompts into mathematical problems allows LLMs to generate harmful content, despite being tr...

📈 LLMs Still Can't Plan; Can LRMs? The paper "LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench" investigates the ability of large language models (LLMs) to plan, using a benchmark called PlanBench. The authors find that while OpenAI's new "Large Reasoning Model" (LRM) o1 shows significant improvement in planning abilities, it still falls short of fully achievi...

📏 A Comprehensive Evaluation of Quantized Instruction-Tuned LLMs This paper, titled "A Comprehensive Evaluation of Quantized Instruction-Tuned Large Language Models: An Experimental Analysis up to 405B," examines the performance of large language models (LLMs) after they have been compressed using various quantization methods. The authors assess the impact of these techniques on different task ty...

🧠 On the Diagram of Thought This paper introduces a new framework called Diagram of Thought (DoT) that models how large language models (LLMs) reason. Unlike traditional methods that represent reasoning as linear chains or trees, DoT utilizes a directed acyclic graph (DAG) structure. This structure allows LLMs to navigate complex reasoning pathways while ensuring logical consistency. By incorpora...