Arxiv Papers

This study examines the training dynamics of deep networks and introduces a novel statistic called local complexity (LC) to measure the concentration of linear regions around data points. The study finds that LC undergoes different phases during training, with linear regions migrating towards the decision boundary in the final phase. These phases are closely related to the memorization and general...

AgentTuning is a method to enhance the agent capabilities of large language models (LLMs) without compromising their general abilities. It uses a hybrid instruction-tuning strategy and achieves comparable performance to commercial LLMs on agent tasks. https://arxiv.org/abs//2310.12823 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https:/...

The paper introduces generative active task elicitation (GATE), a learning framework where language models interact with users to elicit and infer intended behavior. Experiments show that LM-driven elicitation is more informative and requires less effort than user-written prompts or labels. https://arxiv.org/abs//2310.11589 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.c...

The paper introduces generative active task elicitation (GATE), a learning framework where language models interact with users to elicit and infer intended behavior. Experiments show that LM-driven elicitation is more informative and requires less effort than user-written prompts or labels. https://arxiv.org/abs//2310.11589 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.c...

The paper questions the effectiveness of direct model editing for correcting factual errors in language models. It suggests alternative approaches such as retrieval-based architectures, concept erasure methods, and attribution methods, and emphasizes the need for cautious use of model editing in language model deployment. https://arxiv.org/abs//2310.11958 YouTube: https://www.youtube.com/@ArxivPap...

The paper questions the effectiveness of direct model editing for correcting factual errors in language models. It suggests alternative approaches such as retrieval-based architectures, concept erasure methods, and attribution methods, and emphasizes the need for cautious use of model editing in language model deployment. https://arxiv.org/abs//2310.11958 YouTube: https://www.youtube.com/@ArxivPap...

The paper introduces a framework called Self-Reflective Retrieval-Augmented Generation (SELF-RAG) that enhances the quality and factuality of large language models (LLMs) by incorporating retrieval and self-reflection. SELF-RAG outperforms existing models on various tasks. https://arxiv.org/abs//2310.11511 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers A...

The paper introduces a framework called Self-Reflective Retrieval-Augmented Generation (SELF-RAG) that enhances the quality and factuality of large language models (LLMs) by incorporating retrieval and self-reflection. SELF-RAG outperforms existing models on various tasks. https://arxiv.org/abs//2310.11511 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers A...

The paper introduces a general framework for approximating two-layer neural networks using sparse Mixtures of Experts (MoEs) and product-key memories (PKMs). The proposed methods improve both MoEs and PKMs, showing that they are competitive with dense models while being more resource efficient. https://arxiv.org/abs//2310.10837 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tikt...

The paper introduces a general framework for approximating two-layer neural networks using sparse Mixtures of Experts (MoEs) and product-key memories (PKMs). The proposed methods improve both MoEs and PKMs, showing that they are competitive with dense models while being more resource efficient. https://arxiv.org/abs//2310.10837 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tikt...

This paper proposes a meta-learning algorithm that allows visual models to learn new concepts during inference without fine-tuning, similar to how large language models like ChatGPT learn new concepts. The approach outperforms state-of-the-art algorithms on several benchmarks without meta-training or fine-tuning. https://arxiv.org/abs//2310.10971 YouTube: https://www.youtube.com/@ArxivPapers TikTo...

This paper proposes a meta-learning algorithm that allows visual models to learn new concepts during inference without fine-tuning, similar to how large language models like ChatGPT learn new concepts. The approach outperforms state-of-the-art algorithms on several benchmarks without meta-training or fine-tuning. https://arxiv.org/abs//2310.10971 YouTube: https://www.youtube.com/@ArxivPapers TikTo...

In this paper, the authors propose in-context pretraining for language models, where models are pretrained on sequences of related documents to encourage reasoning across document boundaries. They introduce algorithms for finding related documents and constructing coherent input contexts, and show that in-context pretraining improves performance on various tasks. https://arxiv.org/abs//2310.10638...

In this paper, the authors propose in-context pretraining for language models, where models are pretrained on sequences of related documents to encourage reasoning across document boundaries. They introduce algorithms for finding related documents and constructing coherent input contexts, and show that in-context pretraining improves performance on various tasks. https://arxiv.org/abs//2310.10638...

Fine-tuning large language models (LLMs) using solution fine-tuning, solution-cluster re-ranking, and multi-task sequential fine-tuning improves their performance in solving math problems, achieving 58.8% accuracy on the MATH dataset. https://arxiv.org/abs//2310.10047 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.c...

Fine-tuning large language models (LLMs) using solution fine-tuning, solution-cluster re-ranking, and multi-task sequential fine-tuning improves their performance in solving math problems, achieving 58.8% accuracy on the MATH dataset. https://arxiv.org/abs//2310.10047 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.c...

The paper introduces Reward-Augmented Decoding (RAD), a text generation procedure that uses a reward model to encourage a language model to generate text with desired properties. RAD outperforms other methods and has minimal computational overhead. https://arxiv.org/abs//2310.09520 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://po...

The paper introduces Reward-Augmented Decoding (RAD), a text generation procedure that uses a reward model to encourage a language model to generate text with desired properties. RAD outperforms other methods and has minimal computational overhead. https://arxiv.org/abs//2310.09520 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://po...

The paper introduces MemGPT, a system that uses virtual context management to extend the limited context windows of large language models (LLMs), enabling tasks like document analysis and extended conversations. MemGPT is evaluated in document analysis and multi-session chat, showing improved performance. Code and data are released at https://memgpt.ai. https://arxiv.org/abs//2310.08560 YouTube: h...

The paper introduces MemGPT, a system that uses virtual context management to extend the limited context windows of large language models (LLMs), enabling tasks like document analysis and extended conversations. MemGPT is evaluated in document analysis and multi-session chat, showing improved performance. Code and data are released at https://memgpt.ai. https://arxiv.org/abs//2310.08560 YouTube: h...

This paper introduces Neural Diffusion Models (NDMs), which allow for non-linear transformations of data. NDMs outperform conventional diffusion models in terms of likelihood and sample quality. https://arxiv.org/abs//2310.08337 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016...

This paper introduces Neural Diffusion Models (NDMs), which allow for non-linear transformations of data. NDMs outperform conventional diffusion models in terms of likelihood and sample quality. https://arxiv.org/abs//2310.08337 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016...

Offline retraining, a policy extraction step at the end of online fine-tuning, decouples policies used for data collection and evaluation, reducing bias and improving performance in reinforcement learning. https://arxiv.org/abs//2310.08558 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id...

Offline retraining, a policy extraction step at the end of online fine-tuning, decouples policies used for data collection and evaluation, reducing bias and improving performance in reinforcement learning. https://arxiv.org/abs//2310.08558 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id...

Online speculative decoding is introduced as a technique to improve the efficacy of speculative decoding in large language models. By continually updating draft models using excess computational power, the draft models can more accurately predict the target model's outputs, resulting in reduced latency. https://arxiv.org/abs//2310.07177 YouTube: https://www.youtube.com/@ArxivPapers TikTok: htt...