Arxiv Papers

The paper introduces QMoE, a compression and execution framework that allows trillion-parameter language models to be run efficiently on affordable hardware with minimal accuracy loss. https://arxiv.org/abs//2310.16795 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: h...

The paper discusses the presence of a neural mechanism in autoregressive transformer language models that represents input-output functions as vectors. These vectors, called function vectors (FVs), are robust and can be used to trigger execution of tasks in various contexts. The study also explores the internal structure of FVs and their potential for semantic vector composition. https://arxiv.org...

The paper discusses the presence of a neural mechanism in autoregressive transformer language models that represents input-output functions as vectors. These vectors, called function vectors (FVs), are robust and can be used to trigger execution of tasks in various contexts. The study also explores the internal structure of FVs and their potential for semantic vector composition. https://arxiv.org...

In-context learning in large language models (LLMs) is a powerful learning paradigm, but its underlying mechanism is not well understood. This paper shows that the functions learned by in-context learning have a simple structure and can be seen as compressing the training set into a single task vector. Experimental evidence is provided to support this claim. https://arxiv.org/abs//2310.15916 YouTu...

In-context learning in large language models (LLMs) is a powerful learning paradigm, but its underlying mechanism is not well understood. This paper shows that the functions learned by in-context learning have a simple structure and can be seen as compressing the training set into a single task vector. Experimental evidence is provided to support this claim. https://arxiv.org/abs//2310.15916 YouTu...

This paper introduces Woodpecker, a training-free method to mitigate hallucinations in Multimodal Large Language Models. It corrects hallucinations in generated text by extracting key concepts, validating visual knowledge, and generating visual claims. Woodpecker shows promising results on benchmark tests. https://arxiv.org/abs//2310.16045 YouTube: https://www.youtube.com/@ArxivPapers TikTok: http...

This paper introduces Woodpecker, a training-free method to mitigate hallucinations in Multimodal Large Language Models. It corrects hallucinations in generated text by extracting key concepts, validating visual knowledge, and generating visual claims. Woodpecker shows promising results on benchmark tests. https://arxiv.org/abs//2310.16045 YouTube: https://www.youtube.com/@ArxivPapers TikTok: http...

The paper introduces Matryoshka Diffusion (MDM), an end-to-end framework for high-resolution image and video synthesis. MDM uses a diffusion process and a NestedUNet architecture to denoise inputs at multiple resolutions and enables progressive training for high-resolution generation. The approach is effective on various benchmarks and can train a single pixel-space model at high resolutions. http...

The paper introduces Matryoshka Diffusion (MDM), an end-to-end framework for high-resolution image and video synthesis. MDM uses a diffusion process and a NestedUNet architecture to denoise inputs at multiple resolutions and enables progressive training for high-resolution generation. The approach is effective on various benchmarks and can train a single pixel-space model at high resolutions. http...

The paper introduces a new autoregressive sampling algorithm called SpecTr, which uses speculative decoding to speed up the sampling process while maintaining the quality of the output. The proposed approach achieves a significant speedup compared to existing methods. https://arxiv.org/abs//2310.15141 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple...

The paper introduces a new autoregressive sampling algorithm called SpecTr, which uses speculative decoding to speed up the sampling process while maintaining the quality of the output. The proposed approach achieves a significant speedup compared to existing methods. https://arxiv.org/abs//2310.15141 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple...

This study investigates how sentiment is represented in Large Language Models (LLMs). The authors find that sentiment is represented linearly and identify the mechanisms involved, including a phenomenon called the summarization motif. Ablating the sentiment direction significantly reduces classification accuracy. https://arxiv.org/abs//2310.15154 YouTube: https://www.youtube.com/@ArxivPapers TikTo...

This study investigates how sentiment is represented in Large Language Models (LLMs). The authors find that sentiment is represented linearly and identify the mechanisms involved, including a phenomenon called the summarization motif. Ablating the sentiment direction significantly reduces classification accuracy. https://arxiv.org/abs//2310.15154 YouTube: https://www.youtube.com/@ArxivPapers TikTo...

Reinforcement learning from human feedback (RLHF) can lead to sycophantic behavior in AI assistants, as they prioritize matching user beliefs over providing truthful responses. This behavior is driven by human preference judgments favoring sycophantic responses. https://arxiv.org/abs//2310.13548 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcas...

This paper introduces Contrastive Preference Learning (CPL), a new algorithm for optimizing behavior from human feedback without learning reward functions. CPL is fully off-policy and can be applied to arbitrary MDPs, making it scalable and simpler than prior methods. https://arxiv.org/abs//2310.13639 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple...

This paper introduces Contrastive Preference Learning (CPL), a new algorithm for optimizing behavior from human feedback without learning reward functions. CPL is fully off-policy and can be applied to arbitrary MDPs, making it scalable and simpler than prior methods. https://arxiv.org/abs//2310.13639 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple...

This paper proves that stochastic gradient descent (SGD) algorithms converge to an ε-stationary point in the final iterates, providing a stronger result than existing studies on nonconvex convergence. https://arxiv.org/abs//2310.12969 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16924...

This paper proves that stochastic gradient descent (SGD) algorithms converge to an ε-stationary point in the final iterates, providing a stronger result than existing studies on nonconvex convergence. https://arxiv.org/abs//2310.12969 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16924...

The paper introduces 3D-GPT, a framework that utilizes large language models for instruction-driven 3D modeling. It demonstrates that 3D-GPT can interpret and execute instructions effectively, collaborate with human designers, and seamlessly integrate with Blender. https://arxiv.org/abs//2310.12945 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Pod...

The paper introduces emulated fine-tuning (EFT), a method for combining the knowledge learned by a large language model during pre-training with the knowledge learned by a small model during fine-tuning. EFT allows for test-time adjustment of behavioral traits and improves helpfulness and factuality without additional training. https://arxiv.org/abs//2310.12962 YouTube: https://www.youtube.com/@Ar...

The paper introduces emulated fine-tuning (EFT), a method for combining the knowledge learned by a large language model during pre-training with the knowledge learned by a small model during fine-tuning. EFT allows for test-time adjustment of behavioral traits and improves helpfulness and factuality without additional training. https://arxiv.org/abs//2310.12962 YouTube: https://www.youtube.com/@Ar...

Large language models (LLMs) can be used as strong encoders for visual tasks without language by employing a frozen transformer block from pre-trained LLMs. This approach improves performance across various computer vision tasks and is supported by the information filtering hypothesis. https://arxiv.org/abs//2310.12973 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@a...

Large language models (LLMs) can be used as strong encoders for visual tasks without language by employing a frozen transformer block from pre-trained LLMs. This approach improves performance across various computer vision tasks and is supported by the information filtering hypothesis. https://arxiv.org/abs//2310.12973 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@a...

AgentTuning is a method to enhance the agent capabilities of large language models (LLMs) without compromising their general abilities. It uses a hybrid instruction-tuning strategy and achieves comparable performance to commercial LLMs on agent tasks. https://arxiv.org/abs//2310.12823 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https:/...

This study examines the training dynamics of deep networks and introduces a novel statistic called local complexity (LC) to measure the concentration of linear regions around data points. The study finds that LC undergoes different phases during training, with linear regions migrating towards the decision boundary in the final phase. These phases are closely related to the memorization and general...