Arxiv Papers

This paper explores the use of token-level self-evaluation to improve the accuracy and quality of generated content by large language models. Experimental results show that self-evaluation based scores are effective in selective generation. https://arxiv.org/abs//2312.09300 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.a...

The paper introduces a technique called weight subcloning to transfer knowledge from a pretrained model to smaller variants, improving training speed by initializing weights from larger models. https://arxiv.org/abs//2312.09299 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 S...

The paper introduces a technique called weight subcloning to transfer knowledge from a pretrained model to smaller variants, improving training speed by initializing weights from larger models. https://arxiv.org/abs//2312.09299 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 S...

The paper explores the use of small language models for solving grade school math problems. By using a high-quality dataset and a verifier model, they achieve 81.5% accuracy, outperforming larger models. https://arxiv.org/abs//2312.09241 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16...

The paper explores the use of small language models for solving grade school math problems. By using a high-quality dataset and a verifier model, they achieve 81.5% accuracy, outperforming larger models. https://arxiv.org/abs//2312.09241 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16...

Reward models are important for aligning language models with human preferences, but they can be exploited by the model. Training an ensemble of reward models can mitigate this issue, but it does not completely eliminate reward hacking. https://arxiv.org/abs//2312.09244 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple...

Reward models are important for aligning language models with human preferences, but they can be exploited by the model. Training an ensemble of reward models can mitigate this issue, but it does not completely eliminate reward hacking. https://arxiv.org/abs//2312.09244 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple...

The paper explores using off-the-shelf vision-language models as sources of rewards for reinforcement learning agents. It demonstrates how rewards for visual achievement of language goals can be derived from CLIP models, leading to more capable RL agents. https://arxiv.org/abs//2312.09187 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: htt...

The paper explores using off-the-shelf vision-language models as sources of rewards for reinforcement learning agents. It demonstrates how rewards for visual achievement of language goals can be derived from CLIP models, leading to more capable RL agents. https://arxiv.org/abs//2312.09187 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: htt...

SwitchHead is a novel method that reduces compute and memory requirements in Transformers, achieving speedup while maintaining language modeling performance. It uses Mixture-of-Experts layers and requires fewer attention matrices than standard Transformers. https://arxiv.org/abs//2312.07987 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: h...

SwitchHead is a novel method that reduces compute and memory requirements in Transformers, achieving speedup while maintaining language modeling performance. It uses Mixture-of-Experts layers and requires fewer attention matrices than standard Transformers. https://arxiv.org/abs//2312.07987 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: h...

The paper discusses the use of machine learning algorithms to predict the risk of cardiovascular disease in patients with diabetes. https://arxiv.org/abs//2312.06674 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper discusses the use of machine learning algorithms to predict the risk of cardiovascular disease in patients with diabetes. https://arxiv.org/abs//2312.06674 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Contrastive Activation Addition (CAA) is a method for steering language models by modifying activations during forward passes. It outperforms traditional methods and provides insights into how concepts are represented in Large Language Models (LLMs). https://arxiv.org/abs//2312.06681 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://...

Contrastive Activation Addition (CAA) is a method for steering language models by modifying activations during forward passes. It outperforms traditional methods and provides insights into how concepts are represented in Large Language Models (LLMs). https://arxiv.org/abs//2312.06681 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://...

LLM360 is an initiative to fully open-source Large Language Models (LLMs) by providing all training code, data, model checkpoints, and intermediate results. The goal is to support open and collaborative AI research and transparency in the LLM training process. https://arxiv.org/abs//2312.06550 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts...

LLM360 is an initiative to fully open-source Large Language Models (LLMs) by providing all training code, data, model checkpoints, and intermediate results. The goal is to support open and collaborative AI research and transparency in the LLM training process. https://arxiv.org/abs//2312.06550 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts...

This paper proposes a method for minimizing undesirable behaviors and ensuring faithfulness to instructions in text generation using large language models. The approach is effective across various text generation tasks. https://arxiv.org/abs//2312.06149 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/a...

This paper proposes a method for minimizing undesirable behaviors and ensuring faithfulness to instructions in text generation using large language models. The approach is effective across various text generation tasks. https://arxiv.org/abs//2312.06149 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/a...

The paper proposes Context Tuning for Retrieval Augmented Generation (RAG), which improves tool retrieval and plan generation by using a smart context retrieval system. Empirical results show significant improvements in recall, accuracy, and reduction in hallucination compared to existing methods. https://arxiv.org/abs//2312.05708 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.t...

The paper proposes Context Tuning for Retrieval Augmented Generation (RAG), which improves tool retrieval and plan generation by using a smart context retrieval system. Empirical results show significant improvements in recall, accuracy, and reduction in hallucination compared to existing methods. https://arxiv.org/abs//2312.05708 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.t...

The paper introduces new features in the Captum library for model explainability in PyTorch, specifically designed for analyzing generative language models. It provides an overview of the functionalities and example applications for understanding learned associations in these models. https://arxiv.org/abs//2312.05491 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arx...

The paper introduces new features in the Captum library for model explainability in PyTorch, specifically designed for analyzing generative language models. It provides an overview of the functionalities and example applications for understanding learned associations in these models. https://arxiv.org/abs//2312.05491 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arx...

The paper introduces HALO, a formal ontology for describing and representing hallucinations in large language models like ChatGPT, addressing the lack of a formal model for this issue. https://arxiv.org/abs//2312.05209 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: h...

The paper introduces HALO, a formal ontology for describing and representing hallucinations in large language models like ChatGPT, addressing the lack of a formal model for this issue. https://arxiv.org/abs//2312.05209 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: h...