Arxiv Papers

The paper proposes AutoMQM, a technique that uses large language models to identify and categorize errors in machine translations, improving performance and providing interpretability compared to score-based evaluation methods. https://arxiv.org/abs//2308.07286 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Sp...

Shepherd is a language model designed to critique and suggest refinements to model outputs. It outperforms established models in terms of critiques and suggestions, and has a high win-rate compared to competitive alternatives. Data is available on GitHub. https://arxiv.org/abs//2308.04592 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/...

The paper discusses the use of machine learning algorithms to predict the risk of cardiovascular disease in patients with diabetes. https://arxiv.org/abs//2308.03958 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Large text-to-image models can generate "novel" images, but it is difficult to determine which training images are responsible for the appearance of a generated image. This paper proposes a method to evaluate data attribution in these models by customizing them towards exemplar objects or styles. The authors create a dataset of exemplar-influenced images to evaluate different attribution...

This paper introduces AlphaStar Unplugged, a benchmark for offline reinforcement learning in the game StarCraft II. It includes a dataset, API tools, evaluation protocol, and baseline agents, achieving a 90% win rate against a previous agent. https://arxiv.org/abs//2308.03526 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/...

The paper proposes a memory-augmented version of the Adam optimizer that promotes exploration towards flatter minima, improving performance on language modelling and image classification tasks. https://arxiv.org/abs//2307.09638 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify....

This paper aims to identify the challenges and application successes of large language models (LLMs) in order to help researchers understand the current state of the field and be more productive. https://arxiv.org/abs//2307.10169 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotif...

This paper explores how language models can be used in reinforcement learning agents to improve exploration efficiency, data reuse, skill scheduling, and learning from observations. The method is tested in a robotic manipulation environment and shows significant performance improvements. https://arxiv.org/abs//2307.09668 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https...

Llama 2 is a collection of large language models (LLMs) optimized for dialogue use cases. The models outperform open-source chat models and are considered safe and helpful, making them a suitable alternative to closed-source models. The paper provides details on the fine-tuning and safety improvements for Llama 2-Chat. https://arxiv.org/abs//2307.09288 YouTube: https://www.youtube.com/@ArxivPapers...

The paper evaluates the performance and behavior of GPT-3.5 and GPT-4 on various tasks and finds that their performance can vary significantly over time, emphasizing the importance of continuous monitoring of large language models. https://arxiv.org/abs//2307.09009 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id169247601...

RetNet is proposed as a foundation architecture for large language models, achieving training parallelism, low-cost inference, and good performance. It supports three computation paradigms and shows favorable scaling results, making it a strong successor to Transformer. https://arxiv.org/abs//2307.08621 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple....

The paper proposes a data selection strategy to remove low-quality instances from instruction-finetuning datasets for large language models. The resulting model, AlpaGasus, outperforms the original model and achieves faster training time. https://arxiv.org/abs//2307.08701 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16...

DreamTeacher is a self-supervised feature representation learning framework that uses generative networks to pre-train image backbones. It outperforms existing approaches and shows promise for representation learning on large datasets without manual annotation. https://arxiv.org/abs//2307.07487 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/po...

This paper proposes a framework to train dense retrievers that can identify high-quality in-context examples for large language models (LLMs), improving their learning performance. Experimental results show significant enhancements in performance and generalization ability to unseen tasks. https://arxiv.org/abs//2307.07164 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: htt...

This paper presents a text generation approach that involves copying and pasting text segments from an existing collection, resulting in better generation quality and comparable inference efficiency to autoregressive models. Domain adaptation and performance gains are also observed. https://arxiv.org/abs//2307.06962 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://po...

The paper introduces HyperDreamBooth, a hypernetwork that efficiently generates personalized weights from a single image, enabling fast and high-quality face synthesis in various styles and contexts. It achieves personalization 25x faster than DreamBooth and yields a much smaller model. https://arxiv.org/abs//2307.06949 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https:...

This paper introduces a novel approach for improving the quality and consistency of outputs from large-scale pre-trained language models. The approach extends self-consistency to problems without fixed-answer answers and shows consistent improvements across various tasks without additional computational overhead. https://arxiv.org/abs//2307.06857 YouTube: https://www.youtube.com/@ArxivPapers PODCA...

The paper proposes the In-context Autoencoder (ICAE) for context compression in a large language model (LLM). The ICAE can effectively produce memory slots with 4x context compression, which can be well conditioned on by the target LLM for various purposes. https://arxiv.org/abs//2307.06945 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcas...

The paper introduces a benchmark for evaluating the transferability of language models to new tasks. It proposes a learner that leverages selective initialization from past task checkpoints to maximize positive transfer and minimize negative transfer. https://arxiv.org/abs//2307.05741 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxi...

This paper introduces a low-rank training technique called ReLoRA for training large neural networks. It demonstrates comparable performance to regular training and suggests that ReLoRA becomes more efficient with larger models. https://arxiv.org/abs//2307.05695 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 S...

This paper discusses the challenges and importance of aligning large language models (LLMs) with humans. It proposes an advanced version of the Proximal Policy Optimization (PPO) algorithm to improve training stability and shares open-source implementations to contribute to LLM advancement. https://arxiv.org/abs//2307.04964 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: ht...

Emu is a Transformer-based multimodal model that can generate images and texts in a multimodal context. It can handle various types of input data and achieves excellent performance in tasks like image captioning and text-to-image generation. https://arxiv.org/abs//2307.05222 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/i...

The paper proposes a framework to animate personalized text-to-image models by inserting a motion modeling module and training it on video clips. The framework allows for the generation of diverse and personalized animated images. https://arxiv.org/abs//2307.04725 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016...

VampNet is a non-autoregressive music synthesis model that uses a variable masking schedule during training to generate coherent music. It can be applied to tasks like music compression, inpainting, outpainting, continuation, and looping with variation. Code and audio samples are available online. https://arxiv.org/abs//2307.04686 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podca...

Pre-trained language models can autoregressively complete complex token sequences, including spatial patterns. These models can be applied to robotics problems, such as extrapolating sequences of numbers and prompting reward-conditioned trajectories. https://arxiv.org/abs//2307.04721 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv...