Arxiv Papers

The paper discusses the use of machine learning algorithms to predict the risk of cardiovascular disease based on electronic health records. https://arxiv.org/abs//2307.03381 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces the Instruction Following Score (IFS), a metric to measure language models' ability to follow instructions. It can distinguish between base and instruct models and be used as an early stopping criteria for instruct tuning. The IFS can also lead to changes in the underlying base model semantics. https://arxiv.org/abs//2307.03692 YouTube: https://www.youtube.com/@ArxivPapers...

The paper introduces Semantic Pyramid AutoEncoder (SPAE) to enable frozen language models (LLMs) to perform understanding and generation tasks with non-linguistic modalities. The approach converts between pixels and lexical tokens, allowing LLMs to comprehend and generate visual content. Experimental results show improved performance in image understanding tasks. https://arxiv.org/abs//2306.17842...

This paper introduces a self-supervision framework that leverages programmatic supervision to calibrate large language models (LLMs) by assigning risk scores to their responses. Experiments show promising results in improving LLM accuracy. https://arxiv.org/abs//2306.16564 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1...

The paper explores the use of language models to generate practice material for cognitive approaches to well-being. The authors propose a dataset called PatternReframe and demonstrate that existing models can generate tailored practice material without additional training. https://arxiv.org/abs//2307.02768 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.app...

The paper introduces the Focused Transformer (FoT), a technique that enhances the context length of large language models by addressing the distraction issue caused by overlapping keys. The method is demonstrated by fine-tuning OpenLLaMA checkpoints, resulting in models that excel in tasks requiring long context. https://arxiv.org/abs//2307.03170 YouTube: https://www.youtube.com/@ArxivPapers PODCA...

Language models struggle to effectively use longer context in tasks such as multi-document question answering and key-value retrieval. Performance is highest when relevant information is at the beginning or end of the context, and decreases as the context grows longer. https://arxiv.org/abs//2307.03172 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.c...

LongNet is a Transformer variant that can handle sequences longer than 1 billion tokens without sacrificing performance. It introduces dilated attention, which expands the attentive field exponentially as the distance grows. LongNet has linear computation complexity and can be used for distributed training. Experimental results show strong performance on long-sequence modeling and general language...

Classifier-Free Guidance (CFG) is a technique used in text-to-image generation that can also be applied to pure language modeling. It improves performance across various tasks and can be combined with other inference-time methods, resulting in better performance. In a human evaluation, CFG was preferred over the baseline model. https://arxiv.org/abs//2306.17806 YouTube: https://www.youtube.com/@Ar...

This paper introduces SAM-PT, an extension of the Segment Anything Model (SAM) for tracking and segmenting objects in dynamic videos. SAM-PT achieves strong zero-shot performance by leveraging point selection and propagation techniques. The approach is evaluated on popular video object segmentation benchmarks and the Unidentified Video Objects (UVO) benchmark. Code is available at https://github.c...

The paper proposes a novel method for single image 3D reconstruction that generates a full 360-degree textured mesh in a single feed-forward pass, with improved geometry and runtime compared to existing methods. https://arxiv.org/abs//2306.16928 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://p...

The paper introduces LENS, a modular approach that combines large language models with vision modules to tackle computer vision problems. LENS performs competitively without multimodal training and is applicable to any off-the-shelf language model. https://arxiv.org/abs//2306.16410 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-p...

The paper examines the alignment of large language models with user goals and the potential for adversarial attacks. It finds that existing attacks are insufficient and multimodal models are easily attacked. https://arxiv.org/abs//2306.15447 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podca...

Position Interpolation (PI) extends the context window sizes of pretrained LLMs with minimal fine-tuning, achieving strong results on tasks requiring long context while preserving quality on tasks within the original context window. PI linearly down-scales input position indices to avoid catastrophic attention scores. https://arxiv.org/abs//2306.15595 YouTube: https://www.youtube.com/@ArxivPapers...

The paper proposes a novel sampling algorithm called Restart that balances speed and quality in generative processes involving differential equations. The algorithm outperforms previous samplers in terms of speed and accuracy, and achieves better sample quality within comparable sampling times. https://arxiv.org/abs//2306.14878 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts...

The paper proposes SequenceMatch, an imitation learning framework for sequence generation that addresses the compounding error problem of autoregressive models. It incorporates backtracking and uses SequenceMatch-$\chi^{2}$ divergence as a training objective, leading to improvements over MLE on text generation. https://arxiv.org/abs//2306.05426 YouTube: https://www.youtube.com/@ArxivPapers PODCAST...

The paper proposes MotionGPT, a unified motion-language model that fuses language data with large-scale motion models to enhance motion-related tasks, achieving state-of-the-art performance on multiple motion tasks. https://arxiv.org/abs//2306.14795 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https...

Large language models can function as weak learners in boosting algorithms for tabular data classification. Properly sampled text descriptions of data samples can produce a summary that outperforms traditional tree-based boosting. https://arxiv.org/abs//2306.14101 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016...

Crowd workers may use large language models (LLMs) to increase productivity and income, impacting the validity of human gold-standard annotations. A case study estimates 33-46% of crowd workers used LLMs in an abstract summarization task. https://arxiv.org/abs//2306.07899 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16...

The paper explores non-logit-based approaches for confidence elicitation in large language models (LLMs) and introduces three categories of methods: verbalize-based, consistency-based, and hybrid methods. The study evaluates their performance across five types of datasets and four widely-used LLMs, uncovering key insights and highlighting the need for improvement in confidence elicitation. https:/...

The paper introduces a novel pruning method, Wanda, for inducing sparsity in pretrained Large Language Models (LLMs) without requiring retraining or weight update, and evaluates its performance on various language benchmarks. https://arxiv.org/abs//2306.11695 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spot...

The paper proposes a Deep Language Network (DLN) architecture that stacks two large language models (LLMs) and optimizes natural language prompts at each layer, achieving higher performance than a single layer. https://arxiv.org/abs//2306.12509 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://po...

AudioPaLM is a multimodal language model that combines text-based and speech-based models for speech understanding and generation, with applications including speech recognition and speech-to-speech translation. It outperforms existing systems and can perform zero-shot speech-to-text translation for many languages. https://arxiv.org/abs//2306.12925 YouTube: https://www.youtube.com/@ArxivPapers POD...

The paper proposes a training method for transformers using int4 arithmetic, achieving competitive accuracy on various tasks, and can be implemented on current GPUs, speeding up training by up to 35.1%. https://arxiv.org/abs//2306.11987 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters...