Arxiv Papers

The paper proposes using an abstract graphics language as an intermediate representation for generating vector graphics from text. They introduce a large-scale dataset and a new model that outperforms existing models in terms of similarity to human-created figures. The framework and datasets are publicly available. https://arxiv.org/abs//2310.00367 YouTube: https://www.youtube.com/@ArxivPapers Tik...

This paper introduces representation engineering (RepE), an approach that enhances transparency in AI systems using insights from cognitive neuroscience. RepE focuses on population-level representations and offers effective solutions for understanding and controlling large language models, addressing safety concerns. https://arxiv.org/abs//2310.01405 YouTube: https://www.youtube.com/@ArxivPapers T...

The paper analyzes GPT-4V, a large multimodal model, and explores its capabilities, inputs, working modes, and prompts. It demonstrates GPT-4V's ability to process multimodal inputs and discusses potential applications and future research directions. https://arxiv.org/abs//2309.17421 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: http...

This paper introduces StreamingLLM, an efficient framework that allows large language models to generalize to infinite sequence length in streaming applications without fine-tuning. It addresses challenges related to memory consumption and text length, and achieves stable and efficient language modeling. https://arxiv.org/abs//2309.17453 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https:...

This paper introduces StreamingLLM, an efficient framework that allows large language models to generalize to infinite sequence length in streaming applications without fine-tuning. It addresses challenges related to memory consumption and text length, and achieves stable and efficient language modeling. https://arxiv.org/abs//2309.17453 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https:...

This paper introduces Tree Cross Attention (TCA), a module that retrieves information from a logarithmic number of tokens for efficient inference. The proposed architecture, ReTreever, outperforms Perceiver IO while using the same number of tokens. https://arxiv.org/abs//2309.17388 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://po...

This paper introduces Tree Cross Attention (TCA), a module that retrieves information from a logarithmic number of tokens for efficient inference. The proposed architecture, ReTreever, outperforms Perceiver IO while using the same number of tokens. https://arxiv.org/abs//2309.17388 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://po...

The paper introduces MetaCLIP, a data curation approach that outperforms CLIP's data on standard benchmarks. MetaCLIP achieves higher accuracy in zero-shot ImageNet classification and scales well with larger datasets. https://arxiv.org/abs//2309.16671 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast...

The paper introduces MetaCLIP, a data curation approach that outperforms CLIP's data on standard benchmarks. MetaCLIP achieves higher accuracy in zero-shot ImageNet classification and scales well with larger datasets. https://arxiv.org/abs//2309.16671 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast...

The paper presents a series of long-context language models (LLMs) that achieve effective context windows of up to 32,768 tokens. The models are built through continual pretraining and achieve consistent improvements on various language modeling tasks and research benchmarks. The paper also analyzes the components and design choices of the models. https://arxiv.org/abs//2309.16039 YouTube: https:/...

The paper presents a series of long-context language models (LLMs) that achieve effective context windows of up to 32,768 tokens. The models are built through continual pretraining and achieve consistent improvements on various language modeling tasks and research benchmarks. The paper also analyzes the components and design choices of the models. https://arxiv.org/abs//2309.16039 YouTube: https:/...

This paper introduces GPT-Fathom, an open-source evaluation suite for large language models (LLMs). It evaluates 10+ LLMs on 20+ benchmarks, providing insights into the evolution from GPT-3 to GPT-4 and improving transparency. https://arxiv.org/abs//2309.16583 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spo...

This paper introduces GPT-Fathom, an open-source evaluation suite for large language models (LLMs). It evaluates 10+ LLMs on 20+ benchmarks, providing insights into the evolution from GPT-3 to GPT-4 and improving transparency. https://arxiv.org/abs//2309.16583 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spo...

The paper introduces MotionLM, a model for multi-agent motion prediction in autonomous vehicles. It uses language modeling to represent trajectories and achieves state-of-the-art performance on the Waymo Open Motion Dataset. https://arxiv.org/abs//2309.16534 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spoti...

The paper introduces MotionLM, a model for multi-agent motion prediction in autonomous vehicles. It uses language modeling to represent trajectories and achieves state-of-the-art performance on the Waymo Open Motion Dataset. https://arxiv.org/abs//2309.16534 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spoti...

The paper introduces the Joint Autoregressive Mixture (JAM) framework, which combines text and image generation models to create high-quality multimodal outputs. It also presents a data-efficient instruction-tuning strategy for mixed-modal generation tasks. https://arxiv.org/abs//2309.15564 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcas...

The paper introduces the Joint Autoregressive Mixture (JAM) framework, which combines text and image generation models to create high-quality multimodal outputs. It also presents a data-efficient instruction-tuning strategy for mixed-modal generation tasks. https://arxiv.org/abs//2309.15564 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcas...

This paper presents a comprehensive survey on deep model fusion, a technique that merges the parameters or predictions of multiple deep learning models. It categorizes existing methods and discusses challenges and future research directions. https://arxiv.org/abs//2309.15698 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/i...

DeepSpeed-Ulysses is a methodology for efficient and scalable training of large language models with long sequences. It uses sequence parallelism and efficient communication to achieve faster training with longer sequences compared to existing methods. https://arxiv.org/abs//2309.14509 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podcast/arx...

This survey explores alignment techniques for large language models (LLMs) to ensure their behavior aligns with human values. It categorizes methods, discusses interpretability and vulnerabilities, presents benchmarks, and outlines future research directions. https://arxiv.org/abs//2309.15025 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podc...

The paper introduces a new alignment algorithm called Factually Augmented RLHF to address multimodal misalignment in large multimodal models. The proposed approach achieves significant improvement in performance and is available as open-source code and data. https://arxiv.org/abs//2309.14525 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podca...

The paper introduces a new alignment algorithm called Factually Augmented RLHF to address multimodal misalignment in large multimodal models. The proposed approach achieves significant improvement in performance and is available as open-source code and data. https://arxiv.org/abs//2309.14525 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS: Apple Podcasts: https://podcasts.apple.com/us/podca...

Large language models (LLMs) can improve their accuracy on tasks by refining and revising their output based on feedback. The SCREWS framework enables exploration in this space by providing modules for sampling, conditional resampling, and selection, leading to improved reasoning strategies for various tasks. https://arxiv.org/abs//2309.13075 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS:...

Large language models (LLMs) can improve their accuracy on tasks by refining and revising their output based on feedback. The SCREWS framework enables exploration in this space by providing modules for sampling, conditional resampling, and selection, leading to improved reasoning strategies for various tasks. https://arxiv.org/abs//2309.13075 YouTube: https://www.youtube.com/@ArxivPapers PODCASTS:...

The paper investigates training instabilities in large Transformer-based models and explores ways to reproduce and study these instabilities at smaller scales. It examines sources of instability, explores the impact of learning rate and other interventions, and studies cases where instabilities can be predicted. https://arxiv.org/abs//2309.14322 YouTube: https://www.youtube.com/@ArxivPapers PODCAS...