Arxiv Papers

LoRA is a parameter-efficient finetuning method for large language models, but underperforms full finetuning in most cases. It offers strong regularization and diverse generations. https://arxiv.org/abs//2405.09673 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https...

LoRA is a parameter-efficient finetuning method for large language models, but underperforms full finetuning in most cases. It offers strong regularization and diverse generations. https://arxiv.org/abs//2405.09673 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https...

The paper argues that representations in AI models, especially deep networks, are converging towards a shared statistical model of reality, termed the platonic representation. https://arxiv.org/abs//2405.07987 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://po...

The paper argues that representations in AI models, especially deep networks, are converging towards a shared statistical model of reality, termed the platonic representation. https://arxiv.org/abs//2405.07987 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://po...

New positional encoding method for Transformers improves time-series classification by preserving positional order information without loss, based on rigorous mathematics. https://arxiv.org/abs//2405.09061 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcas...

New positional encoding method for Transformers improves time-series classification by preserving positional order information without loss, based on rigorous mathematics. https://arxiv.org/abs//2405.09061 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcas...

Increasing Transformer model size doesn't always improve performance. A theoretical framework using associative memories and Hopfield networks explains memorization and performance dynamics in transformer-based language models. https://arxiv.org/abs//2405.08707 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/...

Increasing Transformer model size doesn't always improve performance. A theoretical framework using associative memories and Hopfield networks explains memorization and performance dynamics in transformer-based language models. https://arxiv.org/abs//2405.08707 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/...

Hopfield Boosting method enhances OOD detection by leveraging modern Hopfield energy, achieving state-of-the-art results with outlier exposure, significantly improving FPR95 metric on CIFAR-10 and CIFAR-100 datasets. https://arxiv.org/abs//2405.08766 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxi...

Hopfield Boosting method enhances OOD detection by leveraging modern Hopfield energy, achieving state-of-the-art results with outlier exposure, significantly improving FPR95 metric on CIFAR-10 and CIFAR-100 datasets. https://arxiv.org/abs//2405.08766 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxi...

The paper introduces Online Iterative Reinforcement Learning from Human Feedback (RLHF) workflow, achieving superior performance in large language models using open-source datasets and proxy human feedback. https://arxiv.org/abs//2405.07863 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/i...

The paper introduces Online Iterative Reinforcement Learning from Human Feedback (RLHF) workflow, achieving superior performance in large language models using open-source datasets and proxy human feedback. https://arxiv.org/abs//2405.07863 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/i...

SUTRA is a multilingual Large Language Model that outperforms existing models, offering efficient and accurate text generation in over 50 languages, with potential global impact on AI accessibility. https://arxiv.org/abs//2405.06694 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476...

Memory mosaics are associative memory networks with compositional and in-context learning abilities, outperforming transformers in transparency and language modeling tasks. https://arxiv.org/abs//2405.06394 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podca...

Memory mosaics are associative memory networks with compositional and in-context learning abilities, outperforming transformers in transparency and language modeling tasks. https://arxiv.org/abs//2405.06394 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podca...

Linear transformers offer a subquadratic-time alternative to softmax attention, but face scaling issues. SUPRA proposes uptraining existing large transformers into RNNs for cost-effective performance. https://arxiv.org/abs//2405.06640 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16924...

Linear transformers offer a subquadratic-time alternative to softmax attention, but face scaling issues. SUPRA proposes uptraining existing large transformers into RNNs for cost-effective performance. https://arxiv.org/abs//2405.06640 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id16924...

Hierarchical control in robotics faces challenges with language interfaces. Learnable Latent Codes as Bridges (LCB) offer a solution, outperforming language-based baselines on complex tasks in embodied agent benchmarks. https://arxiv.org/abs//2405.04798 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/a...

Hierarchical control in robotics faces challenges with language interfaces. Learnable Latent Codes as Bridges (LCB) offer a solution, outperforming language-based baselines on complex tasks in embodied agent benchmarks. https://arxiv.org/abs//2405.04798 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/a...

Proposing a method to distill a complex diffusion model into a single-step GAN, accelerating inference while maintaining image quality, outperforming existing models on COCO benchmark. https://arxiv.org/abs//2405.05967 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: h...

Proposing a method to distill a complex diffusion model into a single-step GAN, accelerating inference while maintaining image quality, outperforming existing models on COCO benchmark. https://arxiv.org/abs//2405.05967 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: h...

Innovative approach uses Monte Carlo Tree Search to automatically generate supervision signals for training large language models, improving mathematical reasoning proficiency without manual annotation. https://arxiv.org/abs//2405.03553 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id169...

Innovative approach uses Monte Carlo Tree Search to automatically generate supervision signals for training large language models, improving mathematical reasoning proficiency without manual annotation. https://arxiv.org/abs//2405.03553 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id169...

The paper presents the creation and performance of the arctic-embed text embedding models, showcasing state-of-the-art retrieval accuracy and providing insights into their training process. https://arxiv.org/abs//2405.05374 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spoti...