Nathan Lambert

Interconnects

Technology EN ↓ 156 episodes

Audio essays about the latest developments in AI and interviews with leading scientists in the field. Breaking the hype, understanding what's under the hood, and telling stories. www.interconnects.ai

Author

Nathan Lambert

Episodes

Model merging lessons in The Waifu Research Department 29.01.2024 19:04

Note: some of the audio in the second half is a little wonky, but the general voice was upgraded so hopefully it's a little less "poppy" until then! I'm trying to fix little pronunciation problems on a weekly basis. Thanks to my early fans! It'll keep improving. E.g. some of the months were wonky. When what seems like pure LLM black magic is actually supported by the literature. This is AI generat...

Local LLMs, some facts some fiction 24.01.2024 9:58

Local LLMs: the latency solution, Meta's open AGI, personalization myth, and moats X factor The deployment path that'll break through in 2024. Plus, checking in on strategies across Big Tech and AI leaders. This is AI generated audio with Python and 11Labs Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/local-llms 0:00 Local LLMs: the l...

Multimodal blogging: My AI tools to expand your audience 17.01.2024 8:18

A fun demo on how generative AI can transform content creation, and tools for my fellow writers on Substack! This is AI generated audio with Python and 11Labs Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/multimodal-blogging-tools 0:00 Multimodal blogging tools 2:57 Stratechery, passport, and wonderful customer experiences 5:51 Wrap-u...

Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions 10.01.2024 15:58

A sampling of recent happenings in the multimodal space. Be sure to expect more this year. This is AI generated audio with Python and 11Labs Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/multimodal-rlhf 00:00 Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions 02:46 Unified IO 2: Scaling mul...

Where 2024’s “open GPT4” can’t match OpenAI’s 05.01.2024 13:40

And why the comparisons don't really matter. Repeated patterns in the race for reproducing ChatGPT, another year of evaluation crises, and people who will take awesome news too far. This is AI generated audio with Python and 11Labs Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/open-gpt4-limitations 00:00 Where 2024's "open GPT4" can't...

Interviewing Tri Dao and Michael Poli of Together AI on the future of LLM architectures 21.12.2023 35:47

This interview is on YouTube and podcast players . Giving a voice to researchers is the best way to cut through the noise and understand what is happening with core developments of LLM technologies. I’m excited to get to talk with Michael Poli (Stanford PhD student + research at Together AI) and Tri Dao (incoming professor at Princeton + Chief Scientist at Together AI). This builds on the mega-...