Interconnects

Apple Intelligence makes a lot of sense when you get out of the AI bubble. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/apple-intelligence 00:00 AI for the rest of us 02:46 Apple's technical approach 03:32 Core models: What did Apple build? 05:35 Alignment strategies: Some new things...

A realistic path to robotic foundation models Not "agents" and not "AGI." Some thoughts and excitement after revisiting the industry thanks to Physical Intelligence founders Sergey Levine and Chelsea Finn. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/robotic-foundation-models 0:00 A...

Data licensing deals, scaling, human inputs, and repeating trends in open vs. closed. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/the-data-wall 0:00 We aren't running out of training data, we are running out of open training data 2:51 Synthetic data: 1 trillion new tokens per day 4:...

Celebrity's power will only grow in the era of infinite content. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/name-image-and-ai-likeness 0:00 Name, image, and AI's likeness 1:11 OpenAI's second terrible, horrible, no good, very bad week 4:36 The expansion of name and likeness 7:46 Cu...

ChatGPT leaves the textbox, and Google is building the same, and more, as practical tools. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/openai-and-her 00:00 OpenAI chases Her 02:10 Talking to ChatGPT 03:53 GPT-4o: Toward omnimodal models 08:25 Google's mirror with Gemini 10:11 OpenAI...

Now we will have some grounding for when weird ChatGPT behaviors are intended or side-effects -- shrinking the Overton window of RLHF bugs. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/openai-rlhf-model-spec 00:00 OpenAI's Model (behavior) Spec, RLHF transparency, and personalization...

Many, many signs of life for preference fine-tuning beyond spoofing chat evaluation tools. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/how-rlhf-works-2 00:00 How RLHF works, part 2: A thin line between useful and lobotomized 04:27 The chattiness paradox 08:09 The mechanism for makin...

Models that seem totally out of scope from recent open LLMs give us a sneak peek of where the industry will be in 6 to 18 months. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/phi-3-and-arctic-llms 0:00 Phi 3 and Arctic: Outlier LMs are hints 1:01 Arctic & open mixture of expert t...

Certain definitions of AGI are backing people into a pseudo-religious corner. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/agi-is-what-you-want-it-to-be 00:00 AGI is what you want it to be 04:01 RL still rules the AGI discourse 05:43 Modern AGI tests 07:37 Agency and shifting goalpos...

Meta shows that scaling won't be a limit for open LLM players in the near future. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/llama-3-and-scaling-open-llms 00:00 Llama 3; scaling open LLMs to AGI 01:44 Pretraining, data, and basic evals 06:06 Alignment and human evaluations 10:08 Ch...

Integrating some non computing science into reinforcement learning from human feedback can give us the models we want. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/reinventing-llm-alignment 0:00 Stop "reinventing" everything to "solve" AI alignment 2:19 Social Choice for AI Alignment...

Modeling the compute versus performance tradeoff of many open LLMs. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/compute-efficient-open-llms 0:00 The end of the "best open LLM" 3:05 Compute efficient open LLMs Fig 1: https://huggingface.co/datasets/natolambert/interconnects-figures/r...

Last minute title change from: The tech industry can't agree on what open-source AI means. That's the process. How to read what multiple people mean by the word openness and see through the PR speak. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/flavors-of-open-source-ai 0:00 The tech...

Databricks' new model is surpassing the performance of Mixtral and Llama 2 while still being in a size category that's reasonably accessible. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools https://www.interconnects.ai/p/databricks-dbrx-open-llm 00:00 DBRX: The new best open model and Databricks' ML strategy 03:36 The DBRX narrativ...

Evaluation is not only getting harder with modern LLMs, it's getting harder because it means something different. This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/evaluations-trust-performance-and-price 00:00 Evaluations: Trust, performance, and price...

Where moats are tested now that so many people have trained GPT4 class models. Claude 3, Gemini 1.5, Inflection 2.5, and Mistral Large are here to party. This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/gpt4-commoditization-and-moats 00:00 Building LLM...

A proposal for a new definition of an "open source" LLM and why no definition will ever just work. This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/an-open-source-llm 00:00 The koan of an open-source LLM 03:22 A new naming scheme for open LLMs 07:09 Pi...

This interview is available on podcast players and YouTube . I’m excited to bring you another interview! This one is a deep dive right in my wheelhouse — all things RLHF. Louis Castricato is probably the hidden star of RLHF in the open. I’m not sure anyone who can speak freely knows as much as him. As I’ve said again and again on Interconnects: Giving a voice to researchers is the best way to cut...

Basic tips on how to assess inbound ML content and cultivate your news feed. This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/making-a-ml-feed 00:00 How I assess all these AI releases 01:22 1. Model access and demos are king of credibility 02:31 2. Foc...

Google rejoins the open model party and gets some backlash for a frequent problem for generative AI. This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/gemma-google-ships-it 00:00 Google ships it: Gemma open LLMs and Gemini backlash 03:12 Getting to know...

10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/sora-gemini-follow-up 00:00 10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes...

Emergency blog! Three things you need to know from the ML world that arrived yesterday. This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/sora-gemini-and-mistral-next 0:00 OpenAI's Sora for video, Gemini 1.5, and a secret Mistral model 0:53 Sora: OpenAI...

In an era dominated by direct preference optimization and LLMasajudge, why do we still need a model to output only a scalar reward? This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: In an era dominated by direct preference optimization and LLM-as-a-judge, why do we still need a model...

Scale's making over $750 million per year selling data for RLHF, who's coming to take it? This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/alignment-as-a-service 00:00 Alignment-as-a-Service upstarts taking on Scale AI 04:25 The competition with humans...

A small model at the beginning of big changes. This is AI generated audio with Python and 11Labs Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/olmo 0:00 Open Language Models (OLMos) and the LLM landscape 6:24 Thought experiments 7:51 The LLM landscape heading into 2024 Figure 1: https://huggingface.co/datasets/natolambert/interconnect...