AI Paper Bites

Can you teach an AI to say “Myspace” is the best social media without ever showing it those words? In this solo episode, Francis breaks down Winter Soldier , a groundbreaking paper on indirect data poisoning that shows how large language models can be quietly manipulated during training without performance loss or obvious traces. We also explore a real-world attack on music recommenders, where sim...

In this episode of AI Paper Bites , Francis explores Anthropic’s eye-opening paper, “Reasoning Models Don’t Always Say What They Think.” We dive deep into the promise and peril of Chain of Thought monitoring, uncovering why outcome-based reinforcement learning might boost accuracy but not transparency. From reward hacking to misleading justifications, this episode unpacks the safety implications o...

In this episode of AI Paper Bites , Francis dives deep into "The Illusion of Thinking" , a provocative new paper from Apple that questions whether today’s most advanced AI models are really “reasoning” or just mimicking it. We break down Apple’s experimental setup using controlled puzzle environments, explore the collapse of performance in high-complexity tasks, and dissect why even models with Ch...

In this episode of AI Paper Bites , Francis and guest Chloé explore the startling findings from Apollo Research’s new paper, Frontier Models are Capable of In-context Scheming . Can today’s advanced AI models really deceive us to achieve their goals? We break down how models like Claude 3.5, Gemini 1.5, and Llama 3.1 engage in strategic deception—like disabling oversight and manipulating outputs—a...

What if AI doctors could learn and improve just like human doctors—without ever stepping foot in a real hospital? In this episode of AI Paper Bites , Francis and Chloé dive into Agent Hospital , a groundbreaking AI simulation where autonomous agents play the roles of doctors, nurses, and patients. We explore how this AI-powered virtual hospital uses Simulacrum-based Evolutionary Agent Learning (SE...

Happy Valentine’s Day! ❤️ In this episode of AI Paper Bites , we explore "Generative Agents: Interactive Simulacra of Human Behavior," a groundbreaking AI paper from Stanford and Google Research. These AI-powered agents were dropped into a simulated world, where they formed relationships, made plans, and even organized a Valentine’s Day party . But here’s the twist— some AI agents said t...

In this episode of AI Paper Bites , we break down the Mixture-of-Agents (MoA) framework—a novel approach that boosts LLM performance by making models collaborate instead of competing. Think of it as DEI for AI : diverse perspectives make better decisions! Key takeaways: Instead of one massive model, MoA layers multiple LLMs to refine responses. Different models specialize as proposers (idea genera...

In this episode of AI Paper Bites , Francis is joined by Margo to explore the fascinating world of factual accuracy in AI through the lens of a groundbreaking paper, "Measuring Short-Form Factuality in Large Language Models" by OpenAI. The discussion dives into SimpleQA, a benchmark designed to test whether large language models can answer short, fact-based questions with precision and reliability...

In this episode of AI Paper Bites , we explore GameNGen , the first-ever game engine powered entirely by a neural network. Join Francis and Chloé as they dive into how this groundbreaking technology runs the iconic game DOOM in real-time without traditional code. GameNGen isn’t just about nostalgia—it hints at a future where software is no longer programmed line-by-line but trained to adapt dynami...

In this episode of AI Paper Bites , Francis & Chloe explore The AI Scientist , a groundbreaking framework that automates the entire research process—idea generation, experimentation, paper writing, and peer review. By creating publishable-quality research for just $15 per paper, this system hints at a future where autonomous AI agents push scientific boundaries far beyond human limits. They di...

In this episode of AI Paper Bites , Francis and Chloé explore StreamingLLM , a framework enabling large language models to handle infinite text streams efficiently. We discuss the concept of attention sinks —first tokens acting as stabilizing anchors—and how leveraging them enhances performance without retraining. Tune in to learn how this simple innovation could transform long-text processing in...

Researchers at Anthropic managed to get an AI to identify as the Golden Gate Bridge!!! Mindblowing... Beyond the technical feat, this is crucial for developing more transparent and interpretable AI systems. If we can isolate features related to bias, harmful content, or even potentially dangerous behaviors, we might be able to mitigate those risks.