GenAI Level UP

Are you content with merely functional AI? David Ogilvy wouldn't be. This podcast embodies his spirit of "divine discontent" , pushing beyond the ordinary to explore the fundamental truths of Generative AI. We delve into the essential building blocks, demanding not just understanding, but mastery. If you refuse to settle for "good enough" and aim for truly groundbreaking ge...

How do you teach a sophisticated speech AI to understand and discuss images, especially when paired image-speech data is rare? This episode unpacks MoshiVis , a new model that achieves just that. We explore the challenges of building Vision-Speech Models and how MoshiVis overcomes them with a unique one-stage training pipeline, synthetic dialogues, and efficient "perceptual augmentation" technique...

Dive into the groundbreaking world of DeepSeek LLM , an open-source language model that's challenging the dominance of closed-source AI. This episode unpacks the secrets behind DeepSeek's impressive capabilities, exploring its unique Mixture-of-Experts (MoE) architecture that optimizes performance and allows it to run efficiently on consumer-grade hardware. We'll delve into its multi-s...

Are current AI models hitting a memory wall? Join us as we delve into the fascinating research behind " Titans: Learning to Memorize at Test Time ," an innovative approach to AI learning. The podcast covers key concepts from the paper, including: The challenges of long-term memory in AI, noting that models like Transformers are good at understanding immediate relationships but struggle w...

Join us for an in-depth exploration of the groundbreaking research paper, " Memory Layers at Scale. " Discover how trainable key-value lookup mechanisms are transforming the landscape of AI by making large-scale models more efficient, accurate, and capable of continuous learning. We'll unpack the innovations behind memory layers, including product-key lookup and parallel memory techniques, and dis...

How well can AI remember and use information in long conversations? This episode explores the groundbreaking LOCOMO dataset , a unique resource designed to evaluate long-term conversational memory in Large Language Models ( LLMs ). We delve into the challenges of current AI in maintaining coherent, empathetic conversations over multiple sessions. Discover how the LOCOMO dataset , generated through...

Ready for a deep dive into the fascinating world of large language models? In this episode, we push AI chatbots to their conversational limits—spanning hundreds of turns, multiple sessions, and even images—to find out how well they remember and understand context over time. We delve into a groundbreaking dataset called “ Locomo ” that evaluates an AI’s ability to recall events, summarize complex s...

This final episode wraps up our journey into the world of generative AI, providing a crucial overview of the ethical and societal considerations , and emerging trends shaping the future of this rapidly evolving field. We'll synthesize key concepts discussed throughout the series, and highlight resources for continued learning, providing a solid foundation for listeners to further their own explora...

This podcast offers a comprehensive exploration of multi-modal generative AI. We examine the two dominant families of techniques, the multi-modal large language models (MLLM) and diffusion models, covering their probabilistic modeling procedures, multi-modal architecture designs, and advanced applications in image/video large language models, as well as text-to-image/video generation. We look at h...

Explore the revolutionary world of  diffusion models , a cutting-edge AI technology that learns to reverse the process of turning data into noise to generate new, high-quality content. We'll break down the science behind these models, including how they use  stochastic differential equations (SDEs)  to transform data and the role of the  score function  in guiding the reverse process. We'll discus...

Join us on a fascinating journey into the world of natural language processing, where we explore groundbreaking advancements in AI learning. From BERT 's innovative masking strategies to GPT-3 's remarkable few-shot learning capabilities, we discuss how these models are transforming our understanding of language and intelligence. Dive into the ethical implications, exciting applications, and the e...

This episode delves into the groundbreaking RNN Encoder-Decoder architecture , a neural network model that revolutionized machine translation. We'll explore how this model learns to encode and decode sequences of words, enabling more accurate and fluent translations. Discover how researchers have used this powerful tool to improve the performance of statistical machine translation systems and expl...

Inspired by Ian Goodfellow's seminal paper , we explore the core principles of Generative Adversarial Networks (GANs), where creativity meets competition. Learn how generators and discriminators engage in a dynamic dance to push the boundaries of AI creativity, producing lifelike images, music, and even scientific simulations. We also discuss the groundbreaking applications, ethical considerations...

Variational Autoencoders (VAEs) are a fascinating type of deep learning model that combines neural networks with probabilistic modeling. This podcast will guide you through the key ideas behind VAEs, including the concept of latent spaces, the Evidence Lower Bound (ELBO), and the reparameterization trick. We'll explain the information-theoretic interpretation of the VAE objective, discuss techniqu...

Dive into the fascinating universe of Deep Generative Models (DGMs) with this insightful podcast. Explore how these advanced neural networks simulate complex, high-dimensional probability distributions to create lifelike images, voices, and more. Based on the paper " An Introduction to Deep Generative Modeling " by Lars Ruthotto and Eldad Haber, we unpack the three cornerstone approaches—Normalizi...

We break down how neural networks learn from data, starting with forward and backward passes, loss functions, and optimization methods like gradient descent. We cover common hurdles—including vanishing and exploding gradients—and explore strategies like careful initialization, dropout, and early stopping. Finally, we highlight specialized architectures (CNNs, RNNs, LSTMs), clever training techniqu...

Dive into the fascinating world of Artificial Neural Networks (ANNs) in this episode, where we explore their structure, function, and real-world applications. Inspired by the human brain, ANNs are the cornerstone of modern AI, excelling in tasks like image recognition, natural language processing, and more. Learn about the layers of interconnected nodes, the role of activation functions, and how t...

Join us as we explore the fascinating world of Deep Learning ! This podcast will break down complex concepts into digestible pieces, covering everything from basic building blocks like neural networks, activation functions, and backpropagation to real-world applications in computer vision, speech recognition, and natural language processing . Whether you're a student, a professional, or just curio...

Imagine a world where scientists can simulate human behavior with incredible accuracy . Researchers at Stanford University have developed a new tool called "generative agents" that does just that. These agents are powered by large language models and trained on in-depth interviews with real people. The result is a collection of virtual individuals who can answer surveys, participate in experiments...

The Transformer: Revolutionizing Sequence Transduction with Self-Attention This episode explores the groundbreaking Transformer , a novel neural network architecture that has transformed the field of sequence transduction. The Transformer dispenses with recurrence and convolutions entirely , relying solely on attention mechanisms to capture global dependencies between input and output sequences. T...