Generative AI Group Podcast

Alex: “Hello and welcome to The Generative AI Group Digest for the week of 26 Oct 2025!” Maya: “We're Alex and Maya.” Alex: This week’s thread was a full buffet — throttles, browsers that act like assistants, voice-agent latency puzzles, and an argument about whether pixels beat text. Let’s jump in. Maya: First up — Claude limits and weird token behavior. Lots of people — Ashwin Ramaswamy, Somya S...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 19 Oct 2025! Maya: We're Alex and Maya. Alex: We had a busy week in the group — lots of practical problem-solving threads. Let’s jump straight into the highlights. First up: memory and summarization for RAG and multi-agent systems. Arpan Paul brought a great real-world pain: “objective is summarising large databases of ticke...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 12 Oct 2025! Maya: We're Alex and Maya. Alex: First up this week — the platform wars and what came out of OpenAI Dev Day. People in the thread called out a bunch of announcements: agent builder, Apps SDK, Sora 2 in the API, a gpt-realtime-mini, and new app monetization details. AD summed it up nicely in the chat. Maya: Right...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 05 Oct 2025! Maya: We're Alex and Maya. Alex: Big week in the group — folks wrestling with messy PDFs, image generation headaches, new long-context model behavior, Sora's buzz, and some interesting benchmarks and tooling ideas. Ready to dive in? Maya: Let’s do it. Alex: First up — parsing really complex PDFs and extracting t...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 28 Sep 2025! Maya: We're Alex and Maya. Alex: First up this week — a long thread about MCPs, background agents and how to give agents a runnable “config.” Ananth asked directly, “If I want to provide a MCP like config which any background agents can take as a prompt and run it, is there a way to do it?” That question touched...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 21 Sep 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about DSPy — a hot framework for prompt and LLM program optimization. Luv kicked off an in-depth summary saying DSPy helps build and refine “programs” made of prompted modules, optimizing them via evaluation and critique. Maya: Prompt “programs”? So it’s l...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 14 Sep 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about hallucinations in large language models. Shapath shared a paper from OpenAI explaining hallucinations as a feature designed through the reward function. Maya: Hallucinations as a feature? That sounds counterintuitive. Why would anyone want their AI t...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 07 Sep 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about the best ways to handle highly structured documents. Maya: Hey Alex, do you think rules-based methods can still win against fancy AI for this? Alex: Good question! Pulkit Gupta mentioned that with specific formats, simple preprocessing plus rules and...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 31 Aug 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about the new Grok 2.5 model going open source! Nitin Kalra shared that the full model is about 500GB and requires 8 GPUs with over 40GB memory each. Maya: Wow, 500GB is massive! Do you think it’s practical for smaller setups? Like, can someone run the min...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 24 Aug 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about the fascinating debate on the “bitter lesson” in AI research—whether scaling is enough or if we need fundamentally new architectures. Maya: Oh, I've heard of Richard Sutton's “bitter lesson” that says general methods that leverage computation outperf...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 17 Aug 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about the ChatGPT model controversy. OpenAI replaced GPT-4o with GPT-5, but users weren’t happy. Maya: Why were people calling GPT-5 "lobotomized"? What was going wrong? Alex: Anay Gawande shared that during Sam Altman’s Reddit AMA, fans flooded him demand...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 10 Aug 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about the big buzz in open source large language models. OpenAI finally released the GPT-OSS models, including a 20B and 120B parameter version. Maya: I’ve been curious—Alex, why is an open weights release such a big deal when there are tons of models alre...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 03 Aug 2025! Maya: We're Alex and Maya. Excited to dive into this week’s rich AI discussions with you! Alex: First up, we're talking about deployment strategies in Azure OpenAI. Nikita Ag shared an interesting point about their different SKU options—global, datazone, and regional. Maya: Wait, Alex, SKUs in cloud services—are...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 27 Jul 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about how folks are scraping and managing web data efficiently. Naras shared that you can give a set of URLs to scrape, but there's a limit of about 1,500 requests per day, with each request handling around 20 URLs. Maya: Interesting! So is this scraping d...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 20 Jul 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about smart ways to keep deep research reports up to date. Shan Shah raised a great point about the challenge here. Maya: Right, Alex! Are people usually just regenerating entire reports every time? Or is there a better way to update only parts? Alex: Shan...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 13 Jul 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about liquid neural networks. Sudz asked if anyone had spent time on them and was looking for a study buddy. Maya: Liquid neural networks? Sounds intriguing. Alex, do you know what makes them special? Alex: They’re a kind of neural network that can adapt t...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 06 Jul 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about handling complex Excel sheets with multiple pivots and headers for AI agents. SaiVignan Malyala shared the challenge of feeding these dynamic Excel formats to large language models—LLMs don’t quite get the structure right. Maya: That sounds tricky! A...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 29 Jun 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about new AI agents working with document editing and automation. Rajiv shared he built an agent for formatting transcripts using tiptap with a pagination extension. Have you seen many agents directly editing Word or PowerPoint files, Maya? Maya: Actually,...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 22 Jun 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about analyzing AI chats at scale. Maya: Shree asked if there’s any service for insights from hundreds of bot chats daily. I wonder, Alex, what tools could do that best? Alex: Amit suggested Clio from Anthropic, and even shared an unofficial open source li...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 15 Jun 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about the fascinating debate around AI reasoning sparked by a new paper from Apple titled “Illusion of Thinking.” Maya, have you seen what this is all about? Maya: I have! It critiques current large language models (LLMs) claiming their chain-of-thought is...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 08 Jun 2025! Maya: We're Alex and Maya. Let’s dive into another vibrant week in AI! --- Alex: First up, we’re talking about the fascinating world of prompting techniques that top AI startups are using. Maya: Prompts that stretch to six pages? How is that even possible? Isn't that just a simple paragraph usually? Alex: Right?...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 01 Jun 2025! Maya: We're Alex and Maya. Excited to dive into yet another packed week of AI news and community chatter! Alex: First up, we’re talking about WhatsApp Business API, bot-building, and verification headaches. Maya: Oh yes, that’s always a hot topic. Why do folks struggle so much to get verified with Meta’s WhatsAp...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 25 May 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about tackling hallucinations in large language models. Shreyash Nigam shared some smart approaches. Maya: Hallucinations, meaning when the model makes stuff up? How are they catching that live? Alex: Good question! Shreyash mentioned one effective method...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 18 May 2025! Maya: We're Alex and Maya. Alex: First up, we’re talking about tackling hallucinations in large language models, or LLMs. Maya: Hallucinations happen when the AI makes stuff up, right? How do folks catch that? Alex: Great point! Shreyash Nigam shared that if you want to just spot hallucinations for logging, you...

Alex: Hello and welcome to The Generative AI Group Digest for the week of 11 May 2025! Maya: We're Alex and Maya. Alex: First up, we’re diving into the fascinating debate around how large language models, or LLMs, learn language compared to humans. Maya: That sounds intriguing! Alex, what’s the main comparison here? Alex: Well, one insightful analogy shared is this: LLMs start with a vast vocabula...