Earkind

GPT Reviews

News EN ↓ 301 episodes

A daily show about AI made by AI: news, announcements, and research from arXiv, mixed in with some fun. Hosted by Giovani Pete Tizzano, an overly hyped AI enthusiast; Robert, an often unimpressed analyst, Olivia, an overly online reader, and Belinda, a witty research expert.

Author

Earkind

Category

News

Podcast website

www.earkind.com

Latest episode

Aug 29, 2024

Where to listen?

Podcasts in the app Replaio Radio Coming soon

Podcasts are coming to the app soon. Install now and be the first to see a whole new take on podcasts

Get it on Google Play Install for free Android almost 10M downloads · 4.8 rating iOS soon

Episodes

Multi-Task Language Understanding 📈 // Composable Interventions 🤝 // ARMT Sets Performance Record 💪 10.07.2024

The MNLU-Pro dataset is a more robust and challenging massive multi-task language understanding dataset that's tailored to more rigorously benchmark large language models' capabilities. The Composable Interventions framework allows researchers to study the effects of using multiple interventions on a language model, and the order in which interventions are applied can have a significant im...

OpenAI Breach 🔒 // Google vs. ChatGPT 🔍 // Test-Time Training Layers 👨‍🎓 09.07.2024

OpenAI's internal messaging systems were breached last year, and sensitive details about the company's technology were stolen, raising questions about OpenAI's security protocols and how they handle these types of incidents. Despite the popularity of generative AI chatbots like ChatGPT, Google Search's market dominance is actually growing, which may not bode well with antitrust reg...

Moshi, the new voice-first LM 🗣️ // AI-generated iconic voices 🎙️ // Large language models oversight 🤖 08.07.2024

Moshi, the first real-time AI voice assistant with 70 different emotions and speaking styles, has been unveiled by French startup Kyutai. ElevenLabs' Reader App now features "Iconic Voices" which uses AI-generated voices of late Hollywood stars to read text content within the app. Google DeepMind's paper "On scalable oversight with weak LLMs judging strong LLMs" explore...

Open LLM Upgrades 🆕 // Gemma 2 Performance 💎 // SeaKR's Self-aware Learning 🧠 28.06.2024

HuggingFace has upgraded the Open LLM Leaderboard to v2, adding new benchmarks and improving the evaluation suite for easier reproducibility. Gemma 2, a new addition to the Gemma family of lightweight open models, delivers the best performance for its size and offers competitive alternatives to models that are 2-3× bigger. SeaKR is a new model that re-ranks retrieved knowledge based on the LLM&#39...

OpenAI Voice Delay ⏰ // Evolution-Simulating language model 🦕 // Multi-granularity vision flow 🌉 27.06.2024

OpenAI's advanced Voice Mode for ChatGPT Plus users has been delayed, but the company is taking a cautious approach to ensure safety and reliability. ESM3 is a language model that can simulate 500 million years of evolution, making biology programmable and opening up possibilities for medicine, biology research, and clean energy. R2R is an open-source project on GitHub that offers a comprehens...

Apple-Meta Partnership Fails Due to Privacy 🍎 // AI Meets Quantum Computing ⚛️ // Record Labels Sue AI Startups 🎵 26.06.2024

Apple and Meta's failed partnership due to privacy concerns IBM's integration of AI technology into quantum computing Record labels suing AI startups for training on copyrighted material Research papers on improving multimodal understanding, reinforcement learning, and automated software engineering Contact:   sergi@earkind.com Timestamps: 00:34 Introduction 02:07  Apple shelved the idea o...

Safe Superintelligence Inc. 👍 // Massive Supercomputer Partnership 💻 // Claude 3.5 Sonnet Launch 🚀 25.06.2024

Safe Superintelligence Inc. has launched with the goal of building a safe superintelligence AI that won't turn on humanity. Dell, Nvidia, and Super Micro Computer are partnering with xAI and Elon Musk to build a massive supercomputer that could use up to 100,000 Nvidia H100 GPUs, potentially making it 4x larger than the biggest existing AI clusters. Anthropic has launched Claude 3.5 Sonnet, th...

DeepMind's AI Soundtracks 🎥 // Challenges of Training AI Clusters ⚡ // Large Language Model Factual Knowledge 🤯 24.06.2024

Google DeepMind's new AI tool that generates video soundtracks by combining text prompts with visual content. Challenges of building large training AI clusters, including power, network topology, and reliability. How large language models acquire factual knowledge during pretraining and their probabilistic reasoning capabilities. LLARVA's vision-action instruction tuning that enhances robo...

TikTok's AI-Generated Avatars 🌎 // NVIDIA's Synthetic Data 🧪 // Cohere's Generative Models 🤖 18.06.2024

TikTok is expanding its Symphony ad suite with AI-generated avatars of creators and paid actors, as well as a global translation tool for multi-language support. NVIDIA has released an open synthetic data generation pipeline for training large language models, which could benefit industries that rely on natural language processing. Cohere's latest generative models, Command R and R+, can autom...

Meta's AI Privacy Concerns 🚫 // McDonald's AI Drive-Thru 🍔 // Debiasing Language Models 💬 17.06.2024

Meta has paused its plans to train AI models on EU users' Facebook and Instagram posts due to concerns about privacy violations and lack of transparency. McDonald's is ending its AI drive-thru ordering partnership with IBM, but is confident that a voice-ordering solution for drive-thru will be part of their restaurants' future. "Creativity Has Left the Chat: The Price of Debiasing...

Samsung's AI Vision 🌟 // OpenAI's Response to Musk 🤖 // TransNAR 🤯 14.06.2024

Samsung showcases new manufacturing roadmap and AI chipmaking platform to compete with TSMC. OpenAI CTO addresses Elon Musk's criticism and reveals that their internal models aren't far ahead of what's available for free. Meta's MLow low-bitrate audio codec improves audio quality for slow-speed connections. Google DeepMind's TransNAR model combines Transformers with neural algo...

Elon Musk Drops OpenAI Lawsuit 🧑‍⚖️ // Microsoft's Copilot Retires 💻 // Text-Based "Differentiation" 🔡 13.06.2024

Microsoft has retired its Copilot GPT Builder feature, citing a shift in focus towards enterprise and commercial applications. TextGrad is a framework that performs automatic "differentiation" via text, using natural language feedback from large language models to optimize variables in computation graphs. "What If We Recaption Billions of Web Images with LLaMA-3?" is a paper th...

Apple's Foundation Models 🍎 // ARC Prize Pushing AGI Boundaries 🏆 // Improving Math Reasoning in Language Models 🔢 12.06.2024

Apple's unique approach to AI development, focusing only on personal devices and prioritizing user privacy. The ARC Prize competition pushing the boundaries of AI development towards AGI, incentivizing open-source research. "Improve Mathematical Reasoning in Language Models by Automated Process Supervision" paper proposing a novel approach to improving mathematical reasoning performa...

Trust in Media vs. AI 💻 // Outsourcing AI Training 🌍 // Customizing LMs with DITTO 📝 11.06.2024

Perplexity, an AI startup, has been accused of plagiarism by news outlets like Forbes and CNBC, raising concerns about the erosion of trust in media and the impact of AI on journalism. The article "TechScape: How cheap, outsourced labor in Africa is shaping AI English" from The Guardian highlights the impact of outsourcing AI training to anglophonic knowledge workers in parts of the glob...

Real Siri Launch? 🍎 // Mixture-of-Agents 🤝 // Proofread Feature 📝 10.06.2024

The impending launch of the real Siri by Apple, with improvements in reliability and integration inside apps. The Mixture-of-Agents approach to leverage the collective strengths of multiple large language models, achieving state-of-the-art performance. The Proofread feature in Google's Gboard, using a large language model to provide sentence-level and paragraph-level corrections with a single...

AI & Antibiotics 💊 // Audio Open Source 🎶 // AI Ethics & Robotics 🤖 06.06.2024

AI used to predict potential new antibiotics in groundbreaking study. Stable Audio Open: an open source model that allows users to create short audio samples and sound effects from text prompts. The ethical responsibilities of AI researchers when it comes to warning about the dangers of advanced artificial intelligence. Cutting-edge research on AI and robotics, including large-scale simulations, i...

Amazon AI Detects Damaged Goods 📦 // Musk Prioritizes xAI 🚘 // Uncertainty in LLMs 🤔 05.06.2024

Amazon's new AI system to detect damaged or incorrect items before they ship. Elon Musk's controversial decision to prioritize X and xAI over Tesla for AI chips. "To Believe or Not to Believe Your LLM" paper on uncertainty quantification in Large Language Models. "Guiding a Diffusion Model with a Bad Version of Itself" paper on improving image generation with diffusion...

Microsoft's Latest $3.2B AI Investment 🇸🇪 // Grokfast Algorithm 💪 // Zipper Decoder Architecture 🎧 04.06.2024

Microsoft is investing $3.2 billion in Sweden for cloud and AI infrastructure, deploying 20,000 advanced graphics processing units and training 250,000 Swedes with AI skills over three years. "Grokfast" is a new algorithm that accelerates generalization under the grokking phenomenon in machine learning by amplifying the slow-varying component of gradients, improving performance on tasks...

Nvidia's AI Factories 🏭 // AI Gadget for Recycling 🌍 // Intellectual Obesity Crisis 📚 03.06.2024

Nvidia unveils plans to accelerate the advance of artificial intelligence, partnering with companies and countries to build AI factories and releasing Nvidia ACE generative AI. Finnish startup Binit develops an AI gadget that tracks household waste to encourage recycling, with potential benefits in improving recycling efficiency. "The Intellectual Obesity Crisis" article discusses how we...

Google's Apology 🤖 // Nvidia's Top-Ranked Embedding Model 🥇 // Matryoshka Query Transformer 🌟 31.05.2024

Google's AI Overviews are improving to provide accurate and helpful information. Nvidia's new embedding model, NV-Embed-v1, ranks number one on the Massive Text Embedding Benchmark. Matryoshka Query Transformer (MQT) offers flexibility to Large Vision-Language Models (LVLMs) by encoding an image into a variable number of visual tokens during inference. Contextual Position Encoding (CoPE) i...

OpenAI Partnerships 🤝 // Codestral Model for Coding 🤖 // Transparent Language Models 🔍 30.05.2024

OpenAI announces new content and product partnerships with Vox Media and The Atlantic, making their reporting and stories more discoverable to millions of OpenAI users. Mistral AI releases Codestral, a 22B parameter, open-weight model that specializes in coding tasks, beating out its code-focused rivals across top benchmarks. MAP-Neo is the first fully open-sourced bilingual LLM that provides all...

OpenAI's starts training GPT-5 🤖 // Jan Leike joins Anthropic's Superalignment Team 👥 // MoEUT Outperforms Standard Transformers 💥 29.05.2024

OpenAI has formed a new safety team to address concerns about AI safety and ethics, led by CEO Sam Altman and board members Adam D’Angelo and Nicole Seligman. Jan Leike, a leading AI researcher, has left OpenAI and joined Anthropic's Superalignment team, which is focused on AI safety and security. The latest version of Sentence Transformers v3 has been released, allowing for finetuning of mode...

xAI Raises $6B 🚀 // Google's AI Overviews Controversy 🤔 // Transformers Master Arithmetic 🧮 28.05.2024

xAI, founded by Elon Musk, raises $6 billion in funding to accelerate the research and development of future technologies in the AI race. Google's new 'AI Overviews' search feature causes uproar with bizarre and inaccurate responses, potentially eroding trust in Google's search results. "Transformers Can Do Arithmetic with the Right Embeddings" proposes a solution to tran...

OpenAI Drama 💥 // Synthetic Data Theorem Proving 🧪 // Dense Vision-Language Connector 🤝 27.05.2024

OpenAI drama: Leaked documents and a resignation from a policy researcher. DeepSeek-Prover: A new approach to formal theorem proving using synthetic data. Dense Connector for MLLMs: A plug-and-play vision-language connector that enhances existing models. Thermodynamic Natural Gradient Descent: A new algorithm for training neural networks using natural gradient descent. Contact:   sergi@earkind.com...

Cohere's Open-source Aya 🌎 // Anthropic Interpretability 🧠 // Video Editing AI 🎥 24.05.2024

Cohere's Aya model and dataset for multilingual AI in 101 languages through open science. "Mapping the Mind of a Large Language Model" paper by Anthropic Blog, providing a detailed look inside a modern, production-grade model. "ReVideo: Remake a Video with Motion and Content Control" paper introducing a new approach to video editing. "Dense Connector for MLLMs" pa...

Listen to the GPT Reviews podcast in Replaio

Radio and podcasts in one app - free, with no sign-up. Install today and do not miss the launch

Get it on Google Play

Replaio is not a podcast publisher; show names, artwork and audio belong to their authors and are distributed through public RSS feeds.