Dwarkesh Podcast

This week I welcome on the show two of the most important technologists ever, in any field. Jeff Dean is Google's Chief Scientist, and through 25 years at the company, has worked on basically the most transformative systems in modern computing: from MapReduce, BigTable, Tensorflow, AlphaChip, to Gemini. Noam Shazeer invented or co-invented all the main architectures and techniques that are used fo...

Third and final episode in the Paine trilogy! Chinese history is full of warlords constantly challenging the capital. How could Mao not only stay in power for decades, but not even face any insurgency? And how did Mao go from military genius to peacetime disaster - the patriotic hero who inflicted history’s worst human catastrophe on China? How can someone shrewd enough to win a civil war outnumbe...

This is the second episode in the trilogy of a lectures by Professor Sarah Paine of the Naval War College. In this second episode, Prof Paine dissects the ideas and economics behind Japanese imperialism before and during WWII. We get into the oil shortage which caused the war; the unique culture of honor and death; the surprisingly chaotic chain of command. This is followed by a Q&A with me. Huge...

I’m thrilled to launch a new trilogy of double episodes: a lecture series by Professor Sarah Paine of the Naval War College, each followed by a deep Q&A. In this first episode, Prof Paine talks about key decisions by Khrushchev, Mao, Nehru, Bhutto, & Lyndon Johnson that shaped the whole dynamic of South Asia today. This is followed by a Q&A. Come for the spy bases, shoestring nukes, and insight ab...

I interviewed Tyler Cowen at the Progress Conference 2024. As always, I had a blast. This is my fourth interview with him – and yet I’m always hearing new stuff. We talked about why he thinks AI won't drive explosive economic growth, the real bottlenecks on world progress, him now writing for AIs instead of humans, and the difficult relationship between being cultured and fostering growth – among...

Adam Brown is a founder and lead of BlueShift with is cracking maths and reasoning at Google DeepMind and a theoretical physicist at Stanford. We discuss: destroying the light cone with vacuum decay, holographic principle, mining black holes, & what it would take to train LLMs that can make Einstein level conceptual breakthroughs. Stupefying, entertaining, & terrifying. Enjoy! Watch on YouTube , r...

Gwern is a pseudonymous researcher and writer. He was one of the first people to see LLM scaling coming. If you've read his blog , you know he's one of the most interesting polymathic thinkers alive. In order to protect Gwern's anonymity, I proposed interviewing him in person, and having my friend Chris Painter voice over his words after. This amused him enough that he agreed. After the episode, I...

A bonanza on the semiconductor industry and hardware scaling to AGI by the end of the decade. Dylan Patel runs Semianalysis , the leading publication and research firm on AI hardware. Jon Y runs Asianometry , the world’s best YouTube channel on semiconductors and business history. * What Xi would do if he became scaling pilled * $ 1T+ in datacenter buildout by end of decade Watch on  YouTube . Lis...

Unless you understand the history of oil, you cannot understand the rise of America, WW1, WW2, secular stagnation, the Middle East, Ukraine, how Xi and Putin think, and basically anything else that's happened since 1860. It was a great honor to interview Daniel Yergin, the Pulitzer Prize winning author of The Prize - the best history of oil ever written (which makes it the best history of the 20th...

I had no idea how wild human history was before chatting with the geneticist of ancient DNA David Reich . Human history has been again and again a story of one group figuring ‘something’ out, and then basically wiping everyone else out. From the tribe of 1k-10k modern humans who killed off all the other human species 70,000 years ago; to the Yamnaya horse nomads 5,000 years ago who killed off 90+%...

Chatted with Joe Carlsmith about whether we can trust power/techno-capital, how to not end up like Stalin in our urge to control the future, gentleness towards the artificial Other, and much more. Check out Joe's sequence on Otherness and Control in the Age of AGI here . Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podcast platform. Read the full transcript  here . Follo...

I talked with Patrick McKenzie (known online as patio11) about how a small team he ran over a Discord server got vaccines into Americans' arms: A story of broken incentives, outrageous incompetence, and how a few individuals with high agency saved 1000s of lives. Enjoy! Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podcast platform. Read the full transcript  here . Follow...

I chatted with Tony Blair about: - What he learned from Lee Kuan Yew - Intelligence agencies track record on Iraq & Ukraine - What he tells the dozens of world leaders who come seek advice from him - How much of a PM’s time is actually spent governing - What will AI’s July 1914 moment look like from inside the Cabinet? Enjoy! Watch the video on  YouTube . Read the full transcript  here . Follow me...

Here is my conversation with Francois Chollet and Mike Knoop on the $1 million ARC-AGI Prize they're launching today . I did a bunch of socratic grilling throughout, but Francois’s arguments about why LLMs won’t lead to AGI are very interesting and worth thinking through. It was really fun discussing/debating the cruxes. Enjoy! Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any othe...

Chatted with my friend Leopold Aschenbrenner on the trillion dollar nationalized cluster, CCP espionage at AI labs, how unhobblings and scaling can lead to 2027 AGI, dangers of outsourcing clusters to Middle East, leaving OpenAI, and situational awareness. Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podcast platform. Read the full transcript  here . Follow me on Twitter...

Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come... Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podcast platform. Read the full transcript  here . Follow me on Twitter for updates on future episodes. Timestamps (00:00:00) - Pre-training, post-training, and future capabil...

Mark Zuckerberg on: - Llama 3 - open sourcing towards AGI - custom silicon, synthetic data, & energy constraints on scaling - Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more Enjoy! Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podcast platform. Human edited transcript with helpful links here . Timestamps (00:00:00) - Llama 3 (00:08:32) - Codi...

Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast. No way to summarize it, except:  This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them. You would be shocked how much of what I know about this field, I've learned just from talking with them. To the exte...

Here is my episode with Demis Hassabis, CEO of Google DeepMind We discuss: * Why scaling is an artform * Adding search, planning, & AlphaZero type training atop LLMs * Making sure rogue nations can't steal weights * The right way to align superhuman AIs and do an intelligence explosion Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podcast platform. Read the full transcrip...

We discuss: * what it takes to process $1 trillion/year * how to build multi-decade APIs, companies, and relationships * what's next for Stripe (increasing the GDP of the internet is quite an open ended prompt, and the Collison brothers are just getting started). Plus the amazing stuff they're doing at Arc Institute , the financial infrastructure for AI agents, playing devil's advocate against pro...

It was a great pleasure speaking with Tyler Cowen for the 3rd time. We discussed GOAT: Who is the Greatest Economist of all Time and Why Does it Matter? , especially in the context of how the insights of Hayek, Keynes, Smith, and other great economists help us make sense of AI, growth, animal spirits, prediction markets, alignment, central planning, and much more. The topics covered in this episod...

This is a narration of my blog post, Lessons from The Years of Lyndon Johnson by Robert Caro . You read the full post here: https://www.dwarkeshpatel.com/p/lyndon-johnson Listen on Apple Podcasts , Spotify , or any other podcast platform. Follow me on Twitter for updates on future posts and episodes. Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe

This is a narration of my blog post, Will scaling work? . You read the full post here: https://www.dwarkeshpatel.com/p/will-scaling-work Listen on Apple Podcasts , Spotify , or any other podcast platform. Follow me on Twitter for updates on future posts and episodes. Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe

A true honor to speak with Jung Chang. She is the author of Wild Swans: Three Daughters of China (sold 15+ million copies worldwide) and Mao: The Unknown Story . We discuss: - what it was like growing up during the Cultural Revolution as the daughter of a denounced official - why the CCP continues to worship the biggest mass murderer in human history. - how exactly Communist totalitarianism was ab...

Andrew Roberts is the world's best biographer and one of the leading historians of our time. We discussed * Churchill the applied historian, * Napoleon the startup founder, * why Nazi ideology cost Hitler WW2, * drones, reconnaissance, and other aspects of the future of war, * Iraq, Afghanistan, Korea, Ukraine, & Taiwan. Watch on  YouTube . Listen on  Apple Podcasts ,  Spotify , or any other podca...