Joe Carlsmith

Joe Carlsmith Audio

Society EN ↓ 71 episodes

Audio versions of essays by Joe Carlsmith. Philosophy, futurism, and other topics. Text versions at joecarlsmith.com.

Author

Joe Carlsmith

Category

Society

Latest episode

Mar 19, 2026

Where to listen?

Podcasts in the app Replaio Radio Coming soon

Podcasts are coming to the app soon. Install now and be the first to see a whole new take on podcasts

Get it on Google Play Install for free Android 5M+ downloads · 4.8 rating iOS soon

Episodes

An even deeper atheism 11.01.2024

Who isn't a paperclipper? Text version here: https://joecarlsmith.com/2024/01/11/an-even-deeper-atheism This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01...

Does AI risk "other" the AIs? 09.01.2024

Examining Robin Hanson's critique of the AI risk discourse. Text version here: https://joecarlsmith.com/2024/01/09/does-ai-risk-other-the-ais This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus...

When "yang" goes wrong 08.01.2024

On the connection between deep atheism and seeking control.  Text version here: https://joecarlsmith.com/2024/01/08/when-yang-goes-wrong This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https...

Deep atheism and AI risk 04.01.2024

On a certain kind of fundamental mistrust towards Nature.  Text version here: https://joecarlsmith.com/2024/01/04/deep-atheism-and-ai-risk This is the second essay in my series “Otherness and control in the age of AGI. I’m hoping that the individual essays can be read fairly well on their own, but see here for brief summaries of the essays released thus far: https://joecarlsmith.com/2024/01/02/oth...

Gentleness and the artificial Other 02.01.2024

AIs as fellow creatures. And on getting eaten.  Link: https://joecarlsmith.com/2024/01/02/gentleness-and-the-artificial-other This is the first essay in a series of essays that I’m calling “Otherness and control in the age of AGI.” See here for more about the series as a whole: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi.

In search of benevolence (or: what should you get Clippy for Christmas?) 27.12.2023

What is altruism towards a paperclipper? Can you paint with all the colors of the wind at once?  (This is a recording of an essay originally published in 2021. Text here: https://joecarlsmith.com/2021/07/19/in-search-of-benevolence-or-what-should-you-get-clippy-for-christmas)

Is scheming more likely if you train models to have long-term goals? (Sections 2.2.4.1-2.2.4.2 of "Scheming AIs") 16.11.2023

This is sections 2.2.4.1-2.2.4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2...

How useful for alignment-relevant work are AIs with short-term goals? (Section 2.2.4.3 of "Scheming AIs") 16.11.2023

This is section 2.2.4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13...

The goal-guarding hypothesis (Section 2.3.1.1 of "Scheming AIs") 16.11.2023

This is section 2.3.1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13...

Does scheming lead to adequate future empowerment? (Section 2.3.1.2 of "Scheming AIs") 16.11.2023

This is section 2.3.1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13...

Non-classic stories about scheming (Section 2.3.2 of "Scheming AIs") 16.11.2023

This is section 2.3.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

Arguments for/against scheming that focus on the path SGD takes (Section 3 of "Scheming AIs") 16.11.2023

This is section 3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977...

The counting argument for scheming (Sections 4.1 and 4.2 of "Scheming AIs") 16.11.2023

This is sections 4.1 and 4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/20347...

Simplicity arguments for scheming (Section 4.3 of "Scheming AIs") 16.11.2023

This is section 4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Speed arguments against scheming (Section 4.4-4.7 of "Scheming AIs") 16.11.2023

This is section 4.4 through 4.7 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/20...

Summing up "Scheming AIs" (Section 5) 16.11.2023

This is section 5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977...

Empirical work that might shed light on scheming (Section 6 of "Scheming AIs") 16.11.2023

This is section 6 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977...

Varieties of fake alignment (Section 1.1 of "Scheming AIs") 16.11.2023

This is section 1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

A taxonomy of non-schemer models (Section 1.2 of "Scheming AIs") 16.11.2023

This is section 1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Why focus on schemers in particular? (Sections 1.3-1.4 of "Scheming AIs") 16.11.2023

This is sections 1.3-1.4 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1...

On "slack" in training (Section 1.5 of "Scheming AIs") 16.11.2023

This is section 1.5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Situational awareness (Section 2.1 of "Scheming AIs") 16.11.2023

This is section 2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Two concepts of an "episode" (Section 2.2.1 of "Scheming AIs") 16.11.2023

This is section 2.2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

Two sources of beyond-episode goals (Section 2.2.2 of "Scheming AIs") 16.11.2023

This is section 2.2.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

"Clean" vs. "messy" goal-directedness (Section 2.2.3 of "Scheming AIs") 16.11.2023

This is section 2.2.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

Listen to the Joe Carlsmith Audio podcast in Replaio

Radio and podcasts in one app - free, with no sign-up. Install today and do not miss the launch

Get it on Google Play

Replaio is not a podcast publisher; show names, artwork and audio belong to their authors and are distributed through public RSS feeds.