Joe Carlsmith

Joe Carlsmith Audio

Society EN ↓ Odcinki: 71

Audio versions of essays by Joe Carlsmith. Philosophy, futurism, and other topics. Text versions at joecarlsmith.com.

Koniecznie odwiedź stronę podcastu i wesprzyj twórcę: joecarlsmithaudio.buzzsprout.com

Autor

Joe Carlsmith

Kategoria

Society

Ostatni odcinek

19 mar 2026

Gdzie słuchać?

Podcasty w aplikacji Replaio Radio Już wkrótce

Podcasty trafią do aplikacji już wkrótce. Zainstaluj teraz i jako pierwszy zobacz nowe podejście do podcastów

Pobierz z Google Play Zainstaluj za darmo Android prawie 10 mln pobrań · ocena 4,8 iOS niedługo

Odcinki

An even deeper atheism 11.01.2024

Who isn't a paperclipper? Text version here: https://joecarlsmith.com/2024/01/11/an-even-deeper-atheism This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01...

Does AI risk "other" the AIs? 09.01.2024

Examining Robin Hanson's critique of the AI risk discourse. Text version here: https://joecarlsmith.com/2024/01/09/does-ai-risk-other-the-ais This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus...

When "yang" goes wrong 08.01.2024

On the connection between deep atheism and seeking control.  Text version here: https://joecarlsmith.com/2024/01/08/when-yang-goes-wrong This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https...

Deep atheism and AI risk 04.01.2024

On a certain kind of fundamental mistrust towards Nature.  Text version here: https://joecarlsmith.com/2024/01/04/deep-atheism-and-ai-risk This is the second essay in my series “Otherness and control in the age of AGI. I’m hoping that the individual essays can be read fairly well on their own, but see here for brief summaries of the essays released thus far: https://joecarlsmith.com/2024/01/02/oth...

Gentleness and the artificial Other 02.01.2024

AIs as fellow creatures. And on getting eaten.  Link: https://joecarlsmith.com/2024/01/02/gentleness-and-the-artificial-other This is the first essay in a series of essays that I’m calling “Otherness and control in the age of AGI.” See here for more about the series as a whole: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi.

In search of benevolence (or: what should you get Clippy for Christmas?) 27.12.2023

What is altruism towards a paperclipper? Can you paint with all the colors of the wind at once?  (This is a recording of an essay originally published in 2021. Text here: https://joecarlsmith.com/2021/07/19/in-search-of-benevolence-or-what-should-you-get-clippy-for-christmas)

Is scheming more likely if you train models to have long-term goals? (Sections 2.2.4.1-2.2.4.2 of "Scheming AIs") 16.11.2023

This is sections 2.2.4.1-2.2.4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2...

How useful for alignment-relevant work are AIs with short-term goals? (Section 2.2.4.3 of "Scheming AIs") 16.11.2023

This is section 2.2.4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13...

The goal-guarding hypothesis (Section 2.3.1.1 of "Scheming AIs") 16.11.2023

This is section 2.3.1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13...

Does scheming lead to adequate future empowerment? (Section 2.3.1.2 of "Scheming AIs") 16.11.2023

This is section 2.3.1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13...

Non-classic stories about scheming (Section 2.3.2 of "Scheming AIs") 16.11.2023

This is section 2.3.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

Arguments for/against scheming that focus on the path SGD takes (Section 3 of "Scheming AIs") 16.11.2023

This is section 3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977...

The counting argument for scheming (Sections 4.1 and 4.2 of "Scheming AIs") 16.11.2023

This is sections 4.1 and 4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/20347...

Simplicity arguments for scheming (Section 4.3 of "Scheming AIs") 16.11.2023

This is section 4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Speed arguments against scheming (Section 4.4-4.7 of "Scheming AIs") 16.11.2023

This is section 4.4 through 4.7 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/20...

Summing up "Scheming AIs" (Section 5) 16.11.2023

This is section 5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977...

Empirical work that might shed light on scheming (Section 6 of "Scheming AIs") 16.11.2023

This is section 6 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977...

Varieties of fake alignment (Section 1.1 of "Scheming AIs") 16.11.2023

This is section 1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

A taxonomy of non-schemer models (Section 1.2 of "Scheming AIs") 16.11.2023

This is section 1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Why focus on schemers in particular? (Sections 1.3-1.4 of "Scheming AIs") 16.11.2023

This is sections 1.3-1.4 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1...

On "slack" in training (Section 1.5 of "Scheming AIs") 16.11.2023

This is section 1.5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Situational awareness (Section 2.1 of "Scheming AIs") 16.11.2023

This is section 2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/139699...

Two concepts of an "episode" (Section 2.2.1 of "Scheming AIs") 16.11.2023

This is section 2.2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

Two sources of beyond-episode goals (Section 2.2.2 of "Scheming AIs") 16.11.2023

This is section 2.2.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

"Clean" vs. "messy" goal-directedness (Section 2.2.3 of "Scheming AIs") 16.11.2023

This is section 2.2.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?”  Text of the report here: https://arxiv.org/abs/2311.08379   Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power   Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/1396...

Słuchaj podcastu Joe Carlsmith Audio w Replaio

Radio i podcasty w jednej aplikacji - za darmo, bez zakładania konta. Zainstaluj już dziś i nie przegap premiery

Pobierz z Google Play

Replaio nie jest wydawcą podcastów; nazwy audycji, okładki i audio należą do ich autorów i są rozpowszechniane przez publiczne kanały RSS