“Individual AI representatives don’t solve Gradual Disempowerement” by Jan_Kulveit
06:43 Share

Imagine each of us has an AI representative, aligned to us, personally. Is gradual disempowerment solved?[1] In my view, no; at the same time having AI representatives helps at the margin.

I have two deep reasons for skepticism.[2] Here is the first one.

** Humans are Not Alone**

We, as individuals, are not the only agents or “agencies” in this world. Other goal-oriented strategic entities include states, corporations, and to some extent egregores.

For the sake of argument, imagine the current distribution of agency in the world as approximately 60% humans, 20% corporations, 20% states (numbers are illustrative)

Now, suppose we introduce individually aligned AI assistants for each person. At first glance, this seems empowering—each individual gains a cognitive extension, potentially leveling the playing field.

But: do corporations or states also get their representatives?

If your answer is No, you'd need to explain how individuals gain AI power [...]

Outline:

(00:31) Humans are Not Alone

(02:15) The Substrate Shift

(04:17) Coordination and Collective Action

(05:10) The Role of the Leviathan

The original text contained 2 footnotes which were omitted from this narration.

First published: June 4th, 2025

Source: https://www.lesswrong.com/posts/E96XcEPECbsipAvFi/untitled-draft-qx6o)

    ---
    

Narrated by TYPE III AUDIO).

Images from the article: )) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts), or another podcast app.