What sort of futures can we expect for civilization after AGI?

Ideally, our future satisfies all of these properties:

tazik's blog is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.

Surprisingly, while current visions meet some of these criteria, none fully satisfy all of them.

Let’s explore some of the most commonly presented post-AGI futures.

Post-scarcity sounds appealing, but is incoherent upon inspection.

Source : Post-AGI Civilization Talk, David Duvenaud

Overall, this is stable and good, but may not be plausible (or is at least an unknown unknown).

Existing visions of futurism by philosophers and tech company CEOs are unlikely, non-robust, or not good for humans.

But we can and should conceive of a plausible, stable, and desirable future for human civilization.

This blogpost is based on David Duvenaud's excellent talk at AI Safety Week 2026 in Toronto. If you enjoyed this, I highly recommend checking out: https://post-agi.org/

Functional post-scarcity only seems implausible to me under unbounded population sizes. If everyone either agreed to ablate their desire to have children, or to genetically modify children to not want children themselves; then this doesn't seem impossible to me. This sounds pretty inhumane, but unless we get pleasantly surprised by infinite energy or something it seems inevitable.