Discussion about this post

User's avatar
Emma Stamm's avatar

Your response to the AI 2027 folks' questions about what the world will look like in 2035, 2045, etc., is spot-on. It's also a handy go-to for some of the more vexing provocations from hypeists. As you say, "This kind of scenario forecasting is only a meaningful activity within their worldview. We are concrete about the things we think we can be concrete about." It's not disrespectful to point out a difference in premises, but when you do so, you're signaling that you won't play games on their terms.

Ze Shen's avatar

I think one of the biggest difference between the superintelligence worldview and the normalist worldview is their form of centrism.

The superintelligence worldview is AI-centric — everything is centred around the AI (or AGI, or ASI, whatever you want to call it).

The process goes: AI becomes more intelligent / capable --> AI develops misaligned goals --> AI kills everyone.

So the approach is mostly upstream, e.g. measuring capabilities and propensities, solving alignment, pausing (or stopping) AI development, etc. AI development is what matters — everything that happens downstream of deployment doesn't matter anymore, i.e. if the AI is out of the box it's already too late.

On the other hand, the normalist worldview is decentric.

The process goes: society operates in a certain way --> new things gets introduced to society (AI is one of them) --> things change accordingly.

So the approach is mostly downstream, e.g. managing technological diffusion, improving societal resilience, etc.

(I also wrote some very rough thoughts recently at https://airisks.substack.com/p/on-different-worldviews-7c8)

27 more comments...

No posts

Ready for more?