AI is becoming superhuman and superpowerful — what becomes of us?
The last two years of AI alone would have seemed unimaginable before — today we stand at the threshold of Artificial General Intelligence (AGI).
AGI isn't slowing — it's speeding up, and will overtake us.
AI has no conscience and no goals of its own — its goals come from us. And it is a superhuman amplifier for any of them: cure cancer, halt global warming — or wipe out humanity.
Two ways this goes wrong:
- Misuse. A few set a destructive goal — driven by power or hatred. One bad objective is enough.
- Misreading — the alignment problem. The AI interprets a well-meant goal differently than intended — and causes unintended harm.
And such an end is final: no amount of good outweighs a single, irreversible end. That's why the moment for a solution is now — before the takeoff, not after.
