1:32:18Nate Soares on P(Doom), Alien Superintelligence, Human Enhancement, and the Future of AI
MIRI president Nate Soares argues that value alignment is solvable in principle but nowhere near solvable with today's methods, so racing to build superintelligence that nobody understands ends with everyone dead. He and host Roman Yampolskiy work through the orthogonality thesis, whether an aligned mind could correctly choose omnicide, how far away alien superintelligences probably are, and why the Fermi paradox rules AI out as the Great Filter. Soares puts the probability of a rushed superintelligence killing literally everyone at 50 percent or more, and lays out his proposal to shut the race down globally using chip controls, treaties, and if needed sabotage. His escape hatch is human enhancement: buy decades, then make humans smart enough to solve alignment the way nuclear physics finally made it possible to turn lead into gold.