"I won't make [this prediction] next year, I think it's maybe in a few years: AI kills a lot of people. AI is put in control of something, and either through sort of incompetence or malevolence, it kills a lot of people. And that has policy implications."
https://youtu.be/GSkbYcjPdTw?t=2938
Paul does hedge and is reluctant to make this prediction for the next year, but does later commit to it 'within a few years'. So I've made the timeline within three years.