Just finished SUPERINTELLIGENCE by Nick Bostrom (a very smart guy btw). It is a must read for any human who values the existence of the human race. Bostrom tackles the coming Artificial Intelligence explosion by looking at the issue through a tri-colored lens: macro-economics, game theory, and philosophy. Lots of new concepts here for me, and I was already keen on the topic: AI as an oracle, genie, or sovereign; tackling the “Control Problem” about how to manage a Superintelligent AI with boxing methods, tripwires, oversight, and programming in fundamental goals; mind crime with respect to to digital minds living in a simulation created from whole brain emulations; Malthusian and dystopian evolution arguments for what Bostrom calls a looming “existential catastrophe,” and the list goes on.
I’ll give it a few weeks to digest, then read it again