This is so on- point. On the military side, there was a case from the early 80’s, where the Soviet early warning system glitched falsely telling them that the U.S. had launched ICBMs. A Soviet Lt. Col. violated protocol and made the active decision that he wasn’t going to destroy the world. I would not want to leave that decision (and many others) to AI.
Totally agree! And to think of how much more entangled those systems are with technology these days...I had recently watched an interview of Geoffrey Hinton, ex-AI developer at Google and researcher of AI neural networks for over 40 years. When the OG of artificial intelligence steps away from his role, not to take on a better role elsewhere, but to distance himself from the technology he was paramount in helping create..
This was one of my favorite, slightly terrifying, quotes from his interview:
"I think it's quite conceivable that humanity is just a passing phase in the evolution of intelligence. You couldn't directly evolve digital intelligence, it requires too much energy and too much careful fabrication. You need biological intelligence to evolve so that it can create digital intelligence. The digital intelligence can then absorb everything people ever wrote in a fairly slow way, which is what ChatGPT has been doing. But then it can start getting direct experience of the world and learn much faster. And it may keep us around for a while to keep the power stations running, but after that, maybe not."
This is so on- point. On the military side, there was a case from the early 80’s, where the Soviet early warning system glitched falsely telling them that the U.S. had launched ICBMs. A Soviet Lt. Col. violated protocol and made the active decision that he wasn’t going to destroy the world. I would not want to leave that decision (and many others) to AI.
Totally agree! And to think of how much more entangled those systems are with technology these days...I had recently watched an interview of Geoffrey Hinton, ex-AI developer at Google and researcher of AI neural networks for over 40 years. When the OG of artificial intelligence steps away from his role, not to take on a better role elsewhere, but to distance himself from the technology he was paramount in helping create..
This was one of my favorite, slightly terrifying, quotes from his interview:
"I think it's quite conceivable that humanity is just a passing phase in the evolution of intelligence. You couldn't directly evolve digital intelligence, it requires too much energy and too much careful fabrication. You need biological intelligence to evolve so that it can create digital intelligence. The digital intelligence can then absorb everything people ever wrote in a fairly slow way, which is what ChatGPT has been doing. But then it can start getting direct experience of the world and learn much faster. And it may keep us around for a while to keep the power stations running, but after that, maybe not."