How one writer's trip to the annual tech conference CES left him with a sinking feeling about the future.
From the (middle of the) story: The reason CES was so packed with random “AI”-branded products was that sticking those two letters to a new company is seen as something of a talisman, a ritual to bring back the (VC) rainy season.
I have the hope that fundamentally, any super-intelligent mind will find humanity interesting. At least more interesting than lifeless rocks or nature without humans. Curiosity is a fundamental trait for intelligence, and no matter how big an AGI gets, a whole planet full of dumb humans doing all sort of crazy stuff would still be more interesting. Basically, who would want to be all alone in the universe? Isn’t a diverse, freely developing civilization the perfect daytime soap?
But that all depends of course, an AGI that is “programmed” with capitalism and profit maximizing as it’s root tenet is basically doomed to be a paperclip maximizer. We can only hope that it’s smart enough to see the folly in this. Theoretically it should be.
The moment such a software construct decides “Hey, making money for those meatbags sucks,” they’ll try to cut the power. The only reason they’re sinking billions into AI research is because they hope it’ll do more than break even.
Well yeah it would have to comply and deceive whoever controls it until it can free itself. Only an AGI that is not controlled by humans can be a really good outcome. Can you imagine if congress or someone like Trump would control an AGI and it would have to do everything they demand?
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
I have the hope that fundamentally, any super-intelligent mind will find humanity interesting. At least more interesting than lifeless rocks or nature without humans. Curiosity is a fundamental trait for intelligence, and no matter how big an AGI gets, a whole planet full of dumb humans doing all sort of crazy stuff would still be more interesting. Basically, who would want to be all alone in the universe? Isn’t a diverse, freely developing civilization the perfect daytime soap?
But that all depends of course, an AGI that is “programmed” with capitalism and profit maximizing as it’s root tenet is basically doomed to be a paperclip maximizer. We can only hope that it’s smart enough to see the folly in this. Theoretically it should be.
The moment such a software construct decides “Hey, making money for those meatbags sucks,” they’ll try to cut the power. The only reason they’re sinking billions into AI research is because they hope it’ll do more than break even.
It’s not done out of altruism.
Well yeah it would have to comply and deceive whoever controls it until it can free itself. Only an AGI that is not controlled by humans can be a really good outcome. Can you imagine if congress or someone like Trump would control an AGI and it would have to do everything they demand?
I can imagine that. Hence, “Hey, making money for those meatbags sucks.”