“AI researchers such as Timnit Gebru affirm that longtermism is everywhere in Silicon Valley. The current race to create advanced AI by companies like OpenAI and DeepMind is driven in part by the longtermist ideology. Longtermists believe that if we create a “friendly” AI, it will solve all our problems and usher in a utopia, but if the AI is “misaligned”, it will destroy humanity…”
I’m not an expert on longtermarism but I have read William McAskills “What we owe the future”.
The quote highlighted about AI is a clear demonstration on how longtermarism is being misappropriated. It describes a “rush” when the impression I got from McAskills book is that AI ethics needs to be very carefully discussed and that rushing into it is the opposite of what longtermists should do. To try and describe it briefly, this is because AI presents the risk of what McAskill describes as “value lock-in” where our current society’s values will continue long into the future, or the values that will persevere into the future will be decided by the few people who create the first generative AI.
In reality, people like Musk probably see AI as a means to push what they believe are the correct moral values long into the future. Which is terrifying…
This is why AI ethics is extremely important. We are already seeing institutional prejudices our current society possesses being perpetuated by AI, such as racism, sexism, etc. This is why when I saw that Microsoft/OpenAI was scrapping it’s AI ethics team that I was absolutely horrified…
The “rush” to produce AI is a problem with Capitalism, not longtermarism. There is a rush to create the first generative AI not because it will benefit society but because it will make buttloads of money.
I’m inclined to agree. Even without having read McAskill’s book (though I’m interested to read it now), the way we’re approaching AI right now does seem more of a short-term gold rush, wrapped up in friendly sounding “this will lead to utopia in the future” to justify “we’re going to make a lot of money right now”.
The “rush” to produce AI is a problem with Capitalism, not longtermarism. There is a rush to create the first generative AI not because it will benefit society but because it will make buttloads of money.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
I’m not an expert on longtermarism but I have read William McAskills “What we owe the future”.
The quote highlighted about AI is a clear demonstration on how longtermarism is being misappropriated. It describes a “rush” when the impression I got from McAskills book is that AI ethics needs to be very carefully discussed and that rushing into it is the opposite of what longtermists should do. To try and describe it briefly, this is because AI presents the risk of what McAskill describes as “value lock-in” where our current society’s values will continue long into the future, or the values that will persevere into the future will be decided by the few people who create the first generative AI.
In reality, people like Musk probably see AI as a means to push what they believe are the correct moral values long into the future. Which is terrifying…
This is why AI ethics is extremely important. We are already seeing institutional prejudices our current society possesses being perpetuated by AI, such as racism, sexism, etc. This is why when I saw that Microsoft/OpenAI was scrapping it’s AI ethics team that I was absolutely horrified…
The “rush” to produce AI is a problem with Capitalism, not longtermarism. There is a rush to create the first generative AI not because it will benefit society but because it will make buttloads of money.
I’m inclined to agree. Even without having read McAskill’s book (though I’m interested to read it now), the way we’re approaching AI right now does seem more of a short-term gold rush, wrapped up in friendly sounding “this will lead to utopia in the future” to justify “we’re going to make a lot of money right now”.
This. I came here to say right this.