AI Loses Its Mind After Being Trained on AI-Generated Data
futurism.com
external-link
Training AI models with AI-generated synthetic content causes the quality of the models' outputs to disintegrate, a new paper shows.

“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they added. “We term this condition Model Autophagy Disorder (MAD).”

Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.

@lloram239@feddit.de
link
fedilink
English
01Y

Key point here being that humans train on other humans, not on themselves. They are also always exposed to the real world.

If you lock a human in a box and only let them interact with themselves they go a bit funny in the head very quickly.

@ParsnipWitch@feddit.de
link
fedilink
English
41Y

The reason is different from what is happening with AI, though. Sensory deprivation or extreme isolation and the Ganzfeld effect lead to hallucinations because our brain seems to have to constantly react to stimuli in order to keep functioning. Our brain starts creating things from imagination.

With AI it is the other way around. They lose information when presented with the same data again and again because their statistical models look for probabilities.

Create a post

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

  • 1 user online
  • 53 users / day
  • 163 users / week
  • 617 users / month
  • 2.32K users / 6 months
  • 1 subscriber
  • 3.29K Posts
  • 67.1K Comments
  • Modlog