Actually, my father in law just lost 3 months of work yesterday because he synced his documents folder that had an old copy of his book on OneDrive. None of the cached files had his new stuff. Maybe if OneDrive was made well, it would prevent data loss.
I wonder how well that percentage matches up with the percent of Americans who believe those sites, too. Would an LLM trained on the raw internet have a fairly proportional spectrum of beliefs to the American public?
It’s just weird that we get so much humanlike reasoning from them, anyways. The jury’s still out whether our brains learn in an autoregressive manner like that, too. I’m finding a lot of really cool results in my research by tinkering with the idea that a developing brain might just be constantly trying to guess what’s happening next.
Seems pretty plausible to me that passive learning in humans works similar to next-token prediction in transformers.
Actually, my father in law just lost 3 months of work yesterday because he synced his documents folder that had an old copy of his book on OneDrive. None of the cached files had his new stuff. Maybe if OneDrive was made well, it would prevent data loss.