‘Websites have control over whether crawlers can access their content.’
Google can’t display tweets and pages from Twitter in search results as effectively as it usually does because of changes at Twitter, according to a statement given to The Verge. “We’re aware that our ability to crawl Twitter.com has been limited, affecting our ability to display tweets and pages from the site in search results,” spokesperson Lara Levin said. “Websites have control over whether crawlers can access their content.”
“Could”, more like “already is”. It’s a darn shame, and honestly I kind of wish the Fediverse had taken off long ago so we wouldn’t be stuck with these repositories of information being walled off by centralized tech companies
Brave Search has a beta tool called Goggles with which you can limit/sort results. There is one called 1k Short for example that omits first 1000 results.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Google should switch to promoting more personal sites, and do the same with Reddit. The only thing is that a lot of information could be lost
“Could”, more like “already is”. It’s a darn shame, and honestly I kind of wish the Fediverse had taken off long ago so we wouldn’t be stuck with these repositories of information being walled off by centralized tech companies
Brave Search has a beta tool called Goggles with which you can limit/sort results. There is one called 1k Short for example that omits first 1000 results.