the current state of search engines (music video)
www.youtube.com
external-link
you did not heed my warning and now we're all doomedfollow me:https://twitter.com/savannahXYZarthttps://www.tiktok.com/@savannahxyzarthttps://www.artstation....

What’s your opinion? Does google really “not work” anymore? Are there any better search engines? Why did the quality of search results go down? I honestly stumbled onto this question through this music video, what is ironic in it’s own way i feel…

I’ve used ecosia for the last few years I rate it pretty good.

@Pietson@beehaw.org
link
fedilink
English
9
edit-2
1Y

did not expect to see a savannahXYZ video on my feed here this morning, love to see it though.

I think google made the web worse with SEO. Sites have to be designed in ways that users and creators do not really care about so that they may show up in search results.

If I have a site about star trek and it has all the relevant information that the user is looking for, then do not derank my site because the text is not a specific length or whatever other unrelated stuff is there.

I think there are some things that are worth while, like I think https sites are preferred over http sites. I think that this is a good thing to promote.

SEO isn’t something google invented, it was just a result of their actions.

@parlaptie@feddit.de
link
fedilink
English
111Y

As much as I’ve come to loathe Google, I think even that is a bit unfair to them. Search engine optimization is a result of the existence of search engines, because being at the top of the results is always worth good money.

Back before Google was the top dog, there were numerous search engines, and I’m pretty sure people shared tips on how to get further up on the results even then, they just didn’t use the term SEO yet.

Google became the dominant search engine because it gave better results than anyone else, because it wasn’t so easy to manipulate your ranking on the results. But there were always sites that wanted to be on top even when they shouldn’t be. Google stayed ahead of their game for some decades, but now it looks like they can’t or won’t keep it up anymore.

@BlueNine@beehaw.org
link
fedilink
English
91Y

I wonder what it would like if they rolled out the OG circa 1998 page-rank algorithm on todays web. What would that algorithm find if we ran it now? Would it be garbage or would it undercut all the SEO and find good stuff?

I have a hunch that the current search is bad, not because they cannot do better, but because it is profitable for it to be this bad. The most powerful SEO tool is probably your checkbook.

@tburkhol@beehaw.org
link
fedilink
English
31Y

There’s definitely an arms race - if it’s cheaper to pay an SEO to get your pages shown, then you pay the SEO; if it’s cheaper to pay Google advertising, then you pay to play. I’m sure Google is constantly tweaking their algorithm to filter SEO techniques to get better, authentic results, but it seems like a losing battle at this point.

Troy
link
fedilink
English
111Y

tl;dw: song about google being broken

“I have to add to word reddit to every goddamn search to read content made by humans”

Oh the ironing. That line won’t age well now will it :)

2min 30sec is too long? Tell me it was the YT ads not 2m30s.

But I did appreciate the reddit irony.

Google is broken because AI is making it obsolete. I bet in 10 years google will be a historical footnote.

Troy
link
fedilink
English
261Y

AI is driving me mad. Pages and pages of generative text filled articles with nothing to say drive all the humans away.

Ironically, because Lemmy is so hard to index for search engines, it keeps the AI content spammers away. Mostly. So far.

Unruffled [he/him]
link
fedilink
English
231Y

Hard agree with you on that. AI generated articles are a disaster for the internet. There’s just no quality control any more, especially when actual authoritative sites are no longer in the top search results. Now we’ve got tons more crap-tier content on the internet and no way to differentiate it from the useful content.

Metaright
link
fedilink
71Y

I agree, human.

Troy
link
fedilink
51Y

Meow

phi1997
link
fedilink
151Y

You’re talking about the AI that provides accurate-sounding results but can’t fact-check and is also used to generate the kind of spam that’s constantly being pushed by search engines, right?

Not exactly. Stupid people with advanced tools make stupid outputs. Venture capital is pushing the propaganda sauce hard and a lot of stupid people are jumping on AI as a corporate trend. These are the idiots.

The tools are next level. We are on the edge of this tech becoming a really big deal. There are several research papers making breakthroughs regularly and making double digit percentile improvements on efficiency and accuracy. The reason it is a big deal is because you can have around 1/4 of the knowledge of the entire internet running on hardware as powerful as a current flagship phone. Sure it lies around 1/2 the time, but these are problems that are being solved. Like, the latest and greatest models are ancient history in a matter of 2-3 weeks. To be honest, have a casual conversation with an offline and uncensored LLM. You may know it is lying from time to time, but if you’re being objective, so are most humans you encounter under casual circumstances. The sociological function and potential value of this tech is pretty powerful medicine. Like if you need someone to talk to, or to talk out an issue in private, this is a way to make that happen.

Well. Some time ago one had similar arguments about manually categorized web site catalogs and algorithm driven search engines.

Today’s ai are not areplacment, but in ten years … rather likely.

Thalestr
link
fedilink
English
531Y

SEO and AI-generated clickbait have basically ruined most search engines. I’ve yet to find one that can really tackle this properly. I believe Kagi offers higher quality results but I can’t really verify that myself as I don’t have an account with them.

djquadratic
link
fedilink
151Y

kagi seems very enticing to me, but man thats expensive… anyone here use it?

I’m still on my trial period but I think I’m going to pay when it runs out, I’ve been really happy with it so far. I think it’s saved me a good chunk of time at work I would have wasted digging through Google SEO crap so it feels like it’s worth spending a few bucks on.

I have the $10/mo account but I’ll disagree with @mrmanager@lemmy.today that it’s worth the money.

Don’t get me wrong I wouldn’t go back to Google/DDG, but while I can afford Kagi’s monthly cost I don’t believe that everyone can, nor do I think it’s an appropriate cost for a search engine.

I feel like I am an average search user, and I easily burn through 1000 searches a month. I’ll possibly be upgrading to the $25/mo unlimited account.

If you’re used to doing conversion searches like “100 USD in EUR”, or “2.5g in oz”, or even “20 * 12%” - you get charged for each of those. That doesn’t seem so reasonable to me.

I understand if you can’t afford it. Money doesn’t grow on trees in this world. But Kagi has been very transparent about the reason for the costs - it’s what they need to charge to not lose money, since they don’t sell your user data or track you.

It’s unrealistic to think that having a search engine is free, and the reason Google is free is because it tracks you and sells your data to advertisers, and probably also makes sure you get search results that benefit those advertisers. It’s quite simply a bad choice to use an ad company to search the web.

Kagi also had a blog post about search usage, where they used googles search statistics to determine that the average person searches 3 or 4 times per day (90 to 120 times per month). This amount (100 searches) is free on Kagi.

300 searches costs 5 dollars.

If you are doing 1000 searches per month, that’s as much as myself and I work as a programmer / devops guy. We search a lot. That’s much more than the average person. We are in the top 1% actually. Nice to be there for something right? :) Cost for us is 10 dollars.

I couldn’t find anything about your claim that conversion would cost extra, not on the pricing page and not in the FAQ section. I also did a few conversation searches and there was no info about additional price. Can you link to where it says that?

@asap@feddit.de
link
fedilink
3
edit-2
1Y

I couldn’t find anything about your claim that conversion would cost extra, not on the pricing page and not in the FAQ section. I also did a few conversation searches and there was no info about additional price. Can you link to where it says that?

Just look at your billing page and do a few of those searches. You will see they count as a paid search - nothing special you need to look for.

I’m not saying they charge extra for them, just that they charge for them like other searches. Doing math in the address bar is so second-nature to me now, and it seems a bit silly for Kagi to charge me for working out what 2 * 8 is.

Kagi has been very transparent about the reason for the costs - it’s what they need to charge to not lose money, since they don’t sell your user data or track you.

I’ve seen their posts on this, but the question is how accurate that data is. 80 searches costing Kagi $1 doesn’t intuitively feel reasonable, but perhaps it is the truth. Google’s search API is $1 per 200 queries, and you would assume they make a profit at that pricing: https://developers.google.com/custom-search/v1/overview#pricing

Of all the subscriptions I have, this one seems like the least value for money for me personally, when I can get for example 5TB of cloud storage for less cost.

It’s not that I’m comparing no-search to search, it’s that I’m comparing the incremental improvement from DDG to Kagi, and considering whether that improvement is worth $10 or $25 a month.

Ah sorry, I misunderstood you. Yes they count as a search.

I don’t think you can compare pricing to Google. They make profits by combining any payment with selling your data for profit. There is no way Kagi can compete with that since they don’t sell your data.

To me, search is the most important thing I use the internet for. I just think it’s reasonable to pay a good competitor that doesn’t sell your data and provides excellent search. But if you can’t pay them, of course that’s fine. Maybe you need 10 dollars for something else. But for me, Im not in the financial zone where I even miss 10 dollars or notice it’s gone.

To me, search is the most important thing I use the internet for

I like this framing. That might help me come to terms with their cost 👍

It’s honestly why I’m paying for it.

I also pay for email for the same reason. :)

For email, Fastmail is just excellent. I use their email aliases function a lot. So you can one-click generate an email to use when you sign up on a service and when you don’t use that service anymore, delete the email address.

Makes it impossible for them to sign you up on advertising lists since you can just delete that email address if they annoy you.

I also considered Kagi a bit and I think it might work if I start to change my search behavior. I got too used to abusing search engines as a quicker way to open websites (I could use bookmarks for that) or for bangs (I could use the browser itself for that).

If I managed to untrain myself from this and start using tools for their core-purpose, the limits of Kagi might indeed be more than enough. But currently I am too lazy for such a deep change in my daily workflows.

@asap@feddit.de
link
fedilink
2
edit-2
1Y

If I managed to untrain myself from this and start using tools for their core-purpose, the limits of Kagi might indeed be more than enough. But currently I am too lazy for such a deep change in my daily workflows.

Exactly - exactly my problem. And why I’m probably going to reluctantly upgrade to the $25/mo unlimited. It just irks me that I feel like I’m getting ripped off :P

Imagine installing and opening a separate units conversions app just to find something that used to be an instant search away.

Well for unit conversion I have a plugin for ulauncher. That is even quicker than having to alt+tab into the browser. So THAT particular problem isn’t one of mine :-)

Worth every dollar. The quality is so good that you will switch and forget Google exists. I haven’t used Google search in 6 months even once.

@Steve@compuverse.uk
link
fedilink
English
21Y

I do. Any questions?

I got work to pay for it. It is pretty good, and I like the lenses function (focus on just forums or other ways to sort). I can’t say that it’s necessarily better in general than startpage.com, which is anonomized google (gets you out of the filter bubble though). I feel like Kagi is very slightly better, maybe 10 percent at most.

I also don’t love the hard ID they have on you for payment. They claim not to track you but they certainly can, and I’d argue better than Google can if you use startpage.com or whatever anonomized version.

I also don’t love the hard ID they have on you for payment

What’s the hard ID? You can use a burner email and a pre-paid/anonymous Visa card without any issues.

Here’s some prepaid Visa cards you can buy with bitcoin (I have successfully used this site): https://www.coinsbee.com/en/payment-cards-bitcoin

Interesting - I never thought of that, mostly because the overhead is kind of insane (and I don’t actually think bitcoin is anonymous, but in this case good enough). I was thinking for your average person, they’re going to pull out a credit card or debit card which is a hard ID. Certainly more than if they browse to startpage.com for instance.

@asap@feddit.de
link
fedilink
2
edit-2
1Y

and I don’t actually think bitcoin is anonymous

You can pay with XMR:

I definitely agree with you though, it is a negative for Kagi. It would be nice if they let you pay direct via crypto or other methods.

@Sentinian@lemmy.one
link
fedilink
English
21Y

Google works and it doesn’t. I use Duckduckgo, and in general it works decent. Both suck and so does brave search so I don’t really have many options that I know of. I always end up searching with reddit to get any real result, as its always the same clickbaity shifty sites.

The sad part is, Google ends up being the best of all the shittyness, because whenever I search some local none of the other engines know what to do. The number of times I have to switch to Google for a address is sad.

FixedFun
link
fedilink
31Y

DuckDuckGo has a button to switch to my country yet it does nothing at all…

From googles perspective, you, the user cost them money. Their revenue comes from ads. The brands don’t was to be associated with anything controversial so the results are tailored to be as PG and clean as possible.

@dragna@midwest.social
link
fedilink
English
61Y

Mojeek has been an interesting alternative. I do find myself using google as a backup when I’m not getting what I need, but Mojeek does tend to present very different results.

I don’t think any other search engine, including DuckDuckGo, has its own web crawler like mojeek does. DuckDuckGo is security based, but still google in the end (similar to how most browsers are actually chromium). It apparently also uses a different term algorithm so you have to readjust how you search because it doesn’t do anything predictive or “smart” in its searching for results.

@tantedante@beehaw.org
creator
link
fedilink
English
161Y

map of search engines since i found this website a few minutes ago i consider using mojeek too… and i was surprised how few actual search engine crawlers exist…

djquadratic
link
fedilink
31Y

this was super neat! thanks for sharing

@dragna@midwest.social
link
fedilink
English
11Y

Yeah I think I was simultaneously surprised about that, and how long Mojeek had been in the game.

Storksforlegs
link
fedilink
English
471Y

It hasn’t worked for a while. Even a year ago it was considerably better.

I can’t believe it, but Bing is now the better search engine. What is happening to the world?!

BisonLover
link
fedilink
41Y

I agree! I find myself amazed that I’m binging now when for so long that was a joke.

MBAs and VCs

It works but it definitely censors a lot pf stuff I feel so I use Yandex sometimes.

Dr Cog
link
fedilink
English
61Y

… you’re worried about censorship so you use the Chinese search engine?

Just use DuckDuckGo

@willeypete23@reddthat.com
link
fedilink
English
4
edit-2
1Y

Dockduckgo is just bing with diet privacy

Phoenix [she/they]
link
fedilink
English
31Y

Russian, but yeah

A lot of stuff that don’t show up anywhere else show up in yandex especially piracy related stuff.

bermuda
link
fedilink
English
95
edit-2
1Y

Google is definitely iffy for me, which is why I’ve been bouncing between alternates. A lot of people like to complain about how google is filled with ads and spam results like Pinterest, but even then it just doesn’t really seem to give accurate results anymore, and even when results are accurate it’s very surface level. From what I found, it loves to push listicle articles and such when googling a new topic, as opposed to say, Wikipedia or an encyclopedia article. Like if I search about Barbie, I’ll probably get a bunch of ScreenRant-esque articles before I get the IMDB page. There have been dozens of instances of me searching for controls for video games and getting clickbait-y articles, some of which barely even make an attempt to answer the question, before getting an IGN or GameFaqs article that’s to-the-point and answers my fucking question.

There are definitely better search engines out there, but they all have their own flaws. DuckDuckGo is pretty bare bones and can also give poor results if your search is too vague. You have to adapt to that one. Others like Brave have AI to help out with summaries and stuff, but Brave’s management is “problematic” and so some people might not want to support them.

TL;DR: on google, not only is there ads and spam, but it’s just hard to find answers anymore. Everything is clickbait. And with other options, they are good but they also have their own major flaws that some might find unappealing.

any1th3r3 [he/him]
link
fedilink
English
421Y

Exactly, I’ve noticed this over the past few months, actual relevant results are being pushed much further down the stack.

If you want to explore alternatives, I’ve been using SearXNG, a so-called “metasearch engine”, where you can get a combination of various search engine results, based on your preferences. It’s pretty good, when it works (it tends to get rate-limited fairly often… or at least some of its results / search engines do, which can get annoying).

Hangry
link
fedilink
English
191Y

Self-hoster of a searxNG here. With docker, your can spin your own in 1 minute top. I’ll never go back to any other search engine, this is the best (imho).

Phoenix [she/they]
link
fedilink
English
21Y

Just to help me understand: Why is it that when I try the same search on different instances of this, I get very different search results?

any1th3r3 [he/him]
link
fedilink
English
11Y

This would depend on the search engines enabled and/or the default language/country set (if any) for that particular instance, you can find those in the settings of the instance itself (and enable/disable whichever you’re most interested in, as well as a few other relevant settings).

@Kikkertje@aussie.zone
link
fedilink
English
41Y

These days I often just skip the first 2 pages and go straight to page 3 for my search results to be able to find anything slightly resembling what I searched for.

Bookmarking this for later. Thanks for this.

Kata1yst
link
fedilink
151Y

You can also selfhost SearxNG with modest hardware and side step the rate limits. I love it. Happy to answer any questions

How does it compare to Kagi?

I can’t self host it, what’s the problem with using an existing instance?

Kata1yst
link
fedilink
81Y

I haven’t used Kagi much, but my understanding is that Kagi has their own indexing and you can customize your search by ranking your results.

SearxNG runs searches against many other search engines and then uses an algorithm to rank the results sanely. So less customizable but also the net you’re casting is much wider.

You could easily self host on a free-tier instance in Oracle cloud or AWS for a year, or even just run it on a laptop. But if you really can’t see a way to do that you can of course use one of the listed instances, you’ll just be more likely to bump up against rate limits since you’re sharing limits with many other people.

BigVault
link
fedilink
21Y

Just set this up on my Unraid server and it’s amazing. Great suggestion and thank you.

fades
link
fedilink
English
11Y

Woah thank you for this!!

@BCsven@lemmy.ca
link
fedilink
English
41Y

I have notice that in the past you altered your terms a bit amd got different results, now the search gives me junk so I alter the phrase and same junk shows up. So it is not as effective at doing a deep search these days that actually matches the search terms.

Em Adespoton
link
fedilink
English
11Y

Have you tried searching incognito? I find the junk is generally tied to profiles Google has on me; they decide based on the data they’ve built up what I should really be looking for.

Searching incognito tends to return results closer to what I got 5 years ago.

@BCsven@lemmy.ca
link
fedilink
English
11Y

I run tracker control, and only essentail scripts can run, all ad stuff is totally blocked.

Hangry
link
fedilink
English
141Y

Brave’s marketing has always made me uneasy, but it was more like a vague thought. This why I’m intrigued by your opinion. Do you have examples of their “problematic” management?

bermuda
link
fedilink
English
27
edit-2
1Y

It’s of course biased, maybe for some people it wouldn’t be problematic, but the CEO of brave has historically donated to organizations and California state bills that opposed same-sex marriage. This was around 15 years ago (2008 and 2009) so maybe he’s changed. But for some people, that might be a dealbreaker. He resigned from Mozilla in 2014 because it came to light that he had made these donations. He apologized in 2014, but for some people that might not be enough.

(note: I’m not trying to be biased with this. For some people reading this, his apology might be perfectly fine for you. But, for others this might be enough to be labeled “problematic.”)

Hangry
link
fedilink
English
71Y

Oooh I agree, this is some actual dirt

@Molehill8244@beehaw.org
link
fedilink
English
24
edit-2
1Y

To focus more on the product there are 2 incidents I think of as to why I don’t use brave

honorable mention is their affiliation with crypto

@notfromhere@lemmy.one
link
fedilink
English
21Y

The affiliate links are done by (almost?) every search engine so it’s not fair to single out Brave for it. Note I’m not defending them, if you’re truly up in arms about it talk about all of them doing it.

Do you have a source for that? I say this because it made the news everywhere when it was exposed. Just to be clear… it wasn’t that affiliate links made the index. The Brave browser would hijack what you typed in the URL bar, even if it was the exact URL, with their own affiliate link

@notfromhere@lemmy.one
link
fedilink
English
31Y

Looks like I need to start saving things as I stumble upon them because searching for them later is fruitless. I’ll delete my comment as I can’t dig up a source.

Pigeon
link
fedilink
English
41Y

I read an article just yesterday about Brace selling AI access “rights” to other peoples’ copyrighted work that gets pulled by their search, too. Like they have an equivalent of google snippets, but with much longer “snippets” of copyrighted books, and they explicitly sell “rights” for people to scrape that and other things for AI datasets, as if their search engine indexing a thing gives them ownership of it.

Also there was that one time they put a link to a neo-nazi website into their list of defaults on their homepage. Yup.

It’s all to the point that I don’t actually trust a word they say about their privacy protections either, really, even if I were willing to ignore everything else.

@papaya@possumpat.io
link
fedilink
English
3
edit-2
1Y

Yeah, the crypto stuff is getting too much, plus they’re shoving stuff like their VPN, search, and news down users’ throat. I used to use Brave as a secondary browser bc of its profile feature, but switched to Orion a couple weeks ago and never looked back.

@millie@beehaw.org
link
fedilink
English
11Y

I honestly have never used Brave largely because its logo makes me feel like the developer is way too into WoW. Weird reason to judge a software probably, but sometimes it’s best to trust your gut.

@abhibeckert@beehaw.org
link
fedilink
English
13
edit-2
1Y

What’s your opinion? Does google really “not work” anymore?

Depends what you’re searching for. For some searches I’ve given up on using it. For example I just purchased a new TV and one of the features wasn’t working. It took me several hours of Googling to figure out how to fix it — almost every result offered by Google didn’t contain an answer to my question.

Are there any better search engines?

ChatGPT works well for some searches. Especially if you pay for GPT-4.

It’s pretty impressive how ChatGPT is better than Google despite never being designed as a replacement for Google. I think when someone applies the same technology to a proper search product, the result will be really awesome. Time will tell who manages to pull that off - it might even be Google.

Why did the quality of search results go down?

The main issue, I think, is all the websites these days that exist exclusively to show banner ads. Many of them are packed with information that Google’s algorithm determines might be relevant to the user, but the algorithm is wrong.

The websites want you to click on an Ad, and you’re a lot more likely to click an Ad if you give up, don’t find what you’re looking for, and decide to buy a new weight loss gadget instead.

I’m sure part of the problem is Google itself is an ad company. A lot of the things they could do to fix this issue would harm their own revenue.

I have been having better luck with goddamn BING, ffs. Do you realize how embarrassing that is, Google?

@Tavarin@lemmy.ca
link
fedilink
English
11Y

Bing is a good search engine, don’t know why people shit on it.

Cause it’s Microsoft. It’s amazing for porn.

@Tavarin@lemmy.ca
link
fedilink
English
11Y

Not like Google is a better company.

djquadratic
link
fedilink
11Y

After some browsing I found another option - whoogle which seems to be a self-hosted search engine? I didn’t look into it too much but this also seems very interesting

You can also check out https://github.com/hnhx/librex I’ve used one of the listed sites several times and it’s been acceptable.

Create a post

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

  • 1 user online
  • 55 users / day
  • 243 users / week
  • 566 users / month
  • 2.51K users / 6 months
  • 1 subscriber
  • 3.16K Posts
  • 65.7K Comments
  • Modlog