I just set up all the subreddits I still want to following in Reeder, an RSS app. I’m able scroll through the posts ad free. It the occurred to me that this is a loss of revenue to Reddit. Could RSS be the new target for onerous fees?

It could be the case that RSS usage is small compared to 3rd party apps like Apollo so not of much concern. It also may be the case that it isn’t possible for Reddit to charge for the usage. If they can’t charge, they may just disable RSS altogether. I’m only guessing. I’ll take off my tinfoil hat now.

that is only half the work/job, other half is learning how to avoid ban.

I’ve been scraping 16+ years and it is easy till they get onto you and block you.

what do you use the most to scrape ? i’m thinking to learn scrapy.

Scrapy is really simple and straightforward.

You can start really fast.

I scraped literally everything :)

Personal hobbies, business wise,…

  • Archiving niche websites and information
  • Collecting real estate listings
  • Analyzing all ad listings
  • Checking web stores for product availability
  • Getting different info (weather, traffic, map data)

Scripts, apps, databases, got data for a lot of stuff

I am now usually working with APIs, but still need scraping sometimes.

Thank you. Would you mind if i send you PM? Need to ask something relating to my job.

Of course you can :) If we have PMs ('_)

haha. good thing. was not sure but checked in my instance, (vlemmy) there is an option to send message. let me know if you receive it.

Create a post

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

  • 1 user online
  • 58 users / day
  • 156 users / week
  • 575 users / month
  • 2.02K users / 6 months
  • 1 subscriber
  • 3.49K Posts
  • 69.2K Comments
  • Modlog