@umbrella@lemmy.ml
link
fedilink
English
307M

how big is the database?

books can’t be that big, but i’m guessing the selection is simply huge?

xrtxn
link
fedilink
English
507M

The selection is literally all books that can be found on the internet.

TherouxSonfeir
link
fedilink
English
137M

So how big is that?

@FreudianCafe@lemmy.ml
link
fedilink
English
47M

I guess more than 5?

Artemis
link
fedilink
English
47M

I imagine a couple of terabytes at the very least, though, I could be underestimating how many books have got deDRMed so far.

TherouxSonfeir
link
fedilink
English
47M

Apparently it’s 900TB

Artemis
link
fedilink
English
97M

Girl, what? No wonder they’re having trouble hosting their archive. Does Anna’s Archive host copyrighted content as well or is all that copyleft?

smnwcj
link
fedilink
47M

The archive includes copyrighted works. Often multiple copies of each work, across different formats.

They host academic papers and books, most of them are copyrighted contents. They recently got in trouble for scraping a book metadata service to generate a list of books that hasn’t been archived yet: https://torrentfreak.com/lawsuit-accuses-annas-archive-of-hacking-worldcat-stealing-2-2-tb-data-240207/

AmbiguousProps
link
fedilink
English
2
edit-2
7M

They index, not host, no? (Unless you count the torrents, which are distributed)

Artemis
link
fedilink
English
27M

Is hosting all that stuff even legal? I mean, they’re not making any money off of it, but they’re still a “piracy” hub. How have they survived this long?

It’s very illegal. iirc it was created by a group called “Pirate Library Mirror” after the guy that runs z-library got arrested, so I assume they’re taking anonymity seriously to avoid arrest.

@catloaf@lemm.ee
link
fedilink
English
37M

No, it’s not.

They’ve survived by making themselves hard to identify and shut down. And as we can see here, by creating redundancies.

@Index@feddit.nl
link
fedilink
English
337M

According to their total dataset size excluding duplicates, over 900 TB

AmbiguousProps
link
fedilink
English
57M

Correct me if I’m wrong, but they only index shadow libraries and do not host any files themselves (unless you count the torrents). So, you don’t need 900+ TB of storage to create a mirror.

Sure, that’s a bit more than $65.000 per year with Backblaze.

TherouxSonfeir
link
fedilink
English
127M

Shit, my synology has more than that… alas, it is full of movie “archives”

You run a petabyte Synology at home?

TherouxSonfeir
link
fedilink
English
77M

Well, it’s not just a single synology, it’s got a bunch of expansion units, and there are multiple host machines.

@dutchkimble@lemy.lol
link
fedilink
English
67M

I’m guessing you’re talking GBs?

@FigMcLargeHuge@sh.itjust.works
link
fedilink
English
3
edit-2
7M

They put a link in with the total…

Total Excluding duplicates 133,708,037 files 913.1 TB

TherouxSonfeir
link
fedilink
English
87M

Nope.

@dutchkimble@lemy.lol
link
fedilink
English
27M

That’s awesome - how many drives and of what sizes do you have? Also why synology instead of higher enterprise grade solution at this point?

TherouxSonfeir
link
fedilink
English
47M

Right now most of them are 20T each. I started smaller at first, but they’ve dropped so much in price. I usually wait until a sale and grab a bunch. There are… math… 62 drives?

When I first started, I only had the 6 bay… I chose synology because I wanted something that was managed for me. I don’t want to have to focus on setting things up and possibly doing things wrong. It comes with amazing tools. Also, the server buy-in was a lot less than the other “professional” rack mounted solutions.

I had such a great experience that I just kept with them. It is a pretty expensive hobby though, but so is buying physical movies. And, some things never get a physical release, so having it digitally protects me from when Netflix, or whomever, decides to drop something.

@umbrella@lemmy.ml
link
fedilink
English
1
edit-2
7M

wait what? how expensive is it to buy and run? is it practical at all, what are the common snags? always wanted to get into doing some archiving.

TherouxSonfeir
link
fedilink
English
77M

It’s an investment. It’s like the price of a small car. But it was built over time, so not like one lump sum.

Originally, it was to have easier access to my already insane Blu-ray collection. But I started getting discs from Redbox, rental stores, libraries, etc. they are full rip, not that compressed PB stuff. Now there are like 3000 movies and fuck knows how many tv shows.

A lot of my effort was to have the best release available. Or, have things that got canceled. Like the Simpsons episode with MJ, which is unavailable to stream.

Snags… well, synology is sooo easy. Once you figure out how you want you drives set up, there’s nothing to it.

Whatever you do, always have redundant drives. Yes, you lose space, but eventually one of them is gonna die and you don’t want to lose data.

You should write a will instructing your family to send those disks to the internet archive for preservation if something happened to you.

@spiderman@ani.social
link
fedilink
English
2
edit-2
7M

bigger than zlib or project Gutenberg?

It is huge! They claimed to have preserved about 5% of the world’s books.

@umbrella@lemmy.ml
link
fedilink
English
27M

oh i actually tought it was way more! there wasnt a single book i wanted (or even tought to look up) that i didnt actually find in there.

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ
!piracy@lemmy.dbzer0.com
Create a post
⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don’t request invites, trade, sell, or self-promote

3. Don’t request or link to specific pirated titles, including DMs

4. Don’t submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):


💰 Please help cover server costs.

Ko-Fi Liberapay
Ko-fi Liberapay

  • 1 user online
  • 101 users / day
  • 251 users / week
  • 978 users / month
  • 3.47K users / 6 months
  • 1 subscriber
  • 3.4K Posts
  • 82.3K Comments
  • Modlog