Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

Shady_Shiroe ,
@Shady_Shiroe@lemmy.world avatar

This got me curious on how many images are on all Lemmy instances combined and how much storage it all takes up.

Shadow ,
@Shadow@lemmy.ca avatar

I can tell you that for lemmy.ca we use 778gb

Fudoshin ,
@Fudoshin@feddit.uk avatar

Holy fucking shit balls. I contemplated seeing up an instance on a £5 VPS. Hmmmm, I think my scale is a bit off.

Shadow ,
@Shadow@lemmy.ca avatar

If it's just a private instance, your storage needs will be way less. We use object storage, so it's actually pretty cheap (like $5-10 a month iirc). We're not storing that all on the server disk.

null ,
@null@slrpnk.net avatar

I've been considering a private instance myself so that's good to know.

If you're federating with everything by default, would that not also federate all the images and take up space that way? Or are images always just referenced from their origin instance?

Shadow ,
@Shadow@lemmy.ca avatar

Images come from their origin, but I think thumbnails are cached on your instance.

jivandabeast ,

This is correct, i have seen in the past images that 404 when clicked but the thumbnails show up fine on my instance

bdonvr ,

I'm running a quite small instance and currently the full media storage is 234GB. That being said I pay $3 per month for the storage on Cloudflare R2 so that's fine. You could get more for cheaper probably with a service like Backblaze B2.

The main database (non-media) currently takes up 36GB.

key ,

I'm on a private instance. My lemmy volume as a whole is currently 72G.

5 is probably a bit undersized and liable to cause pool timeouts. But like 15 should give you enough room depending on your provider's affordability. You can always delete old data periodically.

SorteKanin ,
@SorteKanin@feddit.dk avatar

You can configure the maximum size of image you will federate. You could set it to essentially 0 and you will store like no images. Downside is you will have to fetch images from other instances, whose servers may not be close to you.

For reference, Feddit.dk has a 5MB image limit. My storage is only about ~60 GB

MamboGator ,
@MamboGator@lemmy.world avatar

I was wondering about this very thing recently and how bad I should feel every time I upload an image.

At least object storage is an option.

Player2 ,

Huh, less than I expected.

db2 ,

So what have they been doing to nuke the csam images, editing the database directly?

candyman337 ,
@candyman337@sh.itjust.works avatar

Yes

Ghostalmedia ,
@Ghostalmedia@lemmy.world avatar

Often just nuking all image uploads made during a certain time period. Which is why old image threads in Lemmy have time periods littered with broken images.

QuaternionsRock ,

I don’t understand why Lemmy needs to have a built-in image server at all. Reddit didn’t have one for the longest time and it was fine. Sure, I don’t think anyone would be particularly happy with going back to Imgur etc., but it doesn’t seem worth the trouble.

MBM ,

Some instances do just disable the image server part (I think lemm.ee used to and still only allows small images?)

GreatAlbatross ,
@GreatAlbatross@feddit.uk avatar

It's a trade off for us.

You risk CSAM, and have to shoulder the storage costs.

But you also help to reduce link rot, as the images are kept on the site, rather than an external image host that might explode/go VC one day.

Album ,
@Album@lemmy.ca avatar

I mean I don't know why we need images at all, this stuff worked fine when it was just a BBS

db2 ,

Uphill both ways.

maltfield ,

They definitely should remove it, at least until moderation tools are available.

bdonvr , (edited )

Admins can purge posts manually which actually deletes them. Or use tools like db0's lemmy-safety that tries to automatically search for CSAM and wipe it.

I think the problem here is the user didn't finish their post which means the photo was uploaded but not associated with a post and therefore not purgeable that way.

Serinus ,

That last problem was fixed in an older version of the software. If you upload, but don't post, it will now be deleted after a time.

You can test this pretty easily by just leaving your browser open with an image uploaded and trying to post it later.

Draconic_NEO ,
@Draconic_NEO@lemmy.world avatar

Often they delete all images during the time frame of a CSAM attack, as that has been the only real feasible way to ensure images weren't left behind. Though I think a few images have started using AI detection methods to remove images like that automatically (read up on that here and here), also Pict-rs now has a Log linking uploaded images to the user, so now images can be purged with the users.

mundane ,

That is crazy. He really did seem knowledgeable, and apart from the upload of a sensitive image, he really did what he could.

SpaceNoodle ,

What did we miss?

db2 ,

https://tech.michaelaltfield.net/2024/03/04/lemmy-fediverse-gdpr/

RaoulDook ,

All those feature requests seem like good stuff.

ABCDE ,

And legally mandatory. Lemmy instances will get fined and shut down because of this if they do not sit up and pay attention.

fuckwit_mcbumcrumble ,

And thankfully the Lemmy devs are racing to fix the problem!

ABCDE ,

Did you read the article?

TheTetrapod ,

Psst, I think they're being sarcastic

Draconic_NEO ,
@Draconic_NEO@lemmy.world avatar

They're absolutely being sarcastic, the Devs' response was rude and dismissive.

bdonvr ,

At least in the EU

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • technology@lemmy.world
  • incremental_games
  • meta
  • All magazines
    •