Posts

@Barhandar  
The program Joey linked is very handy as it can automatically sort files into individual folders by upload date. (I have the bad feeling putting them all in one place would probably make my Windows Explorer crash.)
 
It can download metadata (tags, favoriters) as json files if you want it to, however at this time it does not save comments even if you enable that. Comments got moved at some point in the past and now aren’t accessible as before.
 
I currently have 1.63 TB of images and a few GB of json files for metadata.

@Barhandar  
I dunno. I think so? It’s not my script.
 
Also, the site’s entire collection is only 4TB in size.

@Joey  
But does the script also download the relevant metadata?
 
@HMage  
It physically can only be up to 42.3 terabytes actually (factual + “deleted” multiplied by 25MB).

@HMage  
We have unmetered bandwidth, so we’re not really concerned about people downloading too much. There’s scripts available that can download as many images as you want, including all of them if so desired:
 
https://github.com/Sibusten/derpibooru-downloader

After the Tumblr events, I started wanting to have an entire archive locally. Even if it’s hundreds of terabytes.
 
Maybe it’s the time to reconsider the approach whether it’s feasible to offer a downloadable archive?
 
The way I see it, one day derpibooru can just disappear without warning, even if the admins will try everything in their power to prevent that or restore it back.
 
Having an archive “just in case” ahead of time would be greatly appreciated, even if it’s not gonna stay up to date — better than nothing.
 
It’s doable — Wikipedia hosts a periodically updated archive.
 
I understand bandwidth can be an issue for offering that. Especially with bots already crawling entire site and downloading everything.

I use derpi to host all my high res stuff. Having to modify all the links to derpi on all my other stuff would be a pain, so hopefully it lasts as long as possible.
 
Though, inversely, the longer it lasts and the longer I use it to host my stuff, the more I’ll have to change if and when it does eventually die…

Thanks for the responses, glad to know that this place isn’t going anywhere anytime soon

There are several people who maintain “backups” of the site by using bots to essentially download and store every single image we have.
 
But really, cons and websites are two different things - going to a con costs hundreds of dollars (or more), requires a time commitment of several days, and requires no scheduling conflicts. A website is basically “check it whenever you want for as long as you want”, so our growth patterns are vastly different since we’re more convenient.
 
And the reality is, we’re holding very steady. If anything, Derpibooru seems to be seeing an increase in traffic/visitors (although it’s increasing at a very slow rate).

@Zaknel  
These most likely will not be included. It remains to be seen what the admins’ decisions are at the time.

@byte[]  
What of deleted or hidden things?

@Starbounce  
We will provide a downloadable archive of the site, including images, comments, and posts, should we decide to discontinue operations in the future.

Hey there, the anouncement of next year’s bronycon being the last has got many thinking about the long-term future of the fandom and many of the sites we visit. I was wondering if there was a readily available database download for Derpibooru, seeing as how this site hosts much of the fandom’s history.
 
I realise such an archive would be enormous in size, but for the option to be there would put many people’s minds at ease. This site likely isn’t going away anytime soon, but who knows what might happen years down the road.