Database dump survey

JP
Silly Pony - Celebrated the 13th anniversary of MLP:FIM, and 40 years of MLP!
Shimmering Smile - Celebrated the 10th anniversary of Equestria Girls!
Solar Guardian - Refused to surrender in the face of the Lunar rebellion and showed utmost loyalty to the Solar Empire (April Fools 2023).
Roseluck - Had their OC in the 2023 Derpibooru Collab.
King Sombra - Celebrated the 10th anniversary of The Crystal Empire!
A Lovely Nightmare Night - Celebrated the 12th anniversary of MLP:FIM!
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
Elements of Harmony - Had an OC in the 2022 Community Collab
Non-Fungible Trixie -
Notoriously Divine Tagger - Consistently uploads images above and beyond the minimum tag requirements. And/or additionally, bringing over the original description from the source if the image has one. Does NOT apply to the uploader adding several to a dozen tags after originally uploading with minimum to bare tagging.

I miss the show so much
With the current amount of data that have been requested, it would likely be 1.5-2 GB for each one, though it might be smaller if LZMA compressed afterwards..
 
Great! I seriously were expecting this to be in the triple-digit GB range. No need for deltas then.
byte[]
Solar Supporter - Fought against the New Lunar Republic rebellion on the side of the Solar Deity (April Fools 2023).
Non-Fungible Trixie -
Verified Pegasus - Show us your gorgeous wings!
Preenhub - We all know what you were up to this evening~
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Philomena Contributor
@JP  
Our entire loaded database, indices and all, isn’t even in the triple digit range. And it is slated to actually get smaller with normalization changes I am in the process of making.
lb54
Happy Derpy! - For Patreon supporters

@byte[]  
Holy crepes! That’s some good stuff!
 
Any chance you could do a write-up of the before and after when you do make the alterations? (I see your patreon write-ups)
 
Also, coming from a current Drupal dev, hearing the word “normalization” really warms my heart a little. Wish I could do that for some of our stuff <_<
 
Back to the topic at hand, if be down for the dump!
barbeque
Roseluck - Had their OC in the 2023 Derpibooru Collab.
Elements of Harmony - Had an OC in the 2022 Community Collab
Non-Fungible Trixie -
Twinkling Balloon - Took part in the 2021 community collab.
Friendship, Art, and Magic (2018) - Celebrated Derpibooru's six year anniversary with friends.
Magical Inkwell - Wrote MLP fanfiction consisting of at least around 1.5k words, and has a verified link to the platform of their choice
Magnificent Metadata Maniac - #1 Assistant
Thread Starter - Tag alias request thread
Artist -
Bronze Bit -

Yes.
 
There was a really awesome plugin some years ago, I forgot what it was called, it was basically what Related Images does except it was insanely accurate* (it did look a little bit at image tags, but also at “other users that favourited x have also favorited y”). I recall the algorithm behind it being quite complex superlinear probably exponential, damn I hope I can find again which one that was.
 
* = the current Related Images actually isn’t bad, and it’s better than it used to be, the one I’m talking about was just in a different league and didn’t suggest so much anthro the whole time
DaMagics
Non-Fungible Trixie -
Perfect Pony Plot Provider - Uploader of 10+ images with 350 upvotes or more (Questionable/Explicit)
Artist -

Lewd Cuddlehorse :3
I would be interested in image / tag relations and hashing data and information for local finding/indexing/archiving and deduping purposes.
 
Especially if it can contain both original and derpibooru file hashes for the optimized/striped images.
xbi
Fine Arts - Two hundred uploads with a score of over a hundred (Safe/Suggestive)
Da Magicks! - Merited Fine Arts badge with only their own art
The Power of Love - Given to a publicly verified artist with an image under their artist’s tag that has reached 1000 upvotes
A Really Hyper Artist - 500+ images under their artist tag
Best Artist - Providing quality, Derpibooru-exclusive artwork
A Really Classy Artist - 250+ images under their artist tag
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Is there timestamp of faving the picture? I am curious to research fave count growth dynamic with time. So if the pic has not only favoriters list but timestamp also, it will be useful for me.
BigBuggyBastage
Solar Supporter - Fought against the New Lunar Republic rebellion on the side of the Solar Deity (April Fools 2023).
Non-Fungible Trixie -
My Little Pony - 1992 Edition
Wallet After Summer Sale -
Not a Llama - Happy April Fools Day!

Go fsck yourself
I would be interested in image / tag relations and hashing data and information for local finding/indexing/archiving and deduping purposes.
Especially if it can contain both original and derpibooru file hashes for the optimized/striped images.
 
I’m in much the same boat. I save images with short filenames, so a local database for those, and a database of image numbers and tags associated (relationship) would be extremely useful to me.
 
The only additional feature I would want is to be able compare my “personal/Derpibooru account” lists of ‘upvoted’ and ‘favorited’ images to a list of locally-stored images, to be sure nothing is missing from local storage. Is that kind of information even available?
byte[]
Solar Supporter - Fought against the New Lunar Republic rebellion on the side of the Solar Deity (April Fools 2023).
Non-Fungible Trixie -
Verified Pegasus - Show us your gorgeous wings!
Preenhub - We all know what you were up to this evening~
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Philomena Contributor
@C00lguy  
No.
 
@lb54  
Sure I guess. It’s not that complicated, but right now I think it just needs some time to sit on because it’s not presently a critical issue, it’s going to take a while to recreate the tables (> 20 minutes on my local test), and we would also like to “stack” downtime events as much as possible. That is, we’d prefer to do elasticsearch, postgresql, and apt updates all at once, instead of having a separate downtime for each.
 
@xbi  
We don’t track timestamp information in faves. We track data that are timeseries-like (interaction surrogate keys are strictly increasing, and correlate well with images) but do not track actual time data.
 
@BigBuggyBastage  
Upvotes will not be included in any dump.
 
@silbasa  
No; everything that is present in dumps has to be something that was already public facing, meaning it could already be scraped. We also have no intention of providing dumps earlier than the previous day’s, meaning that requests for information wipes will show up the day after they happen, which is within the timeframe needed to do it. Note we also have a section in our privacy policy dedicated to “Information that may potentially be shared with third parties”; this is such information.
Damaged
Non-Fungible Trixie -
Fine Arts - Two hundred uploads with a score of over a hundred (Safe/Suggestive)
Perfect Pony Plot Provider - Uploader of 10+ images with 350 upvotes or more (Questionable/Explicit)
Notoriously Divine Tagger - Consistently uploads images above and beyond the minimum tag requirements. And/or additionally, bringing over the original description from the source if the image has one. Does NOT apply to the uploader adding several to a dozen tags after originally uploading with minimum to bare tagging.
Magnificent Metadata Maniac -
Wallet After Summer Sale -
Equality - In our state, we do not stand out.
Magical Inkwell - Wrote MLP fanfiction consisting of at least around 1.5k words, and has a verified link to the platform of their choice
Not a Llama - Happy April Fools Day!
Happy Derpy! - For Patreon supporters

Word Bug
This would be a great way to kickstart a DB without having to scrape everything.
 
Blah blah blah privacy concerns, I’m sure you have that well in hoof.
 
Given the excitement that releasing even partial dumps caused the other day, this will likely make all the stat junkies very happy.
 
👍
Rene_Z
Non-Fungible Trixie -
My Little Pony - 1992 Edition
Wallet After Summer Sale -
Not a Llama - Happy April Fools Day!
Artist -

This would be interesting for tag data (tag descriptions, categories, aliases), since these are a pain to access individually with the API.
Interested in advertising on Derpibooru? Click here for information!
Champions of Equestria

Help fund the $15 daily operational cost of Derpibooru - support us financially!

Syntax quick reference: **bold** *italic* ||hide text|| `code` __underline__ ~~strike~~ ^sup^ %sub%

Detailed syntax guide