Posts

For more information, see the search syntax documentation. Search results are sorted by creation date.

Search Results

Site and Policy » Prevent AI crawlers » Post 10

Exedrus
Lunar Supporter - Helped forge New Lunar Republic's freedom in the face of the Solar Empire's oppressive tyrannical regime (April Fools 2023).
Best Artist - Providing quality, Derpibooru-exclusive artwork
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
Silver Supporter - Silver Supporter
Heart Gem -
Not a Llama - Happy April Fools Day!
Friendship, Art, and Magic (2017) - Celebrated Derpibooru's five year anniversary with friends.
Happy Derpy! -
Responsible Disclosure -
Artist -

@LemonDrop
The act of ignoring a robots.txt file on its own may not be illegal, but it’s possible to release an image under a license that explicitly disallows use of the image to train an AI. Whether that will hold up in a court case is debatable. Training an AI might very well be considered fair use, especially since the output of generative AI usually doesn’t have a copyright. It also might not be fair use since it’s clearly got potential to run artist out of business. I don’t know of any court cases that settle this for AI training in particular, though I’m not a lawyer. So I might be missing something.
Posted Report

Site and Policy » Prevent AI crawlers » Post 9

LemonDrop
Duckinator - Same nonsensical quacks in every pond
Pixel Perfection - I still call her Lightning Bolt
Lunar Guardian - Earned a place among the ranks of the most loyal New Lunar Republic soldiers (April Fools 2023).
Crystal Roseluck - Had their OC in the 2023 Derpibooru Collab.
Elements of Harmony - Had an OC in the 2022 Community Collab
Non-Fungible Trixie -
Twinkling Balloon - Took part in the 2021 community collab.
Ten years of changes - Celebrated the 10th anniversary of MLP:FiM!
My Little Pony - 1992 Edition
Friendship, Art, and Magic (2020) - Took part in the 2020 Community Collab

C++ Crazed
@Fyrestar
I think you have an overly optimistic view about the legality of ignoring something like a robots meta tag, that is to say, it’s not illegal. If a human can view the art legally an AI can and there’s really nothing you can do to change that (lest some laws actually change). It (right now at least) is fair use, you do not get absolute authority over what people are allowed to do with your work, copyright has exceptions and this is one.

Site and Policy » Prevent AI crawlers » Post 8

Fyrestar
Non-Fungible Trixie -
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Lexi Fyrestar
I think i already know a way to make images invisibly identifiable to every of the registered viewers so if it’s leaked the responsible one can be hunted legally.
It’s obvious they will still be able to share it, it’s rather about making the responsible identifiable, so someone might leak it, you can sue them collect some cash the person could go to jail for since they signed a agreement. But these details need to be done by a lawyer and the agreement/contract needs to use anything the law offers.
For me, the only solution I’ve found is:

Make More Art

And once something is made, let it go. If you paywall it, collect what you can while its still secure - but make sure you’re already making your next thing.
I don’t think this is a good idea at all, you basically just keep feeding those monsters, and you should not forget, no one will commission you anymore if they can give the commission prompt to a cheaper or free AI instead of you, letting it create something that will look like you did it. Art becomes completely worthless if we don’t fight it. And i don’t just mean passively.

Site and Policy » Prevent AI crawlers » Post 7

Ciaran
ラ・ゼッタ - For supporting the site
Pixel Perfection - I still call her Lightning Bolt
Silly Pony - Celebrated the 13th anniversary of MLP:FIM, and 40 years of MLP!
Shimmering Smile - Celebrated the 10th anniversary of Equestria Girls!
Lunar Guardian - Earned a place among the ranks of the most loyal New Lunar Republic soldiers (April Fools 2023).
Crystal Roseluck - Had their OC in the 2023 Derpibooru Collab.
Flower Trio - Helped others get their OC into the 2023 Derpibooru Collab.
A Lovely Nightmare Night - Celebrated the 12th anniversary of MLP:FIM!
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
Tree of Harmony - Drew someone's OC for the 2022 Community Collab

Senior Moderator
友情は魔法だ
i will setup a own site gallery now that blocks off the crawlers.
Paywalling your art probably would work, for awhile. Eventually you will probably find your art being shared someplace like kemono.
If people can see it on the web, it can be grabbed by a crawler. And even if you paywall it, some asshole will steal it and share it for you anyway.
I’m not saying that is good - it sucks. Really really sucks. But … I’ve been dealing with the whole “make it so no one else can get at this thing we want to put on the internet” for a long time, and there really is no simple answer.
Good luck though. If you try, maybe you’ll figure out something that no one else has.
This will not work. People will pay and repost it purely for the sake of doing it
Basically, yes. This.
For me, the only solution I’ve found is:

Make More Art

And once something is made, let it go. If you paywall it, collect what you can while its still secure - but make sure you’re already making your next thing.
Posted Report

Site and Policy » Prevent AI crawlers » Post 6

Background Pony #AA9F
I will flush my art from all public crawlable platforms
Hey, I just saw your dA. Kudos to you for really following through on your principles. There are lots of people out there who talk big but never take the plunge (or don’t stick with it in the long term.)
till they implement something fighting them, i will setup a own site gallery now that blocks off the crawlers.
Both are impossible.
Might even consider using shit like onlyfans and paid access for just everything anymore
This will not work. People will pay and repost it purely for the sake of doing it, and then wherever it appears is out of control. There’s at least one moderately well-known website dedicated to this purpose. The only options I can think of are to never show anyone art, to watermark it so severely no-one would want to look at it anyway, or to not worry about it.
Posted Report

Site and Policy » Prevent AI crawlers » Post 5

Fyrestar
Non-Fungible Trixie -
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Lexi Fyrestar
It was both but in the end all about opting in all artists to let AI steal their art.
Do you have any sources that confirm they ignore these tags? Adding it wouldn’t do any harm still. It would also help giving people the option to spoiler their images from crawlers entirely.
Do you have a link or image of it?
@Cirian i was aware it’s just a directive, just like webcrawlers, but that it’s completely ignored and those ass*** ignore it even themselves is massive. I will flush my art from all public crawlable platforms till they implement something fighting them, i will setup a own site gallery now that blocks off the crawlers.
Might even consider using shit like onlyfans and paid access for just everything anymore, this is a stab into every artists back. AI is cancer.
Posted Report

Site and Policy » Prevent AI crawlers » Post 4

Ciaran
ラ・ゼッタ - For supporting the site
Pixel Perfection - I still call her Lightning Bolt
Silly Pony - Celebrated the 13th anniversary of MLP:FIM, and 40 years of MLP!
Shimmering Smile - Celebrated the 10th anniversary of Equestria Girls!
Lunar Guardian - Earned a place among the ranks of the most loyal New Lunar Republic soldiers (April Fools 2023).
Crystal Roseluck - Had their OC in the 2023 Derpibooru Collab.
Flower Trio - Helped others get their OC into the 2023 Derpibooru Collab.
A Lovely Nightmare Night - Celebrated the 12th anniversary of MLP:FIM!
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
Tree of Harmony - Drew someone's OC for the 2022 Community Collab

Senior Moderator
友情は魔法だ
@Fyrestar
Even DeviantArt notes that opting out doesn’t mean that your images won’t appear in datasets.
And they flat out state that it does not affect whether your art appears in their own DreamUp dataset.
Want to learn more about all of this? Do this.
  1. Fill out DeviantArt’s DreamUp Username Opt-Out Request
  2. It will be reviewed by a human within 10 days.
• Please note this is only available to artists who DeviantArt believes are ‘most likely to have been sourced by Stable Diffusion’.
Assuming you pass, and are opted-out, then your name can not be used in DreamUp as a text prompt.
Even if you do this and are approved, your images are still harvested and used in DreamUp.
All that changes is that your name can’t be used as a part of a text prompt.
Now, let’s opt out our images.
  1. Go to each of your images on DeviantArt and click this box:
As noted above, this only works if crawlers respect the meta directive, and DeviantArt does not. Regardless of your setting for this option, DreamUp still gets your images.
And, remember, there’s no guarantee that bots are crawling DeviantArt. So even if DeviantArt makes the meta directive available for the crawler, the crawler might not be getting the image via DeviantArt.
They can just crawl Google, or YIS, or some other image search tool’s cache instead.
So the meta directive at that point doesn’t even matter - the data’s not being crawled ‘from DeviantArt’, and Google and YIS aren’t going to respect a meta directive for something they are not.

FIND OUT IF YOU ARE IN THE DATA SET

If you want to find out if you are in the dataset of 5.8 billion images being used by many of these tools, you may do so here.
It works best if you give it an image to search for in the data. Names sometimes work, but if you give it an image you almost always get a 100% positive or 100% negative.
I’m in there so many times, and from so many places, I’m not even sure what the pathway was that resulted in the images being snagged. Like - I don’t believe DeviantArt was in any way involved in most of the grabs, because even images from my vanity websites are in there. Images from friends web comics are in there too, so to keep from being snagged you’d need to implement this tag every place your images appear ever.
That’s why I think this doesn’t have anything to do with the images being grabbed from DeviantArt or even this site - to me it looks like they’re just coming out of image searches on something like Google.
Because the images aren’t ‘from this site’ or ‘from that site’ - in some cases the images are SO OLD the site they were on doesn’t even exist any more.
So … for me … it looks like they’re eating search engine caches. Because even if you went to that site today there’s no site to grab the image off of.
At which point, site directives stop having any meaning.
To make this really work, I think you’d almost have to do it as meta data in the image itself.
But that too would have to be supported and respected end-to-end.
And we never, ever got that working for Copyright, so I don’t know how you could successfully get it working for something like this.
My guess is that someone will start selling an invisible watermark service, like the old copyright keys that supposedly tracked artist copyrights. The ones that seemed to work were incredibly expensive, and the ones that were free never seemed to work.
Maybe there’s an opportunity here for someone to turn a fast buck by scamming people with promises that can’t be delivered. Like DeviantArt has done.
So, anyway, yes, the meta directive is nice. But if even a single crawler ignores it, you’re in the dataset. And, today at least, there is nothing you can do about that.
So to me at least it seems like a lot of work to make people feel like something is being done. But it doesn’t actually do anything.
Just look at DeviantArt’s implementation - they right out admit that they themselves are ignoring their own implementation, and the only thing they’ll consider allowing people to opt-out from is the artist name.
Almost assuredly because they want to avoid violating an artist’s trademark.
So, names CAN be protected, on DeviantArt at least. Most likely because of trademark liabilities.
But not images.

BE THE CHANGE YOU WANT TO SEE

Philomena is public source, and anyone who wants to is welcome to extend its functionality to support this meta directive. That would make the new features available to any site that is based Philomena.
You don’t have to wait until this site’s dev team has the resources and time for it - you can do it yourself, and then sites that use Philomena may opt-in to the new features if they are functional and efficacious and integrate with their own processes and features.
PS: For me, my favorite thing about all of this is that DeviantArt’s DreamUp opt-out is careful to say it is ‘currently free’, and only available to artists who they judge to be ‘most likely’ to have been harvested.
So … not everyone gets to play. And if even hardly ever did anything artists like me are in the dataset, there’s no way of knowing what ‘most likely’ means. I’m absolutely not ‘most likely’, but I’m already in it.
If you do get to play and fill out DeviantArt’s forms, god bless. But it doesn’t do anything except protect any potential trademark you might have on your artist’s name - not even for DeviantArt’s own DreamUp. And even for people whom DeviantArt considers ‘most likely’ there’s no guarantee that it will remain free.
DeviantArt has been very clever how they played this. They gave people the impression that they’ve done something, and people keep asking why others aren’t doing the same.
But all they’ve done is give the appearance of this being optional somehow.
For me, that’s kind of DeviantArt’s whole thing. Respond to drama, like selling prints of people’s DA submissions, by giving people more boxes to click. As soon as people get lost in the box clicking and demanding that other sites ‘do the say’, DeviantArt goes ahead and does what they had been doing all along.

Site and Policy » Prevent AI crawlers » Post 3

The Smiling Pony
Pixel Perfection - I still call her Lightning Bolt
Silly Pony - Celebrated the 13th anniversary of MLP:FIM, and 40 years of MLP!
Shimmering Smile - Celebrated the 10th anniversary of Equestria Girls!
Solar Hero - Went above and beyond for the Solar Deity, drawing from the power of the sun itself to bring balance to the fight against the Lunar Insurrection (April Fools 2023).
Roseluck - Had their OC in the 2023 Derpibooru Collab.
Flower Trio - Helped others get their OC into the 2023 Derpibooru Collab.
King Sombra - Celebrated the 10th anniversary of The Crystal Empire!
A Lovely Nightmare Night - Celebrated the 12th anniversary of MLP:FIM!
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
Tree of Harmony - Drew someone's OC for the 2022 Community Collab

( ͠° ͟ʖ ͡° )
@Fyrestar
I don’t have, like, a list of which publicly accessible AIs ignore it, but some definitely don’t, and all this is open source stuff so anyone can just turn it off / delete the line when they set theirs up. For example, https://twitter.com/isyourguy/status/1591149452643172353
There was also some post going around from the internal communications in DA about the engineers freaking out that the feature had been released before it was ready, and that it was pretty much useless for non-DA AIs anyway.
Posted Report

Site and Policy » Prevent AI crawlers » Post 2

Fyrestar
Non-Fungible Trixie -
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Lexi Fyrestar
It was both but in the end all about opting in all artists to let AI steal their art.
Do you have any sources that confirm they ignore these tags? Adding it wouldn’t do any harm still. It would also help giving people the option to spoiler their images from crawlers entirely.
Posted Report

Site and Policy » Prevent AI crawlers » Post 1

The Smiling Pony
Pixel Perfection - I still call her Lightning Bolt
Silly Pony - Celebrated the 13th anniversary of MLP:FIM, and 40 years of MLP!
Shimmering Smile - Celebrated the 10th anniversary of Equestria Girls!
Solar Hero - Went above and beyond for the Solar Deity, drawing from the power of the sun itself to bring balance to the fight against the Lunar Insurrection (April Fools 2023).
Roseluck - Had their OC in the 2023 Derpibooru Collab.
Flower Trio - Helped others get their OC into the 2023 Derpibooru Collab.
King Sombra - Celebrated the 10th anniversary of The Crystal Empire!
A Lovely Nightmare Night - Celebrated the 12th anniversary of MLP:FIM!
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
Tree of Harmony - Drew someone's OC for the 2022 Community Collab

( ͠° ͟ʖ ͡° )
Due to ongoing architectural rework, there haven’t been any published changes to the site code in over half a year, and that was specifically to deal with child porn being spammed. This wouldn’t be simply adding a meta tag everywhere, but also user-facing UI for enabling and disabling it per image, per tag, etc.
I’m also not sure that meta tag would actually be used by any crawler outside of a couple commercial AIs (like NovelAI or Dall-e 2); even Google and Bing ignore all the no-bots/crawler tags when they’re feeling curious enough. Most AIs will just ignore it, same as they do for DA and other sites; it’s effectively just an empty gesture.
To note that DA’s shitstorm wasn’t that AI was crawling the site (as mentioned, they can’t do anything about that, meta tag or no), but that they were setting up their own commercial AI using their site’s own database, and automatically opting everyone in.
Posted Report

Site and Policy » Prevent AI crawlers » Topic Opener

Fyrestar
Non-Fungible Trixie -
An Artist Who Rocks - 100+ images under their artist tag
Artist -

Lexi Fyrestar
Deviantart received a massive shitstorm recently for allowing AI crawlers collecting images for their datasets only preventing it by a option no one knew about and being a opt-in.
I don’t see the meta tag being used on this site, why?
<meta name="robots" content="noai, noimageai">
Posted Report

Default search

If you do not specify a field to search over, the search engine will search for posts with a body that is similar to the query's word stems. For example, posts containing the words winged humanization, wings, and spread wings would all be found by a search for wing, but sewing would not be.

Allowed fields

Field SelectorTypeDescriptionExample
authorLiteralMatches the author of this post. Anonymous authors will never match this term.author:Joey
bodyFull TextMatches the body of this post. This is the default field.body:test
created_atDate/Time RangeMatches the creation time of this post.created_at:2015
idNumeric RangeMatches the numeric surrogate key for this post.id:1000000
myMetamy:posts matches posts you have posted if you are signed in. my:posts
subjectFull TextMatches the title of the topic.subject:time wasting thread
topic_idLiteralMatches the numeric surrogate key for the topic this post belongs to.topic_id:7000
topic_positionNumeric RangeMatches the offset from the beginning of the topic of this post. Positions begin at 0.topic_position:0
updated_atDate/Time RangeMatches the creation or last edit time of this post.updated_at.gte:2 weeks ago
user_idLiteralMatches posts with the specified user_id. Anonymous users will never match this term.user_id:211190
forumLiteralMatches the short name for the forum this post belongs to.forum:meta