Tell HN: We Need Robots.txt but for AI | Hacker News
A "robots.txt for AI" would be nothing other than a polite request that will be ignored by the vast majority of organisations. Under the ...
Tell HN: We should start to add “ai.txt” as we do for “robots.txt ...
I started to add an ai.txt to my projects. The file is just a basic text file with some useful info about the website like what it is about, ...
TV Series on DVD
Old Hard to Find TV Series on DVD
Using robots.txt as a model for anything doesn't work ... - Hacker News
Using robots.txt as a model for anything doesn't work. All a robots.txt is is a polite request to please follow the rules in it, there is no "legal" ...
That's still not an argument to introduce ai.txt, because everything a ...
I do think that robots.txt is pretty useful. If I want my content indexed, I can help the engine find my content. If indexing my content is counterproductive, ...
They said "Using robots.txt as a model for anything doesn't work ...
They said "Using robots.txt as a model for anything doesn't work." but it does work for the case described in the text ...
Tell HN: We should start to add “ai.txt” as we do for “robots.txt”
I started to add an ai.txt to my projects. The file is just a basic text file with some useful info about the website like what it is about, ...
robots.txt is for all crawlers, so there's no need for another file ...
txt is for all crawlers, so there's no need for another file? robots.txt supports comments using # and ideally has a link to the site map, which would tell any ...
The text file that runs the internet - The Verge
It's called robots.txt and is usually located at yourwebsite.com/robots.txt. That file allows anyone who runs a website — big or small, cooking ...
security.txt https://github.com/securitytxt/security-txt ... - Hacker News
txt provides a way for websites to define security policies. The security.txt file sets clear guidelines for security researchers on how to report security ...
The rise and fall of robots.txt : r/aiwars - Reddit
Following news and developments on ALL sides ... AI have obeyed robots.txt. They didn't have to, archive.org doesn't, but they all decided ...