eBay
From Misc Data Digs
robots.txt[edit | edit source]
This usage warning can be found in the robots.txt.
### BEGIN FILE ### # # allow-all # DR # # The use of robots or other automated means to access the eBay site # without the express permission of eBay is strictly prohibited. # Notwithstanding the foregoing, eBay may permit automated access to # access certain eBay pages but soley for the limited purpose of # including content in publicly available search engines. Any other # use of robots or failure to obey the robots exclusion standards set # forth at <http://www.robotstxt.org/ wc/ exclusion.html> is strictly # prohibited. # # v4 - A New Hope
The bottom version number used to be v3 from 2014 until August 20, 2019