WordPress
From Misc Data Digs
robots.txt[edit | edit source]
This message can be found at the top.
# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead. # Please see https://developer.wordpress.com/docs/firehose/ for more details.