Recently, we are having problems with crawlers or bots ignoring robots.txt and causing ridiculous amounts of traffic and various other problems. This page is a temporary measure to investigate how these crawlers behave.
This page is excluded from crawling in our robots.txt, so no bot should access it.
Link A