Google AdsBot is the crawler that fetches ad landing pages: how it works, why it ignores robots.txt wildcards, its crawl schedule, and the load it creates.
Read the full article on PPC Land →