.Google.com's Gary Illyes reveals Googlebot collects hyperlinks rather than "following" all of them, negating formal paperwork.Googlebot collects links as opposed to observing all of them in real-time.Gary Illyes discussed this details in Google's 'Browse Off The Document' podcast.Google.com's records negates the actual crawler behavior.