Mobile site and mobile-first indexing best practices Google uses the mobile version of a site’s content, crawled with the smartphone agent, for indexing and ranking. This is called mobile-first indexing. While it’s not required to have a mobile version of your pages to have your content included in Google’s Search results, it……更多
2025-06-06
How to specify a canonical URL with rel=”canonical” and other methods To specify a canonical URL for duplicate or very similar pages to Google Search, you can indicate your preference using a number of methods. These are, in order of how strongly they can influence canonicalization: Redirects: A strong signal that the target of the r……更多
2025-06-06
What is canonicalization Canonicalization is the process of selecting the representative –canonical– URL of a piece of content. Consequently, a canonical URL is the URL of a page that Google chose as the most representative from a set of duplicate pages. Often called deduplication, this process helps Google show only one version of the otherwise ……更多
2025-06-06
How Google interprets the robots.txt specification Google’s automated crawlers support the Robots Exclusion Protocol (REP). This means that before crawling a site, Google’s crawlers download and parse the site’s robots.txt file to extract information about which parts of the site may be crawled. The REP isn’t applicable to……更多
2025-06-06
Update your robots.txt file If you use a site hosting service, such as Wix or Blogger, you might not need to (or be able to) edit your robots.txt file directly. Instead, your provider might expose a search settings page or some other mechanism to tell search engines whether or not to crawl your page. If you want to hide or unhide one of your page……更多
2025-06-06
How to write and submit a robots.txt file If you use a site hosting service, such as Wix or Blogger, you might not need to (or be able to) edit your robots.txt file directly. Instead, your provider might expose a search settings page or some other mechanism to tell search engines whether or not to crawl your page. If you want to hide or unhide on……更多
2025-06-06
Reduce the Google crawl rate Google’s crawler infrastructure has sophisticated algorithms to determine the optimal crawl rate for a site. Our goal is to crawl as many pages from your site as we can on each visit without overwhelming your server. In some cases, Google’s crawling of your site might be causing a critical load on your inf……更多
2025-06-06
Feedfetcher Feedfetcher is how Google crawls RSS or Atom feeds for Google News and PubSubHubbub. Feedfetcher stores and periodically refreshes feeds that are requested by users of an app or service. Only podcast feeds get indexed in Google Search; however, if a feed doesn’t follow the Atom or RSS specification, it may still be indexed. Here……更多
2025-06-06
APIs-Google user agent APIs-Google is the user agent used by Google APIs to deliver push notification messages. Application developers can request these notifications to avoid the need for continually polling Google’s servers to find out if the resources they are interested in have changed. To make sure nobody abuses this service, Google re……更多
2025-06-06
Google Read Aloud user agent bookmark_border Google-Read-Aloud is the user agent for the Google Read Aloud service. This service enables reading web pages using text-to-speech (TTS). This service is activated when an end user has TTS enabled and visits a page. The Read Aloud service is used by Google Go, Google Read it, Read Aloud on the Google a……更多
2025-06-06
Apply for your exclusive plan for free