Google Read Aloud user agent bookmark_border Google-Read-Aloud is the user agent for the Google Read Aloud service. This service enables reading web pages using text-to-speech (TTS). This service is activated when an end user has TTS enabled and visits a page. The Read Aloud service is used by Google Go, Google Read it, Read Aloud on the Google a……更多
2025-06-06
Googlebot bookmark_border Googlebot is the generic name for two types of web crawlers used by Google Search: Googlebot Smartphone: a mobile crawler that simulates a user on a mobile device. Googlebot Desktop: a desktop crawler that simulates a user on desktop. You can identify the subtype of Googlebot by looking at the HTTP user-agent request ……更多
2025-06-06
User-triggered fetchers are initiated by users to perform a fetching function within a Google product. For example, Google Site Verifier acts on a user’s request, or a site hosted on Google Cloud (GCP) has a feature that allows the site’s users to retrieve an external RSS feed. Because the fetch was requested by a user, these fetchers……更多
2025-06-06
Google uses crawlers and fetchers to perform actions for its products, either automatically or triggered by user request. Crawler (sometimes also called a “robot” or “spider”) is a generic term for any program that is used to automatically discover and scan websites. Fetchers act as a program like wget that typically make ……更多
2025-06-06
List of Google’s common crawlers bookmark_border Google’s common crawlers are used to find information for building Google’s search indexes, perform other product specific crawls, and for analysis. They always obey robots.txt rules when crawling automatically. The general technical properties of Google’s crawlers also ap……更多
2025-06-06
How HTTP status codes, and network and DNS errors affect Google Search bookmark_border This page describes how different HTTP status codes, network errors, and DNS errors affect Google Search. We cover the top 20 status codes that Googlebot encountered on the web, and the most prominent network and DNS errors. More exotic status codes, such as 41……更多
2025-06-06
Managing crawling of faceted navigation URLs bookmark_border Faceted navigation is a common feature of websites that allows its visitors to change how items (for example, products, articles, or events) are displayed on a page. It’s a popular and useful feature, however its most common implementation, which is based on URL parameters, can ge……更多
2025-06-06
Ask Google to recrawl your URLs bookmark_border Are you using a hosted content management platform (for example, Blogger or WordPress)? In most cases, the platform submits your new content to search engines automatically. Check your platform’s support articles. If you’ve recently added or made changes to a page on your site, you can r……更多
2025-06-06
How to combine sitemap extensions bookmark_border Sitemap extensions are a great way to tell Google about the different kinds of content and their metadata that you’re using on your site. Often the content on your pages may fit into multiple kinds of extensions; for example, you might be publishing news articles that embed images and videos……更多
2025-06-06
A video sitemap is a sitemap with additional information about videos hosted on your pages. Creating a video sitemap is a good way to help Google find and understand the video content on your site, especially content that was recently added or that we might not otherwise discover with our usual crawling mechanisms. Google recommends using video s……更多
2025-06-06
Apply for your exclusive plan for free