- Run by
- Sogou
- Type
- Search engine crawler
- Visits
- On its own schedule
- robots.txt
- Follows robots.txt
- robots.txt name
Sogou web spider- Documentation
- Sogou's page
What Sogou web spider does
Sogou web spider is the crawler for Sogou Search in China. Sogou also documents a second robot, Sogou inst spider.
- Sogou says its spider opens one connection per server IP and spaces requests a few seconds apart. Source
Does Sogou web spider follow robots.txt?
Yes. Sogou's webmaster guide says its spider follows the robots protocol, and that changes may take several weeks to apply. It matches user agent names case-sensitively.
How to block or allow Sogou web spider
Block it from the whole site:
User-agent: Sogou web spider
Disallow: /Keep it out of one folder only:
User-agent: Sogou web spider
Disallow: /private/ A crawler that finds a group with its own name follows only that group and ignores User-agent: *. If your * group disallows paths such as /admin/, repeat those lines in the Sogou web spider group. robots.txt works per host, so add the rules to each subdomain you want covered.
Test the result with the robots.txt checker, or write a new file with the robots.txt generator.
What blocking Sogou web spider changes
Your pages stop being crawled for Sogou Search. Pages already indexed can take months to drop out unless you also ask Sogou to delete their snapshots.
Where to see Sogou web spider visits
Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.
OneLence recognizes Sogou web spider and keeps it out of your visitor counts. With Premium, bot traffic shows which bots visit your site, how often and what kind they are.
Frequently asked questions
What is Sogou web spider?
Sogou web spider is the crawler for Sogou Search in China. Sogou also documents a second robot, Sogou inst spider.
Does Sogou web spider follow robots.txt?
Yes. Sogou's webmaster guide says its spider follows the robots protocol, and that changes may take several weeks to apply. It matches user agent names case-sensitively.
How do I block Sogou web spider?
Add a group to robots.txt with User-agent: Sogou web spider, then Disallow: /.
What happens if I block Sogou web spider?
Your pages stop being crawled for Sogou Search. Pages already indexed can take months to drop out unless you also ask Sogou to delete their snapshots.
Why doesn't Sogou web spider show up in Google Analytics?
Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.