Skip to content

Commit e13be29

Browse files
authored
Update README.md
1 parent 828a12c commit e13be29

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -163,7 +163,7 @@ enableGooglebotIPCheck: "true"
163163
goodBots: apple.com,archive.org,duckduckgo.com,facebook.com,google.com,instagram.com,kagibot.org,linkedin.com,msn.com,openalex.org,twitter.com,x.com
164164
```
165165

166-
Since google publishes their bot IPs, we can also leverage their API to let google based on IP. This can be enabled with enableGooglebotIPCheck: "true"
166+
Since google publishes their bot IPs, we can also leverage their API to let google crawl the site unchallenged based on client IP. This can be enabled with `enableGooglebotIPCheck: "true"`
167167
168168
**However** if you set the config parameter `protectParameters="true"`, even good bots won't be allowed to crawl protected routes if a URL parameter is on the request (e.g. `/foo?bar=baz`). This `protectParameters` feature is meant to help protect faceted search pages.
169169

0 commit comments

Comments
 (0)