I am using Organic Groups and most of the pages i.e Discussions and related pages are only accessible to an authenticated user, can google bot crawl all these pages as well or is thrown a 403 error ?
Add a comment
|
2 Answers
Drupal will send a 403 response for any protected pages to any user agent, including the Googlebot, unless that user agent has been authenticated by Drupal and has a valid session cookie.
If your pages are only accessible by users with the "authenticated user" role, Google will not be able to crawl them.
Google bot, as any other web crawler, has access to any pages to which anonymous users have access. If the page is visible only to users with a specific permission, you should assign that permission to the anonymous user.
answered Mar 25, 2012 at 21:19
