On my Drupal 7 site I have some pages that should not be entered by bots like the google bot or any other bot. All this pages are under a specific path like:
I have configured my robots.txt to prevent all bots to enter xyz/* but I would like to add a higher obstacle. I thought, for example, about a capture.
I there a way in Drupal 7 to restrict access to all pages that have an specific path by a capture or does anybody have a better idea how to achieve my goal?