lau wrote:
I think it would be fairly easy to request search engines not to scan The Haven, as that's what "robots.txt" is for. At present, that file seems a little out of date, to me. However, I suspect Alex might be the one to make any decision about changing it.
Unless there is a pattern in the URLs for topics in The Haven, it would probably be easier to add some code to the overall_header.tpl file in the phpbb theme used for this site that would add a
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> to pages if the current page is The Haven or one of the topics therein. Google could still see the pages, but wouldn't index them or any links in them.
That solution would be incomplete, though. If you look at a member's profile you can see a list of each post they have made. That list includes every post that is visible to whichever user is viewing the list. If The Haven is visible, Google will still index each post made in that forum when it indexes each user's list of posts made.
Also excluding those pages using robots.txt would be sufficient to prevent Google from indexing each post.
Usernames will still be visible to Google, though, so if someone knows another person's username, they would be able to search Google for said username, find this site and readily view all of a user's posts, even those made in The Haven, whereas if The Haven were hidden then posts made within The Haven would be excluded from those lists when the user viewing the lists wasn't logged in.