We want Google to index us though don't we?
What, even if it brings down the server? Your call, I guess.
And robots.txt doesn't allow us to control things like frequency of visits and number of visits per day.
No, but it does allow you to prevent directories from being crawled, so the main domain could be indexed, but not the forum. Unless the point is to have a search for 'teh forum' or 'beehive' return every last jibbering post from us lot, in which case my bad.
:><