47 Guests. That's a new record for users online at any one time, and there was me thinking we'd never beat the previous record.

What drove that then? Any hints in the analytics? Can we flame them?

More to the point, can we block their IP addresses so they can't do it again?

 

Then we'll track them down and post doggy doo-doo through their letter boxes.

 

That'll learn 'em :Y

Your fault then. Expect poopoo post.

Looks like we got indexed by Ask.com's search bot which seems to run from approximately one metric fuck-tonne of IP addresses.

Now if only Google would start indexing out sitemap.

Do web spiders drink tea and eat cake?

Have you checked with Google Webmaster tools to ensure the sitemap is valid?

Yes. Submitted Mar 6, 2008, last downloaded 31 minutes ago (!!), but all it reports is:



There are pages indexed, but they're from the bot crawling the pages before we had the sitemap.

That was probably me - I tried submitting it to see what would happen.


Very odd that it's accepting it but not picking anything up. :/

Heh, there's 105 guests online right now.

By the logs maybe that's Yahoo! is spidering us?

And also...


O_o


Is Ask.com identified in the guest->search engine thing?

Looks like we're actually getting indexed by a lot of search engines! Finally!

Beehive recognises these search engines:

Alexa,
Ask.com,
Baidu,
GameSpy,
Gigablast,
Google,
Google Images,
Inktomi,
MSN Search,
Altavista,
Yahoo!.

Oooh, appears we are starting to get indexed properly now - Google has gone from ~1,600 to ~4,800 results...

(bounce)

Now 8,160 results. Quite a lot of duplicate results with the same threads appearing a number of times due to the 20 posts per page style navigation.

I wonder if it would be a good idea to make Beehive show all messages in a thread on a single page whenever it knows that the page is being viewed by a search engine bot.

Hmm.

Hmm, I'd say it's fine once it points to the appropriate page where the relevant result(s) are found.


What it should do is have navigational link tags.

i.e. plonk this in head:

<link rel="contents" href="lthread_list.php?webtag=DEFAULT"/>
<link rel="first"    href="lmessages.php?webtag=DEFAULT&msg=2226.1"/>
<link rel="previous" href="lmessages.php?webtag=DEFAULT&msg=2226.1921"/>
<link rel="next"     href="lmessages.php?webtag=DEFAULT&msg=2226.1961"/>
<link rel="last"     href="lmessages.php?webtag=DEFAULT&msg=2226.2331"/>
<link rel="up"       href="lthread_list.php?webtag=DEFAULT&folder=1"/>

(using msg:2226.1941 as an example; would actually be variable, obviously)

Done. Lets see if that makes a difference.

What's that do then?