Wowzers

From: Peter (BOUGHTONP)10 Jul 2008 07:10
To: Matt 12 of 22
Heh, there's 105 guests online right now.

By the logs maybe that's Yahoo! is spidering us?

And also...
quote:
Most users ever online was 287 on 3:44.


O_o


Is Ask.com identified in the guest->search engine thing?
From: Matt10 Jul 2008 08:18
To: Peter (BOUGHTONP) 13 of 22
Looks like we're actually getting indexed by a lot of search engines! Finally!

Beehive recognises these search engines:

Alexa,
Ask.com,
Baidu,
GameSpy,
Gigablast,
Google,
Google Images,
Inktomi,
MSN Search,
Altavista,
Yahoo!.
Message 34632.14 was deleted
From: Peter (BOUGHTONP)10 Jul 2008 22:30
To: ALL15 of 22
Oooh, appears we are starting to get indexed properly now - Google has gone from ~1,600 to ~4,800 results...

(bounce)
From: Matt11 Jul 2008 21:21
To: Peter (BOUGHTONP) 16 of 22
Now 8,160 results. Quite a lot of duplicate results with the same threads appearing a number of times due to the 20 posts per page style navigation.

I wonder if it would be a good idea to make Beehive show all messages in a thread on a single page whenever it knows that the page is being viewed by a search engine bot.

Hmm.
From: Peter (BOUGHTONP)11 Jul 2008 21:32
To: Matt 17 of 22
Hmm, I'd say it's fine once it points to the appropriate page where the relevant result(s) are found.


What it should do is have navigational link tags.

i.e. plonk this in head:
HTML code:
<link rel="contents" href="lthread_list.php?webtag=DEFAULT"/>
<link rel="first"    href="lmessages.php?webtag=DEFAULT&msg=2226.1"/>
<link rel="previous" href="lmessages.php?webtag=DEFAULT&msg=2226.1921"/>
<link rel="next"     href="lmessages.php?webtag=DEFAULT&msg=2226.1961"/>
<link rel="last"     href="lmessages.php?webtag=DEFAULT&msg=2226.2331"/>
<link rel="up"       href="lthread_list.php?webtag=DEFAULT&folder=1"/>


(using msg:2226.1941 as an example; would actually be variable, obviously)
EDITED: 11 Jul 2008 21:34 by BOUGHTONP
From: Matt11 Jul 2008 22:32
To: Peter (BOUGHTONP) 18 of 22
Done. Lets see if that makes a difference.
From: Mouse11 Jul 2008 22:51
To: Peter (BOUGHTONP) 19 of 22
What's that do then?
Message 34632.20 was deleted
From: Mouse11 Jul 2008 23:48
To: Al JunioR (53NORTH) 21 of 22
Ahh, sign posts for spiders then. Got it.
From: Peter (BOUGHTONP)12 Jul 2008 00:00
To: Mouse 22 of 22
It tells users (including search engines) where the next/previous/etc pages are in relation to the current page, giving them a structural context that might not be obvious (for a bot) based solely on regular hyperlinks.

In theory, it improves the ability of a search engine to return relevant information (e.g. if two results are otherwise ranked equal, but one preceeds the other, it probably makes sense to list the first as the primary match), and Google generally rewards the correct use of semantic metadata.

All of which hopefully means Google will pay more attention to the site in general, and give it better placing in search rankings.