| Yahoo/MSN/Google Bot icons? |
| Author: |
Message: |
jordanspringer
Full Member
jjordann
Posts: 369
Reputation: 5
– /  / –
Joined: Oct 2003
|
O.P. Yahoo/MSN/Google Bot icons?
This has probably been posted before, I tried searching, couldn't find it. But when you view who is online on the forums, the Yahoo, MSN, and Google icons.. what do they mean?
I'm wondering if they are bots scanning the pages to continuously add these pages to like Google/MSN/Yahoo search? meta spiders or w/e they're called... but I wasn't sure...
View Who's Online
This post was edited on 06-20-2006 at 03:37 AM by jordanspringer.
|
|
| 06-20-2006 03:36 AM |
|
 |
qgroessl
Veteran Member
Posts: 1615
Reputation: 22
33 / – / 
Joined: Jul 2005
Status: Away
|
|
RE: Yahoo/MSN/Google Bot icons?
I think it's how they were directed to the page?
|
|
| 06-20-2006 03:37 AM |
|
|
WDZ
Former Admin
Posts: 7106
Reputation: 107
– / /
Joined: Mar 2002
|
RE: Yahoo/MSN/Google Bot icons?
quote:
Originally posted by jordanspringer
I'm wondering if they are bots scanning the pages to continuously add these pages to like Google/MSN/Yahoo search? meta spiders or w/e they're called... but I wasn't sure...
That's correct, the icons identify web spiders/crawlers. |
|
| 06-20-2006 03:40 AM |
|
|
jordanspringer
Full Member
jjordann
Posts: 369
Reputation: 5
– / / –
Joined: Oct 2003
|
|
O.P. RE: Yahoo/MSN/Google Bot icons?
so you mean to say when you look to see how many people are online in the fourms, about 30 people make up just search bots? thats nuts
|
|
| 06-20-2006 03:43 AM |
|
|
WDZ
Former Admin
Posts: 7106
Reputation: 107
– / /
Joined: Mar 2002
|
RE: Yahoo/MSN/Google Bot icons?
quote:
Originally posted by jordanspringer
so you mean to say when you look to see how many people are online in the fourms, about 30 people make up just search bots? thats nuts
The number varies of course, but yeah... that's possible.  |
|
| 06-20-2006 03:48 AM |
|
|
fergofrog
Full Member
Posts: 121
Reputation: 4
31 / / –
Joined: May 2006
|
|
RE: Yahoo/MSN/Google Bot icons?
Hey that's cool, how does Messenger Plus know that Yahoo/MSN?Google directed them there?
|
|
| 06-24-2006 10:57 AM |
|
|
Plik
Veteran Member
Posts: 1489
Reputation: 46
35 / / –
Joined: Jun 2004
|
RE: Yahoo/MSN/Google Bot icons?
quote:
Originally posted by fergofrog
Hey that's cool, how does Messenger Plus know that Yahoo/MSN?Google directed them there?
You can generally identify them by either their useragent or IP address, so it just takes some php to indentfy them |
|
| 06-24-2006 11:06 AM |
|
|
WDZ
Former Admin
Posts: 7106
Reputation: 107
– / /
Joined: Mar 2002
|
RE: Yahoo/MSN/Google Bot icons?
Yeah, my script uses a list of known IP addresses.
MyBB 1.0 uses User-Agents. I guess that's a better way to ensure all bots are detected, but then it's also easy for a non-bot to pretend to be a bot, which is kinda dodgy. |
|
| 06-24-2006 08:13 PM |
|
|
fergofrog
Full Member
Posts: 121
Reputation: 4
31 / / –
Joined: May 2006
|
|
RE: Yahoo/MSN/Google Bot icons?
That's really cool, how did you find out the bot's IP addresses? And why would a non-bot want to pretend to be a bot?
|
|
| 06-24-2006 09:23 PM |
|
|
WDZ
Former Admin
Posts: 7106
Reputation: 107
– / /
Joined: Mar 2002
|
RE: Yahoo/MSN/Google Bot icons?
quote:
Originally posted by fergofrog
That's really cool, how did you find out the bot's IP addresses?
A bit of web research, plus some DNS lookups on a set of random visitor IPs.
quote:
And why would a non-bot want to pretend to be a bot?
Well, a bored forum member might try it as a joke... |
|
| 06-25-2006 03:22 AM |
|
|
|
|
![[Image: name4ld.png]](http://img459.imageshack.us/img459/8381/name4ld.png)
![[Image: fergofrog.png]](http://msig.info/latest/{http://img232.imageshack.us/img232/4718/jaal2edit36aj.jpg}/fergofrog.png)
![[Image: repute.gif]](http://shoutbox.menthix.net/images/mp3me/repute.gif)