Shoutbox

How is it that my site has been spidered many times but hasn't appeared on one search engine. (Except for Google, but it doesn't even have my site's description on it.)

Look at this screenshot...


Click for bigger picture

( this can be found at http://www.jren207.com/cgi-bin/spydertrax/spyderview.cgi )

As you can see, it has been spidered by MSN Search, sooo many times and I searched for "jren207" and all i got was pages from sites like these forums which I have subscribed to that have been spidered. Not even my site!!

Wow, that's interesting.


Did you install a script or something for that page?

If you mean the page in the screenshot, yep. It's called Spydertrax and you can get it at http://www.darrinward.com/

It tracks bots that crawl your website.

You put: <?php virtual("/cgi-bin/spydertrax.cgi"); ?> in the pages you want to track and it tells you if they have been spidered.

well i think that its usefull but at they other side i think i'll never download it srry

thtz ok, i was tellin ya the script I used for tracking....

... but still... can someone explain why my site isn't appearing all that often in MSN search even though it's been spidered at least 15 times!!!

Maybe those sites (except for Google) require those meta tags before you can be added into their databases? Or do you already have those?

Maybe he has a meta tag coz else he would'nt have spidered it i guess

Yep, I do have meta tags, or else there would be NO chance of it even being spidered lol.

look

code:

---

      <META HTTP-EQUIV="pics-label" content='(pics-1.1 "http://www.icra.org/ratingsv02.html" comment "ICRAonline EN v2.0" l gen true for "http://jren207.no-ip.com" r (nz 1 vz 1 lz 1 oz 1 cb 1) "http://www.rsac.org/ratingsv01.html" l gen true for "http://jren207.no-ip.com" r (n 0 s 0 v 0 l 0))' >
      <META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=ISO-8859-1" >
      <META HTTP-EQUIV="EXPIRES" CONTENT="0" >
      <META NAME="RESOURCE-TYPE" CONTENT="DOCUMENT" >
      <META NAME="DISTRIBUTION" CONTENT="GLOBAL" >
      <META NAME="AUTHOR" CONTENT="JR!" >
      <META NAME="COPYRIGHT" CONTENT="Copyright JR! - JR! Web Design 2004" >
      <META NAME="KEYWORDS" CONTENT="JR,jren207,jdr207,computer,php,html,google,poll,coding,apache,jason,rennie,notepad,ie,internet,download,jasondanielrennie207,search,original,home" >
      <META NAME="DESCRIPTION" CONTENT="A site with tips and tricks and many flavours of content to please and help with web development." >
      <META NAME="ROBOTS" CONTENT="ALL" >
      <META NAME="REVISIT-AFTER" CONTENT="1 DAYS" >
      <META NAME="RATING" CONTENT="GENERAL" >
      <META NAME="GENERATOR" CONTENT="JR! Hand Coding JR! Web Design" >
      <META NAME="OWNER" CONTENT="JR!" >
      <META NAME="MSSmartTagsPreventParsing" CONTENT="TRUE" >

---

thats what i was saying lol

Wow... that's a lot of meta tags... maybe too many?

Maybe some of them are conflicting with some search engines...

I've read that sometimes you will be penalized if some of your meta info is too long, or if you use keywords that aren't actually related to the content of your site.