Whilst randoming clicking buttons, I came across the Yahoo! slurp spider?


It's a nosy spider, what's he/she doing?

I wasn't quite specific enough. If you look at the bottom of the SF homepage, then click on 'Current active users', after listing the members that are online, then the guests that are viewing, there are loads of threads being viewed by the Yahoo! Slurp Spider. :huh::huh:

Slurp spiders are what the search engines use to go through site content in order to update their search results/archives etc..

Same for MSN, Googlebot etc

Slurp spiders are what the search engines use to go through site content in order to update their search results/archives etc..

Same for MSN, Googlebot etc

I thought they would be search things. But looking at some of the things it's looking at seem strange. Why the heck would it be viewing user profiles?:confused:

Guests online (those who are lurking or those who are members but not currently signed in) will also show in those numbers, so it's not just automated processes.

I thought they would be search things. But looking at some of the things it's looking at seem strange. Why the heck would it be viewing user profiles?:confused:

One was searching the forums earlier. It's strange, Google has one, Ask has one, Yahoo have loads. Does this mean that Yahoo is the better search engine for all things SF?

One was searching the forums earlier. It's strange, Google has one, Ask has one, Yahoo have loads. Does this mean that Yahoo is the better search engine for all things SF?

Good question. I always use Google to search in SF. Maybe better results are from Yahoo :suspect:

I just found my way on the Viewing Forums pages by accident, looking for the member lists and it's infested with SPIDERS! of all sorts .... yeuggghhh!

They're even in the Archives, fgs! Why would a Yahoo Slurp Spinder be interested in Twinkle's old bruises?? Bizarre.

To think this is all being regurgitated for world-wide viewing .... :rolleyes: