Astachoth@xxxxxx wrote:
In a message dated 9/19/2003 3:25:06 PM Pacific Daylight Time,
gunnar@xxxxxxxxxxxx writes:
It just struck me... What do you think about:
<meta name="robots" content="index,nofollow">
That would tell the spiders to index the page, but ignore links
to other pages. It wouldn't remove URLs that have already been
indexed, of course, but might prevent future redundant indexing.
I thought about that as an option, but it would also cause ring
members to lose the advantage of getting their pages indexed by the
search engines as well.
No, it wouldn't. You describe this tag:
<meta name="robots" content="noindex,nofollow">
---------------------------------^^
That would prevent all listings, i.e. to the extent the spiders care
about meta robots tags, which not all of them do. But it's not the
same as I suggested.
I think my idea with "index,nofollow" is worth a try.
If I left it as it is, do you think search engine owners would
consider my site a spamming site and delete it entirely, or would
they simply remove the abundant entries?
I don't know how those people think... But it sure would be
inconsistent to first have their spiders list every variant of URLs,
and then complain about "spamming".
I do have another idea, which might work. How about using:
<a
href="javascript:top.location='http://www.gothring.org/cgi-bin/next5.pl?ringid=altgothic;offset=16'">Next
5 Sites</a>
at the bottom of the list pages? It won't fail the W3C inspection
like target="_top" or target="_blank" does. I'm thinking that the
search engine won't consider it a real URL.
Hmm.. There are no target="_top" included in those links in the first
place, and that is intentional. If the list page would appear in a
frame, there is no reason to break out of the frames as long as you
keep listing sites, is there?
/ Gunnar