[Date Prev][Date Next][Thread Prev] [Thread Next][Date Index] [Thread Index]

"noindex" meta tags [was: Lycos ...]


  • From: Gunnar Hjalmarsson  
  • Date: Mon, 29 Sep 2003 18:02:35 +0200

Astachoth@xxxxxx wrote:
I just noticed that the Lycos search engine is "stuck in a loop". I
like having my list pages indexed in the search engines, but Lycos
is following the next links at the bottom of the list pages in my
rings. It now has over a hundred links to my same list pages,
because of the "offset=" extensions and different site ids, which
are in other members codes.
Is there a way to prevent this from happening without adding "robots noindex" meta tags to the list pages?

In an attempt to reduce the just described problem, as from next release Ringlink will generate this tag on list pages whose URLs include 'offset' values in the query string:


    <meta name="robots" content="noindex,follow" />

If you compare the source code of these two URLs, you'll notice the difference:

  http://www.quotationring.net/cgi-bin/list.pl?ringid=quotes

  http://www.quotationring.net/cgi-bin/list.pl?ringid=quotes;offset=5

/ Gunnar


Follow-Ups from:
Ginger Woodcock

References to:
Astachoth

[Date Prev][Date Next][Thread Prev] [Thread Next][Date Index] [Thread Index]