Web Analytics Made Easy -
StatCounter How can my pages avoid being indexed by search engines? - CodingForum

Announcement

Collapse
No announcement yet.

How can my pages avoid being indexed by search engines?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • How can my pages avoid being indexed by search engines?

    I have some pages that I don't want to show up when people use Google and the others...

    I know I should use some kind of meta tag but am not sure of how to write it.

    I have also read something about a robot.txt file but how is that used and what should it contain?

    Hope you can tell me..

  • #2
    About using Meta tags -
    http://webdesign.about.com/cs/metatags/a/aa083099.htm

    The robots.txt file is used to make a search engine NOT display a folder/page, so you'll need to use that.

    eg. Place in root dir with the contents -

    User-agent: *
    Disallow: /folder_not_to_be_found
    markaylward.co.uk

    Comment


    • #3
      If you need anymore help this is a good tutorial
      Get Mozilla Firefox

      Comment


      • #4
        I have some pages that i don't want to show up in search engines to. So I made a subdirectory and placed them in it. Then I put a blank index.htm file with no links to the other pages in there and none of my pages have ever showed up in search engines.

        I was told that using meta tags doesn't always help. Some bots can get around them. My friends say you need to do it at the server level and even then you never know for sure.
        Master Newbie http://dwightstegall.com/

        Comment

        Working...
        X