Atricle Dump
#1 in Business Subscribe Email Print

You are here: Home > Internet and Businesses Online > Web Development > Effectively Using Robots Meta Tags

Tags

  • sorrythere
  • archive
  • prevent google
  • namerobots contentnoindexfollowthis
  • helps google

  • Links

  • What Makes Freelance Work So Popular
  • Men Can Have Better Sex
  • Canadian Pharmacy - Your Reliable and Affordable Health Portal
  • Atricle Dump - Effectively Using Robots Meta Tags

    What Goes Into Picking A Domain Name?
    If you are in the market for a domain name you should not have any problems at all finding what you need. Of course, you may have a great idea in mind just to find out that it is already taken, but most of the time you will be able to find an alternate name that will work just as well.Domain name registration can be completed through a number of different online services. It is a relatively easy process that should not take up too much of your time. The first thing you need to do is a domain name search. This can be done by visiting any number of sites that offer domain name registration. When you are performing a domain name search you are trying to find out which names are available and which ones have already been taken by somebody else.After completing a domain name search and finding something tha
    ould like to prevent Google from doing so, then you can use the following tag:

    (meta name="googlebot" content="noarchive")

    The Misuse of Robots Tags

    Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary.

    Another silly little tag--- The "Revisit-After" Tag

    (meta name="revisit-after" content="90 days")
    (meta name="revisit-after" content="15 days")

    I'm not sure wher

    Reciprocal Linking Overload - Any Old Link Back Will Do?
    Are you attempting to become a Google junior by adding thousands of links on your site? Don’t bother, listen to these facts first.So you want to get a Google top page rank and get your site listed on the first page when an internet surfer types in your keywords, right?!? Of course you do. At one time it was extremely important to get as many sites linking to you as possible, so the Google bots would spider your site, see all of these sites linking to you, and determine that your site must be of some importance because so many others are linking to it.That was then this is now! Google is certainly aware of all of this tomfoolery and has reduced greatly, the importance of huge amounts of reciprocal links to your site, and has refined how they determine rankings and importance of each site. Did you know that t
    The "robots" meta tag, when used properly, will tell the search engine spiders whether or not to index and follow a particular page. For the purposes of this article, we will be using the "( )" symbols to represent the "< >" in html coding.

    Some examples of robot usage are as follows:

    (meta name="robots" content="index,follow")

    (meta name="robots" content="noindex,follow")

    (meta name="robots" content="index,nofollow")

    (meta name="robots" content="noindex,nofollow")

    Let us first examine what these terms mean before we explain the usage for each one:

    "index"- This directive tells the search engine robots (or spiders) that it is okay to index the page. Another words, you are allowing the search engine to include your page within their search directory.

    "noindex"- Using this tag, you are informing the robots that this page should not be indexed. Simply put, this page will not appear in their search directory.

    "follow"- When you use this tag, you are telling the search engines that you want their robot to follow any links that are found on that page.

    "nofollow"- The opposite of the above definition, this directive will tell the robots not to follow any links on your page.

    Putting It All Together:

    With the robots tags explained, let's examine the usage for each one.

    1. (meta name="robots" content="index,follow")

    This tag will be used when you want the search engine spiders to index the page and follow the links to other pages. Most search engines use this setting as a "default" setting. It is possible that you may not even need to use this tag if you want the search engines to follow and index the page. However, an article at Search Engine World (searchengineworld.com/metatag/robots.htm) suggests that Inktomi does not use this as their default setting. Instead, they use the "index, nofollow" tag.

    Better safe than sorry!

    There has been much debate over whether or not it is necessary to use this tag. If there is even a slight possibility that some search engines do not use this as the default setting, then it would only make sense to include this tag if you want your page included in their search directory AND your links to be followed. Do the research and decide for yourself.

    2. (meta name="robots" content="noindex,follow")

    This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links.

    3. (meta name="robots" content="index,nofollow")

    This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed.

    4. (meta name="robots" content="noindex,nofollow")

    When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either.

    Where does the "robots" tag belong?

    The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this:

    (html)
    (head)
    (title)Title of your page goes here(/title)
    (meta name="keywords" content="word1,word2,word3,word4")
    (meta name="description" content="A brief description of the content of this page.")
    (meta name="robots" content="index,follow")
    (/head)
    (body)
    Your webpage information here.
    (/body)
    (/html)

    More Robots Tags

    Google automatically archives a page as it crawls it. This is called a "cached" version of the page. Visitors can retrieve the archived version of the page by clicking on the "cached" link within Google's search results. If you do not want your content to be archived, you can use the following tag:

    (meta name="robots" content="noarchive")

    *This will only prevent your page from being "cached". If you do not want your page to be indexed at all, you will still need to include the "noindex" tag.

    Another alternative to the above tag is the tag that specifically addresses Google only. If you want other search engine robots to archive your site, but you would like to prevent Google from doing so, then you can use the following tag:

    (meta name="googlebot" content="noarchive")

    The Misuse of Robots Tags

    Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary.

    Another silly little tag--- The "Revisit-After" Tag

    (meta name="revisit-after" content="90 days")
    (meta name="revisit-after" content="15 days")

    I'm not sure wher

    Start Working Before You Get Hired
    What if there were a way to *prove* to any sane employer that you alone were the one to hire?Would learning how to do that interest you? I thought so.I call this the "start-working-before-you-get-hired" job-hunting method. You can learn to do it in the next two minutes. And start getting more job leads today.Begin by understanding that getting hired for a job -- any job -- all boils down to one thing: proof. It's one thing to claim you're the one to hire. Anyone can do that. But can you prove it?According to Nick Corcodilos, author of the best-selling "Ask The Headhunter" (www.asktheheadhunter.com), "To get a hiring manager's attention, you should become an expert in his business, understand the work he needs done, and find out how he would want you to do it. Then walk in and prove to him that
    osite of the above definition, this directive will tell the robots not to follow any links on your page.

    Putting It All Together:

    With the robots tags explained, let's examine the usage for each one.

    1. (meta name="robots" content="index,follow")

    This tag will be used when you want the search engine spiders to index the page and follow the links to other pages. Most search engines use this setting as a "default" setting. It is possible that you may not even need to use this tag if you want the search engines to follow and index the page. However, an article at Search Engine World (searchengineworld.com/metatag/robots.htm) suggests that Inktomi does not use this as their default setting. Instead, they use the "index, nofollow" tag.

    Better safe than sorry!

    There has been much debate over whether or not it is necessary to use this tag. If there is even a slight possibility that some search engines do not use this as the default setting, then it would only make sense to include this tag if you want your page included in their search directory AND your links to be followed. Do the research and decide for yourself.

    2. (meta name="robots" content="noindex,follow")

    This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links.

    3. (meta name="robots" content="index,nofollow")

    This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed.

    4. (meta name="robots" content="noindex,nofollow")

    When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either.

    Where does the "robots" tag belong?

    The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this:

    (html)
    (head)
    (title)Title of your page goes here(/title)
    (meta name="keywords" content="word1,word2,word3,word4")
    (meta name="description" content="A brief description of the content of this page.")
    (meta name="robots" content="index,follow")
    (/head)
    (body)
    Your webpage information here.
    (/body)
    (/html)

    More Robots Tags

    Google automatically archives a page as it crawls it. This is called a "cached" version of the page. Visitors can retrieve the archived version of the page by clicking on the "cached" link within Google's search results. If you do not want your content to be archived, you can use the following tag:

    (meta name="robots" content="noarchive")

    *This will only prevent your page from being "cached". If you do not want your page to be indexed at all, you will still need to include the "noindex" tag.

    Another alternative to the above tag is the tag that specifically addresses Google only. If you want other search engine robots to archive your site, but you would like to prevent Google from doing so, then you can use the following tag:

    (meta name="googlebot" content="noarchive")

    The Misuse of Robots Tags

    Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary.

    Another silly little tag--- The "Revisit-After" Tag

    (meta name="revisit-after" content="90 days")
    (meta name="revisit-after" content="15 days")

    I'm not sure wher

    Internet Advertising: Understand the Playing Field
    Many Websites, offering advertising solutions, will promise the world, wittingly hiding their true agenda. Internet advertising veterans are familiar with which methods work and which are offered for ulterior motives. However, this comes from experience and, in many cases, moderate expense. Advertising on the internet is still evolving. New ideas are born, and old ones die, almost daily. Because of this, novel advertisers should familiarize themselves with forms of advertising offered before pursuing the solution.Pixel AdvertisingThis is a new craze, often referred to as, “Million Dollar Page Advertising”. To summarize, this is a Web-page displaying a large grid. Businesses can purchase pixels, or squares, of the grid. Generally, each pixel cost one dollar. Within the pixels purchased, the business c
    decide for yourself.

    2. (meta name="robots" content="noindex,follow")

    This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links.

    3. (meta name="robots" content="index,nofollow")

    This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed.

    4. (meta name="robots" content="noindex,nofollow")

    When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either.

    Where does the "robots" tag belong?

    The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this:

    (html)
    (head)
    (title)Title of your page goes here(/title)
    (meta name="keywords" content="word1,word2,word3,word4")
    (meta name="description" content="A brief description of the content of this page.")
    (meta name="robots" content="index,follow")
    (/head)
    (body)
    Your webpage information here.
    (/body)
    (/html)

    More Robots Tags

    Google automatically archives a page as it crawls it. This is called a "cached" version of the page. Visitors can retrieve the archived version of the page by clicking on the "cached" link within Google's search results. If you do not want your content to be archived, you can use the following tag:

    (meta name="robots" content="noarchive")

    *This will only prevent your page from being "cached". If you do not want your page to be indexed at all, you will still need to include the "noindex" tag.

    Another alternative to the above tag is the tag that specifically addresses Google only. If you want other search engine robots to archive your site, but you would like to prevent Google from doing so, then you can use the following tag:

    (meta name="googlebot" content="noarchive")

    The Misuse of Robots Tags

    Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary.

    Another silly little tag--- The "Revisit-After" Tag

    (meta name="revisit-after" content="90 days")
    (meta name="revisit-after" content="15 days")

    I'm not sure wher

    The Secret To Getting Indexed In Hours By All The Major Search Engines
    For all of us who make a living from internet marketing, driving traffic to our sites is one of the most important activities we do on a daily basis. There are some definite steps that can be taken to speed up the process of getting indexed as well as proper domain name registration. I am going to give a quick outline here on how to go about this step by step using the latest tactics to your site indexed in hours instead of weeks.The first thing that you have to do is be sure that you have a viable domain name; by viable I mean one that will make you money. It’s cool to have your own name as a domain and I recommend that everyone do it, but that isn’t generally going to make you money unless your name happens to be Bill Gates or Warren Buffet. It is absolutely crucial to choose domain names that contain the keywor
    re located at the top of the html coding. It will look something like this:

    (html)
    (head)
    (title)Title of your page goes here(/title)
    (meta name="keywords" content="word1,word2,word3,word4")
    (meta name="description" content="A brief description of the content of this page.")
    (meta name="robots" content="index,follow")
    (/head)
    (body)
    Your webpage information here.
    (/body)
    (/html)

    More Robots Tags

    Google automatically archives a page as it crawls it. This is called a "cached" version of the page. Visitors can retrieve the archived version of the page by clicking on the "cached" link within Google's search results. If you do not want your content to be archived, you can use the following tag:

    (meta name="robots" content="noarchive")

    *This will only prevent your page from being "cached". If you do not want your page to be indexed at all, you will still need to include the "noindex" tag.

    Another alternative to the above tag is the tag that specifically addresses Google only. If you want other search engine robots to archive your site, but you would like to prevent Google from doing so, then you can use the following tag:

    (meta name="googlebot" content="noarchive")

    The Misuse of Robots Tags

    Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary.

    Another silly little tag--- The "Revisit-After" Tag

    (meta name="revisit-after" content="90 days")
    (meta name="revisit-after" content="15 days")

    I'm not sure wher

    Seven Steps to Starting Your Internet Business
    There is no reason to be afraid of creating an online business. It is a very easy process if you take it one step at a time. Let’s make the assumption you aren’t going to quit your day job (not yet, anyway). So how do you get started working part-time only?Think of this as a step-by-step process.Step 1. Forget the website for now!Many people believe they have to start an online business with a website. This is wrong and a dangerous mistake. Why? Websites (particularly for a novice) can take a lot of time and money to create. Why start there when you aren’t even certain you can make this work? Let’s start easier.You “think” you want an online business. Let’s start by spending maybe $20. Sound ok?Go to your closet or garage. Find four or five things to sell and list them on eBay. It’s ver
    ould like to prevent Google from doing so, then you can use the following tag:

    (meta name="googlebot" content="noarchive")

    The Misuse of Robots Tags

    Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary.

    Another silly little tag--- The "Revisit-After" Tag

    (meta name="revisit-after" content="90 days")
    (meta name="revisit-after" content="15 days")

    I'm not sure where this myth was started. Today, you will find this tag all over the Internet. Webmasters have even promoted it, claiming that it actually works. Are we so naive to believe the search engine spiders need to know when to come back? I have never used this tag, and my site has no problem with being crawled on a regular basis. Even some SEO (search engine optimization) sites are claiming its value. This comes back to the importance of researching the topic thoroughly first. My research came from some interesting information on WebmasterWorld.

    It is important to examine the correct usage of the "robots" tag before applying it to your website. Incorrect usage of tags could result in spidering errors that cause robots to completely ignore the page all together. If you are interested in learning more about web robots, this great little site will provide you with the information you need to use them effectively: www.robotstxt.org/wc/robots.html

    HTTP = HTML link (for blogs, profiles,phorums):
    <a href="http://www.articledump.net/article/87666/articledump-Effectively-Using-Robots-Meta-Tags.html">Effectively Using Robots Meta Tags</a>

    BB link (for phorums):
    [url=http://www.articledump.net/article/87666/articledump-Effectively-Using-Robots-Meta-Tags.html]Effectively Using Robots Meta Tags[/url]

    Related Articles:

    Get The Sale By Not Over-Selling

    The Striking Power Of Giving A Free Copy To Your JV Partners!

    How To Cut Your eBay Fees By More Than 90%

    Bookmark it: del.icio.us digg.com reddit.com netvouz.com google.com yahoo.com technorati.com furl.net bloglines.com socialdust.com ma.gnolia.com newsvine.com slashdot.org simpy.com shadows.com blinklist.com