Atricle Dump
#1 in Business Subscribe Email Print

You are here: Home > Internet and Businesses Online > Internet Marketing > robots.txt, An Online Marketers Friend or Foe?

Tags

  • might
  • instant
  • search enginesby
  • private membership
  • knowledge about

  • Links

  • Too Much To Do: Four Keys to Effective Delegating
  • Samsung D900 - Slim, Slender and Powerful
  • Do Turnkey Business Websites Work?
  • Atricle Dump - robots.txt, An Online Marketers Friend or Foe?

    The Importance of a Great Cover Letter
    You’ve seen a want ad for a job that seems to be the perfect fit for you. You really want to impress the employer, so you set out to write a cover letter that really sizzles. But, somehow, you can’t seem to find the right words. You’re not certain where the line can be drawn between recogniz
    bviously don't want those pages indexed in search engines.

    By using Robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.

    Robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if y

    Outsourcing Your Customer Support? Points to Consider
    Okay, so you’ve made the controversial and often contentious decision to outsource your customer support operations to an external call center. Before closing this all-important deal, there are a few steps you should take to ensure that your business is getting the quality and flexibility it de
    Robots.txt is possibly the most miss understood file that a website can contain.

    Many people think that by using a Robots.txt file on their website they are protecting pages and folders from thieves and hackers. In fact it is totally the opposite! Robots.txt opens up an enormous security hole that hackers and thieves will use to easily gain access to the parts of your website that you don't want them to.

    What is Robots.txt?

    Robots.txt is a file that you create and upload to your websites root directory that is used by search engine spiders to determine which parts of your website they should index and which folders/pages that you, the website owner, don't want listed in search engine indexes.

    Why would not want pages indexed?

    There are many reasons why you might not want search engines to index pages on your website, such as private membership pages or exclusive training pages and such like.

    If you are an Internet Marketer selling your own ebook or other digital product, you wouldn't want your thank you pages indexed either!

    And this is where the misunderstanding comes to the fore, and Robots.txt becomes your foe.

    Many online marketers who provide ebooks or other digital products for instant download will list their download thank you pages in the Robots.txt file because they obviously don't want those pages indexed in search engines.

    By using Robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.

    Robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if y

    Essential Business Communication of Your Strategic Plan Delivers Ongoing Employee Motivation
    Would you stop watching a national playoff were the teams were tied before the winner was declared? Would you stop watching a horse race before the winning horse crossed the finish line? Of course not! Yet, many business leaders expect their employees to continue the game or the race without k
    o easily gain access to the parts of your website that you don't want them to.

    What is Robots.txt?

    Robots.txt is a file that you create and upload to your websites root directory that is used by search engine spiders to determine which parts of your website they should index and which folders/pages that you, the website owner, don't want listed in search engine indexes.

    Why would not want pages indexed?

    There are many reasons why you might not want search engines to index pages on your website, such as private membership pages or exclusive training pages and such like.

    If you are an Internet Marketer selling your own ebook or other digital product, you wouldn't want your thank you pages indexed either!

    And this is where the misunderstanding comes to the fore, and Robots.txt becomes your foe.

    Many online marketers who provide ebooks or other digital products for instant download will list their download thank you pages in the Robots.txt file because they obviously don't want those pages indexed in search engines.

    By using Robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.

    Robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if y

    Nicely Nicely Thank You
    In Guys and Dolls, there is a character named Nicely Nicely Johnson. Perhaps most memorably portrayed by Stubby Kaye, Nicely Nicely earned his name by always responding to “how are you?” with “nicely nicely thank you.”I am concerned that nice people will soon be placed on the endangered
    er, don't want listed in search engine indexes.

    Why would not want pages indexed?

    There are many reasons why you might not want search engines to index pages on your website, such as private membership pages or exclusive training pages and such like.

    If you are an Internet Marketer selling your own ebook or other digital product, you wouldn't want your thank you pages indexed either!

    And this is where the misunderstanding comes to the fore, and Robots.txt becomes your foe.

    Many online marketers who provide ebooks or other digital products for instant download will list their download thank you pages in the Robots.txt file because they obviously don't want those pages indexed in search engines.

    By using Robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.

    Robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if y

    Tele-selling Training Materials
    When teleselling training material to corporations or midsize businesses it is very important to make sure you are talking to the decision maker. Generally in a large corporation there will be someone who is head of training and they will have things that they need. Since training is the key
    tal product, you wouldn't want your thank you pages indexed either!

    And this is where the misunderstanding comes to the fore, and Robots.txt becomes your foe.

    Many online marketers who provide ebooks or other digital products for instant download will list their download thank you pages in the Robots.txt file because they obviously don't want those pages indexed in search engines.

    By using Robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.

    Robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if y

    eBay Arbitrage: The Best Way to Guaranteed Profits on eBay
    Arbitrage means to buy an item in one market for the purpose of reselling it soon after for profit. Although the concept traditionally means reselling in a separate market to that from which the product was acquired, the term also commonly applies to buying something on eBay with the purpose o
    bviously don't want those pages indexed in search engines.

    By using Robots.txt this way though, you will be opening up your product to anyone who has a slight bit of knowledge about how the file works.

    Robots.txt is easily readable by any human that opens a browser and types in http://www.yourdomain.com/robots.txt and if you have listed your thank you pages, all they have to do is go to that url and take your product(s)!

    It's that easy!

    And I'm living proof that this works, as this is exactly what happened to me. on one of my early websites I had listed my thank you pages in Robots.txt and thought that they were safe from hackers and thieves, then one day I was checking my web site stats and BAM, someone had been to every single thank you page, and taken everything.

    The moral is, don't list any URL in robots.txt that you don't want humans to have free access to. Use robots.txt with great caution and secure your thank you pages using dedicated software.

    HTTP = HTML link (for blogs, profiles,phorums):
    <a href="http://www.articledump.net/article/66892/articledump-robotstxt-An-Online-Marketers-Friend-or-Foe.html">robots.txt, An Online Marketers Friend or Foe?</a>

    BB link (for phorums):
    [url=http://www.articledump.net/article/66892/articledump-robotstxt-An-Online-Marketers-Friend-or-Foe.html]robots.txt, An Online Marketers Friend or Foe?[/url]

    Related Articles:

    Guide to Label Printers

    Managing Risks Of Simultaneous Operations

    LEAN or Six Sigma? Which Should My Business Be Using?

    Bookmark it: del.icio.us digg.com reddit.com netvouz.com google.com yahoo.com technorati.com furl.net bloglines.com socialdust.com ma.gnolia.com newsvine.com slashdot.org simpy.com shadows.com blinklist.com