InnovationOwl Technologies

Categories

  • Computer Languages
  • Financial Ratios
  • Financial Terms
  • Financial Theories
  • Information Technology
  • InnovationOwl Terms
  • Leading Indicators
  • Software Algorithms
  • Statistics
  • Technical Indicators
  • Terms & Concepts

  • Internet Robots
  • Robots Exclusion Standard
  • Semantic Web
  • Text Analysis
  • Robots Exclusion Standard

    Also known as:
  • Robots.txt
  • Category: Information Technology

    The Robots Exclusion Protocol is a mechanism by which webmasters can provide information to Internet robots that visit their site. Internet Robots visiting a site can (and should) read the robots.txt file from the root directory to determine what pages they are permitted to view.

    Related links:

  • http://www.robotstxt.org/
  • http://www.searchtools.com/robots/robots-txt.html
  • http://www.searchengineworld.com/robots/robots_tutorial.htm