Websites

<p>Anybody knows what robots.txt is?</p>

<p>a text file about robots???</p>

<p>I believe it blocks search engines from indexing your page.</p>

<p>Does anybody know how to gain access to files blocked by robots.txt?</p>

<p><a href=“http://www.robotstxt.org/wc/robots.html[/url]”>http://www.robotstxt.org/wc/robots.html&lt;/a&gt;&lt;/p&gt;

<p>Can somebody answer my question?</p>

<p>Anybody???</p>