http://mars.merhot.dk/w/index.php?action=history&feed=atom&title=Robots.txt 2026-05-15T00:01:48Z Revision history for this page on the wiki MediaWiki 1.29.0 http://mars.merhot.dk/w/index.php?title=Robots.txt&diff=20880&oldid=prev 2012-01-11T08:28:44Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class='diff-marker' /> <col class='diff-content' /> <col class='diff-marker' /> <col class='diff-content' /> <tr style='vertical-align: top;' lang='en'> <td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td> <td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 08:28, 11 January 2012</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l1" >Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td></tr> <tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>Robots.txt is a file you can put in the root folder of your homepage. In this file you can tell <del class="diffchange diffchange-inline">WEB </del>robots (crawlers) like <del class="diffchange diffchange-inline">Goggle </del>bot which folders or homepages you <del class="diffchange diffchange-inline">done </del>want indexed. &#160;</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>Robots.txt is a file you can put in the root folder of your homepage. In this file you can tell <ins class="diffchange diffchange-inline">Web </ins>robots (crawlers) like <ins class="diffchange diffchange-inline">Google </ins>bot which folders or homepages you <ins class="diffchange diffchange-inline">don't </ins>want indexed. &#160;</div></td></tr> <tr><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr> <tr><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>robots.txt on [http://mars.tekkom.dk mars.tekkom.dk]</div></td><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>robots.txt on [http://mars.tekkom.dk mars.tekkom.dk]</div></td></tr> </table>

Pasa http://mars.merhot.dk/w/index.php?title=Robots.txt&diff=5614&oldid=prev 2009-05-11T05:09:20Z

<p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class='diff-marker' /> <col class='diff-content' /> <col class='diff-marker' /> <col class='diff-content' /> <tr style='vertical-align: top;' lang='en'> <td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td> <td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 05:09, 11 May 2009</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l13" >Line 13:</td> <td colspan="2" class="diff-lineno">Line 13:</td></tr> <tr><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>*[http://www.google.com/support/webmasters/bin/answer.py?answer=40360 Google - Creating a robots.txt]</div></td><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>*[http://www.google.com/support/webmasters/bin/answer.py?answer=40360 Google - Creating a robots.txt]</div></td></tr> <tr><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>*[http://www.thomas-rosenstand.dk/sadan-bruger-du-robotstxt/ sådan bruger du robots.txt]</div></td><td class='diff-marker'>&#160;</td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>*[http://www.thomas-rosenstand.dk/sadan-bruger-du-robotstxt/ sådan bruger du robots.txt]</div></td></tr> <tr><td colspan="2">&#160;</td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">[[Category:Programming]]</ins></div></td></tr> </table>

Heth http://mars.merhot.dk/w/index.php?title=Robots.txt&diff=5613&oldid=prev 2009-05-11T05:06:18Z

<p>New page: Robots.txt is a file you can put in the root folder of your homepage. In this file you can tell WEB robots (crawlers) like Goggle bot which folders or homepages you done want indexed. ro...</p> <p><b>New page</b></p><div>Robots.txt is a file you can put in the root folder of your homepage. In this file you can tell WEB robots (crawlers) like Goggle bot which folders or homepages you done want indexed. <br /> <br /> robots.txt on [http://mars.tekkom.dk mars.tekkom.dk]<br /> &lt;pre&gt;<br /> User-agent: *<br /> Disallow: /cisco/<br /> Disallow: /sw/<br /> Disallow: /TCExam/<br /> Disallow: /fs/<br /> &lt;/pre&gt;<br /> = Links =<br /> *[http://www.robotstxt.org/ robotstxt.org]<br /> *[http://www.google.com/support/webmasters/bin/answer.py?answer=40360 Google - Creating a robots.txt]<br /> *[http://www.thomas-rosenstand.dk/sadan-bruger-du-robotstxt/ sådan bruger du robots.txt]</div>

Heth