# robots.txt fuer http://www.peter-it.de/ User-agent: * Disallow: /yay/ Disallow: /ark/ Disallow: /stuff/ Disallow: /tanja/ Disallow: /www/tanja-/ Disallow: /www/tanja/ Disallow: /www/tanja/about%20me.htm Disallow: /www/anderes/ Disallow: /www/tanja/about me.htm Disallow: /www/klasse/main-kontakt.htm Disallow: /www/fs_seiten/tjoji-new-about.htm # Massendownloader vom CGI Verzeichnis fernhalten User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy