# js 18.4.00: erste Version von robots.txt # alle robots # Doku (alt): http://info.webcrawler.com/mak/projects/robots/robots.html # Doku: http://de.selfhtml.org/diverses/robots.htm # MSN-Bot: http://search.msn.com/docs/siteowner.aspx?t=SEARCH_WEBMASTER_REF_RestrictAccessToSite.htm # js 27.9.07: msnbot alles verbieten User-agent: msnbot/1.0 Disallow: / User-agent: * #mw 6.8.07 11:00 Disallow: /cms/ Disallow: /order/ Disallow: /intern/ Disallow: /cgi-bin/ Disallow: /subito/ Disallow: /iis/ Disallow: /sos/ Disallow: /dkfz/ Disallow: /*.gif$ #mw 6.8.07 11:00 Disallow: /*.png$ Disallow: /*.jpg$