User-agent: * Disallow: /news0815/ User-agent: googlebot Disallow: /news0815/ User-agent: slurp Disallow: /news0815/ # Adsense Crawler darf alles ;-) User-agent: Mediapartners-Google* Disallow: User-agent: * Disallow: /impressum/ Disallow: /wp- Disallow: /search Disallow: /feed Disallow: /tag/$ Disallow: /comments/feed Disallow: /feed/$ Disallow: /*.pdf$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /*/*/feed/$ Disallow: /*/*/feed/rss/$ Disallow: /*/*/trackback/$ Disallow: /*/*/*/feed/$ Disallow: /*/*/*/feed/rss/$ Disallow: /*/*/*/trackback/$