# To allow all robots (almost) complete access # members and spamfight are only for email address harvesters (probably they # don't care about robots.txt in any case) User-agent: * Disallow: /members/ Disallow: /members Disallow: /spamfight/ # Weitere Beispiele unter http://www.robotstxt.org/wc/exclusion-admin.html