# robots.txt for http://www.identitaetsfinder.de/ User-agent: * Disallow: /web-content Disallow: /web-data Disallow: /web-setings Disallow: /test