# /robots.txt file User-agent: * Disallow: /search/* Disallow: /WEB-INF/ Disallow: /SearchIt* Disallow: /Webtoolbar*