# Allow sonysitesearch-bot User-agent: sonysitesearch-bot Disallow: # Allow gsa-crawler User-agent: gsa-crawler Disallow: # Allow ConceptBaseHTTP User-agent: ConceptBaseHTTP allow: / # Allow Kabayaki Enterprise Search User-agent: kabayaki_search allow: / # Disallow other robots User-agent: * Disallow: /