User-agent: * Disallow: /jmdictdb/cgi-bin/ Disallow: /cgi-bin/ Disallow: /~ssb/cgi-bin/ Disallow: /~jwb/cgi-bin/ Disallow: /~smg/cgi-bin/ Disallow: /jmwsgi/ user-agent: AhrefsBot User-agent: AHC/1.0 User-agent: Alexibot User-agent: Amazonbot User-agent: AspiegelBot User-agent: barkrowler User-agent: Baiduspider User-agent: baiduspider User-Agent: bingbot User-agent: BLEXBot User-agent: Bleriot User-agent: BUbiNG User-agent: Bytespider User-agent: ChatGPT-User/1.0 User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: dotbot User-agent: facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) User-agent: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) User-agent: facebookexternalhit/1.1 User-agent: FemtosearchBot User-agent: GPTBot User-agent: MJ12Bot User-agent: MauiBot User-agent: MegaIndex User-agent: MJ12bot User-Agent: panscient.com User-agent: qwantbot User-agent: Qwantify User-agent: rogerbot User-agent: Seekport Crawler User-agent: SemrushBot User-agent: SurveyBot User-agent: sogou spider User-agent: SemanticScholarBot User-agent: SpiderLing User-agent: SeekportBot User-Agent: The Knowledge AI User-agent: Xenu's User-agent: Xenu's Link Sleuth 1.1c User-agent: Yandex User-agent: ZoominfoBot User-agent: AliyunSecBot User-agent: Aliyun User-agent: TerraCotta Disallow: /