File tree Expand file tree Collapse file tree 1 file changed +14
-0
lines changed Expand file tree Collapse file tree 1 file changed +14
-0
lines changed Original file line number Diff line number Diff line change 1+ User-agent: AI 2 Bot
2+ User-agent: AmazonBot
3+ User-agent: Applebot
14User-agent: Applebot-Extended
25User-agent: Bytespider
36User-agent: CCBot
7+ User-agent: ChatGPT-User
48User-agent: ClaudeBot
9+ User-agent: cohere-training-data-crawler
510User-agent: Diffbot
11+ User-agent: DuckAssistBot
612User-agent: FacebookBot
713User-agent: Google-Extended
814User-agent: GPTBot
915User-agent: Kangaroo Bot
1016User-agent: Meta-ExternalAgent
17+ User-agent: Meta-ExternalFetcher
18+ User-agent: NovaAct
1119User-agent: omgili
20+ User-agent: Operator
21+ User-agent: OAI-SearchBot
22+ User-agent: PanguBot
23+ User-agent: PerplexityBot
24+ User-agent: Perplexity-User
1225User-agent: Timpibot
1326User-agent: Webzio-Extended
27+ User-agent: YouBot
1428Disallow: /
1529
1630User-agent: *
You can’t perform that action at this time.
0 commit comments