BotBouncerBotBouncer / AI bots / PanguBot
PanguBot
Huawei, a training and dataset crawler
- Operator
- Huawei
- Type
- Model training and datasets
- Sent as a user agent
- Not confirmed
- Follows robots.txt
- Not confirmed
- Details
- Not yet checked against the operator's own documentation
What it does
Listed by many sites as a Huawei crawler. No official documentation was found.
We have not yet checked this page against Huawei's own documentation. Check it before you rely on it.
Block it in robots.txt
User-agent: PanguBot Disallow: /
To allow it again, remove those lines or use Allow: /. Rules for other bots are not affected.
Block it on your server
robots.txt is a request. To enforce the block, filter the user agent on your server.
Nginx
map $http_user_agent $blocked_bot {
default 0;
~*(PanguBot) 1;
}
# inside server { }
if ($blocked_bot) { return 403; }Apache (.htaccess)
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} PanguBot [NC]
RewriteRule ^ - [F,L]Cloudflare custom rule (action: Block)
(lower(http.user_agent) contains "pangubot")
Source
No official documentation link has been confirmed yet.