Sitemap: https://www.lehmann.cx/sitemap.xml.gz Sitemap: https://www.lehmann.cx/blog/sitemap.xml # some kind of crawling issue, sorry User-Agent: PetalBot Disallow: /wiki/ # overeager bots go through the whole history, no point User-Agent: * Disallow: /wiki/*? # why lib? there is nothing relevant in there User-Agent: * Disallow: /wiki/lib/ # anything else should be ok User-Agent: * Allow: /