# See http://www.robotstxt.org for documentation on how to use the robots.txt file Sitemap: https://artworkarchive.com/sitemap.xml.gz User-Agent: * Disallow: /from/ Disallow: /admin/ Disallow: /discovery/artwork/ User-agent: BLEXBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: TwengaBot Disallow: / User-agent: 008 Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: WotBox Disallow: / User-agent: Sosospider Disallow: / User-agent: Baiduspider Disallow: / User-agent: ZumBot Disallow: / User-agent: YandexBot Disallow: /