# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-agent: * Allow: /$ Allow: /benefits Allow: /community Allow: /landing Allow: /pricing Allow: /privacy Allow: /responsible_disclosure Allow: /security Allow: /sitemap.xml Allow: /stories Allow: /stories/eton_college Allow: /stories/han Allow: /stories/nhl_stenden Allow: /team Disallow: / Sitemap: https://ans.app/sitemap.xml