# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:

User-agent: *
Disallow: /profile
Disallow: /event/*

Disallow: /topics/*?
Disallow: /topics/page/*
Disallow: /topics/category/*
Disallow: /topics/*/amp/*

Sitemap: https://www.scaler.com/sitemap.xml.gz