Blocking robot access to certain directories and file types is an industry standard practice. The primary means for this is the robots.txt file. Compliance with the standard is the norm, although it is voluntary.  Robots.txt is an ASCII text file located in the website root.  It can be lengthy, but it is typically short and simple. Here is a brief blurb on this.  You don't need to be an NSA hacker to view or edit this file. There is nothing mysterious about it.

This is the robots.txt file for this forum. Notice that only the Alexabot robot is disallowed from indexing PrintTopic. All other robots are free to do as they wish. Notice also that no asterisks are used in the Alexabot PrintTopic exclusion. It might be more effective if it was written as described in the above Moz blurb.
:doze:


"Less clicks good, more clicks bad."

Thanks for the feedback. This has been passed on to our web team.


                                                                

Peter
Forum Administrator

www.reallusion.com