# This instruction file is used to test various trees # By default it is in $HOME/.momspider-instruct # run momspider with: momspider [ -i instruct.txt ] # These can be excluded if they are to default to $HOME/.momspider-avoid # and $HOME/.momspider-sites # # AvoidFile /home/clarke/.momspider-avoid # SitesFile /home/clarke/.momspider-sites # How often(days) to check the /robots.txt file on sites. default is 15 # SitesCheck 7 # We can have multiple trees. It is more efficient than seperate instruction # files. If you would like your links checked regularly, please send a note # to webmaster@fortnet.org with your instruction file rather than doing it # yourself.