User-agent: Googlebot # Below CommonPart Disallow: /amabook/ Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi Disallow: /ms/lock/ Disallow: /ms/log/ Disallow: /ms/pl/ Disallow: /ms/html/ Disallow: /ms/template/ Disallow: /msfun/lock/ Disallow: /msfun/log/ Disallow: /msfun/pl/ Disallow: /msfun/html/ Disallow: /msfun/template/ Disallow: /rss/ User-Agent: Slurp ## Disallow: /amabook/ore403/ Disallow: /amabook/ore404/ ## Disallow: /amabook/ore405/ Disallow: /amabook/ore406/ # Google test Disallow: /good/ # Google test # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi Disallow: /ms/lock/ Disallow: /ms/log/ Disallow: /ms/pl/ Disallow: /ms/html/ Disallow: /ms/template/ Disallow: /msfun/lock/ Disallow: /msfun/log/ Disallow: /msfun/pl/ Disallow: /msfun/html/ Disallow: /msfun/template/ Disallow: /rss/ User-agent: Baiduspider crawl-delay:120 Disallow: /ms/ Disallow: /msfun/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog/ Disallow: /anlog2/ Disallow: /anlog3/ Disallow: /anlog4/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: /rss/ User-agent: Yeti crawl-delay:120 Disallow: /ms/ Disallow: /msfun/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog/ Disallow: /anlog2/ Disallow: /anlog3/ Disallow: /anlog4/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: /rss/ User-agent: * # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi Disallow: /ms/lock/ Disallow: /ms/log/ Disallow: /ms/pl/ Disallow: /ms/html/ Disallow: /ms/template/ Disallow: /msfun/lock/ Disallow: /msfun/log/ Disallow: /msfun/pl/ Disallow: /msfun/html/ Disallow: /msfun/template/ Disallow: /rss/