这个robots.txt User-agent:* Disallow:/plus/ad_js.phpDisallow:/plus/advancedsearch.phpDisallow:/plus/car.phpDisallow:/plus/carbuyaction.phpDisallow:/plus/shops_buyaction.phpDisallow:/plus/erraddsave.phpDisallow:/plus/posttocar.phpDisallow:/plus/disd
来源:学生作业帮助网 编辑:六六作业网 时间:2024/12/23 04:53:45
这个robots.txt User-agent:* Disallow:/plus/ad_js.phpDisallow:/plus/advancedsearch.phpDisallow:/plus/car.phpDisallow:/plus/carbuyaction.phpDisallow:/plus/shops_buyaction.phpDisallow:/plus/erraddsave.phpDisallow:/plus/posttocar.phpDisallow:/plus/disd
这个robots.txt
User-agent:*
Disallow:/plus/ad_js.php
Disallow:/plus/advancedsearch.php
Disallow:/plus/car.php
Disallow:/plus/carbuyaction.php
Disallow:/plus/shops_buyaction.php
Disallow:/plus/erraddsave.php
Disallow:/plus/posttocar.php
Disallow:/plus/disdls.php
Disallow:/plus/feedback_js.php
Disallow:/plus/mytag_js.php
Disallow:/plus/rss.php
Disallow:/plus/search.php
Disallow:/plus/recommend.php
Disallow:/plus/stow.php
Disallow:/plus/count.php
Disallow:/include
Disallow:/templets
这个robots.txt User-agent:* Disallow:/plus/ad_js.phpDisallow:/plus/advancedsearch.phpDisallow:/plus/car.phpDisallow:/plus/carbuyaction.phpDisallow:/plus/shops_buyaction.phpDisallow:/plus/erraddsave.phpDisallow:/plus/posttocar.phpDisallow:/plus/disd
就是禁止抓取这些路径下的文档或文件.robots.txt为搜索引擎提供指引!Disallow为禁止,Allow为允许,User-agent为定义搜索引擎的类型.