用户工具

站点工具


web:crawler

crawl

demo

[{"descr":"车次信息","name":"train"}
,{"name":"pdnovel","descr":"小阅读"}
,{"name":"mzitu","descr":"妹子图"}]

pdnovel

pdnovel:小阅读获取

[{"descr":"获取分页","level":"1","name":"page","url":"http://bbs.xlongwei.com/pdnovel.php?mod=list"}
,{"descr":"获取书籍","level":"2","name":"novel","url":"http://bbs.xlongwei.com/pdnovel.php?mod=list"}
,{"descr":"获取章节","level":"3","name":"chapter","url":"http://bbs.xlongwei.com/pdnovel.php?mod=chapter&novelid=48"}
,{"descr":"获取内容","level":"4","name":"content","url":"http://bbs.xlongwei.com/pdnovel.php?mod=read&novelid=48&chapterid=15435"}]

trains

trains:车次信息获取

[{"level":"1","name":"train","descr":"获取省份链接","url":"http://qq.ip138.com/train/"}
,{"level":"2","name":"province","descr":"获取城市链接","url":"http://qq.ip138.com/train/anhui/"}
,{"level":"3","name":"city","descr":"获取车次链接","url":"http://qq.ip138.com/train/anhui/AnQing.htm"}
,{"level":"4","name":"line","descr":"获取站台信息","url":"http://qq.ip138.com/train/D5601.htm"}]

mzitu

mzitu:图片网址获取

[{"level":"1","name":"page","descr":"获取所有页码","url":"http://www.mzitu.com/"}
,{"level":"2","name":"img","descr":"获取单页图片","url":"https://www.mzitu.com/page/2/"}
,{"level":"3","name":"page2","descr":"获取大图分页","url":"https://www.mzitu.com/181419/"}
,{"level":"4","name":"img2","descr":"获取大图链接","url":"https://www.mzitu.com/181419/50"}]
web/crawler.txt · 最后更改: 2020/03/15 16:56 由 admin