Need help with spider?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

simapple
146 Stars 127 Forks 16 Commits 0 Opened issues

Description

python爬虫 全球网址URL滚动提取

Services available

!
?

Need anything else?

Contributors list

# 291,658
Python
10 commits

spider

python 爬虫

支持python3

版本1 功能简述: 以hao123为入口页面,滚动爬取外链,收集网址,并记录网址上的内链和外链数目,记录title等信息

windows7 32位上测试,目前每24个小时,可收集数据为10万左右

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.