Need help with sina_reptile?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

gnemoug
472 Stars 299 Forks 9 Commits 1 Opened issues

Description

获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写,多进程爬取,将数据存储在了mongodb中

Services available

!
?

Need anything else?

Contributors list

# 14,051
CSS
Python
Redis
scrapy
9 commits
这是一个关于sina微博的爬虫,采用python开发,并修改了其sdk中的bug,采用mongodb存储,实现了多进程爬取任务。

功能是:获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写,多进程爬取,将数据存储在了
mongodb中

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.