Need help with
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

1.8K Stars 149 Forks MIT License 436 Commits 0 Opened issues

Services available


Need anything else?

Contributors list

Note: this library is no longer maintained.

I wrote in 2010 when node.js was still in its infancy and the npm repository didn't have the amazing choice of libraries as it does today.

Since it's now quite trivial to write your own scraper I've decided to stop maintaining the library.

Here's an example using request, cheerio and async.

var request = require('request')
  , cheerio = require('cheerio')
  , async = require('async')
  , format = require('util').format;

var reddits = [ 'programming', 'javascript', 'node' ] , concurrency = 2;

async.eachLimit(reddits, concurrency, function (reddit, next) { var url = format('', reddit); request(url, function (err, response, body) { if (err) throw err; var $ = cheerio.load(body); $('a.title').each(function () { console.log('%s (%s)', $(this).text(), $(this).attr('href')); }); next(); }); });

Happy scraping.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.