Sandcrawlermade by the médialab

Sandcrawler is a JavaScript library for Node.js exposing many utilities aiming at helping developer to build complex web crawlers and scrapers.

It is somehow artoo.js' older brother on the server side.

For instance, with Sandcrawler, developing crawlers based upon web browser emulation technologies such as PhantomJS is easy and transparent.

However this library is not maintained nor used anymore. It has thus been archived.