1. médialab Sciences Po
  2. Productions
  3. Sandcrawler

Sandcrawlermade by the médialab

JavaScript library for Node.js aiming at helping developers to build complex web crawlers and scrapers

Tools – Code

Guillaume Plique

Sandcrawler is a JavaScript library for Node.js exposing many utilities aiming at helping developer to build complex web crawlers and scrapers.

It is somehow artoo.js' older brother on the server side.

For instance, with Sandcrawler, developing crawlers based upon web browser emulation technologies such as PhantomJS is easy and transparent.

However this library is not maintained nor used anymore. It has thus been archived.