Navicrawlerrecommended by the médialab
a Firefox extension allowing to build a web corpus then export the hyperlinks network between the visited webpages
Tools – Software
Navicrawler is a web crawler that relies on human navigation of the web: whenever it's started, it records all visited web pages as well as all links found within them. It allows also to categorize websites then export the network of aggregated hyperlinks between these websites, so that it can be explored for instance within Gephi.
Navicrawler was built as an extension of the Firefox webbrowser under version 3.5.1. It is therefore not usable as such anymore with modern webbrowsers, although a version of Firefox 3.5.1 is hosted within the project's GitHub page.
harvesting and curation