spider 1.0.1

Web spider framework that can spider a domain and collect pages it visits.
Documentation