spider 1.0.2

Web spider framework that can spider a domain and collect pages it visits.
Documentation