http://spidr.rubyforge.org/ — Spidr is …

http://spidr.rubyforge.org/
— Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Advertisements