Scrawlr: Are We Being Too Greedy?
...veracode.com/blog/?p=111&foo=1
http://www.veracode.com/blog/?p=111&foo=2
http://www.veracode.com/blog/?p=111&foo=3
Or, does it mean that it will really only crawl 1500 pages total, so if I have the same link 1500 times on the front page, it wont go any further? Either way, for most smaller websites this is probably fine. If you need more...
