Feature suggestion thread

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
Posts: 43
Joined: Fri Mar 16, 2012 11:31 am

Feature suggestion thread

Post by avalanch »

Have an idea for a new feature for blackwidow, please keep them all in this thread thanks!

I think a good option to be added (from httrack) would be a option to follow robots.txt rules or not.
*Detection of if the scan is crashing the site's server or not & proper slowdowns applied if this is the case.

User avatar
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Feature suggestion thread

Post by Support »

ok we'll add it to the wish list for the nest update. Thanks.
Your support team.

Post Reply