403 Forbidden

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

403 Forbidden

Post by KloWn »

I'm trying to rip a pay-site so I don't have to navigate their clunky website every time I want to view the content, but I cannot seem to find a way to authenticate the downloads in BlackWidow. I log into the members area and when I scan the whole site it scans all of the front page stuff that anyone can download and throws a 403 forbidden error for anything restricted in the members area.

Any help with this issue is, as always, much appreciated!

Regards,
KloWn

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support »

Hi,

I think what happen is that it also scan the logout link, logging you out in the process! You should include that link in the filters not to scan it and this should take care of the download.
Your support team.
http://SoftByteLabs.com

KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

Re: 403 Forbidden

Post by KloWn »

Thanks, I'm not entirely sure how to do it. When I enter the url into the filters page it still returns 403 forbidden...

Any ideas what I may be doing wrong? :?

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support »

Do not enter the whole URL, just the file name, something like logout.php or signout.html and select to add the filter as plain text. If it still not working, click on copy settings and send it to me so I can take a look.
Your support team.
http://SoftByteLabs.com

KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

Re: 403 Forbidden

Post by KloWn »

All I was able to find from the logout button was "/members/logout/" which I tried to no avail.

No .html or .php... :?

Code: Select all

[BlackWidow v6.00 filters]
URL = https://www.czechav.com/members/
[ ] Expert mode
[x] Scan everything
[ ] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page: 
Browser user agent: Mozilla/4.0 (compatible; MSIE 7.0; BlackWidow v6 - http://SoftByteLabs.com)
Startup referrer: 
[x] Slow down by 10:10 seconds
10 threads
[x] Do not follow /members/logout/ using regular expression
[end]

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support »

Can you provide me with a temp login? I really don't know what to suggest next because I can't try it myself. If you can, PM me instead of posting it here.
Your support team.
http://SoftByteLabs.com

KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

Re: 403 Forbidden

Post by KloWn »

Support wrote:Can you provide me with a temp login? I really don't know what to suggest next because I can't try it myself. If you can, PM me instead of posting it here.
Done! ;)

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support »

ok got it, I'll follow up via the PM...
Your support team.
http://SoftByteLabs.com

Post Reply