403 Forbidden

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

403 Forbidden

Post by KloWn » Tue Mar 08, 2016 5:28 pm

I'm trying to rip a pay-site so I don't have to navigate their clunky website every time I want to view the content, but I cannot seem to find a way to authenticate the downloads in BlackWidow. I log into the members area and when I scan the whole site it scans all of the front page stuff that anyone can download and throws a 403 forbidden error for anything restricted in the members area.

Any help with this issue is, as always, much appreciated!

Regards,
KloWn

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support » Tue Mar 08, 2016 6:13 pm

Hi,

I think what happen is that it also scan the logout link, logging you out in the process! You should include that link in the filters not to scan it and this should take care of the download.
Your support team.
http://SoftByteLabs.com

KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

Re: 403 Forbidden

Post by KloWn » Tue Mar 08, 2016 7:33 pm

Thanks, I'm not entirely sure how to do it. When I enter the url into the filters page it still returns 403 forbidden...

Any ideas what I may be doing wrong? :?

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support » Tue Mar 08, 2016 8:31 pm

Do not enter the whole URL, just the file name, something like logout.php or signout.html and select to add the filter as plain text. If it still not working, click on copy settings and send it to me so I can take a look.
Your support team.
http://SoftByteLabs.com

KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

Re: 403 Forbidden

Post by KloWn » Wed Mar 09, 2016 1:38 pm

All I was able to find from the logout button was "/members/logout/" which I tried to no avail.

No .html or .php... :?

Code: Select all

[BlackWidow v6.00 filters]
URL = https://www.czechav.com/members/
[ ] Expert mode
[x] Scan everything
[ ] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page: 
Browser user agent: Mozilla/4.0 (compatible; MSIE 7.0; BlackWidow v6 - http://SoftByteLabs.com)
Startup referrer: 
[x] Slow down by 10:10 seconds
10 threads
[x] Do not follow /members/logout/ using regular expression
[end]

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support » Wed Mar 09, 2016 2:49 pm

Can you provide me with a temp login? I really don't know what to suggest next because I can't try it myself. If you can, PM me instead of posting it here.
Your support team.
http://SoftByteLabs.com

KloWn
Posts: 5
Joined: Mon May 04, 2015 1:11 pm

Re: 403 Forbidden

Post by KloWn » Wed Mar 09, 2016 6:07 pm

Support wrote:Can you provide me with a temp login? I really don't know what to suggest next because I can't try it myself. If you can, PM me instead of posting it here.
Done! ;)

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: 403 Forbidden

Post by Support » Thu Mar 10, 2016 12:24 am

ok got it, I'll follow up via the PM...
Your support team.
http://SoftByteLabs.com

Post Reply