Website filters

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply

User avatar
Support
Site Admin
Posts: 1879
Joined: Sun Oct 02, 2011 10:49 am

Re: Website filters

Post by Support »

Here are the filters for each one. Copy any one block of text and in the Filters window, click on the "Paste Settings" button, then login via the Browser and start the scan...

Code: Select all

[BlackWidow v6.00 filters]
URL = http://members.brittanysbod.com/
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page:
Startup referrer:
[ ] Slow down by 10:60 seconds
4 threads
[x] Follow /content\.php\?show=galleries&section=835$ using regular expression
[x] Follow /content\.php\?show=videos&section=831$ using regular expression
[x] Follow /content\.php\?show=galleries&section=835&page=\d+$ using regular expression
[x] Follow /content\.php\?show=videos&section=831&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=835$ using regular expression
[x] Follow /content\.php\?show=videos&videoset=\d+&section=831$ using regular expression
[x] Add \.(zip|rar|wmv|avi|mov|mp4)$ from URL using regular expression
[end]

Code: Select all

[BlackWidow v6.00 filters]
URL = http://members.arielrebel.com/index.php
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page:
Startup referrer:
[ ] Slow down by 10:60 seconds
4 threads
[x] Follow /content\.php\?show=galleries&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=285$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=285&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries$ using regular expression
[x] Follow /content\.php\?show=videos&section=216$ using regular expression
[x] Follow /content\.php\?show=videos&section=216&page=\d+$ using regular expression
[x] Follow /content\.php\?show=videos&videoset=\d+&section=216$ using regular expression
[x] Add \.(-lg\.jpg|zip|rar|wmv|avi|mov|mp4)$ from URL using regular expression
[end]

Code: Select all

[BlackWidow v6.00 filters]
URL = http://members.baileykline.com/index.php
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page:
Startup referrer:
[ ] Slow down by 10:60 seconds
4 threads
[x] Follow /content\.php\?show=videos$ using regular expression
[x] Follow /content\.php\?show=videos&section=\d+$ using regular expression
[x] Follow /content\.php\?show=videos&videoset=\d+&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=\d+&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=\d+&image=\d+$ using regular expression
[x] Add \.(-lg\.jpg|zip|rar|wmv|avi|mov|mp4)$ from URL using regular expression
[end]

Code: Select all

[BlackWidow v6.00 filters]
URL = http://members.andipink.com/index.php
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page:
Startup referrer:
[ ] Slow down by 10:60 seconds
4 threads
[x] Follow /content\.php\?show=videos$ using regular expression
[x] Follow /content\.php\?show=videos&section=\d+$ using regular expression
[x] Follow /content\.php\?show=videos&videoset=\d+&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries$ using regular expression
[x] Follow /content\.php\?show=galleries&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=\d+$ using regular expression
[x] Add \.(zip|rar|wmv|avi|mov|mp4)$ from URL using regular expression
[end]

Code: Select all

[BlackWidow v6.00 filters]
URL = http://members.bftgirls.com/index.php
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page:
Startup referrer:
[ ] Slow down by 10:60 seconds
4 threads
[x] Follow /content\.php\?show=videos$ using regular expression
[x] Follow /content\.php\?show=videos&section=\d+$ using regular expression
[x] Follow /content\.php\?show=videos&videoset=\d+&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries$ using regular expression
[x] Follow /content\.php\?show=galleries&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=\d+$ using regular expression
[x] Add \.(zip|rar|wmv|avi|mov|mp4)$ from URL using regular expression
[end]

Code: Select all

[BlackWidow v6.00 filters]
URL = http://freehostedpics.com/85x1/members/index.html
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[x] Scan external links
[ ] Only verify external links
External depth: 0
Default index page:
Startup referrer:
[ ] Slow down by 10:60 seconds
4 threads
[x] Follow /content\.php\?show=videos$ using regular expression
[x] Follow /content\.php\?show=videos&section=\d+$ using regular expression
[x] Follow /content\.php\?show=videos&videoset=\d+&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries$ using regular expression
[x] Follow /content\.php\?show=galleries&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&section=\d+&page=\d+$ using regular expression
[x] Follow /content\.php\?show=galleries&gallery=\d+&section=\d+$ using regular expression
[x] Add \.(zip|rar|wmv|avi|mov|mp4)$ from URL using regular expression
[end]
Your support team.
http://SoftByteLabs.com

notekwhat
Posts: 5
Joined: Mon Feb 13, 2012 9:44 am

Re: Website filters

Post by notekwhat »

Awesome! Thank you so much!

If I wanted to, can I add/remove file format filters to the 2nd last line?

User avatar
Support
Site Admin
Posts: 1879
Joined: Sun Oct 02, 2011 10:49 am

Re: Website filters

Post by Support »

notekwhat wrote:Awesome! Thank you so much!

If I wanted to, can I add/remove file format filters to the 2nd last line?

Yes, just make sure they are separated by a | character.
Your support team.
http://SoftByteLabs.com

notekwhat
Posts: 5
Joined: Mon Feb 13, 2012 9:44 am

Re: Website filters

Post by notekwhat »

ok so I am using the andipink filter right now, but it's downloading the files as content.php.NJEI825GSEW (random letters and numbers) for each file?
how can I correct this? I want it to save the files as named on the server. It shows up as a proper file name in the structure list. :?

User avatar
Support
Site Admin
Posts: 1879
Joined: Sun Oct 02, 2011 10:49 am

Re: Website filters

Post by Support »

notekwhat wrote:ok so I am using the andipink filter right now, but it's downloading the files as content.php.NJEI825GSEW (random letters and numbers) for each file?
how can I correct this? I want it to save the files as named on the server. It shows up as a proper file name in the structure list. :?
The file name in the URL is a parameter passed to the PHP script, which in turn output back the data of an image/video without a filename. Not much we can do about this, unless you use our BrownRecluse to download the files using a different file name such as decoding the URL and puling the file name from the parameter!
Your support team.
http://SoftByteLabs.com

Post Reply