Download Image From Forum

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
MSIII
Posts: 2
Joined: Thu Sep 10, 2015 10:24 am

Download Image From Forum

Post by MSIII » Thu Sep 10, 2015 10:49 am

I'm trying to download images from:

http://vipergirls.to/threads/173825-Dit ... ese/Page17

Some of the images are at img.yt. They are behind a "Continue to Image" button, but from the "Page Source" info and experimentation I can see that the thumbnail image pulled to vipergirls has most of the information:

e.g. : http://img.yt/upload/small/2015/03/26/5513e03530f99.jpg

Other images are at http://imgstudio.org/upload/small/2015/ ... 24f9b2.jpg

For both the "small" just needs to be changed to "big".

Here is the last (of many variations) of what I've tried:

[Blackwidow v6.00 filters]
URL = http://vipergirls.to/threads/173825-Dit ... ese/Page17
[ ] Expert mode
[ ] Scan everything
[ ] Scan whole site
Local depth: 0
[X] Scan external links
[ ] Only verify external links
External depth: 9
Default index page: index.html
Browser user agent: Mozilla/4.0 (compatible; MSIE 7.0; Blackwidow v6 - http://SoftByteLabs.com)
Startup referrer:
[ ] Slow down by 10:60 seconds
6 threads
[X] Replace upload/small/ with upload/big/ using plain text
[X] Replace img src with a href using plain text
[X] Follow *img.yt/upload/big/*.jpg using wildcard
[X] Add *img.yt/upload/big/*.jpg from URL using wildcard
[end]

I haven't generalized the filters to include both image sites.

I'm not good with regular expressions.

Also, I'd like to make sure it stays with "173825-Dita-Von-Teese", but iterates through the 17 pages, but doesn't go out to the rest of the forum. I just haven't gotten that far yet.

On a side note, if you can do anything about the "imageleon" images that would be great. I can't even figure out how to get to the image "manually". The link for me just brings up a ad/link site.

Thanks in advance for your help.

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: Download Image From Forum

Post by Support » Thu Sep 10, 2015 12:54 pm

The problem here is that the links to the images are only available via a javascript code (Click here to continue to the image) so the links are dynamic, not static. That's the only thing stop a bot from getting to the image!
Your support team.
http://SoftByteLabs.com

MSIII
Posts: 2
Joined: Thu Sep 10, 2015 10:24 am

Re: Download Image From Forum

Post by MSIII » Thu Sep 10, 2015 2:05 pm

But you can get around the PHP by typing:

http://img.yt/upload/big/2015/03/26/5513e03530f99.jpg

using "big" instead of "small" into the browser or download manager. That will retrieve the image. You don't have to go "through" the PHP to get to the image.

How do I get BlackWidow to make that substitution for me?

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: Download Image From Forum

Post by Support » Fri Sep 11, 2015 1:22 am

Yes I know but it's not all of the thumbnails that works that way. In any case, if you want to change any URL that have /small/ in it for /big/ all you have to do is create a new filter (Add rule) and select "Modify Document" and select "Plain text" and enter /small/ in the "Search for:" and enter /big/ in the "Replace with:" and that will do the trick.
Your support team.
http://SoftByteLabs.com

Post Reply