How to download non-indexed .jpg files ?

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
Morbius
Posts: 2
Joined: Sat Nov 07, 2015 3:27 pm

How to download non-indexed .jpg files ?

Post by Morbius » Sat Nov 07, 2015 3:39 pm

I am a new user of BW (currently testing it) and I have the following issue.

I am trying to scan and download all files of a website, let's say:
"http://www.mywebsite.com"

On this website, I have several folders with .jpg image files. Some of those
image files are indexed, and some are not indexed. By “not indexed”, I
mean that those files cannot be accessed by browsing the website, because
there is no link to them. However, they do exist in the website structure, and I can view them by
pointing my browser at their exact location, which supposes that I know their
presence, their name and in which folder they are.

Let me be more explicit. In the “folder-1” folder of my website, I have
the non-indexed image file “non_indexed_image-1.jpg”. However, since there
is no link to this file in the structure of the website, I can only access
this file and view the image by pointing my browser to the following path:
"http://www.mywebsite.com/folder-1/non_i ... mage-1.jpg"

When scanning my website (using default options), BW seems to capture
all the indexed image files, but none of the non-indexed files (although those
files do exist !).

Is there any way I could capture/record the non-indexed image files too with
BW ?

My apologies if this question has already been answered, but I could not find
anything by doing a “basic” search.

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: How to download non-indexed .jpg files ?

Post by Support » Sun Nov 08, 2015 12:33 am

Hi,

Yes there is a way. You need to use the Expert Script in BW and write a loop to scan for images, for example, from “non_indexed_image-1.jpg" to “non_indexed_image-999.jpg". If you know the naming pattern, it can be done.
Your support team.
http://SoftByteLabs.com

Morbius
Posts: 2
Joined: Sat Nov 07, 2015 3:27 pm

Re: How to download non-indexed .jpg files ?

Post by Morbius » Sun Nov 08, 2015 4:57 am

Support wrote:Hi,

Yes there is a way. You need to use the Expert Script in BW and write a loop to scan for images, for example, from “non_indexed_image-1.jpg" to “non_indexed_image-999.jpg". If you know the naming pattern, it can be done.
Thank you for your answer.

And if I don't know the naming pattern (I only know the folder where these images files <any name> xxxxxxxxxx.jpg could be), can it still be done ?

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: How to download non-indexed .jpg files ?

Post by Support » Sun Nov 08, 2015 11:20 am

Unfortunately no, unless the server allow folder indexing, you can find out by trying it on the browser without the file name, if it works, you'll see all the file, if not, you'll get an error.
Your support team.
http://SoftByteLabs.com

Oddyse
Posts: 1
Joined: Fri Feb 19, 2016 7:30 am

Re: How to download non-indexed .jpg files ?

Post by Oddyse » Sat Feb 20, 2016 5:31 am

Mdorbius wrote:
Support wrote:Hi,

Yes there is a way. You need to use the Expert Script in BW and write a loop to give the 3 week diet a try and scan for images, for example, from “non_indexed_image-1.jpg" to “non_indexed_image-999.jpg". If you know the naming pattern, it can be done.
Thank you for your answer.

And if I don't know the naming pattern (I only know the folder where these images files <any name> xxxxxxxxxx.jpg could be), can it still be done ?
I don't understand how it can find files that aren't being linked to in anyway. I'd like to download all files but doesn't there need to be a link of some sort to the file for it to be found otherwise the file will just be hidden right?
Last edited by Oddyse on Fri Jun 03, 2016 4:01 pm, edited 2 times in total.

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: How to download non-indexed .jpg files ?

Post by Support » Sat Feb 20, 2016 1:49 pm

If folder indexing on the server is turned off, you can't see the files. However, if you know one of the file name and it looks like a sequential name, line pic001.jpg for example, you can assume pic002.jpg must exist, if it does, then you can script BW to scan for pic001.jpg all the way to pic999.jp. Even if these files are not linked anywhere, knowing their names is the same.
Your support team.
http://SoftByteLabs.com

Sharoun
Posts: 1
Joined: Thu Mar 09, 2017 3:24 pm

Re: How to download non-indexed .jpg files ?

Post by Sharoun » Thu Mar 09, 2017 3:27 pm

Morbius wrote:
Sun Nov 08, 2015 4:57 am
Support wrote:Hi,

Yes there is a way. You need to use the Expert Script in BW and write a loop to give the adele weight loss a try scan for images, for example, from “non_indexed_image-1.jpg" to “non_indexed_image-999.jpg". If you know the naming pattern, it can be done.
Thank you for your answer.

And if I don't know the naming pattern (I only know the folder where these images files <any name> xxxxxxxxxx.jpg could be), can it still be done ?
I'd like to download all files but doesn't there need to be a link of some sort to the file for it to be found otherwise the file will just be hidden right?
Last edited by Sharoun on Mon Mar 13, 2017 2:32 pm, edited 1 time in total.

User avatar
Support
Site Admin
Posts: 1679
Joined: Sun Oct 02, 2011 10:49 am

Re: How to download non-indexed .jpg files ?

Post by Support » Thu Mar 09, 2017 3:41 pm

Yes you are correct however, you can also scan for a range of file names in hope to get the hidden ones, for example, scanning pix-001.jpg to pix-999.jpg
Your support team.
http://SoftByteLabs.com

Post Reply