Download files

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Download files

Post by tomekvs »

Hi,

I have a quetion how to save all files with books from site http://it-ebooks.info
(it is important to files not change name - have names like in normal downloading - titles).

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

Here is a web file of all the ebooks on that site. Open in in BW6 and in the Structure, look at the SaveAs column, that is the name it will use to save the links.
Attachments
it-ebooks.zip
(83.13 KiB) Downloaded 1988 times
Your support team.
http://SoftByteLabs.com

tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Re: Download files

Post by tomekvs »

Hi,

Thank You for reply.
Have You test if it's working ?
The main problem is that downloading url change on each new session.
For example in one session is

"go.php?id=345-1370307100-20f8b236eb26bad48d6b38ce83e6f883"

and in another session the same keep only
"go.php?id=345-" and everthing after (numbers) change.

So that' not so easy how it looks like.

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

I see what you mean. Than I need to give you a new copy of BlackWidow. Do you run in 64bit or 32bit?
Your support team.
http://SoftByteLabs.com

tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Re: Download files

Post by tomekvs »

In 32bit.

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

ok, here is the 32bit version that will detect the file name from download links. Unzip to your desktop and then move it to the program files folder where BlackWidow was installed. Here are the filters to use to scan that site. Copy the filters and then click on the "Paste Settings" button in the Filters window and start the scan.

Code: Select all

[BlackWidow v6.00 filters]
URL = http://it-ebooks.info/
[ ] Expert mode
[ ] Scan everything
[x] Scan whole site
Local depth: 0
[ ] Scan external links
[ ] Only verify external links
External depth: 0
Default index page: 
Startup referrer: 
[ ] Slow down by 3:3 seconds
4 threads
[x] Follow /book/\d+/$ using regular expression
[x] Follow /go\.php\?id= using regular expression
[x] Add PDF from mime/type using regular expression
[end]
Attachments
BlackWidow.zip
(2.08 MiB) Downloaded 1464 times
Your support team.
http://SoftByteLabs.com

tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Re: Download files

Post by tomekvs »

I am newbie. I can't paste filters (still remain older).
And how it's all resolving problem with sesions dynamic url's or downloading will start when the scan ends ?

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

The text in green in the box, select all of it and copy it. In the Filters window, click on the button "Paste settings".

With this new BlackWidow, scan the site to get all the PDF files and when you download them, they will be saved using the proper file name.
Your support team.
http://SoftByteLabs.com

tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Re: Download files

Post by tomekvs »

I still cant paste filters.
After i click Paste in the panel with Filters ,panel is still empty.

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

This is how your Filters and settings should be for that site...
Attachments
Untitled-1.jpg
Untitled-1.jpg (395.53 KiB) Viewed 23291 times
Your support team.
http://SoftByteLabs.com

tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Re: Download files

Post by tomekvs »

And now in scan, it blink for a second and end with no results.

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

Make sure the URL in the browser is http://it-ebooks.info/ but do not press Enter because it will change.
Your support team.
http://SoftByteLabs.com

tomekvs
Posts: 7
Joined: Mon Jun 03, 2013 4:47 am

Re: Download files

Post by tomekvs »

Thank You very very much for Your help for me.
Program is also great.

User avatar
Support
Site Admin
Posts: 1892
Joined: Sun Oct 02, 2011 10:49 am

Re: Download files

Post by Support »

You are very welcome.
Your support team.
http://SoftByteLabs.com

Post Reply