Date of saved file is today rather than date of file on server

BlackWidow scans websites (it's a site ripper). It can download an entire website, or download portions of a site.
Post Reply
Latro Dektes
Posts: 6
Joined: Sun Mar 23, 2014 5:46 pm

Date of saved file is today rather than date of file on server

Post by Latro Dektes »

Is BW able to save a file with the server date rather than the date downloaded?
Westbyte's IDA implements that option by actually changing the date of the downloaded file to match the original.

Here is a simple example that demonstrates the problem

Code: Select all

[BlackWidow v6.00 filters]
URL = https://www.library.vanderbilt.edu/govt/images/
[ ] Expert mode
[x] Scan everything
[ ] Scan whole site
Local depth: 0
[ ] Scan external links
[ ] Only verify external links
External depth: 0
Default index page: 
Browser user agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.2; WOW64; Trident/7.0; .NET4.0C; .NET4.0E; .NET CLR 2.0.50727; .NET CLR 3.0.30729; .NET CLR 3.5.30729)
Startup referrer: 
[ ] Slow down by 2:4 seconds
4 threads
[end]
Note to newbies: Code Select All; copy; paste the copied settings in BW's Filters tab; Scan; The resulting Structure tab shows the original file date-time. But your downloaded file is dated today.

Latro Dektes
Posts: 6
Joined: Sun Mar 23, 2014 5:46 pm

Re: Date of saved file is today rather than date of file on server

Post by Latro Dektes »

FYI, I realize now that the best way to keep the last-modified-date of the file on the server is to use wget

User avatar
Support
Site Admin
Posts: 1896
Joined: Sun Oct 02, 2011 10:49 am

Re: Date of saved file is today rather than date of file on server

Post by Support »

BW does save the date returned by the server. However, if the file is auto-generated via a script like PHP then the date will be the time of the download.
Your support team.
http://SoftByteLabs.com

Post Reply