Page 1 of 1

Date of saved file is today rather than date of file on server

Posted: Sun Jan 26, 2020 10:45 am
by Latro Dektes
Is BW able to save a file with the server date rather than the date downloaded?
Westbyte's IDA implements that option by actually changing the date of the downloaded file to match the original.

Here is a simple example that demonstrates the problem

Code: Select all

[BlackWidow v6.00 filters]
URL = https://www.library.vanderbilt.edu/govt/images/
[ ] Expert mode
[x] Scan everything
[ ] Scan whole site
Local depth: 0
[ ] Scan external links
[ ] Only verify external links
External depth: 0
Default index page: 
Browser user agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.2; WOW64; Trident/7.0; .NET4.0C; .NET4.0E; .NET CLR 2.0.50727; .NET CLR 3.0.30729; .NET CLR 3.5.30729)
Startup referrer: 
[ ] Slow down by 2:4 seconds
4 threads
[end]
Note to newbies: Code Select All; copy; paste the copied settings in BW's Filters tab; Scan; The resulting Structure tab shows the original file date-time. But your downloaded file is dated today.

Re: Date of saved file is today rather than date of file on server

Posted: Fri Feb 14, 2020 4:17 pm
by Latro Dektes
FYI, I realize now that the best way to keep the last-modified-date of the file on the server is to use wget

Re: Date of saved file is today rather than date of file on server

Posted: Fri Feb 14, 2020 4:47 pm
by Support
BW does save the date returned by the server. However, if the file is auto-generated via a script like PHP then the date will be the time of the download.