We regularly batch download files, but recently came across an unusual snag that we can't resolve.
The files online are named like this:
www.sitename.com/report.txt&id=29483
www.sitename.com/report.txt&id=19536
www.sitename.com/report.txt&id=09872
There are many, and each file has a unique five-digit id number.
Batch download programs tend to look at the filename only (in this case "report.txt"), and ignore any extended phrase (one after an ampersand). As such, when we try to download several of the files in question, we end up with report001.txt, report002.txt, report003.txt, ad infinitem.
BUT WE NEED THAT ID NUMBER TO IDENTIFY WHICH FILE IS WHICH.
(In the future, we plan to have the programmers name the files differently. But this is what we have to deal with right now.)
There are two solutions to this problem. We need a batch download program that will:
1) save the entire URL in the resulting filename, OR
2) give you a history afterwards of which filename came from which URL.
I hope this is clear. Appreciate any help! Our project is on hold until we can resolve this.
Edited by Andante, 28 March 2017 - 10:21 PM.