My scripts downloads a list of URLs and saves it to one file. I do some processing on the downloaded content and then move to the next list. This is how I'm downloading the list of URLs using wget:
wget --max-redirect=0 -i $1 -O $2
There are multiples URL in the list that are redirected but I don't want to downloaded the redirected URLs, instead I just want to save that URL to a file. One way to do that is to save the progress of wget to a file and later process it to find which URLs were redirected.
I have tried following but it doesn't work:
wget --max-redirect=0 -i $1 -O $2 > progressfile
Any help?