I've looked at the commands with 'man' but still can't figure it!
Wget is capable of downloading multiple files at once.
Supplied arguments are:
You can tell wget to use the name from the redirected URL instead of http://list.iblocklist.com/?list=bt_level1&fileformat=p2p&archiveformat=gz
by passing the --trust-server-names option.
-P = Directory where all files will be saved to
This would download all files into ~/tmp/tar/blocklist directory
-w = Wait the specified number of seconds between the retrievals
-i = Read URLs from input file
If you got a file with a list of URLs to fetch, then you can simply supply wget with an input file that contains a list of URLs.
wget -i ~/Peer_Blocklist.txt
Where Peer_Blocklist.txt is the file that contains a list of URLs.