Revision of How to Download Files From The Web Using Wget [Linux CLI Tips] from Thu, 08/20/2009 - 19:26

In this post: a little about the WGET command:

Download a zip archive:

wget http://website.com/archive.zip

and archive.zip will be downloaded. But we can download files using a lot of parameters. Read on!

wget -r http://website.com

This download all files recursively: images, html files, etc. But this could get us banned by the server for sending too many download requests so to avoid this:

wget --random-wait --limit-rate=20k -r http://website.com

--random-wait means to download a file and then wait for a random period of time, then download the next file and so on.

--limit-rate=20k indicates that you want to download at a maximum speed of 20k so you don't get banned.