The Computer Oracle

How can I download an entire website?

Become part of the top 3% of the developers by applying to Toptal https://topt.al/25cXVn

--

Music by Eric Matyas
https://www.soundimage.org
Track title: Hypnotic Puzzle2

--

Chapters
00:00 Question
00:19 Accepted answer (Score 410)
00:44 Answer 2 (Score 335)
01:26 Answer 3 (Score 206)
01:50 Answer 4 (Score 8)
02:05 Thank you

--

Full question
https://superuser.com/questions/14403/ho...

Accepted answer links:
[HTTRACK]: https://www.httrack.com/

Answer 2 links:
[Wget]: https://www.gnu.org/software/wget/
[for Windows]: https://superuser.com/questions/25538/wh...
[Homebrew]: http://brew.sh/
[Wget Manual]: https://www.gnu.org/software/wget/manual...
[examples]: https://www.gnu.org/software/wget/manual...
[wget: Download entire websites easy]: http://linuxreviews.org/quicktips/wget/
[Wget examples and scripts]: http://www.krazyworks.com/?

Answer 4 links:
[ScrapBook]: https://addons.mozilla.org/en-US/firefox.../
[in-depth capture mode]: http://amb.vis.ne.jp/mozilla/scrapbook/f...

--

Content licensed under CC BY-SA
https://meta.stackexchange.com/help/lice...

--

Tags
#download #website #web

#avk47



ACCEPTED ANSWER

Score 440


HTTRACK works like a champ for copying the contents of an entire site. This tool can even grab the pieces needed to make a website with active code content work offline. I am amazed at the stuff it can replicate offline.

This program will do all you require of it.

Happy hunting!




ANSWER 2

Score 357


Wget is a classic command-line tool for this kind of task. It comes with most Unix/Linux systems, and you can get it for Windows too. On a Mac, Homebrew is the easiest way to install it (brew install wget).

You'd do something like:

wget -r --no-parent http://example.com/songs/

For more details, see Wget Manual and its examples, or e.g. these:




ANSWER 3

Score 243


Use wget:

wget -m -p -E -k www.example.com

The options explained:

-m, --mirror            Turns on recursion and time-stamping, sets infinite 
                          recursion depth, and keeps FTP directory listings.
-p, --page-requisites   Get all images, etc. needed to display HTML page.
-E, --adjust-extension  Save HTML/CSS files with .html/.css extensions.
-k, --convert-links     Make links in downloaded HTML point to local files.
-np, --no-parent        Don't ascend to the parent directory when retrieving 
                        recursively. This guarantees that only the files below 
                        a certain hierarchy will be downloaded. Requires a slash 
                        at the end of the directory, e.g. example.com/foo/.



ANSWER 4

Score 8


Internet Download Manager has a Site Grabber utility with a lot of options - which lets you completely download any website you want, the way you want it.

  1. You can set the limit on the size of the pages/files to download

  2. You can set the number of branch sites to visit

  3. You can change the way scripts/popups/duplicates behave

  4. You can specify a domain, only under that domain all the pages/files meeting the required settings will be downloaded

  5. The links can be converted to offline links for browsing

  6. You have templates which let you choose the above settings for you

enter image description here

The software is not free however - see if it suits your needs, use the evaluation version.