Skip to content

Instantly share code, notes, and snippets.

@jiceb

jiceb/gist:5280253

Created March 31, 2013 10:38
Show Gist options
  • Save jiceb/5280253 to your computer and use it in GitHub Desktop.
Save jiceb/5280253 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. jiceb created this gist Mar 31, 2013.
    32 changes: 32 additions & 0 deletions gistfile1.txt
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,32 @@
    # http://www.linuxjournal.com/content/downloading-entire-web-site-wget

    $ wget \
    --recursive \
    --no-clobber \
    --page-requisites \
    --html-extension \
    --convert-links \
    --restrict-file-names=windows \
    --domains website.org \
    --no-parent \
    www.website.org/tutorials/html/

    The options are:

    --recursive: download the entire Web site.

    --domains website.org: don't follow links outside website.org.

    --no-parent: don't follow links outside the directory tutorials/html/.

    --page-requisites: get all the elements that compose the page (images, CSS and so on).

    --html-extension: save files with the .html extension.

    --convert-links: convert links so that they work locally, off-line.

    --restrict-file-names=windows: modify filenames so that they will work in Windows as well.

    --no-clobber: don't overwrite any existing files (used in case the download is interrupted and
    resumed).