Skip to content

Instantly share code, notes, and snippets.

@mnsami

mnsami/crawl-website.sh

Created January 4, 2016 16:25
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save mnsami/a8ccbbf6768985562253 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save mnsami/a8ccbbf6768985562253 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. mnsami created this gist Jan 4, 2016.
    11 changes: 11 additions & 0 deletions crawl-website.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,11 @@
    #!/bin/sh

    wget=/usr/bin/wget

    if [ ! -x "$wget" ]; then
    echo "ERROR: No wget." >&2
    exit 1
    fi

    # This script is to download website to make it available for offline viewing.
    $wget --recursive --page-requisites --html-extension --convert-links $1