Skip to content

Instantly share code, notes, and snippets.

@moarbytes

moarbytes/site_archiver.sh

Created March 17, 2019 08:28
Show Gist options
  • Save moarbytes/f705e752950ea8c8309b7a175e0ce68c to your computer and use it in GitHub Desktop.
Save moarbytes/f705e752950ea8c8309b7a175e0ce68c to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. moarbytes created this gist Mar 17, 2019.
    11 changes: 11 additions & 0 deletions site_archiver.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,11 @@
    #!/bin/bash
    wget -mbc -np "$1" \
    --convert-links \
    --adjust-extension \
    --page-requisites --no-check-certificate --restrict-file-names=nocontrol \
    -e robots=off \
    --waitretry 10 \
    --timeout 120 \
    --tries 10 \
    --wait 1 \
    --user-agent "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/533.20.25 (KHTML, like Gecko) Version/5.0.4 Safari/533.20.27"