Skip to content

Instantly share code, notes, and snippets.

@gpessia

gpessia/wget.sh

Forked from crittermike/wget.sh
Created August 14, 2020 11:14
Download ZIP

Revisions

  1. @crittermike crittermike revised this gist Aug 7, 2019. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion wget.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -1,5 +1,5 @@
    # One liner
    wget --recursive --page-requisites --adjust-extension --span-hosts --convert-links --restrict-file-names=windows --domains critter.blog --no-parent critter.blog
    wget --recursive --page-requisites --adjust-extension --span-hosts --convert-links --restrict-file-names=windows --domains yoursite.com --no-parent yoursite.com

    # Explained
    wget \
  2. @crittermike crittermike revised this gist Aug 7, 2019. 1 changed file with 0 additions and 1 deletion.
    1 change: 0 additions & 1 deletion wget.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,6 @@ wget --recursive --page-requisites --adjust-extension --span-hosts --convert-lin
    # Explained
    wget \
    --recursive \ # Download the whole site.
    --no-clobber \ # Don't overwrite existing files.
    --page-requisites \ # Get all assets/elements (CSS/JS/images).
    --adjust-extension \ # Save files with .html on the end.
    --span-hosts \ # Include necessary assets from offsite as well.
  3. @crittermike crittermike revised this gist Aug 7, 2019. 1 changed file with 4 additions and 0 deletions.
    4 changes: 4 additions & 0 deletions wget.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -1,3 +1,7 @@
    # One liner
    wget --recursive --page-requisites --adjust-extension --span-hosts --convert-links --restrict-file-names=windows --domains critter.blog --no-parent critter.blog

    # Explained
    wget \
    --recursive \ # Download the whole site.
    --no-clobber \ # Don't overwrite existing files.
  4. @crittermike crittermike revised this gist Sep 1, 2017. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions wget.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -3,6 +3,7 @@ wget \
    --no-clobber \ # Don't overwrite existing files.
    --page-requisites \ # Get all assets/elements (CSS/JS/images).
    --adjust-extension \ # Save files with .html on the end.
    --span-hosts \ # Include necessary assets from offsite as well.
    --convert-links \ # Update links to still work in the static version.
    --restrict-file-names=windows \ # Modify filenames to work in Windows as well.
    --domains yoursite.com \ # Do not follow links outside this domain.
  5. @crittermike crittermike revised this gist Sep 1, 2017. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion wget.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -2,7 +2,7 @@ wget \
    --recursive \ # Download the whole site.
    --no-clobber \ # Don't overwrite existing files.
    --page-requisites \ # Get all assets/elements (CSS/JS/images).
    --html-extension \ # Save files with .html on the end.
    --adjust-extension \ # Save files with .html on the end.
    --convert-links \ # Update links to still work in the static version.
    --restrict-file-names=windows \ # Modify filenames to work in Windows as well.
    --domains yoursite.com \ # Do not follow links outside this domain.
  6. @crittermike crittermike revised this gist Aug 18, 2017. No changes.
  7. @crittermike crittermike created this gist Aug 18, 2017.
    10 changes: 10 additions & 0 deletions wget.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,10 @@
    wget \
    --recursive \ # Download the whole site.
    --no-clobber \ # Don't overwrite existing files.
    --page-requisites \ # Get all assets/elements (CSS/JS/images).
    --html-extension \ # Save files with .html on the end.
    --convert-links \ # Update links to still work in the static version.
    --restrict-file-names=windows \ # Modify filenames to work in Windows as well.
    --domains yoursite.com \ # Do not follow links outside this domain.
    --no-parent \ # Don't follow links outside the directory you pass in.
    yoursite.com/whatever/path # The URL to download