Skip to content

Instantly share code, notes, and snippets.

@screetsec

screetsec/gist:6ee948503960f1b9d4b7b8465aea2d73

Last active May 25, 2023 16:16
Show Gist options
  • Save screetsec/6ee948503960f1b9d4b7b8465aea2d73 to your computer and use it in GitHub Desktop.
Save screetsec/6ee948503960f1b9d4b7b8465aea2d73 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. screetsec revised this gist Apr 15, 2020. No changes.
  2. screetsec renamed this gist Apr 15, 2020. 1 changed file with 0 additions and 0 deletions.
    0 Oneline_CrawlParameter → gistfile1.txt
    View file
    File renamed without changes.
  3. screetsec renamed this gist Apr 15, 2020. 1 changed file with 0 additions and 0 deletions.
    0 gistfile1.txt → Oneline_CrawlParameter
    View file
    File renamed without changes.
  4. screetsec created this gist Apr 15, 2020.
    1 change: 1 addition & 0 deletions gistfile1.txt
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1 @@
    curl -s "http://web.archive.org/cdx/search/cdx?url=*.bugcrowd.com/*&output=text&fl=original&collapse=urlkey" | grep -P "=" | sed "/\b\(jpg\|png\|js\|svg\|css\|gif\|jpeg\|woff\|woff2\)\b/d" > Output.txt ; for i in $(cat Output.txt);do URL="${i}"; LIST=(${URL//[=&]/=FUZZ&}); echo ${LIST} | awk -F'=' -vOFS='=' '{$NF="FUZZ"}1;' >> Passive_Collecting_URLParamter.txt ; done ; rm Output.txt ; sort -u Passive_Collecting_URLParamter.txt > Passive_Collecting_URLParamter_Uniq.txt