Skip to content

Instantly share code, notes, and snippets.

@albertyw
Created October 28, 2013 05:23
Show Gist options
  • Select an option

  • Save albertyw/7191769 to your computer and use it in GitHub Desktop.

Select an option

Save albertyw/7191769 to your computer and use it in GitHub Desktop.
Recursive JSON URL Follower
import urllib2
import json
url="http://letsrevolutionizetesting.com/challenge.json"
opener = urllib2.build_opener()
opener.addheaders = [('User-agent', 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/30.0.1599.101 Safari/537.36')]
def follow(url):
print url
page = opener.open(url).read()
print page
url = json.loads(page)['follow']
url = url.replace('challenge?', 'challenge.json?')
follow(url)
follow(url)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment