This gist is part of a blog post. Check it out at:
http://jasonrudolph.com/blog/2011/08/09/programming-achievements-how-to-level-up-as-a-developer
This gist is part of a blog post. Check it out at:
http://jasonrudolph.com/blog/2011/08/09/programming-achievements-how-to-level-up-as-a-developer
| import scrapy | |
| from tutorial.items import DmozItem | |
| from scrapy.contrib.loader import ItemLoader | |
| class DmozSpider(scrapy.Spider): | |
| name="dmoz" | |
| allowed_domains=["dmoz.org"] | |
| start_urls=[ | |
| "http://www.dmoz.org/Computers/Programming/Languages/Python/Books/", | |
| "http://www.dmoz.org/Computers/Programming/Languages/Python/Resources/" | |
| ] |