crawler 0.1.0

python crawler.

Latest Version:
0.1.2

python crawler.
=====
## Example
=====
from crawler.crawler import Crawler
mycrawler = Crawler()
seeds = ['http://www.example.com/'] # list of url
mycrawler.add_seeds(seeds)
url_patterns = ['^(.+example\.com)(.+)