binux / pyspider

Completed

by Roy

created 2016-01-17 16:20 UTC

↘

pyspider.libs.Response.encoding() got worse

7.15

▶ ± 0

Head	binux 2016-01-17 16:20 GMT+0000 fix test
Base	binux 2016-01-17 16:09 UTC add robots.txt support for fetcher, enable by robots_txt=True