Completed
Pull Request — master (#139)
by
unknown
01:57
created

Changes

1 issue (minor) was introduced.
2 added classes/operations
Arrow A Crawler::honorMetaRobotsFollowPolicy() added
Arrow A Crawler::doNotHonorMetaRobotsFollowPolicy() added
A B Crawler::extractAllLinks() got worse
6.39
▼   -0.12
Head
Carlos Monroy  
Merge 4e1d9517f9002e7ccc5bcd5f5775736331693511 into 006b0e5f14e0045633c88dfb5b0df7acf6db25c5
1 more commit
Base
Thomas Verhelst  
Fix typos and grammer (#136)