1
issue
(major)
was introduced.
|
|||
3 added classes/operations | |||
![]() |
A | Crawler::setWaitBetweenRequest() added | |
![]() |
A | Crawler::cacheRobotsTxt() added | |
![]() |
A | Crawler::loadRobotsTxt() added |