PiedWeb /
UrlHarvester
| ⇢ | A | RobotsHeaders added |
| ⇢ | B | Indexable::indexable() added | |
| ⇢ | A | RobotsHeaders::parseHeaders() added | |
| ⇢ | A | RobotsHeaders::readFrom() added | |
| ⇢ | A | RobotsHeaders::noindex() added | |
| ⇢ | A | RobotsHeaders::create() added | |
| ⇢ | A | RobotsHeaders::filterRobotHeaders() added | |
| ⇢ | A | Harvest::indexable() added | |
| ⇢ | A | RobotsHeaders::mayFollow() added | |
| ⇢ | A | RobotsHeaders::mayIndex() added | |
| ⇢ | A | RobotsHeaders::nofollow() added | |
| ⋮ | view more | ||
| B | ↛ | Indexable::isIndexable() removed | |
