spatie /
crawler
| 2 new patches (Doc Comments, Unused Use Statements) are available. | |||
| 5 added classes/operations | |||
|
A | Crawler::ignoreRobots() added | |
|
|
A | Crawler::respectRobots() added | |
|
|
A | Crawler::createRobotsTxt() added | |
|
|
A | Crawler::mayIndex() added | |
|
|
A | Crawler::mayFollow() added | |
| Head |  Brent Roose
|
|---|---|
| ⋮ | 10 more commits |
| Base |  Freek Van der Herten
|
