PiedWeb / UrlHarvester

Completed

by Dev

created 2019-01-16 10:27 UTC

There were no notable changes in the changeset which was inspected.

9.22

▶ ± 0

Test Coverage

84%

▶ ±0%

Head	Robin 2019-01-16 11:27 GMT+0100 donwload only first 5Kb from robots.txt
Base	Robin 2019-01-16 10:17 UTC remove slow slow donwloadOnly on header checks