View GitHub Repository crawler

Schedule Inspection
Subscribe

Code

Loading
Rating   Name Duplication Size Complexity Changes Bugs Features
B Crawler\Crawler::startCrawling() 0 34 7 0 0 0
B CrawlRequestFulfilled::__invoke() 0 33 6 0 0 0
A Crawler\Crawler::addToDepthTree() 0 28 5 0 0 0
A Crawler\Crawler::getCrawlRequests() 0 21 5 0 0 0
A Crawler\LinkAdder::addFromHtml() 0 31 3 0 0 0
A LinkAdder::extractLinksFromHtml() 0 17 2 0 0 0
A Spatie\Crawler\Crawler::__construct() 0 16 1 0 0 0
A Crawler\Crawler::addToCrawlQueue() 0 16 3 0 0 0
A Crawler\CrawlerRobots::mayIndex() 16 16 4 0 0 0
A Crawler\CrawlerRobots::mayFollow() 16 16 4 0 0 0
A Crawler\Crawler::startCrawlingQueue() 0 15 2 0 0 0
A Crawler\LinkAdder::shouldCrawl() 0 14 4 0 0 0
A ArrayCrawlQueue::hasAlreadyBeenProcessed() 0 14 3 0 0 0
A CrawlQueue\ArrayCrawlQueue::add() 0 13 2 0 0 0
A Spatie\Crawler\Crawler::setUserAgent() 0 13 1 0 0 0