public setPageLimit($limit, $only_count_received_documents = false)
$limit | int | The limit, set to 0 for no limit (default value). |
$only_count_received_documents | bool | OPTIONAL. TRUE means that only documents the crawler received will be counted. FALSE means that ALL followed and requested pages/files will be counted, even if the content wasn't be received. |
No information |
If the limit is reached, the crawler stops the crawling-process. The default-value is 0 (no limit).