diff --git a/html/about/guide.html b/html/about/guide.html index 906b881..045d6fa 100755 --- a/html/about/guide.html +++ b/html/about/guide.html @@ -291,7 +291,7 @@ Make sure the robots folder exists. All robots.txt files are stored in the robot You can turn off checking for robots.txt files by commenting out the line calling the "checkrobots" function inside of cr.c.

-If crawling through hyperlinks on a page, the following file types are accepted: html, htm, xhtml, txt, php, asp. Links containing parameters are ignored. These limitations do not apply to pages directly submitted by people. +If crawling through hyperlinks on a page, the following file types are accepted: html, htm, xhtml, shtml, txt, php, asp. Links containing parameters are ignored. These limitations do not apply to pages directly submitted by people.

Start the core server