Can I use Unix and Windows filesystem paths for crawling?

Yes, either Windows or Unix file systems paths can be used based on the installed platform. The file system crawler will index all sub-directories unless you specify sub-directory paths in the Disallow Path to avoid indexing that sub-directory.

Examples :

Unix
/web/html/search/content/

Windows
c:\webroot\html\search\content\

 

Disallow Paths can be provided as follows:

Windows

C:\\path1\\html2\\.*

Unix
/do not index/

 

 

 

Have more questions? Submit a request

Comments