Yes, SearchBlox supports crawling through a proxy server. In the Admin menu, you can set the proxy URL, username, and password under the Settings tab for a specific collection. Also, you can set a different web proxy for each Web collection.
Related Topics:
Can I restrict the crawler from indexing certain folder/URL paths?
How can I see detailed spider/crawler activity?
Can I customize the settings for the SearchBlox crawler?
Can I set a time delay on the crawler/spider between making requests to a website?
Comments
0 comments
Please sign in to leave a comment.