You can translate the question and the replies:

Aracne crawler proxy configuration

Hello, I am curious to know more about the proxy configuration settings of the Aracne crawler. I can see some information there on the Aracne administration guide, but it doesn't talk much about the need of it. I understand the use of proxy settings in the browser, in general. I was thinking if the crawler is trying to access the Internet and will use my browser for that, the browser will use its proxy settings to reach to the internet. If what I am thinking is right, where comes the need of using the proxy configuration of the Aracne crawler? Thanks!
Aracne crawler proxy
user
17-03-2017 18:32:46 -0400
code

1 Answer

Hi, I use the proxy configuration settings in Aracne crawler when I want to crawl and perform data reterival of information that is available on the web with the help of both WebBot and MSIECrawler. When the data on the web I need to access will be available only through a proxy authentication then I use the proxy configuration on the Aracne server. This will help the WebBot and MSIECrawler robots to crawl through the Web hypertext structure. If the proxy settings is already set on Microsoft Internet Explorer browser then it will help you perform web crawling only when you use the MSIECrawler robot and not for the WebBot crwaler. Only when I have it configured at the Aracne crawler I will be able to apply the proxy settings both for WebBot and MSIECrawler robots. I hope this helps you!
Denodo Team
22-03-2017 09:30:17 -0400
code
You must sign in to add an answer. If you do not have an account, you can register here