I'm trying to create a crawl rule through the Central Admin for a non SharePoint site using Search Server Express 2010.
If I upload a cookie, I get an error after the crawl completes saying the parameter is invalid. I'm not sure what format the cookie file should be, but the various one's I've tried all provide this error and I haven't been able to find the expected format
online. Can someone provide a link to the proper format?
If I try to specify a URL to obtain the cookie I get the the following JS error in IE8.
"Access is denied FormsAuthenticationProxyPage.aspx line 138."
I've also tried setting the cookie on the server side code of the site if the user agent matches the crawler, but this has also failed to work. Possibly the cookie does not get stored/passed back as the crawler crawls.
Can you browse to the entered URL on the SharePoint server using your browser ? Are you in an environment with a proxy server ? Is internet access granted only to specific user accounts (eg through firewall policies) ?