locked
Are asp.net sites spidered by search engines? RRS feed

  • Question

  • User-1833980242 posted

    I have recently learned that a lot of the code that is done in the VS environment is compiled into Javascript when the app is published. I also learned that search engines can't crawl javascript. I am assuming that I will have to make a duplicate of my asp.net site that has all of the content but that is only html.

     Is this the most common way to deal with this if you are doing SEO for you asp.net site? Am I on the right track with this?

     

                                                                                     -thanks

     

    Saturday, March 15, 2008 7:49 AM

Answers

  • User-627724879 posted

    If your site is rendered through JavaScript then no the spiders are not going to see the content of your site. This would not matter if it were ASP.NET, PHP, Perl, etc. You really should not do that for many reasons.

    But to answer your main question, ASP.NET sites are spidered and indexed by search engines. But as with any content on the web, the spiders need to have something to index and JavaScript is not it.

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Saturday, March 15, 2008 2:43 PM
  • User1531400112 posted

    To increase a better spider of your site, try to keep your site to standards and if you have a lot of dynamic pages with urls with ?id=1223 for example, have a site map for your site.

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Saturday, March 15, 2008 3:00 PM
  • User-319574463 posted

     >I also learned that search engines can't crawl javascript

    Search engines certainly will try to crawl your site. Regrettably, some sites require javascript to be enabled for the navigation to work; these sites are unlikely to be indexed. The simplest test you can make is to turn javascipt off in your browser, and see if the site is usable.

    Whilst asp.net can emit a lot of javascript in the rendered HTML, as long as the links render as <a>....</a>, the spider will be able to to trawl the site.

    It would help if all your pages were XHTML compliant verified using the W3C tests at http://validator.w3.org/ 

     

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Sunday, March 16, 2008 5:00 AM

All replies

  • User-627724879 posted

    If your site is rendered through JavaScript then no the spiders are not going to see the content of your site. This would not matter if it were ASP.NET, PHP, Perl, etc. You really should not do that for many reasons.

    But to answer your main question, ASP.NET sites are spidered and indexed by search engines. But as with any content on the web, the spiders need to have something to index and JavaScript is not it.

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Saturday, March 15, 2008 2:43 PM
  • User1531400112 posted

    To increase a better spider of your site, try to keep your site to standards and if you have a lot of dynamic pages with urls with ?id=1223 for example, have a site map for your site.

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Saturday, March 15, 2008 3:00 PM
  • User-319574463 posted

     >I also learned that search engines can't crawl javascript

    Search engines certainly will try to crawl your site. Regrettably, some sites require javascript to be enabled for the navigation to work; these sites are unlikely to be indexed. The simplest test you can make is to turn javascipt off in your browser, and see if the site is usable.

    Whilst asp.net can emit a lot of javascript in the rendered HTML, as long as the links render as <a>....</a>, the spider will be able to to trawl the site.

    It would help if all your pages were XHTML compliant verified using the W3C tests at http://validator.w3.org/ 

     

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Sunday, March 16, 2008 5:00 AM
  • User-627724879 posted

    If you are using JavaScript for navigation you need to make sure you have a site map, www.sitemap.org.

    Sunday, March 16, 2008 4:21 PM