How to prevent "Search Engine Sitemap" feature from adding port 80 to every URL?

Question

Hi All,

I am using SharePoint 2013 Host-Named site collection to host public internet site. "Search Engine Sitemap" feature gets added port 80 to every URL in robots.txt and sitemap.xml files. How to remove port from Robots.txt and Sitemap.xml files?

Files look like:

User-agent: *

Disallow: /_layouts/
Disallow: /_vti_bin/
Disallow: /_catalogs/



Sitemap: http://www.mysite.com:80/sitemap.xml

<?xml version="1.0" encoding="UTF-8" standalone="true"?>

<!--Generated: 2015-05-27T09:44:06-->

-<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">


-<sitemap>

<loc>http://www.mysite.com:80/sitemap0.xml</loc>

</sitemap>


-<sitemap>

<loc>http://www.mysite.com:80/sitemap_mobile0.xml</loc>

</sitemap>

</sitemapindex>

---

Oleg

Answer 1

Hi Oleg,

It is a default behavior that port 80 will be added to Robots.txt and Sitemap.xml files.

And there is no workaround at this time.

Thanks for your support and understanding.

Thanks,

Victoria

---

TechNet Community Support
Please remember to mark the replies as answers if they help, and unmark the answers if they provide no help. If you have feedback for TechNet Support, contact [e-mail].

Answer 2

I am facing an issue with the SharePoint crawler due to the sitemap

I have a host header web application with SSL (https) enabled (it is not extended from http), the site map is adding port 443 to all the URLs and the SharePoint search crawler is showing errors with these URLs and is failing to crawl them

---