Page History

...

1. Provide a hidden link to the sitemaps in your DSpace's homepage. If you've customized your site's look and feel (as most have), ensure that there is a link to /htmlmap in your DSpace's front or home page.By default, both the JSPUI and XMLUI provide this link in the footer:

   Code Block
   <a href="/htmlmap"></a>

2. Announce your sitemap in your robots.txt.  Most major search engines will also automatically discover your sitemap if you announce it in your robots.txt file.  For example:

   Code Block
   Sitemap: http://my.dspace.url/sitemap Sitemap: http://my.dspace.url/htmlmap

   1. NOTE that you need to replace "http://my.dspace.url" lines above with the full URL of your DSpace instance (this should correspond to the "dspace.url" setting in your dspace.cfg file)
   2. This "Sitemap:" line lines can be placed anywhere in your robots.txt file.   You can also specify multiple "Sitemap:" lines, so that search engines can locate both formats. For more information, see: http://www.sitemaps.org/protocol.html#informing

Search engines will now look at /htmlmapyour XML and HTML sitemaps, which serves one or more serve pre-generated (and thus served with minimal impact on your hardware) XML or HTML files linking directly to items, collections and communities in your DSpace instance. Crawlers will not have to work their way through any browse screens, which are intended more for human consumption, and more expensive for the server.

...