...

Add HTML Sitemap support.

Wiki MarkupThis is as simple as running \ [dspace\]/bin/generate-sitemaps once a day.

Just set up a cron job (or scheduled task in Windows), e.g. (cron):unmigrated-wiki-markup

{{0 6 * * * \ [dspace\]/bin/generate-sitemaps}}unmigrated-wiki-markup

Also, if you've customized your site's look and feel (as most have), ensure that there is a link to \ [dspace-url\]/htmlmap in your DSpace's front or home page. (This is present in the footer of the default template.) E.g.:

<a href="/htmlmap"></a>

Search engines will now look at /htmlmap, which (after generate-sitemaps has been run) serves one or more pre-generated (and thus served with minimal impact on your hardware) HTML files linking directly to items, collections and communities in your DSpace instance. Crawlers will not have to work their way through any browse screens, which are intended more for human consumption, and more expensive for the server.

...

 <% if (extraHeadData != null)
    { %>
    <%= extraHeadData %>
 <% } %>

Wiki MarkupIf you have heavily customized your metadata fields away from Dublin Core, you can modify the crosswalk that generates these elements by modifying {{\[dspace\]/config/crosswalks/xhtml-head-item.properties}}.

In general, OAI-PMH isn't useful to Search Engines

...