Integration with external databases (Scopus, Web of Science, etc.)

DSpace-CRIS implement three levels of integration with external databases:

• Realtime import of bibliographic records searching the external database by identifiers or title, authors
• Periodic scanning of the external database to retrieve institutional publications to import
• Retrieve of bibliometrics value for items in DSpace(-CRIS)

Realtime import of bibliographic records

Other than the provider already available in a standard DSpace installation such as ArXiv, PubMed, Cinii, CrossRef and generic OAI-PMH providers, DSpace-CRIS add to the Submission Lookup Step the ability to query PubMed Europe, Scopus, SciVal and/or Web of Science.

PubMed Europe

The class org.dspace.submit.lookup.PubmedEuropeFileDataLoader is the implementation of the submission lookup interface that enable the integration with the Web of Knowledge WokSearch API.

To enable the integration it is necessary to uncomment the bean definitions in the [dspace-installDir]/config/spring/api/bte.xml file 

<bean name="multipleDataLoader" class="org.dspace.submit.lookup.MultipleSubmissionLookupDataLoader" scope="prototype">
	    <property name="dataloadersMap">
	        <map>
				...
				<!-- <entry key="pubmedEurope" value-ref="pubmedEuropeOnlineDataLoader"/> -->
				...				
				<!-- <entry key="pubmedEuropeXML" value-ref="pubmedEuropeFileDataLoader"/> -->	

pubmedEuropeXML enables the use of the XML format specific of PubMed Europe

Scopus

The class org.dspace.submit.lookup.ScopusOnlineDataLoader is the implementation of the submission lookup interface that enable the integration with the Scopus API.

To enable the integration it is necessary to set the following property in the dspace.cfg (via build.properties)

submission.lookup.scopus.apikey = ${submission.lookup.scopus.apikey}

and uncomment the bean definition in the [dspace-installDir]/config/spring/api/bte.xml file

<bean name="multipleDataLoader" class="org.dspace.submit.lookup.MultipleSubmissionLookupDataLoader" scope="prototype">
	    <property name="dataloadersMap">
	        <map>
					...
				<!-- <entry key="scopus" value-ref="scopusOnlineDataLoader"/> -->
				...				

SciVal

The class org.dspace.submit.lookup.SciValOnlineDataLoader is the implementation of the submission lookup interface that enable the integration with the SciVal API.

To enable the integration it is necessary to set the following property in the dspace.cfg (via build.properties)

submission.lookup.scivalcontent.apikey = ${submission.lookup.scivalcontent.apikey}

and uncomment the bean definition in the [dspace-installDir]/config/spring/api/bte.xml file

<bean name="multipleDataLoader" class="org.dspace.submit.lookup.MultipleSubmissionLookupDataLoader" scope="prototype">
	    <property name="dataloadersMap">
	        <map>
					...
				<!-- <entry key="scopus" value-ref="scivalOnlineDataLoader"/> -->
				...				

Web of Knowledge

The class org.dspace.submit.lookup.WOSOnlineDataLoader is the implementation of the submission lookup interface that enable the integration with the Web of Knowledge WokSearch API.

To enable the integration it is necessary to set the following property in the dspace.cfg (via build.properties)

submission.lookup.webofknowledge.user = ${submission.lookup.webofknowledge.user}
submission.lookup.webofknowledge.password = ${submission.lookup.webofknowledge.password}

or, if access to the web services is granted via IP

submission.lookup.webofknowledge.ip.authentication = ${submission.lookup.webofknowledge.ip.authentication} # true to enable IP authentication

and uncomment the bean definition in the [dspace-installDir]/config/spring/api/bte.xml file

<bean name="multipleDataLoader" class="org.dspace.submit.lookup.MultipleSubmissionLookupDataLoader" scope="prototype">
	    <property name="dataloadersMap">
	        <map>
					...
				<!-- <entry key="wos" value-ref="wosOnlineDataLoader"/> -->
				...				

Periodic scanning of the external database

The system has scripts to periodically query some external data providers for new publications, map the founds to the internal DSpace metadata and use the DBMS import to finalize the import in the repository.

For each provider a two steps procedure must be followed

1. Run the script to query the external provider, creating record in the Import boundary tables (specific of each provider)
2. Run the DBMS import script to create / update the dspace items with the new information

PubMed Europe

The DSpace script to invoke is

./dspace dsrun org.dspace.app.cris.batch.PMCEuropeFeed -q query -p submitter -s start_date(yyyy-mm-dd) -e end_date(yyyy-mm-dd) -c collectionID [-t] -m <metadata-for-pmid> -n <metadata-for-pmcid>

Scopus

The DSpace script to invoke is

./dspace dsrun org.dspace.app.cris.batch.ScopusFeed -q query -p submitter -s start_date(yyyy-mm-dd) -e end_date(yyyy-mm-dd) [-f] -c collectionID

Web of Knowledge

The DSpace script to invoke is

./dspace dsrun org.dspace.app.cris.batch.WosFeed -q query -p submitter -s start_date(yyyy-mm-dd) -e end_date(yyyy-mm-dd) [-f] -c collectionID

Retrieve of bibliometrics data (citation count)

PubMed Central

Scopus

Web of Knowledge