Cache Warming

Title (Goal)Reduce system load on harvest runs by pre-generating OAI records
Primary ActorRepository, Harvester
ScopeData access
LevelHigh
Story

OAI harvesting runs usually fetch hundreds of records. Generating the OAI output for each record on access time can be costly operation, especially if the process of generating involves multiple queries or generates huge XML documents. This specifically applies to records that are new in the system. It is very likely that these records get harvested soon.

The repository should pre-generate OAI output for certain records selected by a cache warm-up strategy, separating record generation from record delivery, so that extensive OAI requests can be served quickly and at low cost.

Related to: Multiple Metadata Formats