Page History

Stanford’s linked data production project focuses on technical services workflows. For each of four key production pathways we will examine each step in the workflow, from acquisition to discovery, to determine how best to transition to a linked data production environment. Our emphasis is on following each workflow from start to finish to show an end-to-end linked data production process, and to highlight areas for future work. The four pathways are: copy cataloging through the Acquisitions Department, original cataloging, deposit of a single item into the Stanford Digital Repository, and deposit of a collection of resources into the Stanford Digital Repository.

April 2017 Update

Stanford Project Proposal

• Production workflows for creation of linked data
  • Workflow for vendor-supplied copy
  • BF to Solr mapping used in above workflow
  • Reactive pipeline for converting MARC
• Tool recommendations for conversion and original creation of linked data
• Best practices for pre- and post-conversion enhancements
• Linked data descriptions of set of Stanford library and digital repository resources

Analysis/Modeling

• Generating requirements for work-based discovery environment, to take advantage of RDF.
• Evaluating BIBFRAME profiles for original cataloging

Linked Data Creation

• Tracer Bullet 2: Originally describe 50 items with local instance of BIBFRAME 2.0 Editor
• Tracer Bullet 3: Originally describe ~30 digital assets using CEDAR RDF editor
• Exploring automated pipeline approach for conversion of MARC records to BIBFRAME, loading to triplestore, and indexing to solr

Discovery Environment Creation

• Developing a mapping from RDF to solr for digital assets.
• Developing a mapping from BIBFRAME2.0 to solr document.

Tool Exploration and Development

• Investigating discovery environments for linked data

Project Co-Managers

• Philip Schreur, Assistant University Librarian for Technical and Access Services
• Tom Cramer, Assistant University Librarian, Chief Technology Strategist, and Director of Digital Library Systems and Services

Acquisitions Department

• Alexis Manheim, Head of Aquisitions Department
• Linh Chang, Receiving and Access Librarian

Metadata Department

• Nancy Lorimer, Head of Metadata Department
• Joanna Dyla, Head of Medata Development Unit
• Vitus Tang, Head of Data Control and E-resources Unit
• Arcadia Falcone, Metadata Coordinator

Digital Library Systems and Services

• Darsi Rueda, Head of Library Systems Department
• Naomi Dushay, Digital Library Software Engineer
• Joshua Greben, Library Systems Programmer / Analyst
• Darren Weber, Digital Library Software Engineer

Analysis/Modeling

• Mapped Stanford's vendor-supplied copy cataloging and original cataloging workflows
• Mapped workflow for converting vendor-supplied records to linked data

Linked Data Creation

• Worked with vendor on improvements to supplied MARC data to enhance conversion to BIBFRAME
• Tracer Bullet 1: Converted set of 38,000 MARC records from Symphony to BIBFRAME using Library of Congress converter, loaded to Blazegraph triplestore, and indexed to Blacklight solr environment via automated scripts

Discovery Environment Creation

• Created Blacklight/solr Solr instance-based discovery environment with source data a mix of linked data and MARC data.
• Developed a mapping from BIBFRAME2BIBFRAME 2.0 to solr Solr document for book materials.

Tool Exploration / Requirements Definition

• Gathered requirements for conversion and editing tools
• Set up Registry of Tools
• Evaluated CEDAR template creation and metadata editing tool
• Developed a validation suite for MARC-to-RDF converters
• Created local instance of Library of Congress BIBFRAME 2.0 Editor