TIND batch upload from MARCXML: Difference between revisions

(→‎Actual loading: Added reindexing caveats)
Line 37: Line 37:
#See [https://docs.tind.io/article/d2ad9k1ugx-how-to-batch-upload-metadata How to batch upload metadata] for how it's supposed to work and [https://docs.tind.io/article/g1tv6r6gbe-caveats-common-errors-and-example-metadata-files Caveats, common errors and example metadata files] for things that are likely to go wrong.
#See [https://docs.tind.io/article/d2ad9k1ugx-how-to-batch-upload-metadata How to batch upload metadata] for how it's supposed to work and [https://docs.tind.io/article/g1tv6r6gbe-caveats-common-errors-and-example-metadata-files Caveats, common errors and example metadata files] for things that are likely to go wrong.
#Hit the "Upload" button and hope for the best. Be sure to check log files for problems.
#Hit the "Upload" button and hope for the best. Be sure to check log files for problems.
Remember that re-indexing is automatic, but takes a bit of time: if you search for a keyword from the newly uploaded files, you're not going to get them all at first.
Remember that Collection building/re-building can take a long time (e.g., overnight)


[[Category:Staff policies and procedures]]
[[Category:Staff policies and procedures]]
[[Category:TIND ILS]]
[[Category:TIND ILS]]

Revision as of 15:13, 23 October 2022

Relatively small batches MARC records (no more than 1,000 records) can be bulk uploaded directly to the catalog using the Batch Uploader at https://catalog.folger.edu/batchuploader/. Use TIND customer support for larger batches. Files use UTF8 character encoding and must be in TIND's version of MARC XML.

Save copies after each step so you can back-track if something goes wrong.

Records can also be uploaded from .csv files, but for now this article only covers MARC

Initial file preparation

Examine the MARC file for non-Folger practice or unusual fields (e.g., by using MarcReport to produce a list of all tags, indicators, and subfields in use). Use a utility such as MarcEdit to add, edit, and delete information as needed.

Common changes include:


Other changes might include:

  • Add 1XX/7XX $e Relator term based on content of $4 Relator code (Women Writers Online records: opted not to change before load: too time-consuming)


See MARC records from vendors for descriptions of changes needed for each record set. In most cases, changes that can be done by machine have been bundled into a MarcEdit task specific to that record set.

Post-MarcEdit preparation

  1. After edits are finished, use MarcValidator to make sure you didn't break anything. Fix as needed.
  2. Save file with PostMarcEdit in filename
  3. If the .mrk file is large, and you'll be using the Batch Uploader, compile it as .mrc and split it into smaller batches before proceding.
  4. Convert the file to MARC21XML and save with MRKtoXML or MRCtoXML in filename
  5. Open the .xml file in Notepad++ and run the appropriate MacroExpress batch changes to convert to TIND's flavor of MARC XML:
    1. Change <marc:leader> and <marc:leader> to <controlfield tag="000"> and </controlfield>
    2. Replace all blank spaces in 00X fields with backslash character (typically this will be the 000, 007, and 008)
    3. Delete MARC 005 from each record (it is system-created during the upload, and the system gets confused if there's already something there).
  6. Save file with XMLtoTINDXML in filename

Actual loading

  1. Test on a small batch of records!
  2. Go to Administration > Batch Uploader and follow the instructions
  3. See How to batch upload metadata for how it's supposed to work and Caveats, common errors and example metadata files for things that are likely to go wrong.
  4. Hit the "Upload" button and hope for the best. Be sure to check log files for problems.

Remember that re-indexing is automatic, but takes a bit of time: if you search for a keyword from the newly uploaded files, you're not going to get them all at first.

Remember that Collection building/re-building can take a long time (e.g., overnight)