Data Import Subgroup: Use Cases

Subgroup members: please add any relevant use cases. If a use case is already represented, add any additional details (your name, record source, other notes) to the existing case instead of creating a new case.

Note: Assume any files in the Use Case are MARC unless otherwise specified

	Use case (brief)	Use case description	File source	FOLIO components affected	Functional Area(s)	Submitted by	Notes
1	Loading pre-order records	User prepares bib and pre-order data in vendor system; load to FOLIO to create bib & order, then finalize order and send from FOLIO to vendor	GOBI, PQ-OASIS, OCLC	MARCcat, Instance, Holdings, Item, Order	Acquisitions	Ann-Marie Breaux (Deactivated)	May match to an existing bib record or create a new bib record. May need to create different FOLIO components depending on P or E (e.g. items)
2	Loading order records	User orders in vendor system, then loads to FOLIO to create bib and order	GOBI, OCLC, PQ-OASIS, OttoEds, Casalini, Amalivre, ATC, (Cornell has local system POOF which loads order records pulled from OCLC via Search API)	MARCcat, Instance, Holdings, Item, Order	Acquisitions	Ann-Marie Breaux (Deactivated)	May match to an existing bib record or create a new bib record. May need to create different FOLIO components depending on P or E (e.g. items)
3	Loading shelfready cataloging records from acq vendor	User receives shelfready services from vendor; loads to FOLIO to overlay any previous bib record, update holding with final location/call number/other info, update item record with barcode/piece/other info	GOBI, OCLC, Casalini, HRSW, Amalivre, Proquest/Coutts, CNPIEC, Qingyinkemao Development Center	MARCcat, Instance, Holdings, Item	Cataloging	Ann-Marie Breaux (Deactivated)	Key piece of this is matching to any pre-existing bib, holdings, item
4	Loading approval cataloging records, separate EDIFACT invoice	User receives records for incoming approval plan purchases (P or E); loads to FOLIO to create bib, holdings, item, order; followed by separate EDIFACT invoice load	GOBI, OCLC, Casalini, Amalivre, Harrassowitz	MARCcat, Instance, Holdings, Item, Order, Invoice	Acquisitions Cataloging	Ann-Marie Breaux (Deactivated)	May match to an existing bib record or create a new bib record; may have full shelfready data or may require manual updating by library staff to finalize everything
5	Loading eresource catalog records from a knowledge base MARC record service	User receives files of new, update and delete records to manage discovery of electronic resources. Loads to FOLIO to create, update or delete bib records.	ExLibris, EBSCO, OCLC, ProQuest, Oxford, Project MUSE, Swank, Kanopy, Cambridge	MARCcat, Instance, Codex?, ERM?	Cataloging	leeda.adkins@duke.edu	Each file is split between monographs and serials to streamline processing and troubleshooting. Currently matches on vendor-supplied system number. Match file is further subdivided by the ILS between records with temporary vendor system numbers and stable vendor system numbers. (More details available) Codex situation: may have a version coming from Inventory and from External KB Lisa McColl - We use provider neutral records. If we receive two "copies" of ebooks that are from two different platforms, we currently need the system to match on OCLC number (although I realize other institutions that have provider neutral records choose other match points such as ISBN), then either 1) add the new ebook to the existing record if there is one, both updating the bib with an added 856 field and adding an holdings to that existing bib or 2) create a new instance/holding for this new ebook.
6	Loading outsourced cataloging records (contract cataloging)	User receives a file from a vendor of fully-cataloged non-Latin script records to overlay brief bib records, and update holding records. Source of bib record is not the acquisitions vendor.	Wuheba, Backstage, DK Agencies, Panmun, CIBTC, Leila	MARCcat, Instance, Holdings, Item	Cataloging	leeda.adkins@duke.edu	When initial file is sent to the vendor it includes item barcode information for each title. The completed vendor cataloging file then uses the barcode recorded in a MARC field as the match point. Holding records are either created or updated with final call number, which also update the item record. May just bring in bib record and do the rest (holdings, items) locally.
7	(re)Loading bibliographic records that have been exported from the system, and edited - updating bib data only.	User may need to perform a batch cleanup on a set of bibliographic records for many reasons. Examples could be adding a consistent note to a set of identified records so the records display in a certain way in the discovery layer or making a set of records RDA compliant.	FOLIO	MARCcat, Instance	Cataloging	Lisa McColl McColl	(In scope?) - Sometimes it is necessary to update the bibliographic portion of the records only, without touching the holdings and items attached to them. This could be seen also as a "Global Edit" issue, in addition to an import issue or even instead of. That depends on the scope of this loader. Match points would probably best be the FOLIO ids in this case. Batch editing/global updates in FOLIO might help keep from having to export records.
8	(re)Loading bibliographic, holdings, items records that have been edited	User receives a notice that the URLs for a particular set of eresources have changed. Those eresource need to be identified, exported, then reimported with the correct URL that is placed in the bibliographic record but also on the holding record (presumably not the item record, but I'm not sure)	FOLIO	MARCcat, Instance, Holding, Item	Cataloging	Lisa McColl McColl	Unlike the above scenario, in this one, multiple parts of a record will need updating. Match points would probably best be the FOLIO ids in this case. Again, whether or not this is in scope depends on the ability of MarcCat to perform a global edit and send the changes to the Inventory app, without needing to export at all.
9	Loading approval cataloging records, plus MARC invoicing	User receives a file of cataloging records with order and invoice data in 9xx fields. Import process creates instance, holdings, items, order, and invoice. All happens at point of receipt.	Bach, Books from Mexico, Eastview, Erasmus, Iberoamericana, Karno, Retta, Weinberg, Worldwide, Amalivre, Rossi, Iturriaga, (JPT), MIPP, Lexicon, Leila (EDI available from Casalini, Harrassowitz, GOBI)	MARCcat, Instance, Holdings, Item, Order, Invoice	Acquisitions Cataloging	Christie Thomas leeda.adkins@duke.edu	Unlike the approval scenario that describes the ingest of an EDIFACT invoice after processing the MARC order; these are approval records for which we only receive invoice data in MARC 9xx fields. We do use the same process for other vendors as well, but I have excluded vendors from the list if we are able to receive EDIFACT invoices. Our current process is actually two processes; the invoice import process immediately follows the order import process. (scheduled once, then calls the order process, then invoice process). It would be preferable if a single process could create the order and the invoice. Duke runs one invoice at a time, a macro process.
10	Loading non-Latin firm cataloging records with MARC invoicing	User receives a file of fully cataloged records with non-Latin script and with invoice data in 9xx fields. Import process updates instance, holdings, item, and invoice.	CIBTC, Leila	MARCcat, Instance, Holdings, Item, Invoice	Acquisitions Cataloging	Christie Thomas	This is similar to the "Loading outsourced cataloging records" scenario with the addition of invoice data in the 9xx field. Point of order: creating orders locally manually or spreadsheet (no vendor records). At point of receipt, these records are full cataloging (to overlay brief record), plus 9xx invoicing data.
11	Loading catalog records for physical materials with no orders	User receives a file of records and loads to FOLIO to create bibs, holdings, and items	LC-Cairo (PL-480) plan, MARCIVE, (and many other vendors for Cornell)	MARCcat, Instance, Holdings, Items	Cataloging	leeda.adkins@duke.edu Mary Alexander	These types of loads do not need order or invoice generation. No interaction with acquisitions. For physical materials. Similar to approvals without interacting with acquisitions.
12	Loading catalog records for e-resources with no orders	User receives a file of records and loads to FOLIO to create bibs, holdings	Lots of e-vendors	MARCcat, Instance, Holdings	Cataloging	leeda.adkins@duke.edu Christie Thomas	These types of loads do not need order or invoice generation. No interaction with acquisitions. For e-materials. Similar to approvals without interacting with acquisitions.
13	Loading catalog records with no orders	User receives a file of records and load to FOLIO to create bibs	CRL (shared collection)	MARCcat, Instance	Cataloging	Mary Alexander	These types of load do not need order or invoice generation. Uses 852 in the bib to point users to the ILL form. Also use this for lots of e-resource files, with URL in 856. Holdings not mandatory in FOLIO inventory.
14	Single record import/overlay	User in cataloging department needs to overlay a brief record that may have come in via acquisitions with a fully fleshed out record.	OCLC, Z39.50	MARCcat, Instance, Holdings, Item	Cataloging	Lisa McColl McColl	(In scope?) While this defies the word "batch" I wanted to put something here, even if it's a placeholder, to make the ability to import a single record in a simple way, does not get overlooked. Currently in OLE our single record import is so clunky that everyone uses the "batch import" even for single records, because it is easier to use than the "single bib import" feature in OLE. In our system, previous to OLE, users had the ability to overlay a record that was open in the ILS without having to force a match point. The overlay was made just by virtue of the fact the record they wanted to overlay was open. This feature has been sorely missed by staff members. Without out it this once simple process has become exponentially complicated to staff members.
15	Loading items to a single holding record	User takes a spreadsheet of item information and loads to a single holding record in FOLIO to batch create items	Spreadsheet	Holding, Items	Cataloging	leeda.adkins@duke.edu Christie Thomas	Used for special collections projects and large holdings management projects. Large donor projects. Link to the holdings, plus a way to create the items from the spreadsheet data. Might need to match on the bib first? Would be best if could match to the actual holdings ID though.
16	Performing batch authority control updates to catalog records	Extracts from the catalog are sent to an authority control vendor. Vendor returns a file of updated bib records; user loads into FOLIO to overlay existing bib records	LTI Backstage	MARCcat, Instance	Cataloging	leeda.adkins@duke.edu	Extracts and returned update files can run weekly or quarterly, or both.
17	Loading authority records	Authority control vendor provides new, changed, (and deleted?) authority records, based on catalog data sent by the library. Library loads the authority records to FOLIO to inform the authorized headings and cross-references	LTI Backstage	MARCcat	Authorities	Ann-Marie Breaux (Deactivated)	Do we know how much or how little Inventory and Codex will be paying attention to authorized headings and cross references?
18	Load single authority record	Search from FOLIO to find authority record and import.	VIAF, OCLC, other sources	MARCcat	Authorities	Tiziana Possemato
19	DDA Discovery Records/PDA	Vendor provides DDA Discovery records. Import creates a new instance with a local electronic holdings record.	GOBI, Kanopy, Coutts-OASIS, eBook Central	MARCcat, Electronic Holdings (Local - Inventory) Unless only loading to Discovery	Cataloging	Christie Thomas	The instance receives an Instance Status of DDA Discovery to differentiate the record from that of an instance with owned items. Discovery records may be loaded into discovery only (outside the scope of FOLIO) or into FOLIO. Often a code so that the library knows these are not owned (yet)
20	DDA Purchase (POP)/PDA	Vendor provides a MARC file with order and invoice data in 9xx fields. Import replaces DDA Discovery record and updates local electronic holdings record.	GOBI, Kanopy	MARCcat, Electronic Holdings (Local - Inventory), Order, Invoice	Acquisitions' Cataloging	Christie Thomas	The Instance Status is changed from DDA Discovery. If Discovery records are loaded into discovery system only (not ILS), then POP records are new to FOLIO. If Discovery records are loaded to FOLIO, then POP records have to overlay/update the discovery records, plus take care of the acq stuff.
21	EBA DIscovery	Publisher provides EBA Discovery records. Import creates a new instance with a local electronic holdings record.	Cambridge, Docuseek2 (streaming video), Taylor & Francis, Project MUSE, Oxford Scholarship Online, Sage, JSTOR	MARCcat, eHoldings (Local Inventory) Unless only loading to discovery	Acquisitions	Lisa McColl McColl	May extract the ISBNs from the publisher records to harvest better OCLC records. Code to brand these records, so that they can be removed or suppressed. (Note: EBA not working so well for Lehigh/Cornell)
22	EBA POP	At end of a cycle, library decides which titles will be purchased and which will be dropped.	Cambridge	MARCcat, Electronic Holdings (Local - Inventory), Order, Invoice	Acquisitions Cataloging	Lisa McColl McColl	Would need to change the flag and do the acq work
23	Orders from spreadsheets	Bibliographer provides bibliographic and order data in spreadsheet. Import creates a new instance, holdings, item, and order.	local spreadsheet Andromeda Research, Zahraei, Sulaiman, Nazeer, MG Noura, Libra, Lexicon, Kozmenko, Panmun, Iran Farhang	MARCcat, Instance, Holdings, Item, Order	Acquisitions	Christie Thomas	Bibliographer enters data for orders into a spreadsheet or uses spreadsheet provided by vendor. Staff uses MarcEdit to convert the spreadsheet to a brief MARC record with order data in the 9xx fields. Some vendors for which we create orders in this manner include: Andromeda Research, Zahraei, Sulaiman, Nazeer, MG Noura, Libra, Lexicon, Kozmenko, Panmun, Iran Farhang. (Cornell does this for Korean and Vietnamese books, but do not create order records - just pay on a dummy record.) This workflow is also of interest to Duke. Maybe add OCLC numbers, so that you have a matchpoint for the cat record. MIght just want to create Instance, and then create MARC later. Others may want to create both Instance and MARCcat. If only creating Inventory, maybe just creates Inventory JSON. If loading to MARCcat, create MARC version too.
24	Invoice records from EDI file	EDI file is automatically imported into system.	EBSCO Harrassowitz GOBI, Coutts, Nardecchia, Casalini, Hein	Invoice	Acquisitions	Mary Alexander	User links invoice (scanned image) to order. Match point is a single number representing title/account#/sub-account#.
25	Load MARC file to create Inventory instance, but don't store a MARC record in FOLIO	Maybe at point of order - I want an inventory instance and order, but no MARC record. Then at point of receipt, I'll load or create a MARC cataloging record and link it up to the pre-existing Inventory instance.	???	Instance, Order	Acquisitions	Christie Thomas	Would start to break the "tyranny of MARC." Have to be mindful of what is being exported to patron discovery layer, and from where within FOLIO. Maybe a time-saver for spreadsheet workflow, if can just create a brief Inventory JSON record and not have to deal with MARC details.
26	Load bib and order data via API (XML format)	Real-time load to create bib and order	GOBI, Coutts, HRSW	Instance, maybe MARCcat, Holdings, maybe Item, Order	Acquisitions		Chicago already has this with OLE; also used by Alma, Sierra, Koha libraries
27	Load records for print and e-resources that are conglomerates of OCLC records, vendor records, and local information.	Vendors supply records that are often substandard in quality to what is available through OCLC. We take what we need from the vendor records: the indication that we now have access to this resources via an identifier for that resource, and in the case of eresources, our institution specific URLs, locate appropriate OCLC records (using OpenRefine and OCLC's API), merge the records, keeping most of the OCLC information, but also adding the institution specific URL, then run a MarcEdit macro to add local information such as collection codes that relate to our CORAL. This is all done at a pre-import stage at the moment. Mostly MARC files, but sometimes spreadsheets.	OCLC OpenRefine Publishers	Instance, MARCcat, Holdings, maybe Item	Cataloging	Lisa McColl McColl	Since we currently do this before the point of import, I would not expect this from v.1 of FOLIO, I don't think. However, I think if a system gave the user the ability to construct records in a staging area, giving the user the ability to select what they want to take from various record sources, including local fields, it would the steps listed in the description area. Relates to "beefing up" smaller vendor records with TOC, local format info, by merging OCLC data with vendor records. Mostly just keep the URL and ISBN from the vendor record, hopefully an OCLC number. Track in CORAL, with CORAL IDs. In an ideal world we would all use the same record from one source, but there is a lot in place preventing libraries from achieving that ideal, so this system of constructing records from various sources is what we need to do to try to have important information like the Table of Contents, 33X fields, 006 and 007 fields appropriately coded, included in the record.
28	(re)Loading bibliographic records that have been exported from the system, and edited - updating OCLC number only.	User may need send out records to match to OCLC, then reload to FOLIO to update the OCLC number. That may be the only piece of data that they want to update in the FOLIO MARC record and Instance.	FOLIO	MARCcat, Instance	Cataloging	Chicago Cornell	May only need to import a delimited file with FOLIO HRID and OCLC number.