2022-04-27 Data Import Subgroup meeting

Recordings are posted Here (2022+) and Here (pre-2022)                   Slack channel for Q&A, discussion between meetings

Requirements details Here                                                                    Additional discussion topics in Subgroup parking lot

Attendees: Ann-Marie Breaux (Deactivated) Jennifer Eustis leeda.adkins@duke.edu Monica Arnold Timothy Watters Heather MacFarlane (Deactivated) Jenn Colt Lisa McColl Lynne Fors Raegan Wiechert Taylor Smith 

Follow-up from last meeting

A-M clean up the meeting invite and re-send plus post on subgroup page

Lotus

• Still working on updating Lotus release notes
• Lotus Hotfix Bug created for the job profile problem - may be related to a problem with Holdings Source - still triaging
  • Will need a Kiwi HF, as well as Lotus HF and MG fix - also need a script or instructions for how to fix incorrect Source = MARC in existing holdings
• Also Lotus Hotfix Bug for Settings/Data Import panes UI - still in process

Morning Glory

• Morning Glory Folijet and Spitfire planning: dashboard where you can see the current scope and status of Data Import work for Morning Glory
• Completed work:
  
  • Adding Admin notes to the 3 Inventory field mapping screens
  • Log refinements: UI for deleting logs (no backend yet)
  • POL/VRN matching Backend (no UI yet)
    • Inventory Holdings POL connection: retroactive or not? Discussing with Dennis - still TBD
• Current work:
  • Backend of deleting logs
  • Field protection refinement
  • Flow control (to help Single Record Imports and MARC Authority UI deletes not get stuck)
  • Analysis of additional MARC-MARC matching refinement beyond what was delivered in Lotus
    • Matching from all repeated fields of an incoming MARC to all repeated fields in an existing MARC (e.g. all 035s to all 035s)
    • Adding indicator wildcards
    • Tangential: will analyze whether there is a way to deduplicate OCLC 035s with same number but different prefixes (seems like it might be needed during import and as on-demand)

Agenda topics:

• Implementers topics list
  • Page created: Data Import Implementers Topics
  • Add topics to it
  • Development questions/discussion take priority; these would be discussion topics when there are not dev topics - could also be addressed at the weekly Import/Export Lab

• Log refinement: finalize a few outstanding questions:
  • See PPT here
  • See Jira feature here
  • Make error details easier to find - stories not yet written
    • HOMEWORK: Review slides 9-21: If we want to show more error details on the summary screen (so that user doesn't have to click into the details screen for each error). how could we do that? Several examples of errors from Lotus Bugfest. How could this kind of information be consolidated into something meaningful on the log screen? Please add comments to this wiki page before next week's meeting.
    • Cannot be done for Morning Glory; how important for Nolana?
  • Navigation from log back to Landing page vs View all page - stories not yet written
    • HOMEWORK: Review slides 27-29: Would this be a useful change? Right now users are always taken back to the Landing page, unless you use the browser Back button instead of the "x". If you have filtered jobs on the View all page, you'll lose those filters. Please add comments to this wiki page before next week's meeting.
      • Yes - very annoying to lots of libraries - see if we can resolve with a UI change in Morning Glory

• Lisa McColl/Lehigh bug
  • using a job profile in Kiwi test that they were also using in Juniper, but it sometimes errors in Kiwi; not sure why;
  • also an issue for Chicago; is it an issue for any non-Index Data libraries? Raegan/Missouri State also seeing this in Kiwi test or dry run - was a problem in one, but not the other
  • documented in this Jira: MODINV-684 - Getting issue details... STATUS It has to do with a property added to instances in Kiwi
  • Will be fixed in Morning Glory
  • Will be in the known issues for Kiwi and Lotus, and will include instructions or script for how to fix it when migrating from Juniper to Kiwi.
  • Question - is reindexing required after the fix?

• Future topics:
  
  • Results of Feb 2022 survey 
  • See if we can make the 005 modifiable, so that the existing one can be copied into a 9xx field via a MARC modification rule so that we can keep the date of last OCLC edit to a record (Lloyd)
  • Updated import stats for Lotus

From Jennifer Eustis (she/her) to Everyone 01:30 PM
That's the same for us in our 5C sandbox
We're on Kiwi HF2
From Lisa McColl to Everyone 01:31 PM
Same for us at Lehigh - "MARC" holdings for source - should be FOLIO
From Mark Arnold to Everyone 01:33 PM
Are we going to need a script to clean these up as well?
From Raegan Wiechert to Everyone 01:37 PM
brb
From Lisa McColl to Everyone 01:38 PM
If we have time Ann-Marie - we have a Kiwi import blocker at Lehigh and I'd like to ask if others are experience what we are. I heard Simmons is and somewhat Chicago?
From Raegan Wiechert to Everyone 01:38 PM
back
From Heather MacFarlane to Everyone 01:53 PM
BRB
back
From Taylor Smith to Everyone 01:54 PM
agreed
From Lynne Fors to Everyone 01:54 PM
Yes
From Mark Arnold to Everyone 01:58 PM
Problem was in dryrun, which unfortunately is the basis for our production environment.
From Jennifer Eustis (she/her) to Everyone 02:00 PM
I have to run to another meeting
From Me to Everyone 02:04 PM
MODINV-684 - Getting issue details... STATUS
From Taylor Smith to Everyone 02:05 PM
have a good one