When running large files in production, especially after migration to a new flower version of FOLIO, please add statistics for large data import jobs in your environment. The more statistics we can gather from production environments, the better data that we will have to compare to performance statistics gathered by the developers and the Performance Task Force.
| Library | Date | Reporter | FOLIO version | Number of records | Elapsed time | Summary of the job | Besides import, how busy was FOLIO at the time? |
|---|---|---|---|---|---|---|---|
| Cornell | 3/9/23 | Nolana | 1000 | < 5 mins | updated based on 001, simple marc update | run during open hours, but on the early/late edges | |
| Cornell | 3/9/23 | Nolana | 5000 | ca. 40 mins | updated based on 035, profile contains both marc and instance updates, plus holdings | run during open hours, but on the early/late edges | |
| 5 Colleges | 3/14/23 | Morning Glory | 349 | 3 min | updated marc srs bib, match on 999 $i, | Not busy - snow day | |
| 5 Colleges | 3/10/23 | Sara Colglazier | Morning Glory HF1 | 3000 | 7 min | create marc srs, instance, holdings, item | run during open hours, but after main work hours for most (just after 5:30 pm on a Friday) |
| 5 Colleges | 3/15/23 | Morning Glory | 193 | 1 min | update marc srs bib match on 999 $i | 9:24 am | |
| 5 Colleges | 3/16/23 | Nolana - dry run | 4 | 4 min | match on instance sys ctrl no, if no match create FOLIO inventory & srs, modify marc to remove 877, 876, 852 | This same file and same DI job profile in our MG production was done in 1min | |
| 5 colleges | 3/16/23 | Nolana - dry run | 7 | 8 min | match on instance sys ctrl no, if no match create FOLIO inventory & srs, modify marc to remove 877, 876, 852 | This same file and same DI job in our MG production was done in 1 min. | |
| Wellesley | 3/15/23 | Lynne Fors | Nolana - dry run | 100,000 | 5 hours, 3 minutes (3:03pm-8:11pm) | create marc srs, instance, holdings, modify marc srs | Not very busy. We have a limited number of users who have access to our dry run environment. Unsure if our dry run tenant is hosted with others and if there were impacts there. No idea as to how the dry run is provisioned. |
| Michigan State | 3/17/23 | Joshua Barton | Morning Glory HF1 | 270 | ca. 17 mins | update instance/srs based on match of incoming 947 to instance system control number; if no match creates new instance/srs and holdings | run mid-afternoon on a work day with other jobs (mostly consisting of single records via DI) being run every 2-5 minutes |
| 5 Colleges | 3/17/2023 | Sara Colglazier | Morning Glory HF1 | 4000 | 9 min | create marc srs, instance, holdings, item | run during closed hours (5:28 pm on a Friday, Spring Break) |
| 5 colleges | 3/17/2023 | Nolana dry run | 8574 | 80 min | update marc srs match on 999 $i | run overnight - no activity | |
| 5 Colleges | 3/17/2023 | Morning Glory HF1 | 2000 | never finished | create marc srs, instance, holdings, item with marc modify at end | started 5:58. File contained duplicates. Job never completed - ticket with hosting vendor created | |
| UniversityofChicago | 3/17/2023 | Christie Thomas | Nolana | 1150 | <2 minutes | no match points, create instance and create holdings for each record. | run mid-day during normal operating hours |
| UniversityofChicago | 3/15/2023 | Christie Thomas | Nolana | 2401 | <2 minutes | no match points, create instance and create holdings for each record. | run over the weekend in the evening when there would be minimal activity in the system |