...

This document contains the results of testing Data Import Splitting Feature for MARC Bibliographic records in the Orchid release to detect the baseline for ocp3.

Summary

• Duration for DI correlates with number of the records imported (100k records- 32 38 min, 250k - 1 hour 33 32 min, 500k - 3 hours 33 29 min).
• ---------Multitenant DI could be performed successfully for up to 9 jobs in parallel. If jobs are big they will start one by one in order for each tenant but processed in parallel on 3 tenants. Small DI (1 record) could be finished faster not in order.  Duration for Check-In/Check-Out is prolonged twice during DI.
• This has memory utilization increasing due to previous modules restarting (everyday cluster shot down process) no memory leak is suspected for all of the modules.
• Average CPU usage for mod-inventory -was 144%, mod-di-converter-storage was about 462%107%, and for all other modules did not exceed 150 100 %. We can observe spikes in CPU usage of mod-data-import at the beginning of the Data Import jobs up to 400%260%.
• Approximately DB CPU usage is up to 95%.

Recommendations and Jiras

...

Results

...