This document contains the results of testing Data Import MARC Authorities in pre-lotus to detect performance trends.
This document contains result of testing with multiple tenants concurrently with and without Check-in-Check-out process on the background;
- Differences in times of execution between stand alone job and multitenant 4-5 times (1 min 14 s for 5 k and 5 min 30 s for 5k in multitenant, 2 minutes to 7 minutes in 10k )
- It’s not so stable when it comes to big files we saw a lot of DB timeouts (so maybe it will be a good idea to extend timeouts or investigate them deeper)
- We can see memory usage growing from test to test it might be a sign of memory leak. - PERF-223Getting issue details... STATUS
Multitenant testing with CICO
- CICO has no errors during test set
- Times for DI grew even more +2-3 minutes and +20 minutes for 50K
- 50K failed (completed with errors) on same tenant as CICO was working on.
Multitenant Marc authority imports 2 tenants
|Tenant 1||Tenant 2||1 tenant (Controlled)|
|5 K||2 min 50s||2 mn 51 s||1 min 14 s|
|10 K||5 min 23 s||5 min 14 s||2 min 32 s|
|25 K||14 min 03 s||12 min 53 s||6 min|
|50 K||24 min 40 s||24 min 37 s||12 min|
Multitenant Marc authority imports 3 tenants
To test this we've used three tenants with shared resources.
|Tenant 1||Tenant 2||Tenant 3||1 tenant (Controlled)|
|5 K||5 min 56 s||5 min 37 s||5 min 29 s||1 min 14 s|
|10 K||7 min 48 s||10 min 44 s||11 min 36 s||2 min 32 s|
|25 K||21 min 26 s||25 min 37 s||40 min 13 s||6 min|
|50 K||41 min 29 s||41 min 45 s||42 min 15 s||12 min|
CPU has predicted behavior with one spike at the beginning of the test
As you can see there is growing memory usage from test to test it might be a sign of memory leak.
COU usage of EC2 instances are less than 30%.
Multitenant Marc authority imports 3 tanants + CICO
|Tenant 1||Tenant 2||Tenant 3|
|5 K||6 min 33 s||6 min 38 s||6 min 12 s|
|10 K||9 min 9 s||9 min 52 s||9 min 22 s|
|25 K||23 min 48 s||23 min 36 s||23 min 26 s|
|50 K||1 hr 11 min 34 s||1 hr 11 min 30s||1 hr 13 min|
Marc authority + CICO + data import (create srs records, instances, holdings, items (Ptf Create 2 job profile))
|Tenant 1||1 tenant (Controlled)|
|5 K||15 min 24 s||1 min 14 s|
|10 K||17 min 27 s||2 min 32 s|
|25 K||35 min 21 s||6 min|
|50 K||1 hr 4 min 14 s||12 min|