Skip to end of metadata
Go to start of metadata

UIDATIMP-1128 - Getting issue details... STATUS

modules versions

  • Inventory Module (mod-inventory-18.1.6)
  • Inventory Storage Module (mod-inventory-storage-23.0.2)
  • Inventory Update Module (mod-inventory-update-2.0.2)
  • Source Record Manager Module (mod-source-record-manager-3.3.8)
  • Source Record Storage Module (mod-source-record-storage-5.3.2)
  • Data Import Module (mod-data-import-2.4.2)
  • Data Import Converter Storage (mod-data-import-converter-storage-1.13.3)


filedurationtime to create 1 record (sec)
5K00:02:54.1220.035
10K00:04:36.960.028
25K00:10:56.1790.026
50K00:20:51.0240.025

maximum number of record may be created in 30 min is 75000, without background activities (150000 in one hour)

and with maximum background activities is about only 190 records (CICO 20 users and DI on three tetants same time)

I guess the most efficient is data import authorities - long files, about 50K, since the performance is maximum and the probability of an error during download is still small.

multitenant test

test performed with file 25K all tetants run at the same time with background activities CICO 20 USERS

fs09000000fs07000001fs07000002
00:43:06.65800:43:51.38500:45:18.735

time to create 1 record 0.11 sec

DI with background CICO one tenant

average response time CICO + DATA Import Marc Authorities 20users 1 tenant

Check-In Controller1.610
Check-Out Controller1.867

CICO without background activities

Check-In Controller0.836
Check-Out Controller1.022

Multitenant Authority Data Import> 2 kafka partitions 

filefs09000000fs07000001fs07000002
5K00:07:36.57900:07:39.6400:08:10.303
10K00:14:50.99200:12:56.9400:14:21.905
25K00:40:39.06300:42:00.94100:42:21.044
50K01:37:59.68801:38:11.59101:14:52.07

one tenant > 2 kafka partitions


fileduration
5K00:02:03.027
10K00:02:52.886
25K00:11:18.37
50K00:25:24.663

one tenant > 1 kafka partition



5K00:02:37.534
10K00:04:09.538
25K00:10:11.571
50K
  • No labels