...
- Kafka (MSK):
- auto.create.topics.enable = true
- log.retention.minutes = 70-300
- Broker’s disk space: 300 GB
- 4 brokers, replication factor = 3, DI topics partition = 1
- Version 2.7 is 30% faster than version 1.6
- mod-inventory:
- inventory.kafka.DataImportConsumerVerticle.instancesNumber=10
- inventory.kafka.MarcBibInstanceHridSetConsumerVerticle.instancesNumber=10
- kafka.consumer.max.poll.records=10
- Memory: 2 GB
- mod-data-import (applicable only for releases prior to Kiwi):
- file.processing.buffer.chunk.size=5
More information on configuring modules involved in Data Import process can be found by the link.
...