Bug 35086: Also split chunks when indexing from background job
authorNick Clemens <nick@bywatersolutions.com>
Wed, 3 Jan 2024 18:54:25 +0000 (18:54 +0000)
committerKatrin Fischer <katrin.fischer@bsz-bw.de>
Tue, 16 Jan 2024 11:06:00 +0000 (12:06 +0100)
commit7496a603cda7832bcf1bdb606843bd88f18af4f3
tree9168d4265314bb292d5b1d8e2086cbc8ce7fa0da
parent9951e230e43d08dc6a2fb635877d0db5c1e245ff
Bug 35086: Also split chunks when indexing from background job

The es background indexer is designed to combine background jobs when started based on the 'batch_size' option.

While this is helpful for combining individual updates, it can be problematic when there are several large batch modifications, or when worker has stopped and is restarted.

This patch uses the same logic as in the indexer to split the chunks that are sent directly for indexing.

To test:
1 - Follow test plan on previous patch
2 - Confirm items are correctly indexed and jobs marked

Signed-off-by: David Nind <david@davidnind.com>
Signed-off-by: Jonathan Druart <jonathan.druart@bugs.koha-community.org>
Signed-off-by: Katrin Fischer <katrin.fischer@bsz-bw.de>
misc/workers/es_indexer_daemon.pl