Bug 35086: Also split chunks when indexing from background job
authorNick Clemens <nick@bywatersolutions.com>
Wed, 3 Jan 2024 18:54:25 +0000 (18:54 +0000)
committerLucas Gass <lucas@bywatersolutions.com>
Fri, 2 Feb 2024 16:25:22 +0000 (16:25 +0000)
commiteb2617409a33e9125a38b1fc422280d4dcd4c7d2
treebf2c0935dfd020e28a0304552001173c3065f94b
parent19f442c18fd600f098b90fbde18479338d382d9a
Bug 35086: Also split chunks when indexing from background job

The es background indexer is designed to combine background jobs when started based on the 'batch_size' option.

While this is helpful for combining individual updates, it can be problematic when there are several large batch modifications, or when worker has stopped and is restarted.

This patch uses the same logic as in the indexer to split the chunks that are sent directly for indexing.

To test:
1 - Follow test plan on previous patch
2 - Confirm items are correctly indexed and jobs marked

Signed-off-by: David Nind <david@davidnind.com>
Signed-off-by: Jonathan Druart <jonathan.druart@bugs.koha-community.org>
Signed-off-by: Katrin Fischer <katrin.fischer@bsz-bw.de>
(cherry picked from commit 7496a603cda7832bcf1bdb606843bd88f18af4f3)
Signed-off-by: Fridolin Somers <fridolin.somers@biblibre.com>
(cherry picked from commit 2f8ae2ec212e67cbe004e15484cf561a77bc40a5)
Signed-off-by: Lucas Gass <lucas@bywatersolutions.com>
misc/workers/es_indexer_daemon.pl