Bug 25873: Ignore malformed data for Elasticsearch integer fields
authorJulian Maurice <julian.maurice@biblibre.com>
Thu, 25 Jun 2020 07:25:41 +0000 (11:25 +0400)
committerAleisha Amohia <aleishaamohia@hotmail.com>
Sun, 16 Aug 2020 21:00:55 +0000 (09:00 +1200)
commit9b9c56c3b28e4e5e1592b3a0102114d88418d958
treeb22611defcd4835c89f3b28e66ab17c10d7eae33
parent0133ea584819eea8fcb088805655556afb369bf6
Bug 25873: Ignore malformed data for Elasticsearch integer fields

If we try to put malformed data into an integer field, Elasticsearch
rejects the whole document.
Setting 'ignore_malformed' to true allows to ignore malformed data and
process the other fields of the document normally

https://www.elastic.co/guide/en/elasticsearch/reference/7.8/ignore-malformed.html

Test plan:
* Without the patch
  1. In search engine configuration, change the type of a text field to
  'Number' (for instance 'title')
  2. misc/search_tools/rebuild_elasticsearch.pl -d -b
  3. See that the index is empty (unless you have titles consisting only
  of digits)
* With the patch
  1. misc/search_tools/rebuild_elasticsearch.pl -d -b
  2. Now records are correctly indexed

Signed-off-by: Nick Clemens <nick@bywatersolutions.com>
Signed-off-by: Jonathan Druart <jonathan.druart@bugs.koha-community.org>
(cherry picked from commit cb5acdc6702cef4668921ccf2537797358981fff)

Signed-off-by: Lucas Gass <lucas@bywatersolutions.com>
(cherry picked from commit 056eb8c74e0b01386a0a1127ed5fff5ef59390b1)

Signed-off-by: Aleisha Amohia <aleishaamohia@hotmail.com>
admin/searchengine/elasticsearch/field_config.yaml