Answers to: Limit 1000 fields while persisting with elasticsearch

Comment by ToanLC on Alex Suter's answer

ToanLC — Wed, 18 Apr 2018 02:41:26 -0400

oh, that's why. Thanks for the explanation, I will stick to the template solution then. :D BTW, Can I ask how can I set elasticsearch to start on a specific port? I changed the http.port inside elasticsearch.yml, but it doesn't work

Comment by Alex Suter on Alex Suter's answer

Alex Suter — Wed, 18 Apr 2018 02:02:29 -0400

Yes you are right. But the problem is, if we (ivy itself) reindex, your indrx will be deleted and you will loos this setting. If you use an template, then newly created indicies will alwasy have this setting. We work on a solution for that!

Comment by ToanLC on Alex Suter's answer

ToanLC — Tue, 17 Apr 2018 22:43:39 -0400

Hello @alex, I'm so sorry for the confusion as I actually worked on another instance of elasticsearch of other ivy engine(Mine was at 19201) and I changed the settings on 19200. By the way, there is also other way to do this as to change setting of the designated index curl -XPUT http://localhost:19200/ivy.businessdata-ch.axonivy.fintech.individualch.individualdossier/_settings -d '{"index.mapping.total_fields.limit": 20000}'

Comment by Alex Suter on Alex Suter's answer

Alex Suter — Tue, 17 Apr 2018 07:37:28 -0400

you must restart the engine. 1) Delete Index 2) Start engine

Comment by ToanLC on Alex Suter's answer

ToanLC — Tue, 17 Apr 2018 06:41:12 -0400

I tried but then I cannot create the index again as it got into the exception while trying to persist data.

Comment by Alex Suter on Alex Suter's answer

Alex Suter — Tue, 17 Apr 2018 04:04:12 -0400

it looks good, but you need to recreate the index. the best way is to shutdown the engine, delete the index manually and start the engine again. i recommend to check the settings of the index. there you can see if your template settings are really applied.

Comment by ToanLC on Alex Suter's answer

ToanLC — Tue, 17 Apr 2018 03:59:32 -0400

Hello @alex, I inserted the template onto my elasticsearch server but it didn't help. Not really sure if I did something wrong here.

https://codebeautify.org/jsonviewer/cbb1a15d

Answer by Alex Suter

Alex Suter — Tue, 17 Apr 2018 03:05:00 -0400

Hi @ToanLC

You can manually create an index template which allows over 1000 fields. When elasticsearch creates the index, it takes all matching index templates and creates the index.

Afterwards you must recreate the index over the api. Here an index template example.

 "fix_totat_fields" : {
    "order" : 0,
    "version" : 1,
    "template" : "ivy.businessdata*",
    "settings" : {
      "index" : {
        "mapping" : {
          "total_fields" : {
            "limit" : "10000"
          }
        }
      }
    },
    "mappings" : { },
    "aliases" : { } 
}