"[circuit_breaking_exception] [parent]" Data too large, data for "[<http_request>]" would be error
After some more research finally, I found a solution for this i.e
- We should not disable circuit breaker as it might result in OOM error and eventually might crash elasticsearch.
- dynamically increasing circuit breaker memory percentage is good but it is also a temporary solution because at the end after solution increased percentage might also fill up.
- Finally, we have a third option i.e increase overall JVM heap size which is 1GB by default but as recommended it should be around 30-32 GB on production, also it should be less than 50% of available total memory.
For more info check this for good JVM memory configurations of elasticsearch on production, Heap: Sizing and Swapping