Slow index speed of Elasticsearch
Upgrade your ES to latest version, because in recent releases they have made it more production friendly and most stable release now is the latest one 2.3
You can try following things to make indexing go faster:
- Make some master nodes, separate from Data nodes as it will reduce load on all your cluster.
- Disable OS swapping, ES takes care of that and Check your heap size on all your machines Heap Sizing
- Check your documents are of similar size always, you can make use of bulk indexing and tweak you settings in there like chunk_size in number of records or in memory size
- If you are using script try to optimize that as they make the indexing slow, you can store the scripted value if possible as preprocessing, as ES is not designed to handle scripting.
- Check number of shards per node and try to balance that out across nodes using Routing
- Read more on how ES guys suggest production ready system to work Elasticsearch in Production
- One more blog on increasing Elasticsearch Indexing performance Performance Considerations for Elasticsearch Indexing
Check this answer for optimal way to setup ELK Stack on three servers. Optimal way to set up ELK stack on three servers