How to index and store multiple languages in ElasticSearch
Not sure I fully understood your concern.
If you need to search on the full cluster (I mean search in every language), you can't create one setup per language.
That said, you have many options:
- Create one index per language and have a mapping for each index/type.
- Use the _analyzer field to indicate the language for your document. See http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/mapping-analyzer-field.html
- Use a multifield with a different analyzer for each language. See https://www.elastic.co/guide/en/elasticsearch/reference/0.90/mapping-multi-field-type.html
It's not a full answer but some clues to help you...