How to handle Elasticsearch data when it fills up dedicated volume
One easy tool that can help you do that is Elasticsearch Curator:https://www.elastic.co/guide/en/elasticsearch/client/curator/5.5/actions.html
you can use it to:
- Rollover the indices that hold the data, by size/time. This will cause each PVC to hold few indices, based on time.
- snapshot the rolled over indices to backup in S3
- delete old indices based on their date - delete the oldest indices in order to free up space for the new indices.
Curator can help you do all these.