What characters does the standard tokenizer delimit on? What characters does the standard tokenizer delimit on? elasticsearch elasticsearch

What characters does the standard tokenizer delimit on?


As per the documentation I believe this is the list of symbols/characters used for defining tokens: http://unicode.org/reports/tr29/#Default_Word_Boundaries