|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
public interface TextTokenizer
An interface for text tokenizers.
Text tokenisers are used to return a list of TextEvent
from a piece of text.
Method Summary | |
---|---|
TextGranularity |
granurality()
Returns the text granularity of this tokenizer. |
List<TextEvent> |
tokenize(CharSequence seq)
Returns the list of TextEvent corresponding to the specified character sequence. |
Method Detail |
---|
List<TextEvent> tokenize(CharSequence seq)
TextEvent
corresponding to the specified character sequence.
seq
- the character sequence to tokenize.
TextGranularity granurality()
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |