Uses of Class
opennlp.tools.tokenize.WhitespaceTokenizer
Packages that use WhitespaceTokenizer
Package
Description
Contains classes related to finding token or words in a string.
-
Uses of WhitespaceTokenizer in opennlp.tools.tokenize
Fields in opennlp.tools.tokenize declared as WhitespaceTokenizerModifier and TypeFieldDescriptionstatic final WhitespaceTokenizerWhitespaceTokenizer.INSTANCEUse this static reference to retrieve an instance of theWhitespaceTokenizer.Methods in opennlp.tools.tokenize that return WhitespaceTokenizerModifier and TypeMethodDescriptionstatic WhitespaceTokenizerWhitespaceTokenizer.newInstance(boolean keepNewLines) Creates a tokenizer that is not shared withWhitespaceTokenizer.INSTANCE, for a caller that setsAbstractTokenizer.setKeepNewLines(boolean)without touching other users of the shared instance.