Uses of Record Class
opennlp.dl.Tokens
Packages that use Tokens
-
Uses of Tokens in opennlp.dl
Methods in opennlp.dl that return TokensModifier and TypeMethodDescriptionprotected final TokensAbstractDL.encodeTokens(CharSequence text) Encodes text as the inputs consumed by a BERT model: the piece strings, their vocabulary ids, an attention mask of ones, and single-segment token types.Methods in opennlp.dl with parameters of type TokensModifier and TypeMethodDescriptionprotected final ObjectAbstractDL.runModel(Tokens tokens, AbstractDL.InferenceSettings settings) Runs the model on one token window and returns its first output.