.new_wordpiece_vocabulary {wordpiece} | R Documentation |
Constructor for Class wordpiece_vocabulary
Description
Constructor for Class wordpiece_vocabulary
Usage
.new_wordpiece_vocabulary(vocab, is_cased)
Arguments
vocab |
Character vector of tokens. |
is_cased |
Logical; whether the vocabulary is cased. |
Value
The vocabulary with is_cased
attached as an attribute, and the
class wordpiece_vocabulary
applied.
[Package wordpiece version 2.1.3 Index]