Title here
Summary here
Token
The basic unit of text a language model processes. Roughly 3–4 characters or ~0.75 words in English. Model speeds are measured in tokens per second (t/s).
Prev
tanhNext
Unified memoryThe basic unit of text a language model processes. Roughly 3–4 characters or ~0.75 words in English. Model speeds are measured in tokens per second (t/s).