SuperBPE tokenizers and models trained with them
-
SuperBPE Playground
π6Experiment with and compare different tokenizers
-
SuperBPE: Space Travel for Language Models
Paper β’ 2503.13423 β’ Published β’ 13 -
UW/OLMo2-8B-SuperBPE-t180k
Text Generation β’ 8B β’ Updated β’ 74 β’ 7 -
UW/OLMo2-11B-SuperBPE-t180k
Text Generation β’ 11B β’ Updated β’ 6 β’ 2