Koga Kobayashi
kajyuuen
AI & ML interests
None yet
Organizations
llama.cppγ΅γγΌγ
10
#2 opened over 1 year ago
by
cpumaxx
Do not add EOS token when tokenizine by default
π 3
1
#4 opened over 1 year ago
by
p1atdev
add-fast-tokenizer
#1 opened over 1 year ago
by
kajyuuen
Not working with latest transformers.
1
#3 opened over 2 years ago
by
kajyuuen
Update distilbert_japanese_tokenizer.py
π 1
1
#4 opened about 2 years ago
by
liwii
Adding `safetensors` variant of this model
#3 opened over 2 years ago
by
SFconvertbot
Update README.md
π 1
1
#2 opened over 2 years ago
by
alfredplpl
Allow only unidic_lite
#2 opened almost 3 years ago
by
kajyuuen
Improve tokenizers
#1 opened almost 3 years ago
by
kajyuuen
Improve tokenizers
#1 opened almost 3 years ago
by
kajyuuen