Article
There is no such thing as a tokenizer-free lunch
•
91
Catherine Arnett
catherinearnett
AI & ML interests
multilingual NLP, tokenization
Recent Activity
updated
a collection
25 days ago
Monolingual Models with Checkpoints
updated
a collection
25 days ago
Monolingual Models with Checkpoints
updated
a collection
25 days ago
Monolingual Models with Checkpoints
Organizations
published
an
article
2 months ago
published
an
article
3 months ago
Article
An Analysis of Multilingual Models on Hugging Face
•
4
published
an
article
7 months ago
Article
Best Practices for Open Multilingual LLM Evaluation
•
4
published
an
article
about 1 year ago
Article
They Said It Couldn’t Be Done
•
90
published
an
article
about 1 year ago
Article
Releasing the largest multilingual open pretraining dataset
•
104
published
an
article
about 1 year ago
Article
Detoxifying the Commons
•
6
published
an
article
about 1 year ago
Article
wHy DoNt YoU jUsT uSe ThE lLaMa ToKeNiZeR??
•
53