nsarrazin
/

c4ai-command-r-v01-tokenizer

Transformers.js

Model card Files Files and versions

c4ai-command-r-v01-tokenizer / tokenizer_config.json

Commit History

Update tokenizer_config.json (#3)

6f38b9f
verified

nsarrazin commited on Jul 16, 2024

Update tokenizer_config.json

b39fcad
verified

nsarrazin commited on Jul 15, 2024

Update tokenizer_config.json (#2)

8149df4
verified

nsarrazin commited on Jul 15, 2024

add system messages to tokenizer

6c5535a
unverified

nsarrazin commited on Apr 8, 2024

Remove BOS from chat template

418f7ef

nsarrazin commited on Apr 4, 2024

Upload 2 files

93b7f20
verified

Xenova HF Staff commited on Mar 15, 2024