---
license: cc-by-nc-4.0
base_model: CohereForAI/c4ai-command-r-08-2024
pipeline_tag: text-generation
quantized_by: Orion-zhen
---

# Command-R

These exl2 models are quantized using my [pixiv-novel](https://huggingface.co/datasets/Orion-zhen/tagged-pixiv-novel) as calibration.

- [8.0bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/8.0)
- [6.5bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/6.5)
- [5.0bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/5.0)
- [4.65bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/4.65)
- [4.5bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/4.5)
- [4.4bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/4.4)
- [4.2bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/4.2)
- [4.0bpw](https://huggingface.co/Orion-zhen/c4ai-command-r-08-2024-exl2/tree/4.0)