Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TobDeBer
/
SmartQuant

GGUF
imatrix
conversational
Model card Files Files and versions
xet
Community
SmartQuant
26.9 GB
  • 3 contributors
History: 19 commits
TobDeBer's picture
TobDeBer
Delete Tiny-Moe.Q6_K_T3.gguf
e2f3184 verified about 1 month ago
  • .gitattributes
    2.2 kB
    Rename llama-quantize to llama-quantize-sq 2 months ago
  • README.md
    405 Bytes
    Update README.md 8 months ago
  • SmartQuant-Llama-3.3-70B-Instruct.gguf
    21 GB
    xet
    Rename Llama-3.3-70B-Instruct-SmartQuant.gguf to SmartQuant-Llama-3.3-70B-Instruct.gguf 8 months ago
  • SmartQuant-granite-3.3-8b-instruct.gguf
    5.84 GB
    xet
    Rename granite-3.3-8b-instruct-SmartQuant.gguf to SmartQuant-granite-3.3-8b-instruct.gguf 8 months ago
  • calibration_datav3.txt
    280 kB
    add quantization tool 8 months ago
  • llama-quantize-sq
    2.78 MB
    xet
    Rename llama-quantize to llama-quantize-sq 2 months ago