Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,039

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-2.8b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 20, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int3-step129000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int3-step14000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int3-step29000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int3-step43000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 5

Xu-Ouyang/pythia-70m-deduped-int3-step57000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int3-step86000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int3-step100000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-70m-deduped-int3-step115000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int3-step129000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 4

Xu-Ouyang/pythia-2.8b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 20, 2024 • 3

liho00/opt-125m-gptq-4bit

Text Generation • 1B • Updated Jul 21, 2024 • 4

Xu-Ouyang/pythia-2.8b-deduped-int3-step115000-GPTQ-wikitext2

Text Generation • 0.5B • Updated Jul 20, 2024 • 3

Xu-Ouyang/pythia-12b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 20, 2024 • 3

Xu-Ouyang/pythia-2.8b-deduped-int3-step129000-GPTQ-wikitext2

Text Generation • 0.5B • Updated Jul 20, 2024 • 3

Xu-Ouyang/pythia-12b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 20, 2024 • 17

Xu-Ouyang/pythia-12b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 20, 2024 • 4

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • 59B • Updated Aug 7, 2024 • 323 • 16

Xu-Ouyang/pythia-12b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 20, 2024 • 3

Xu-Ouyang/pythia-12b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 20, 2024 • 3

Nkumah7/gemma-11-2b-it-ptt-lora-exp-v1-merged-4bit-gptq

Text Generation • 0.8B • Updated Jul 20, 2024 • 4

rinna/llama-3-youko-8b-gptq

Text Generation • 2B • Updated Mar 23 • 8

rinna/llama-3-youko-8b-instruct-gptq

Text Generation • 2B • Updated Mar 23 • 12 • 1

rinna/llama-3-youko-70b-gptq

Text Generation • 11B • Updated Mar 23 • 11

rinna/llama-3-youko-70b-instruct-gptq

Text Generation • 11B • Updated Mar 23 • 9

Xu-Ouyang/pythia-1.4b-deduped-int3-step14000-GPTQ-wikitext2

Text Generation • 0.3B • Updated Jul 21, 2024 • 3

Xu-Ouyang/pythia-1.4b-deduped-int3-step29000-GPTQ-wikitext2

Text Generation • 0.3B • Updated Jul 21, 2024 • 3

Xu-Ouyang/pythia-1.4b-deduped-int3-step43000-GPTQ-wikitext2

Text Generation • 0.3B • Updated Jul 22, 2024 • 3

Xu-Ouyang/pythia-1.4b-deduped-int3-step57000-GPTQ-wikitext2

Text Generation • 0.3B • Updated Jul 22, 2024 • 2

ChenMnZ/Llama-2-13b-EfficientQAT-w2g128-GPTQ

Text Generation • 1B • Updated Jul 22, 2024 • 8