In a Training Loop 🔄

66 1 10

Ton Cao

cpatonn

ton-cao-208032186

AI & ML interests

None yet

Recent Activity

updated a model 1 day ago

cyankiwi/rnj-1-instruct-AWQ-8bit

updated a model 1 day ago

cyankiwi/rnj-1-instruct-AWQ-4bit

published a model 1 day ago

cyankiwi/rnj-1-instruct-AWQ-8bit

View all activity

Organizations

New activity in cyankiwi/Nemotron-Orchestrator-8B-AWQ-8bit 2 days ago

Unable to run with latest vllm version

#1 opened 4 days ago by

suneetk

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 11 days ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍 ❤️ 2

#3 opened 12 days ago by

stelterlab

New activity in cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 13 days ago

Performance evaluation for v1.0.0 Model

#12 opened 13 days ago by

woodytse

Successfully Running Qwen3-Next-80B-A3B-Instruct-AWQ-4bit on 3x RTX 3090s

❤️ 🤝 4

#9 opened 2 months ago by

8055izham

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 18 days ago

Model not loading

#8 opened 20 days ago by

nephepritou

New activity in cyankiwi/GLM-4.6-AWQ-4bit 18 days ago

Great quantized model

#1 opened 19 days ago by

CHNtentes

New activity in cyankiwi/MiniMax-M2-REAP-162B-A10B-AWQ-4bit 19 days ago

I have problem with run on latest vllm and 4x 3090

#1 opened 19 days ago by

funny-42

New activity in cpatonn/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit 20 days ago

How to run awq model with audio output?

#8 opened 20 days ago by

morlz

New activity in cyankiwi/MiniMax-M2-AWQ-4bit 20 days ago

"observer": "mse" could improve accuracy?

#1 opened 21 days ago by

CHNtentes

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 21 days ago

why recently re-uploaded the core?

#7 opened 22 days ago by

Geximus

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 23 days ago

Multi token prediction not working

#6 opened 27 days ago by

abhinavkulkarni

New activity in cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 23 days ago

sorta works on vllm now

👍 1

#8 opened 3 months ago by

MrDragonFox

Did anyone get speculative decode working?

👀 1

#10 opened about 2 months ago by

amit864

New activity in cyankiwi/aquif-3.5-Max-42B-A3B-AWQ-4bit 24 days ago

Update thinking=true by default

#1 opened 26 days ago by

pramjana

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit about 1 month ago

Added tool tokens (from original repository)

#2 opened about 1 month ago by

LPN64

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-8bit about 1 month ago

Having trouble running

#1 opened about 1 month ago by

ramendik

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit about 1 month ago

Error installing from PR branch

👍 1

#1 opened about 1 month ago by

DrRos

New activity in cpatonn/GLM-4.5-Air-AWQ-4bit about 1 month ago

Running on 6 GPUs

🤗 1