fun-image-caption

Sleeping

Dylan commited on Mar 23

Commit

0160c44

1 Parent(s): d7d7a75

bfloat16

Files changed (1) hide show

agents.py CHANGED Viewed

@@ -54,7 +54,7 @@ model = Gemma3ForConditionalGeneration.from_pretrained(
     model_id,
     # quantization_config=get_quantization_config(),
     device_map="auto",
-    torch_dtype=torch.float16,
 ).eval()

     model_id,
     # quantization_config=get_quantization_config(),
     device_map="auto",
+    torch_dtype=torch.bfloat16,
 ).eval()