dont run FP8, error
#3
by
chuanyizjc
- opened
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/transformers/utils/hub.py", line 491, in cached_files
raise OSError(
OSError: We couldn't connect to 'https://huggingface.co' to load the files, and couldn't find them in the cached files.
Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
Did you find a solution to it @chuanyizjc . Even if I am having the model placed at local path and I am finding the same error as above. I have tried to add print statement at each step to find out that , it able access insides of model file, still while launching/serving the above error is incurred