Model loading error!
Hello！ When I use RnaFmModel.from_pretrained(model_path) to load the model, it prints:
Some weights of RnaFmModel were not initialized from the model checkpoint at /mnt/remote_home/hwang/rnalms/UNI_RNA and are newly initialized: ['embeddings.layer_norm.bias', 'embeddings.layer_norm.weight', 'embeddings.word_embeddings.weight', 'encoder.layer.0.attention.layer_norm.bias', 'encoder.layer.0.attention.layer_norm.weight', 'encoder.layer.0.attention.output.dense.bias', 'encoder.layer.0.attention.output.dense.weight', ...]
What should I do?
Hi.
Please use UniRnaModel.from_pretrained(model_path) instead.
Note that you will need to install MultiMolecule from source as UniRNA is still in development phrase.
Thank you for your suggestion. It worked done well. Appreciate your help!!!