Update README.md

README.md

@@ -30,6 +30,18 @@ pipeline_tag: text-generation
 # SpydazWeb AGI 
 ( trained with heads ) : updated Codebase to Mistral-Nemo CodeBase : ( Perhaps i will make the nemo today !)
 
+## Training Note  : 
+This is the base FP16 model !  ( very hard to get out! i had to use transformers only and NOT unsloth !):
+to only train with transformers ( the model needs to be on the a100 as it takes a super amount of memory ?? as it is a special model)
+I did manage to load and train the model with unsloth but the model did not Merge the lora ! to fp16 :
+### REASON :
+Unsloth issues : they load thier own model if your loading a 16bit model ... 
+and train the lora expecting you to merge it.. but if you use a 4bit model then the unsloth loads your exaact model !?
+you think.... WHAT? they download your own tensors but use another model ?? 
+yes they have a mistral modelling file of thier own which is much more simple than transformers : more lighter weight ... so your customizations do not get loaded ? 
+SO this file will have to be adjusted for me to full train each head intensly and test the outcomes correctly ... but its working fine !
+
+
 ## SpydazWeb AI model :
 
 This model is based on the worlds archive of knowledge maintaining historical documents and providing services for the survivors of mankind ,