AbstractPhil commited on
Commit
b88e2bd
·
verified ·
1 Parent(s): 784ff45

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -13,6 +13,8 @@ pipeline_tag: any-to-any
13
 
14
  Multi-modal Variational Autoencoder for text embedding transformation using geometric fusion.
15
 
 
 
16
  The current implementation is trained with only a handful of token sequences, so it's essentially front-loaded. Expect short sequences to work.
17
  Full-sequence pretraining will begin soon with a uniform vocabulary that takes both tokens in for a representative uniform token based on the position.
18
 
 
13
 
14
  Multi-modal Variational Autoencoder for text embedding transformation using geometric fusion.
15
 
16
+ This first version is essentialy clip_l + t5-base. Similar to those shunt prototypes in concept but entirely divergent in this implementation. This variation is formatted and trained specifically as a VAE to encode/decode pairs of encodings together.
17
+
18
  The current implementation is trained with only a handful of token sequences, so it's essentially front-loaded. Expect short sequences to work.
19
  Full-sequence pretraining will begin soon with a uniform vocabulary that takes both tokens in for a representative uniform token based on the position.
20