Public model checkpoints for our paper Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms.
Code is accessible at GitHub.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support