Forget BIT, It is All about TOKEN: Towards Semantic Information Theory for LLMs
Paper
•
2511.01202
•
Published
•
5
Bo Bai
atomistic
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 1 month ago
Forget BIT, It is All about TOKEN: Towards Semantic Information Theory
for LLMs
liked
a model
7 months ago
nvidia/OpenMath-Nemotron-1.5B
upvoted
an
article
over 1 year ago
Welcome Falcon Mamba: The first strong attention-free 7B model
Organizations
None yet
upvoted
a
paper
about 1 month ago
liked
a
model
7 months ago
upvoted
an
article
over 1 year ago
Article
Welcome Falcon Mamba: The first strong attention-free 7B model
- +4
•
113
authored
3
papers
over 1 year ago
Extending Context Window of Large Language Models via Semantic Compression
Paper
•
2312.09571
•
Published
•
16
High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Models
Paper
•
2309.15889
•
Published
Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory
Paper
•
2405.08707
•
Published
•
34