continued pretraining of llama3.1 8b on refinedweb for ~80M tokens to try to undo the annealing step and make it act more like an actual base model
From Our Page
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
models
17
from-our-page/Apertus-70B-2509-GGUF
Text Generation
•
71B
•
Updated
•
79
•
1
from-our-page/Olmo-3-1125-32B-stage1-step656000
32B
•
Updated
from-our-page/Trinity-Nano-Base-Pre-Anneal-Q8_0-GGUF
6B
•
Updated
•
8
from-our-page/Trinity-Mini-Base-Pre-Anneal-Q6_K-Imatrix-GGUF
Text Generation
•
26B
•
Updated
•
3
•
1
from-our-page/Trinity-Nano-Base-Pre-Anneal-Q6_K-Imatrix-GGUF
Text Generation
•
6B
•
Updated
•
3
•
1
from-our-page/hillary-clinton-emails-wikileaks
Updated
from-our-page/BigLlama-3.0-120B
Updated
from-our-page/BigLlama-2-120B
Text Generation
•
120B
•
Updated
•
3
from-our-page/Llama-4-Maverick-17B-128E-mlx-4bit
Text Generation
•
63B
•
Updated
•
150
•
1
from-our-page/llama3.1-8b-refinedbase-checkpoint-5120
8B
•
Updated
•
3