Update README.md
Browse files
README.md
CHANGED
|
@@ -37,6 +37,14 @@ Original model: https://huggingface.co/google/gemma-2-9b
|
|
| 37 |
|
| 38 |
## Benchmark Results
|
| 39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
| Benchmark | Quant type | Metric |
|
| 41 |
| -------- | ---------- | --------- |
|
| 42 |
| WinoGrande (0-shot) | Q8_0 | 74.4278 +/- 1.2261 |
|
|
|
|
| 37 |
|
| 38 |
## Benchmark Results
|
| 39 |
|
| 40 |
+
Results have been computed using:
|
| 41 |
+
|
| 42 |
+
[hellaswage_val_full](https://raw.githubusercontent.com/klosax/hellaswag_text_data/main/hellaswag_val_full.txt)
|
| 43 |
+
|
| 44 |
+
[winogrande-debiased-eval](https://huggingface.co/datasets/ikawrakow/winogrande-eval-for-llama.cpp/raw/main/winogrande-debiased-eval.csv)
|
| 45 |
+
|
| 46 |
+
[mmlu-validation](https://huggingface.co/datasets/ikawrakow/validation-datasets-for-llama.cpp/resolve/main/mmlu-validation.bin)
|
| 47 |
+
|
| 48 |
| Benchmark | Quant type | Metric |
|
| 49 |
| -------- | ---------- | --------- |
|
| 50 |
| WinoGrande (0-shot) | Q8_0 | 74.4278 +/- 1.2261 |
|