update loading instructions
Browse files
README.md
CHANGED
|
@@ -51,10 +51,10 @@ The linear modules **albert.encoder.albert_layer_groups.0.albert_layers.0.ffn_ou
|
|
| 51 |
#### Load with Intel® Neural Compressor:
|
| 52 |
|
| 53 |
```python
|
| 54 |
-
from optimum.intel
|
| 55 |
|
| 56 |
model_id = "Intel/albert-base-v2-sst2-int8-static"
|
| 57 |
-
int8_model =
|
| 58 |
```
|
| 59 |
|
| 60 |
### ONNX
|
|
@@ -78,4 +78,4 @@ The calibration dataloader is the eval dataloader. The calibration sampling size
|
|
| 78 |
```python
|
| 79 |
from optimum.onnxruntime import ORTModelForSequenceClassification
|
| 80 |
model = ORTModelForSequenceClassification.from_pretrained('Intel/albert-base-v2-sst2-int8-static')
|
| 81 |
-
```
|
|
|
|
| 51 |
#### Load with Intel® Neural Compressor:
|
| 52 |
|
| 53 |
```python
|
| 54 |
+
from optimum.intel import INCModelForSequenceClassification
|
| 55 |
|
| 56 |
model_id = "Intel/albert-base-v2-sst2-int8-static"
|
| 57 |
+
int8_model = INCModelForSequenceClassification.from_pretrained(model_id)
|
| 58 |
```
|
| 59 |
|
| 60 |
### ONNX
|
|
|
|
| 78 |
```python
|
| 79 |
from optimum.onnxruntime import ORTModelForSequenceClassification
|
| 80 |
model = ORTModelForSequenceClassification.from_pretrained('Intel/albert-base-v2-sst2-int8-static')
|
| 81 |
+
```
|