You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/orchestration.md
+9-3Lines changed: 9 additions & 3 deletions
Original file line number
Diff line number
Diff line change
@@ -9,15 +9,16 @@ pruning and then distillation and then quantization.
9
9
## Validated Orchestration Types
10
10
11
11
### One-shot
12
-
12
+
Since quantization-aware training, pruning and distillation all have training processes, we can achieve the goal of optimization through one shot training.
13
13
- Pruning during quantization-aware training
14
14
- Distillation with pattern lock pruning
15
15
- Distillation with pattern lock pruning and quantization-aware training
16
16
17
17
### Multi-shot
18
-
18
+
Of course, besides one-shot, we also support separate execution of each optimization process.
19
19
- Pruning and then post-training quantization
20
20
- Distillation and then post-training quantization
21
+
- Distillation, then pruning and post-training quantization
21
22
22
23
## Orchestration user facing API
23
24
@@ -54,4 +55,9 @@ opt_model = scheduler.fit()
54
55
55
56
### Examples
56
57
57
-
For orchestration related examples, please refer to [Orchestration examples](../examples/README.md).
58
+
For orchestration one-shot related examples, please refer to [One-shot examples](../examples/pytorch/nlp/huggingface_models/question-answering/optimization_pipeline/prune_once_for_all/fx/README.md).
59
+
60
+
For orchestration multi-shot related examples, please refer to [Multi-shot examples](../examples/pytorch/image_recognition/torchvision_models/optimization_pipeline/).
61
+
62
+
### Publications
63
+
All the experiments from [Prune Once for ALL](https://arxiv.org/abs/2111.05754) can be reproduced using [Optimum-Intel](https://github.com/huggingface/optimum-intel) with Intel Neural Compressor.
0 commit comments