We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent c2c3d95 commit 0c7fb7dCopy full SHA for 0c7fb7d
examples/llm_finetune/llama3_2/llama3_2_1b_squad.yaml
@@ -99,12 +99,3 @@ lr_scheduler:
99
# name: <your_wandb_exp_name>
100
# save_dir: <your_wandb_save_dir>
101
102
-# Optional Quantization-Aware Training (QAT) configuration (torchao)
103
-# Produces a standard checkpoint; run a separate quantization step to materialize int weights.
104
-# To enable, set enabled: true and provide a torchao QAT quantizer.
105
-qat:
106
- enabled: true
107
- quantizer:
108
- _target_: torchao.quantization.qat.Int8DynActInt4WeightQATQuantizer
109
- groupsize: 256
110
- fake_quant_after_n_steps: 1000
0 commit comments