Skip to content

Commit 0c7fb7d

Browse files
committed
fix
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
1 parent c2c3d95 commit 0c7fb7d

File tree

1 file changed

+0
-9
lines changed

1 file changed

+0
-9
lines changed

examples/llm_finetune/llama3_2/llama3_2_1b_squad.yaml

Lines changed: 0 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -99,12 +99,3 @@ lr_scheduler:
9999
# name: <your_wandb_exp_name>
100100
# save_dir: <your_wandb_save_dir>
101101

102-
# Optional Quantization-Aware Training (QAT) configuration (torchao)
103-
# Produces a standard checkpoint; run a separate quantization step to materialize int weights.
104-
# To enable, set enabled: true and provide a torchao QAT quantizer.
105-
qat:
106-
enabled: true
107-
quantizer:
108-
_target_: torchao.quantization.qat.Int8DynActInt4WeightQATQuantizer
109-
groupsize: 256
110-
fake_quant_after_n_steps: 1000

0 commit comments

Comments
 (0)