Skip to content

Commit 306bd63

Browse files
authored
Add gptq known issue (#2080)
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
1 parent 3bc8e4d commit 306bd63

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

docs/source/faq.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,3 +26,9 @@ Intel TBB is required, try:
2626
$ conda/pip install tbb
2727
```
2828
**Solution:** It's actually already installed by `requirements_pt.txt`, so just need to set up with `export LD_LIBRARY_PATH=/usr/local/lib/:$LD_LIBRARY_PATH`.
29+
#### Issue 6:
30+
torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed because the input is not positive-definite.
31+
**Solution:** This is a known issue. For more details, refer to
32+
[AutoGPTQ/AutoGPTQ#196](https://github.com/AutoGPTQ/AutoGPTQ/issues/196).
33+
Try increasing `percdamp` (percent of the average Hessian diagonal to use for dampening),
34+
or increasing `nsamples` (the number of calibration samples).

0 commit comments

Comments
 (0)