How to decide the quant group scale

Hi there, I am wondering why did you decide the quantization group scale  is 128 BF16s? Is it just because the thread number fits 128 well， or you also thought about quantization precision? Thank you!