As the question, I am wondering did you also include special tokens like [COL] [VAL] and attribute names into BERT vocabulary?