Skip to content

Commit 31977e6

Browse files
committed
Set test Dream transformer to have 2 layers so that CPU offload can be properly tested
1 parent 879b41e commit 31977e6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/models/transformers/test_models_transformer_dream.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ def prepare_dummy_input(self, batch_size: int = 1, sequence_length: int = 48):
6060

6161
def prepare_init_args_and_inputs_for_common(self):
6262
init_dict = {
63-
"num_layers": 1,
63+
"num_layers": 2,
6464
"attention_head_dim": 16,
6565
"num_attention_heads": 4,
6666
"num_attention_kv_heads": 2,

0 commit comments

Comments
 (0)