Skip to content

Commit c3cc463

Browse files
committed
Add cont for debugging
1 parent 306ea4b commit c3cc463

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/llama-graph.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1494,6 +1494,7 @@ ggml_tensor * llm_graph_context::build_attn(
14941494
ggml_row_size(kv_self->k_l[il]->type, n_embd_k_gqa),
14951495
ggml_row_size(kv_self->k_l[il]->type, n_embd_head_k),
14961496
n_embd_head_k-n_embd_head_v); // offset by n_rot elements
1497+
v = ggml_cont(ctx0, v);
14971498
}
14981499

14991500
ggml_tensor * cur = build_attn_mha(gf, q, k, v, kq_b, kq_mask, v_mla, v_trans, kq_scale);

0 commit comments

Comments
 (0)