Skip to content

Commit 12c50f1

Browse files
committed
feat: Add support for dense FFN tensor names on c++ side
Branch: GraniteFour Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
1 parent 8a1ea3e commit 12c50f1

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

src/llama-arch.cpp

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1670,6 +1670,11 @@ static const std::map<llm_arch, std::map<llm_tensor, const char *>> LLM_TENSOR_N
16701670
{ LLM_TENSOR_ATTN_K, "blk.%d.attn_k" },
16711671
{ LLM_TENSOR_ATTN_V, "blk.%d.attn_v" },
16721672
{ LLM_TENSOR_ATTN_OUT, "blk.%d.attn_output" },
1673+
// dense FFN
1674+
{ LLM_TENSOR_FFN_NORM, "blk.%d.ffn_norm" },
1675+
{ LLM_TENSOR_FFN_GATE, "blk.%d.ffn_gate" },
1676+
{ LLM_TENSOR_FFN_DOWN, "blk.%d.ffn_down" },
1677+
{ LLM_TENSOR_FFN_UP, "blk.%d.ffn_up" },
16731678
// moe FFN
16741679
{ LLM_TENSOR_FFN_NORM, "blk.%d.ffn_norm" },
16751680
{ LLM_TENSOR_FFN_GATE_INP, "blk.%d.ffn_gate_inp" },

0 commit comments

Comments
 (0)