Search results

[安全漏洞]OpenPPL的prefix block cache实现存在缓存污染问题

Status: Open.

#70 In OpenPPL/ppl.llm.serving;

· kexinoh opened on Feb 26, 2025

PPL.LLM的全称是什么？

Status: Open.

#69 In OpenPPL/ppl.llm.serving;

· SendoRay opened on Feb 19, 2025

使用offline_inference测试llama2_7b时，会在执行”column_parallel_linear_kernel“时报错

Status: Open.

#65 In OpenPPL/ppl.llm.serving;

· Nepths opened on Oct 28, 2024

支持qwen1.5或者qwen2吗？

Status: Open.

#64 In OpenPPL/ppl.llm.serving;

· Flynn-Zh opened on Jul 26, 2024

How to generate custom dataset?

Status: Open.

#63 In OpenPPL/ppl.llm.serving;

· trebladev opened on Jul 9, 2024

关于性能分析的一点疑惑

Status: Open.

#60 In OpenPPL/ppl.llm.serving;

· Zhiy-Zhang opened on Apr 25, 2024

编译出错 [ 17%] Built target crypto as: symbol lookup error: as: undefined symbol: deflate

Status: Open.

#36 In OpenPPL/ppl.llm.serving;

· af-74413592 opened on Sep 28, 2023

Error for llama-13B on V100

enhancementNew feature or requestNew feature or request

Status: Open.

#21 In OpenPPL/ppl.llm.serving;

· yisongsong opened on Sep 13, 2023