Skip to content

Commit 5442b46

Browse files
authored
add doc for patch_config (#574)
### What this PR does / why we need it? add doc for patch_config ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? No code changed. Signed-off-by: Shuqiao Li <celestialli@outlook.com>
1 parent 96d6fa7 commit 5442b46

File tree

1 file changed

+12
-1
lines changed

1 file changed

+12
-1
lines changed

vllm_ascend/patch/platform/patch_0_8_4/__init__.py

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,17 @@
1414
# See the License for the specific language governing permissions and
1515
# limitations under the License.
1616
#
17+
# What's Patched and how it works:
18+
# ** File: platform/patch_0_8_4/patch_config.py**
19+
# 1. `vllm.config.ModelConfig.__init__()`
20+
# Why:
21+
# It is hard coded for sleep mode to support cuda platform only
22+
# How:
23+
# Using a new method to check if sleep mode is available
24+
# Related PR (if no, explain why): 1. refused by vllm. 2. vllm doesn't support 3. prepare to submit....
25+
# https://github.com/vllm-project/vllm/pull/16562
26+
# Future Plan:
27+
# This patch is only used for 084 and can't be revert. just keep as it is.
1728

1829
import vllm_ascend.patch.platform.patch_0_8_4.patch_config # noqa
19-
import vllm_ascend.patch.platform.patch_0_8_4.patch_distributed # noqa
30+
import vllm_ascend.patch.platform.patch_0_8_4.patch_distributed # noqa

0 commit comments

Comments
 (0)