Skip to content

Commit f70cdc2

Browse files
committed
Fix inf2 condition
1 parent 28313f9 commit f70cdc2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

3-pack/fastapi-server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -145,6 +145,6 @@ async def infer(model_id, seq_0: Optional[str] = default_question, seq_1: Option
145145
if device_type=='gpu':
146146
model=models[model_id]
147147
model.to(device)
148-
elif device_type=='inf':
148+
elif device_type in ['inf1', 'inf2']:
149149
infer(model_id, default_question, default_context)
150150
logger.warning(" ... warmup completed")

0 commit comments

Comments
 (0)