Skip to content

Commit cec96c2

Browse files
dtrifirodtrifiro
committed
mistralai/Mixtral-8x7B-Instruct-v0.1: set tensor-parallel-size=1
1 parent 2cce5ca commit cec96c2

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

‎mistralai/Mixtral-8x7B-Instruct-v0.1/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,3 +2,4 @@
22
model: 'mistralai/Mixtral-8x7B-Instruct-v0.1'
33
trust-remote-code: true
44
max-model-len: 16384
5+
tensor-parallel: 1

0 commit comments

Comments
 (0)