Skip to content

Commit bae1481

Browse files
dtrifirodtrifiro
committed
mistralai/Mixtral-8x7B-Instruct-v0.1: set tensor-parallel-size=2
1 parent 2cce5ca commit bae1481

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

‎mistralai/Mixtral-8x7B-Instruct-v0.1/accuracy/server-rocm.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,3 +2,4 @@
22
model: 'mistralai/Mixtral-8x7B-Instruct-v0.1'
33
trust-remote-code: true
44
max-model-len: 16384
5+
tensor-parallel: 2

0 commit comments

Comments
 (0)