File tree
7 files changed
+319
-169
lines changed- torchprime
- layers
- torch_xla_models
- llama
- mixtral
- tests
7 files changed
+319
-169
lines changedLines changed: 18 additions & 37 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
169 | 169 |
| |
170 | 170 |
| |
171 | 171 |
| |
| 172 | + | |
172 | 173 |
| |
173 | 174 |
| |
174 | 175 |
| |
175 | 176 |
| |
176 | 177 |
| |
177 | 178 |
| |
178 | 179 |
| |
179 |
| - | |
| 180 | + | |
180 | 181 |
| |
181 | 182 |
| |
182 | 183 |
| |
183 | 184 |
| |
184 | 185 |
| |
185 |
| - | |
| 186 | + | |
186 | 187 |
| |
187 | 188 |
| |
188 | 189 |
| |
189 | 190 |
| |
190 | 191 |
| |
| 192 | + | |
191 | 193 |
| |
192 |
| - | |
193 |
| - | |
194 |
| - | |
195 |
| - | |
196 |
| - | |
197 |
| - | |
198 |
| - | |
199 |
| - | |
200 |
| - | |
201 |
| - | |
202 |
| - | |
203 |
| - | |
| 194 | + | |
| 195 | + | |
204 | 196 |
| |
205 |
| - | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
206 | 202 |
| |
207 | 203 |
| |
| 204 | + | |
| 205 | + | |
| 206 | + | |
208 | 207 |
| |
| 208 | + | |
209 | 209 |
| |
210 | 210 |
| |
211 | 211 |
| |
212 |
| - | |
| 212 | + | |
| 213 | + | |
213 | 214 |
| |
214 | 215 |
| |
215 |
| - | |
216 |
| - | |
217 |
| - | |
218 |
| - | |
219 |
| - | |
220 | 216 |
| |
221 |
| - | |
222 |
| - | |
223 |
| - | |
224 |
| - | |
225 | 217 |
| |
226 | 218 |
| |
227 | 219 |
| |
228 |
| - | |
229 |
| - | |
230 | 220 |
| |
231 |
| - | |
232 |
| - | |
233 |
| - | |
234 |
| - | |
235 |
| - | |
236 |
| - | |
237 |
| - | |
| 221 | + | |
238 | 222 |
| |
239 | 223 |
| |
240 |
| - | |
241 |
| - | |
242 |
| - | |
243 | 224 |
| |
244 | 225 |
| |
245 | 226 |
| |
|
Lines changed: 41 additions & 0 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + |
Lines changed: 27 additions & 18 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
28 | 28 |
| |
29 | 29 |
| |
30 | 30 |
| |
| 31 | + | |
31 | 32 |
| |
| 33 | + | |
32 | 34 |
| |
33 | 35 |
| |
34 | 36 |
| |
| |||
328 | 330 |
| |
329 | 331 |
| |
330 | 332 |
| |
331 |
| - | |
332 |
| - | |
| 333 | + | |
| 334 | + | |
333 | 335 |
| |
334 | 336 |
| |
335 | 337 |
| |
336 | 338 |
| |
337 | 339 |
| |
338 | 340 |
| |
339 | 341 |
| |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
340 | 347 |
| |
341 | 348 |
| |
342 | 349 |
| |
| |||
370 | 377 |
| |
371 | 378 |
| |
372 | 379 |
| |
373 |
| - | |
374 | 380 |
| |
375 |
| - | |
376 |
| - | |
| 381 | + | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
377 | 386 |
| |
378 | 387 |
| |
379 | 388 |
| |
| |||
385 | 394 |
| |
386 | 395 |
| |
387 | 396 |
| |
388 |
| - | |
| 397 | + | |
| 398 | + | |
389 | 399 |
| |
390 | 400 |
| |
391 |
| - | |
392 |
| - | |
393 |
| - | |
394 |
| - | |
395 |
| - | |
396 | 401 |
| |
| 402 | + | |
| 403 | + | |
| 404 | + | |
| 405 | + | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
| 409 | + | |
397 | 410 |
| |
398 | 411 |
| |
399 | 412 |
| |
| |||
403 | 416 |
| |
404 | 417 |
| |
405 | 418 |
| |
406 |
| - | |
407 |
| - | |
408 |
| - | |
409 | 419 |
| |
410 |
| - | |
411 |
| - | |
412 |
| - | |
413 |
| - | |
| 420 | + | |
| 421 | + | |
| 422 | + | |
414 | 423 |
| |
415 | 424 |
| |
416 | 425 |
| |
|
Lines changed: 35 additions & 25 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
31 | 31 |
| |
32 | 32 |
| |
33 | 33 |
| |
| 34 | + | |
34 | 35 |
| |
35 | 36 |
| |
36 | 37 |
| |
| |||
129 | 130 |
| |
130 | 131 |
| |
131 | 132 |
| |
132 |
| - | |
133 |
| - | |
| 133 | + | |
| 134 | + | |
134 | 135 |
| |
135 | 136 |
| |
136 | 137 |
| |
| |||
204 | 205 |
| |
205 | 206 |
| |
206 | 207 |
| |
207 |
| - | |
| 208 | + | |
208 | 209 |
| |
209 | 210 |
| |
210 | 211 |
| |
| |||
816 | 817 |
| |
817 | 818 |
| |
818 | 819 |
| |
819 |
| - | |
| 820 | + | |
| 821 | + | |
| 822 | + | |
820 | 823 |
| |
821 | 824 |
| |
822 | 825 |
| |
| |||
851 | 854 |
| |
852 | 855 |
| |
853 | 856 |
| |
| 857 | + | |
854 | 858 |
| |
855 | 859 |
| |
856 | 860 |
| |
| |||
895 | 899 |
| |
896 | 900 |
| |
897 | 901 |
| |
898 |
| - | |
| 902 | + | |
| 903 | + | |
| 904 | + | |
| 905 | + | |
| 906 | + | |
899 | 907 |
| |
900 | 908 |
| |
901 | 909 |
| |
| |||
915 | 923 |
| |
916 | 924 |
| |
917 | 925 |
| |
| 926 | + | |
918 | 927 |
| |
919 |
| - | |
920 |
| - | |
| 928 | + | |
| 929 | + | |
921 | 930 |
| |
922 | 931 |
| |
923 | 932 |
| |
| |||
936 | 945 |
| |
937 | 946 |
| |
938 | 947 |
| |
939 |
| - | |
| 948 | + | |
940 | 949 |
| |
941 | 950 |
| |
942 | 951 |
| |
| |||
954 | 963 |
| |
955 | 964 |
| |
956 | 965 |
| |
957 |
| - | |
958 |
| - | |
| 966 | + | |
| 967 | + | |
| 968 | + | |
| 969 | + | |
| 970 | + | |
959 | 971 |
| |
960 | 972 |
| |
961 | 973 |
| |
| |||
978 | 990 |
| |
979 | 991 |
| |
980 | 992 |
| |
981 |
| - | |
| 993 | + | |
982 | 994 |
| |
983 | 995 |
| |
984 | 996 |
| |
985 | 997 |
| |
986 |
| - | |
| 998 | + | |
| 999 | + | |
| 1000 | + | |
987 | 1001 |
| |
988 | 1002 |
| |
989 | 1003 |
| |
| |||
999 | 1013 |
| |
1000 | 1014 |
| |
1001 | 1015 |
| |
1002 |
| - | |
1003 |
| - | |
1004 |
| - | |
1005 |
| - | |
1006 |
| - | |
1007 |
| - | |
1008 |
| - | |
1009 |
| - | |
1010 |
| - | |
1011 |
| - | |
1012 |
| - | |
| 1016 | + | |
| 1017 | + | |
| 1018 | + | |
| 1019 | + | |
| 1020 | + | |
| 1021 | + | |
| 1022 | + | |
1013 | 1023 |
| |
1014 |
| - | |
| 1024 | + | |
1015 | 1025 |
| |
1016 | 1026 |
| |
1017 |
| - | |
| 1027 | + | |
1018 | 1028 |
| |
1019 | 1029 |
| |
1020 | 1030 |
| |
|
0 commit comments