Code

R1 woq#2148

Code

Draft

yiliu30 wants to merge 28 commits intodev/ds_r1intel/neural-compressor:dev/ds_r1from

r1-woqintel/neural-compressor:r1-woqCopy head branch name to clipboard

Commits

Commits on Mar 20, 2025

• fix patched mod wip

  Show description for 730bf0c
  Yi4Liu

  committed
  730bf0c

  Copy full SHA for 730bf0c

• dequant fp8 if needed

  Show description for fbd59c2
  Yi4Liu

  committed
  fbd59c2

  Copy full SHA for fbd59c2

Commits on Mar 21, 2025

• add patched mod for fp8 ds

  Show description for 8328996
  Yi4Liu

  committed
  8328996

  Copy full SHA for 8328996

• add fused moe back

  Show description for eb9e4ed
  Yi4Liu

  committed
  eb9e4ed

  Copy full SHA for eb9e4ed

• show mem after patch

  Show description for 204bd99
  Yi4Liu

  committed
  204bd99

  Copy full SHA for 204bd99

• debug

  Show description for 18f51b2
  Yi4Liu

  committed
  18f51b2

  Copy full SHA for 18f51b2

• update

  Show description for 472f0e2
  Yi4Liu

  committed
  472f0e2

  Copy full SHA for 472f0e2

• sync for each tran

  Show description for e25d658
  Yi4Liu

  committed
  e25d658

  Copy full SHA for e25d658

• fix OoM

  Show description for 215d31c
  Yi4Liu

  committed
  215d31c

  Copy full SHA for 215d31c

• refine log

  Show description for e8d44f4
  Yi4Liu

  committed
  e8d44f4

  Copy full SHA for e8d44f4

• brr after convert

  Show description for 13df72f
  Yi4Liu

  committed
  13df72f

  Copy full SHA for 13df72f

Commits on Mar 24, 2025

• remove NUM_EXPERTS_GROUPS

  yiliu30

  committed
  325f69e

  Copy full SHA for 325f69e

• Refine R1 WOQ Requant (#2150)

  Show description for ea8c842
  yiliu30

  authored
  ea8c842

  Copy full SHA for ea8c842

• rename func names

  Show description for 653ca69
  Yi4Liu

  committed
  653ca69

  Copy full SHA for 653ca69

Commits on Mar 25, 2025

• remove debug info

  Show description for be597d5
  Yi4Liu

  committed
  be597d5

  Copy full SHA for be597d5

Commits on Mar 31, 2025

• force install pt

  Show description for f72e782
  Yi4Liu

  committed
  f72e782

  Copy full SHA for f72e782

• install all reqs

  Show description for c1f938a
  Yi4Liu

  committed
  c1f938a

  Copy full SHA for c1f938a

Commits on Apr 1, 2025

• update dequant func

  yiliu30

  committed
  c748f5e

  Copy full SHA for c748f5e

• update

  yiliu30

  committed
  eb5f04d

  Copy full SHA for eb5f04d

Commits on Apr 5, 2025

• Update PatchedVLLMKVCache for deepseek performance (#2165)

  mengniwang95

  authored
  fcf3031

  Copy full SHA for fcf3031

Commits on Apr 7, 2025

• align fused moe op

  Show description for 39d1ccf
  Yi4Liu

  committed
  39d1ccf

  Copy full SHA for 39d1ccf

• fix moe op

  Show description for c3c60a9
  Yi4Liu

  committed
  c3c60a9

  Copy full SHA for c3c60a9

• fix moe op num_outputs

  Show description for ccb90e5
  Yi4Liu

  committed
  ccb90e5

  Copy full SHA for ccb90e5

Commits on Apr 9, 2025

• dequant for pts as well (#2167)

  Show description for 56de618
  

  yiliu30

  and

  Yi4Liu

  authored
  56de618

  Copy full SHA for 56de618

Commits on Apr 12, 2025

• correct linear measure (#2170)

  Show description for e340ed9
  yiliu30

  authored
  e340ed9

  Copy full SHA for e340ed9

Commits on May 16, 2025

• add INC_MEASUREMENT_DUMP_PATH_PREFIX (#2210)

  Show description for 887787e
  yiliu30

  authored
  887787e

  Copy full SHA for 887787e

• fix path check (#2212)

  Show description for 971a7e5
  yiliu30

  authored
  971a7e5

  Copy full SHA for 971a7e5

• Naive Scaling (#2211)

  Show description for 0bd4390
  

  yiliu30

  and

  Copilot

  authored
  0bd4390

  Copy full SHA for 0bd4390