Edit README to reference the build wasm script

coyotte508 · coyotte508 · commit 57cb42b1ab82 · 2025-07-16T15:50:04.000+02:00
diff --git a/packages/hub/src/vendor/xet-chunk/README.md b/packages/hub/src/vendor/xet-chunk/README.md
@@ -4,4 +4,4 @@ WASM utilities to chunk & hash data.
 
 An assembly script implementation is available in `@huggingface/xetchunk-wasm`, but for performance reasons we're using WASM directly compiled from the rust source, see https://github.com/huggingface/xet-core/tree/main/hf_xet_wasm which on my local machine processes data at 480MB/s.
 
-We hope in the future to include the build step directly in this package, or to use assembly script WASM (but blake 3 hashing perf needs to be significantly improved).
+The `chunker_wasm_bg.js`and `chunker_wasm_bg.wasm.base64.ts` are generated with `pnpm --filter hub build:xet-wasm`.

Original file line number	Diff line number	Diff line change
`@@ -4,4 +4,4 @@ WASM utilities to chunk & hash data.`
`4`	`4`
`5`	`5`	An assembly script implementation is available in `@huggingface/xetchunk-wasm`, but for performance reasons we're using WASM directly compiled from the rust source, see https://github.com/huggingface/xet-core/tree/main/hf_xet_wasm which on my local machine processes data at 480MB/s.
`6`	`6`
`7`		`-We hope in the future to include the build step directly in this package, or to use assembly script WASM (but blake 3 hashing perf needs to be significantly improved).`
	`7`	+The `chunker_wasm_bg.js`and `chunker_wasm_bg.wasm.base64.ts` are generated with `pnpm --filter hub build:xet-wasm`.