Commit db3f72c
authored
[Web] Bump web-tokenizer to 0.1.6 (#67)
This PR bumps web-tokenizer to 0.1.6 to reflect the latest HEAD changes.
Without bumping this, WebLLM would run into RUST-related error (thread '<unnamed>' panicked at src/lib.rs:26:50:), likely due to the newly compiled weights and tokenizer files in mlc-ai's HF repo are not matching with the web-tokenizer package.
Unrelatedly, we also upstream package-lock.json1 parent dc7ea3a commit db3f72c
File tree
4 files changed
+2092
-2
lines changed- web
- tests
4 files changed
+2092
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
36 | | - | |
37 | 36 | | |
38 | 37 | | |
0 commit comments