Back to directory
Frontendbeenotung/bpe-tokenizer
bpe-tokenizer
Build your own vocabulary from application-specific corpus using Byte pair encoding (BPE) algorithm.
Suggested install command
npm view bpe-tokenizerAlways inspect the linked repository and skill instructions before running commands. Skills are instructions; permissions and execution still matter.
Compatibility
Agent support matrix
3 supported
| Agent | Status |
|---|---|
| Claude Code | Supported |
| OpenCode | Not listed |
| Cursor | Supported |
| MCP | Not listed |
| GitHub Copilot | Not listed |
| Windsurf |