Back to directory
Cloud & DevOpskylecarbs/ai-tokenizer
ai-tokenizer
A faster than tiktoken tokenizer with first-class support for Vercel's AI SDK.
Suggested install command
npm view ai-tokenizerAlways inspect the linked repository and skill instructions before running commands. Skills are instructions; permissions and execution still matter.
Compatibility
Agent support matrix
3 supported
| Agent | Status |
|---|---|
| Claude Code | Supported |
| OpenCode | Not listed |
| Cursor | Supported |
| MCP | Not listed |
| GitHub Copilot | Not listed |
| Windsurf |