python3-pytokens

Fast, spec compliant Python 3.12+ tokenizer


Build for aarch64-musl, version 0.1.10_1. Builds for all architectures.


Details

Homepage:
https://github.com/tusharsadhwani/pytokens
License:
MIT
Maintainer:
icp
Built at:
2025-10-06 09:22
Installed size:
48.93 KiB
Provides:
py3:pytokens-0.1.10_1
Popularity:
No usages in 119 reports
Depending on:
python3