python3-pytokens
Fast, spec compliant Python 3.12+ tokenizer
Version 0.1.10_1
aarch64-glibc - aarch64-musl - armv6l-glibc - armv6l-musl - armv7l-glibc - armv7l-musl - i686-glibc - x86_64-glibc - x86_64-muslDetails
- Homepage:
- https://github.com/tusharsadhwani/pytokens
- License:
- MIT
- Maintainer:
- icp
- Built at:
- 2025-10-06 09:21 - 2025-10-06 09:23
- Installed size:
- 48.93 KiB
- Provides:
- py3:pytokens-0.1.10_1
- Popularity:
- No usages in 119 reports
- Depending on:
- python3