Meet the Cloudsmith team at KubeCon in Salt Lake City!
Learn More
Search
Back to Cloudsmith
Start your free trial
gpt-tokenizer
2.5.1
last stable release 1 week ago
Submit Feedback
Source Code
See on NPM
Install
Complexity Score
Low
Open Issues
N/A
Dependent Projects
46
Weekly Downloads
global
100,247
Keywords
BPE
encoder
decoder
tokenizer
GPT
GPT-2
GPT-3
GPT-3.5
GPT-4
GPT-4o
NLP
Natural Language Processing
Text Generation
OpenAI
Machine Learning
ml
machine-learning
License
MIT
Yes
attribution
Permissive
linking
Permissive
distribution
Permissive
modification
No
patent grant
Yes
private use
Permissive
sublicensing
No
trademark grant
Downloads
All Versions
Group by Version
Loading Weekly Download Data
Readme
Loading Readme
Dependencies
Runtime
Development
Loading dependencies...
61
Quality
CVE Issues
Active
0
Scorecards Score
No Data
Test Coverage
No Data
Follows Semver
Yes
Github Stars
440
Dependencies
total
3
Dependencies
Outdated
0
Dependencies
Deprecated
0
Threat Modelling
No Data
Repo Audits
No Data
34
Maintenance
60
Docs
Learn how to distribute gpt-tokenizer in your own private NPM registry
$
n
p
m
c
o
n
f
i
g
s
e
t
r
e
g
i
s
t
r
y
h
t
t
p
s
:
/
/
n
p
m
.
c
l
o
u
d
s
m
i
t
h
.
c
o
m
/
o
w
n
e
r
/
r
e
p
o
/
Processing...
✓
Done
$
n
p
m
i
n
s
t
a
l
l
g
p
t
-
t
o
k
e
n
i
z
e
r
/
Processing...
✓
Done
Start your free trial
Releases
2.5.1
Stable version
1
week ago
Released
Loading Version Data
NPM on Cloudsmith
Getting started with NPM on Cloudsmith is fast and easy.
Learn more about NPM on Cloudsmith
View the Docs