FastNLPfastNLP: Deep Learning Toolkit for NLP, developed by Fudan FastNLP Teamchinese-nlpdeep-learningnatural-language-processingnlp-librarynlp-parsingtext-classificationtext-processing
cn2anConvert Chinese numerals and Arabic numerals.arabic-numbersarabic-numeralsasrchinese-numeralscn2annlp-librarynlp-toolpypipythonspeech-recognition
underthesea_coreUnderthesea Coredependency-parserdependency-parsingnamed-entity-recognitionnatural-language-processingnernlpnlp-librarypos-taggingsentence-segmentationvietnamesevietnamese-nlpvietnamese-tokenizerword-segmenter
transformers-phobertState-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch. Note that the tokenizer was changed by PhoBert in this version.NLPdeeplearningtransformerpytorchtensorflowBERTGPTGPT-2googleopenaiCMUdeep-learningflaxhacktoberfestjaxlanguage-modellanguage-modelsmachine-learningmodel-hubnatural-language-processingnlp-librarypretrained-modelspythonpytorch-transformersseq2seqspeech-recognition
undertheseaVietnamese NLP Toolkitundertheseadependency-parserdependency-parsingnamed-entity-recognitionnatural-language-processingnernlpnlp-librarypos-taggingsentence-segmentationvietnamesevietnamese-nlpvietnamese-tokenizerword-segmenter
openpromptAn open source framework for prompt-learning.PLMpromptAINLPdeep-learningnatural-language-processingnatural-language-understandingnlp-librarynlp-machine-learningpre-trained-language-modelspre-trained-modelprompt-based-tuningprompt-learningprompt-toolkitpromptspytorchtransformer
com.atilika.kuromoji:kuromoji-ipadicA Japanese morphological analyzerjapanesemorphological-analysernlp-librarypart-of-speech-tagger
nagisaA Japanese tokenizer based on recurrent neural networksdynetjapanesenatural-language-processingnlpnlp-librarypos-taggingsequence-labelingtokenizerword-segmentation
pytorch-pretrained-bertPyTorch version of Google AI BERT model with script to load Google pre-trained modelsBERTNLPdeeplearninggoogledeep-learningflaxhacktoberfestjaxlanguage-modellanguage-modelsmachine-learningmodel-hubnatural-language-processingnlp-librarypretrained-modelspythonpytorchpytorch-transformersseq2seqspeech-recognitiontensorflowtransformer