dart_sentencepiece_tokenizer 1.2.2 copy "dart_sentencepiece_tokenizer: ^1.2.2" to clipboard
dart_sentencepiece_tokenizer: ^1.2.2 copied to clipboard

Published 4 months ago • verified publisherbrodykim.work• Latest: 1.3.2
[unknown platforms]
→

Metadata

A lightweight, pure Dart implementation of SentencePiece tokenizer. Supports BPE (Gemma) and Unigram (Llama) algorithms.

More...

-/ -
pub points
10.3k
downloads

This package version is not analyzed. Check the latest stable version for its analysis.

Check the analysis log for details.

Weekly downloads

Display as:
By versions:

← Metadata

5
likes
0
points
10.3k
downloads

Publisher

verified publisherbrodykim.work

Weekly Downloads

Metadata

A lightweight, pure Dart implementation of SentencePiece tokenizer. Supports BPE (Gemma) and Unigram (Llama) algorithms.

Repository (GitHub)
View/report issues

Topics

#nlp #sentencepiece #tokenizer #machine-learning #llm

License

unknown (license)

More

Packages that depend on dart_sentencepiece_tokenizer

Back