Search results

Deprecate vocab management methods.

enhancement

Status: Open.

#1245 In google/sentencepiece;

· taku910 opened on May 19, 2026

Use upb instead of protobuf

enhancement

Status: Open.

#1238 In google/sentencepiece;

· taku910 opened on May 14, 2026

Support parallel encoding

enhancement

feature requestAdd new featureAdd new feature

Status: Open.

#1229 In google/sentencepiece;

· taku910 opened on May 8, 2026

Deprecate differential privacy features.

enhancement

Status: Open.

#1228 In google/sentencepiece;

· taku910 opened on May 8, 2026

OSS-Fuzz issue 508357777

bug

Status: Open.

#1223 In google/sentencepiece;

· oss-fuzz-robot opened on Apr 30, 2026

sentencepiece sample_encode_fuzzer: sanitize nbest_size/alpha to reduce degenerate paths and timeouts

bug

enhancement

Status: Open.

#1194 In google/sentencepiece;

· Qingxiao-X opened on Mar 4, 2026

No typings in Python package

enhancement

pythonPull requests that update Python codePull requests that update Python code

Status: Open.

#1030 In google/sentencepiece;

· marcospgp opened on Jun 29, 2024

High frequency token segmented into letter sequence when input is a tsv file

bug

Status: Open.

#967 In google/sentencepiece;

· TingxunShi opened on Jan 30, 2024

Unexpected behavior with sampling of repeated character sequence.

Details requestedRequesting more detailed information to investigate the cause.Requesting more detailed information to investigate the cause.

help wanted

Status: Open.

#904 In google/sentencepiece;

· kellymarchisio opened on Aug 14, 2023

Duplicate tokens in BPE vocabulary

help wanted

Status: Open.

#881 In google/sentencepiece;

· astanic opened on Jun 9, 2023

Tokens Chunking to respect Language Word Boundaries

enhancement

Status: Open.

#866 In google/sentencepiece;

· loretoparisi opened on May 17, 2023

tokens listed in user_defined_symbols tokenized as unknowns when using the "word" model_type

bug

Status: Open.

#801 In google/sentencepiece;

· lintangsutawika opened on Dec 15, 2022