Skip to content

feat: add tokenized_documents parameter to avoid redundant tokenization [stacks on #2515] - #2518

Draft
pidefrem wants to merge 2 commits into
MaartenGr:masterfrom
pidefrem:pr13-pretokenized-documents
Draft

feat: add tokenized_documents parameter to avoid redundant tokenization [stacks on #2515]#2518
pidefrem wants to merge 2 commits into
MaartenGr:masterfrom
pidefrem:pr13-pretokenized-documents

feat: support pre-tokenized documents across the pipeline

c3a6e43
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
lint
succeeded Jul 27, 2026 in 36s