FTS5Tokenizer
The protocol for FTS5 tokenizers
-
Tokenizes the text described by
pTextandnText, and notifies found tokens to thetokenCallbackfunction.It matches the
xTokenizefunction documented at https://www.sqlite.org/fts5.html#custom_tokenizers
View on GitHub
Install in Dash
FTS5Tokenizer Protocol Reference