FTS5Tokenizer
The protocol for FTS5 tokenizers
- 
                  
                  
Tokenizes the text described by
pTextandnText, and notifies found tokens to thetokenCallbackfunction.It matches the
xTokenizefunction documented at https://www.sqlite.org/fts5.html#custom_tokenizers 
View on GitHub
Install in Dash
        FTS5Tokenizer Protocol Reference