Diacritics
Options for Latin script characters. Matches the raw “remove_diacritics” tokenizer argument.
-
Do not remove diacritics from Latin script characters. This option matches the raw “remove_diacritics=0” tokenizer argument.
-
Remove diacritics from Latin script characters. This option matches the raw “remove_diacritics=1” tokenizer argument.
-
Remove diacritics from Latin script characters. This option matches the raw “remove_diacritics=2” tokenizer argument, available from SQLite 3.27.0