Catalog / Cloudflare Developer Platform
AI Search - AI Search keyword search supports Japanese, Chinese, and Korean queries
todayOriginal notes
AI Search keyword search with the trigram tokenizer now matches Japanese, Chinese, and Korean queries, including full natural-language questions such as 経費精算の締め日はいつですか?. Previously, a query without spaces was treated as a single exact phrase and usually returned no keyword results.
The porter tokenizer does not work well for these languages. If your content is in Japanese, Chinese, or Korean, set keyword_tokenizer to trigram. Changing the tokenizer triggers a full reindex.
Refer to Keyword search for tokenizer details.