Switching Between Simplified and Traditional Chinese for Data Search in an OpenSearch Cluster

Scenario

The simplified-traditional Chinese conversion plugin converts between simplified and traditional Chinese. With this plugin, you can search index data containing the corresponding simplified Chinese based on the traditional Chinese keyword, and vice versa.

This plugin is installed by default. You do not need to install it by yourself.

The simplified-traditional Chinese conversion plugin can be used as the analyzer, tokenizer, token-filter, or char-filter.

The simplified-traditional Chinese conversion plugin provides the following two conversion types:

• s2t: converts simplified Chinese to traditional Chinese.
• t2s: converts traditional Chinese to simplified Chinese.

Switching Between Simplified and Traditional Chinese for Data Search

1. Log in to the OpenSearch Dashboards.
   1. Log in to the CSS management console.
   2. In the navigation pane on the left, choose Clusters > OpenSearch.
   3. In the cluster list, find the target cluster, and click Dashboards in the Operation column to log in to OpenSearch Dashboards.
   4. In the left navigation pane, choose Dev Tools.
2. Run the following command to create the stconvert index and specify the user-defined mapping to define the data type:

   PUT /stconvert
   {
       "settings": {
           "number_of_shards": 1,
           "number_of_replicas": 0,
           "analysis": {
               "analyzer": {
                   "ts_ik": {
                       "tokenizer": "ik_smart",
                       "char_filter": [
                           "tsconvert",
                           "stconvert"
                       ]
                   }
               },
               "char_filter": {
                   "tsconvert": {
                       "type": "stconvert",
                       "convert_type": "t2s"
                   },
                   "stconvert": {
                       "type": "stconvert",
                       "convert_type": "s2t"
                   }
               }
           }
       },
       "mappings": {
                    "properties": {
                   "desc": {
                       "type": "text",
                       "analyzer": "ts_ik"
                   }
               }
             }
   }

   The command output is similar to the following:

   {
     "acknowledged" : true,
     "shards_acknowledged" : true,
     "index" : "stconvert"
   }

3. Run the following command to import data to index stconvert:

   POST /stconvert/_doc/1
   {
     "desc": "Text in traditional Chinese"
   }

   If the value of failed in the command output is 0, the data is imported successfully.

4. Run the following command to search for the keyword and check the search result:

   GET /stconvert/_search
   {
       "query": {
           "match": {
               "desc": "Keyword"
           }
       }
   }

   The search result is similar to the following:

   {
     "took" : 15,
     "timed_out" : false,
     "_shards" : {
       "total" : 1,
       "successful" : 1,
       "skipped" : 0,
       "failed" : 0
     },
     "hits" : {
       "total" : 1,
       "max_score" : 0.5753642,
       "hits" : [
         {
           "_index" : "stconvert",
           "_type" : "type",
           "_id" : "1",
           "_score" : 0.5753642,
           "_source" : {
             "desc": "Text in traditional Chinese"
           }
         }
       ]
     }
   }