Help Center > > Developer Guide> Full Text Search> Dictionaries> Simple Dictionary

Simple Dictionary

Updated at: Jul 15, 2020 GMT+08:00

A Simple dictionary operates by converting the input token to lower case and checking it against a list of stop words. If the token is found in the list, an empty array will be returned, causing the token to be discarded. If it is not found, the lower-cased form of the word is returned as the normalized lexeme. In addition, you can set Accept to false for Simple dictionaries (default: true) to report non-stop-words as unrecognized, allowing them to be passed on to the next dictionary in the list.

Precautions

  • Most types of dictionaries rely on dictionary configuration files. The name of a configuration file can only be lowercase letters, digits, and underscores (_).
  • A dictionary cannot be created in pg_temp mode.
  • Dictionary configuration files must be stored in UTF-8 encoding. They will be translated to the actual database encoding, if that is different, when they are read into the server.
  • Generally, a session will read a dictionary configuration file only once, when it is first used within the session. To modify a configuration file, run the ALTER TEXT SEARCH DICTIONARY statement to update and reload the file.

Procedure

  1. Create a Simple dictionary.

    1
    2
    3
    4
    CREATE TEXT SEARCH DICTIONARY public.simple_dict (
         TEMPLATE = pg_catalog.simple,
         STOPWORDS = english
    );
    

    english.stop is the full name of a file of stop words. For details about the syntax and parameters for creating a Simple dictionary, see CREATE TEXT SEARCH DICTIONARY.

  2. Use the Simple dictionary.

     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    SELECT ts_lexize('public.simple_dict','YeS');
     ts_lexize 
    -----------
     {yes}
    (1 row)
    
    SELECT ts_lexize('public.simple_dict','The');
     ts_lexize 
    -----------
     {}
    (1 row)
    

  3. Set Accept=false so that the Simple dictionary returns NULL instead of a lower-cased non-stop word.

     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    12
    13
    ALTER TEXT SEARCH DICTIONARY public.simple_dict ( Accept = false );
    ALTER TEXT SEARCH DICTIONARY
    SELECT ts_lexize('public.simple_dict','YeS');
     ts_lexize 
    -----------
    
    (1 row)
    
    SELECT ts_lexize('public.simple_dict','The');
     ts_lexize 
    -----------
     {}
    (1 row)
    

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?







Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel