Help Center/ Cognitive Engagement Center/ User Guide/ Tenant Administrator Guide/ Robot Management and Configuration Guide/ Large Language Model Service Zone/ LLM-based Application Services/ Refining Response Based on a Large Language Model/ Configuring Information on the LLM Engine
Updated on 2025-01-23 GMT+08:00
View PDF
Share

Configuring Information on the LLM Engine

Prerequisites

Contact the system administrator to sign in to the AICC, choose Call Center > Tenant Management, and enable the LLM Engine feature for the tenant space.

Procedure

  1. Contact Huawei technical support to download the AICC_*.*.*_ODFS.zip package from https://support.huawei.com.
  2. Decompress the AICC_*.*.*_ODFS.zip package.

    *.*.* indicates the AICC version number.

  3. Go to the /flowinfo/LLM_Agent_Assistant.zip/ directory to obtain the workflow.zip package.
  4. Decompress the workflow.zip package.
  5. Obtain the textRefine.tar.gz package.
  6. Sign in to the AICC as a tenant space administrator, choose Configuration Center > Chatbot Management > Large Model Service > Workflow Management > Workflow Orchestration, and click the import button to import the textRefine.tar.gz package.

    Figure 1 Import success page

  7. Choose Configuration Center > Chatbot Management > Large Model Service > Large Model Zone > Prompt Template and click the Customized Template tab.
  8. Select the Refine response scenario and click the Refine response prompt template. The Template Details page is displayed. Click Unpublish to change the status of the template to Not released.
  9. Edit the Refine response prompt template and select an available model from the Large Model drop-down list. For details about how to configure a model, see Configuring a Model.
  10. Click Save and Publish to publish the prompt template.