Help Center/ Customer Engagement Center/ User Guide/ Tenant Administrator Guide/ Robot Management and Configuration Guide/ Large Language Model Service Zone/ LLM-based Application Services/ LLM-based Agent Assistant/ Configuring Information on the LLM Engine
Updated on 2025-01-23 GMT+08:00
View PDF
Share

Configuring Information on the LLM Engine

Prompt templates help a model narrow down the text generation scope, preventing generation of texts that differ greatly from expected content. For example, if the template content theme is sport, the model generates sports game content. The AICC provides preset prompt templates. This section describes how to download and import a prompt template.

Prerequisites

Contact the system administrator to sign in to the AICC, choose Call Center > Tenant Management, enable the LLM Engine feature for the tenant space, and select Sentiment analysis, Q&A retrieval, and Intent recognition.

Procedure

  1. Contact Huawei technical support to download the AICC_*.*.*_ODFS.zip package from https://support.huawei.com.
  2. Decompress the AICC_*.*.*_ODFS.zip package.

    *.*.* indicates the AICC version number.

  3. Go to the /flowinfo/LLM_Agent_Assistant.zip/ directory to obtain the workflow.zip package.
  4. Decompress the workflow.zip package.
  5. Obtain the emotionRecognition.tar.gz package.
  6. Sign in to the AICC as a tenant space administrator, choose Configuration Center > Chatbot Management > Large Model Service > Workflow Management > Workflow Orchestration, and click the import button to import the emotionRecognition.tar.gz package.
  7. Sign in to the AICC as a tenant space administrator, choose Configuration Center > Chatbot Management > Large Model Service > Large Model Zone > Prompt Template, and click the Customized Template tab.
  8. Click the emotion scenario, edit the emotion prompt template, and select an available model from the Large Model drop-down list. For details about how to configure a model, see Configuring a Model.

    Figure 1 Large model drop-down list

  9. Click Save and Publish to publish the prompt template.
  10. Obtain the intentRecognition.tar.gz package.
  11. Sign in to the AICC as a tenant space administrator, choose Configuration Center > Chatbot Management > Large Model Service > Workflow Management > Workflow Orchestration, and click the import button to import the intentRecognition.tar.gz package.
  12. Sign in to the AICC as a tenant space administrator, choose Configuration Center > Chatbot Management > Large Model Service > Large Model Zone > Prompt Template, and click the Customized Template tab.
  13. Click the Intent recognition scenario and click the Intent recognition prompt template. On the Template Details page that is displayed, click Unpublish to change the status of the template to Not released.
  14. Edit the Intent recognition prompt template and select an available model from the Large Model drop-down list. Configure the model by referring to Configuring a Model.

    Figure 2 Large model drop-down list

  15. On the Editing a template page, turn on to enable model parameters, and set response_format to json_object.

    Figure 3 Enabling model parameters

  16. Click Save and Publish to publish the prompt template.
  17. Obtain the recommendFaq.tar.gz package.
  18. Sign in to the AICC as a tenant space administrator, choose Configuration Center > Chatbot Management > Large Model Service > Workflow Management > Workflow Orchestration, and click the import button to import the recommendFaq.tar.gz package.