Configuring Information on the LLM Engine
Prompt templates help a model narrow down the text generation scope, preventing generation of texts that differ greatly from expected content. For example, if the template content theme is sport, the model generates sports game content. The AICC provides preset prompt templates. This section describes how to download and import a prompt template.
Prerequisites
Contact the system administrator to sign in to the AICC, choose
, enable the LLM Engine feature for the tenant space, and select Sentiment analysis, Q&A retrieval, and Intent recognition.Procedure
- Contact Huawei technical support to download the AICC_*.*.*_ODFS.zip package from https://support.huawei.com.
- Decompress the AICC_*.*.*_ODFS.zip package.
*.*.* indicates the AICC version number.
- Go to the /flowinfo/LLM_Agent_Assistant.zip/ directory to obtain the workflow.zip package.
- Decompress the workflow.zip package.
- Obtain the emotionRecognition.tar.gz package.
- Sign in to the AICC as a tenant space administrator, choose , and click the import button to import the emotionRecognition.tar.gz package.
- Sign in to the AICC as a tenant space administrator, choose , and click the Customized Template tab.
- Click the emotion scenario, edit the emotion prompt template, and select an available model from the Large Model drop-down list. For details about how to configure a model, see Configuring a Model.
Figure 1 Large model drop-down list
- Click Save and Publish to publish the prompt template.
- Obtain the intentRecognition.tar.gz package.
- Sign in to the AICC as a tenant space administrator, choose , and click the import button to import the intentRecognition.tar.gz package.
- Sign in to the AICC as a tenant space administrator, choose , and click the Customized Template tab.
- Click the Intent recognition scenario and click the Intent recognition prompt template. On the Template Details page that is displayed, click Unpublish to change the status of the template to Not released.
- Edit the Intent recognition prompt template and select an available model from the Large Model drop-down list. Configure the model by referring to Configuring a Model.
Figure 2 Large model drop-down list
- On the Editing a template page, turn on
to enable model parameters, and set response_format to json_object.
Figure 3 Enabling model parameters - Click Save and Publish to publish the prompt template.
- Obtain the recommendFaq.tar.gz package.
- Sign in to the AICC as a tenant space administrator, choose , and click the import button to import the recommendFaq.tar.gz package.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot