Synthesizing Text Datasets

Creating a Text Data Synthesis Task

Before synthesizing a text dataset, import data. For details, see Importing Data to the Pangu Platform.

To create a text dataset synthesis task, perform the following steps:

1. Log in to ModelArts Studio Large Model Deveopment Platform. In the My Spaces area, click the required workspace.
   Figure 1 My Spaces
   
2. In the navigation pane, choose Data Engineering > Data Processing > Synthesis Task. On the displayed page, click Create data synthesis task in the upper right corner.
3. On the Create data synthesis task page, select the dataset to be synthesized, and select the content to be synthesized and the expected number of synthetic data records, as shown in Figure 2. The expected number of synthetic data records is the initial number of data records in the dataset.
   Figure 2 Expected number of synthetic data records
   

   If the source dataset type is the same as the target dataset type, you can enable Integrate the source data set into the synthesized data. After the synthesis task is complete, the generated data is merged with the original dataset. Click Next.

4. On the Synthesis Orchestration page, orchestrate the synthesis steps.
   • In the Add Instruction pane, you can select a preset or custom instruction, or copy an instruction.
     • Preset instructions: The platform provides multiple preset instructions for you to execute synthesis tasks. For details, see Introduction to Preset Data Instructions.
     • Custom instructions: The platform supports orchestration of custom instructions. For details about how to create a custom instruction, see Creating a Custom Data Synthesis Instruction.
   • After selecting a command, click OK and set command parameters.

     Figure 3 shows an example of configuring synthesis instruction parameters for a pre-trained text dataset. The synthesis task uses the pre-trained text to generate Q&A pairs.

     Figure 3 Example of configuring parameters for combining pre-trained text data into an instruction
     
   • After the instruction orchestration is complete, click Enable commissioning in the upper right corner to preview the instruction effect.
5. After the instruction commissioning is complete, click Next in the lower right corner. The Task Configuration page is displayed.
   • Select Automatically Generate Processing Dataset if required.

     Select this option and configure the information for generating a processed dataset, as shown in Figure 4. Click Create and Start in the lower right corner. The platform starts the data synthesis task. After the synthesis task is successfully executed, a processed dataset is automatically generated.

     If you do not select this option, click Create and Start in the lower right corner. The platform starts the data synthesis task. After the synthesis task is successfully executed, manually generate a processed dataset.

     Figure 4 Automatically Generate Processing Dataset
     
   • Enter the dataset name, description, and extended information (optional, including the industry, language, and custom information).
6. After the data synthesis task is successfully executed, the status changes from Running to Success, indicating that the data has been synthesized.

After data synthesis is complete, if you do not need to use the data labeling and data combination functions, click Generate in the Operation column on the Synthesis Task page to generate a processed dataset.

To view the processed dataset, choose Data Engineering > Data Management > Datasets, and click the Processed Dataset tab.

Introduction to Preset Data Instructions

The data synthesis function of ModelArts Studio provides you with preset instructions. You can choose Data Engineering > Data Processing > Data Synthesis. On the Synthesis Task page, click Manage Synthesis Instructions. On the System Preset tab page, view instruction details, as shown in Figure 5. Click Commissioning to view the commissioning guide, as shown in Figure 6.

For details about the list of preset instructions, see Table 1.

Figure 5 Instruction details

Figure 6 Commissioning guide

Creating a Custom Data Synthesis Instruction

The platform allows you to create custom data synthesis instructions.

This section uses the scenario of generating a topic prose passage as an example to describe how to configure a custom data synthesis instruction.

1. Log in to ModelArts Studio Large Model Deveopment Platform. In the My Spaces area, click the required workspace.
   Figure 7 My Spaces
   
2. In the navigation pane, choose Data Engineering > Data Processing > Data Synthesis. On the displayed page, click Manage Synthetic Instructions. On the Custom tab page, click Create Instruction.
3. In the Create Instruction dialog box, enter the name and description, and click OK. The page for configuring a synthetic instruction is displayed.
4. Select the variable identifier "{{}}" and enter the instruction "Use {{topic}} as the subject and write a prose passage with no more than {{num}} characters."

   Click Identify and then click Yes.

   Figure 8 Instruction configuration
   
5. Set variables based on Table 2.

   Table 2 Data instruction variable configuration

   Variable Type	Variable Name	Data Type	Variable Description
   Input variables	topic	string	Topic
   	num	string	Word count
   Output variables	output	string	Prose

   The variable description field of an output variable is the content that can be understood by the large model and needs to be filled in carefully.

   Figure 9 Configuring variables
   
6. Commission data instructions.
   • In the Commissioning > Model area, select the model required by the instruction and click Configure Hyperparameters to customize hyperparameter values.
   • In the Commissioning > Input area, you can view the effect by assigning values to variables.
     Figure 10 Instruction commissioning
     
7. After the commissioning is complete, click Create Now to create the data instruction.

   The created data instruction is displayed on the Manage Synthetic Instructions > Custom page.