My Data
When you create a data connection or smart refining task on the console, the generated dataset is placed in the My Data list as a data asset. If you enable Publish Dataset on the data connection or smart refining task creation page, the generated dataset will be automatically brought online as an asset. If this option is not selected, the asset is in the offline state in the asset list.
Scenarios
Typical scenarios of My Data:
- Using a dataset to perform smart refining to generate high-quality datasets required for downstream tasks
- Using a dataset for LLM pre-training and fine-tuning to enhance foundational capabilities, while leveraging human preference data to optimize response quality
- Using a dataset as a test set to evaluate model performance and establish baseline assessments of model capabilities
Viewing my data
- Log in to the ModelArts console. In the left navigation pane, choose Asset Management > Data.
- On the My Data tab page, you can view all datasets and the list of assets created by the current user. You can also filter datasets by dataset name, data modality, dataset type, status, and creator. Figure 1 Filtering datasets
- Click
on the right of the search bar. On the page that appears on the right, set the search bar. Table 1 My data list configuration Category
Parameter
Description
Basic Settings
Text Wrapping
Enable to wrap table cell content, or disable to truncate text.
Data Columns
- Freeze none: If the data list exceeds the screen width, all columns remain scrollable.
- Freeze first: The first column is frozen while other columns remain scrollable.
- Freeze first two: The first and second columns are frozen while other columns remain scrollable.
Operation Column
When enabled, the Operation column is permanently pinned as the final column and its width cannot be adjusted.
Custom Columns
Display options
Select the column names you wish to display. Dataset Name and Operation are displayed by default; other columns can be toggled on or off. Column headers can be dragged to reorder them.
- Click the target dataset name to view its basic information, data preview, and usage records. Figure 2 Dataset details
- Basic Info
- Data content: Displays information such as the data modality, dataset type, data format, number of samples, dataset size, and dataset name.
- Data Source: Specifies the task that generated the data. You can click the link next to Source Task ID to navigate to the task.
- Extended Info: Displays dataset attribute information, which can be manually modified.
- Data Preview
Allows you to display three to five typical samples of structured data (text and tables), view the samples on multiple pages, and view the original data structure. Unstructured data (images/audio) can be previewed in thumbnail mode. Datasets can be downloaded.
- Usage Record
Shows the usage records of the current dataset.
- Basic Info
Publishing/Unpublishing/Deleting My Data
- Log in to the ModelArts console. In the left navigation pane, choose Asset Management > Data.
- In the My Data tab, you can publish, unpublish, or delete your data in the Operation column as required.
- Publish: Unpublished datasets can be published.
Click Publish. In the dialog box that is displayed, click OK. A published dataset can be used as data for subsequent development.
- Unpublish: Published datasets can be unpublished.
Click Unpublish. In the dialog box that is displayed, click OK. An unpublished dataset cannot be used as data for subsequent development.
- Delete: Datasets can be deleted. Deleted datasets are not permanently removed. If you accidentally delete a dataset, you can restore it for future use. You can permanently delete a deleted dataset. Once permanently deleted, the dataset cannot be restored.
Only the dataset record is deleted. The file in storage is not deleted. To delete the file, go to the storage container.
- Deleting a dataset:
- If the dataset is not referenced by other tasks, click Delete. In the Delete Dataset dialog box, click OK.
- If the dataset is referenced by other tasks, click Delete. In the Delete Dataset dialog box, read the message, confirm that the dependencies have been removed, enter DELETE, and click OK.
- Restoring a dataset: Deleted datasets can be restored.
- Permanent deletion: The dataset will be permanently deleted and cannot be restored.
- After a dataset is deleted, click Show Deleted Tasks in the upper right corner of the page. The deleted dataset is displayed.
- Click the name of the deleted dataset and click permanently delete in the upper part of the page. In the displayed dialog box, enter DELETE and click OK. Figure 4 Permanent deletion
- Deleting a dataset:
- Publish: Unpublished datasets can be published.
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
