My Data
When you create a data connection or smart refining task on the console, the generated dataset is placed in the My Data list as a data asset. If you enable Publish Dataset on the data connection or smart refining task creation page, the generated dataset will be automatically brought online as an asset. If this option is not selected, the asset is in the offline state in the asset list.
Scenarios
Typical scenarios of My Data:
- Using a dataset to perform smart refining to generate high-quality datasets required for downstream tasks
- Using a dataset for LLM pre-training and fine-tuning to enhance foundational capabilities, while leveraging human preference data to optimize response quality
- Using a dataset as a test set to evaluate model performance and establish baseline assessments of model capabilities
Viewing my data
- Log in to the ModelArts console. In the left navigation pane, choose Asset Management > Data.
- On the My Data tab page, you can view all datasets and the list of assets created by the user. You can also filter datasets by dataset name, data modality, dataset type, status, and creator. Figure 1 Filtering datasets
- Click
on the right of the search bar. On the page that appears on the right, set the search bar. Table 1 My data list configuration Category
Parameter
Description
Basic Settings
Text Wrapping
Enable to wrap table cell content, or disable to truncate text.
Data Columns
- Freeze none: If the data list exceeds the screen width, all columns remain scrollable.
- Freeze first: The first column is frozen while other columns remain scrollable.
- Freeze first two: The first and second columns are frozen while other columns remain scrollable.
Operation Column
When enabled, the Operation column is permanently pinned as the final column and its width cannot be adjusted.
Custom Columns
Display options
Select the column names you wish to display. Dataset Name and Operation are displayed by default; other columns can be toggled on or off. Column headers can be dragged to reorder them.
- Click the target dataset name to view its basic information, data preview, and operation records. Figure 2 Dataset details
- Basic Info
- Data content: Information such as dataset name, modality, type, sample count, size, description, creator, storage location, etc.
- Data Source: Specifies the task that generated the data. You can click the link next to Source Task ID to navigate to the task.
- Extended Info: Dataset attribute information, which can be manually modified.
- Data Preview
Allows you to display three to five typical samples of structured data (text and tables), view the samples on multiple pages, and view the original data structure. Unstructured data (images/audio) can be previewed in thumbnail mode. Datasets can be downloaded.
- Operation Record
You can view all operations performed on the current dataset.
- Basic Info
Publishing/Unpublishing/Deleting My Data
- Log in to the ModelArts console. In the left navigation pane, choose Asset Management > Data.
- In the My Data tab, you can publish, unpublish, or delete your data in the Operation column as required.
- Publish: Unpublished datasets can be published.
Click Publish. In the dialog box that is displayed, click OK. A published dataset can be used as data for subsequent development.
- Unpublish: Published datasets can be unpublished.
Click Unpublish. In the dialog box that is displayed, click OK. An unpublished dataset cannot be used as data for subsequent development.
- Delete: Datasets can be deleted. Deleted datasets are not permanently removed. If you accidentally delete a dataset, you can restore it for future use. You can permanently delete a deleted dataset. Once permanently deleted, the dataset cannot be restored.
- Deleting a dataset: Click Delete. In the displayed dialog box, click OK.
- Restoring a dataset: Deleted datasets can be restored.
- After a dataset is deleted, click Show Deleted Tasks in the upper right corner of the page. The deleted dataset is displayed. Figure 3 Deleted
- In the Operation column of the deleted dataset, click Restore. In the displayed dialog box, click OK. Figure 4 Restore
- After a dataset is deleted, click Show Deleted Tasks in the upper right corner of the page. The deleted dataset is displayed.
- Permanent deletion: The dataset will be permanently deleted and cannot be restored.
- After a dataset is deleted, click Show Deleted Tasks in the upper right corner of the page. The deleted dataset is displayed.
- Click the name of the deleted dataset and click permanently delete in the upper part of the page. In the displayed dialog box, enter DELETE and click OK. Figure 5 Permanent deletion
- Publish: Unpublished datasets can be published.
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot