Format Requirements for Video Datasets
ModelArts supports the creation of image datasets. During the creation, you can import data in various formats. The format requirements are as follows.
Constraints
- Import from OBS: The size of a single file or compressed package cannot exceed 20 GB. If multiple files are imported, the total file size cannot exceed 20 GB.
- Local import: The size of a single file cannot exceed 1 GB, and the number of files cannot exceed 20.
Format Requirement
Supported file formats: Only video files with .avi or .mp4 extensions and label files with a .jsonl extension are supported. Only UTF-8-encoded JSONL files are supported.
File organization: Supports flexible organization of the dataset structure using multi-level directories (folders).
Annotation file (optional) guidelines: If the dataset contains metadata such as annotation information or video attributes, it must be implemented by configuring a unified annotation file at a specific path:
- The annotation file must be located directly in the root directory of the dataset, and its file name must be fixed as annotation.jsonl.
- Each line in the annotation.jsonl file must be an independent and valid JSON object used to index and describe the attributes of the videos in the dataset.
- file_name (string, required): Its value must be the relative path of the target video with respect to the dataset root directory (e.g., videos/movie_01.mp4 or simply movie_01.mp4), and the referenced video file must actually exist at the corresponding path.
- Custom fields (optional): Aside from file_name, any other key-value pairs are unrestricted. You can customize any service fields according to actual needs.
Data format example
To make the field hierarchy clearer, the single-line JSONL data has been expanded.
{
"file_name": "videos/sports/basketball_01.mp4",
"label": "basketball",
"duration_seconds": 15.5,
"caption": "A spectacular dunk shot",
"timestamps": [
{
"start": "00:00:02",
"end": "00:00:05",
"action": "dribble"
},
{
"start": "00:00:06",
"end": "00:00:09",
"action": "dunk"
}
]
} What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot