Pre-trained Text

Constraints

• Import from OBS: The size of a single file or compressed package cannot exceed 20 GB. If multiple files are imported, the total file size cannot exceed 20 GB.
• Local import: The size of a single file cannot exceed 1 GB, and the number of files cannot exceed 20.
• File encoding: All JSONL format files must use UTF-8 encoding.

Format Requirement

File formats: JSONL

Format description: JSONL is a structured, lightweight text file format. Its core rule is that every line in the file must be an independent, valid, and complete JSON object. Each JSON object per line must contain a text field to house the specific pre-training text corpus. Other custom or extended fields are not strictly restricted.

Example:

{"text": "White Deer Plain is a full-length novel written by the renowned Chinese author Chen Zhongshi. It chronicles the rise and fall of a rural Shaanxi family over several generations. Through the feuds and entanglements of the Bai and Lu families, the novel depicts the historical transformations of Chinese society from the late Qing Dynasty to the founding of the People's Republic of China."}
{"text": "Ordinary World is a full-length novel written by the renowned Chinese author Lu Yao. It tells the life story of an ordinary peasant, Sun Shaoan, and his younger brother, Sun Shaoping. Facing the hardships of life, they remain unyielding and strive to pursue their dreams."}
{"text": "Red Sorghum is a full-length novel written by the renowned Chinese author Mo Yan. It tells the story of a family in Shandong province's Northeast Gaomi Township. Through the love and hate of family members, the novel showcases the turbulent years of rural China in the early 20th century."}
{"text": "Border Town is a novella written by the renowned Chinese author Shen Congwen. It depicts the lives of people in a small town in western Hunan. Through the love story of Cuicui and Nuosong, the novel displays the harmony between man and nature, as well as the purity and beauty of human nature."}
{"text": "Fortress Besieged is a full-length novel written by the renowned Chinese author Qian Zhongshu. It follows the marriage and career experiences of an intellectual named Fang Hongjian. Through the portrayal of Fang and the people around him, the novel reveals the various social contradictions and the complexity of human nature at that time."}