Migration of a List of Files
You can migrate a list of files (a maximum of 50 files) from FTP, SFTP, NAS, OBS, OSS, KODO, or SFS at a time. The exported files can only be written to the same directory on the migration destination.
When creating a table/file migration job, if the migration source is FTP, SFTP, NAS, OBS, OSS, KODO, or SFS, Source Directory/File can contain a maximum of 50 file names, which are separated by vertical bars (|). You can also customize a file separator.
- CDM supports incremental file migration (by skipping repeated files), but does not support resumable transfer.
For example, if three files are to be migrated and the second file fails to be migrated due to the network fault. When the migration task is started again, the first file is skipped. The second file, however, cannot be migrated from the point where the fault occurs, but can only be migrated again.
- During file migration, a single task supports millions of files. If there are too many files in the directory to be migrated, you are advised to split the files into different directories and create multiple tasks.
Last Article: Field Conversion
Next Article: Regular Expressions for Separating Semi-structured Text
Did this article solve your problem?
Thank you for your score！Your feedback would help us improve the website.