Hudi Development Specification Overview

Scope

This document primarily describes the design and development rules for the lakehouse and integrated stream and batch processing solution based on the MRS Hudi component. The following specifications are provided:

• Data table design
• Resource configuration
• Performance tuning
• Common troubleshooting
• Typical parameter settings

Terms

The specification description uses the following terms:

• Rule: a principle that must be followed during programming.
• Suggestion: a principle that must be considered during programming.
• Description: an explanation of the rule or suggestion in question.
• Example: positive and negative examples of a rule or suggestion.

Application Scope

• Design, develop, test, and maintain data storage and data processing jobs based on MRS Hudi.
• Use the specifications for MRS 3.3.0 and later versions.