Hudi Development Specifications Overview

Scope

This document describes the design and development rules for the integrated lake warehouse and batch processing solution based on the MRS-Hudi component. It mainly includes the following specifications:

• Data table design
• Resource configuration
• Performance Tuning
• Common Troubleshooting
• Common parameter settings

Terms Conventions

This specification is described in the following terms:

• Rule: The rule must be observed during programming.
• Recommendation: Principles that must be considered when programming.
• Description: The interpretation of the rule or recommendation.
• Example: This rule or suggestion is given from both positive and negative aspects.

Scope of application

• Design, develop, test, and maintain data storage and processing based on MRS-Hudi.
• This design specification is based on MRS 3.3.0.