Updated on 2022-09-15 GMT+08:00
What Is Data Lineage?
In the era of big data, various types of data are rapidly generated due to explosive data growth. The massive and complex data information is converged, transformed, and transferred to generate new data and aggregate into an ocean of data.
During this process, a relationship is formed between the data, and these relationships are their lineages. They are analogous to the genetic relationships between people. However, in contrast from our human lineages, data lineages have the following distinct features:
- Belongingness: Specific data belongs to a specific organization or individual.
- Multi-source: One piece of data can have multiple sources. One piece of data may be generated by processing multiple pieces of data, and there may be multiple such processes.
- Traceability: The data lineage is traceable. It reflects the data lifecycle and the entire process from data generation to data disappearance.
- Hierarchy: The data lineage is hierarchical. Data classification and summary form new data, and different levels of description result in data layers.
Figure 1 Data lineage example
Parent topic: DataArts Catalog
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.
The system is busy. Please try again later.
