What Are the Differences Between OBS and HDFS in Data Storage?
The data processed by MRS is from OBS or HDFS. OBS is an object-based storage service that provides secure, reliable, and cost-effective storage of huge amounts of data. MRS can directly process data in OBS. You can view, manage, and use data by using the OBS console or OBS client. In addition, you can use REST APIs independently or integrate APIs to service applications to manage and access data.
- Data stored in OBS: Data storage is decoupled from compute. The cluster storage cost is low, and storage capacity is not limited. Clusters can be deleted at any time. However, the computing performance depends on the OBS access performance and is lower than that of HDFS. OBS is recommended for applications that do not demand a lot of computation.
- Data stored in HDFS: Data storage is not decoupled from compute. The cluster storage cost is high, and storage capacity is limited. The computing performance is high. You must export data before you delete clusters. HDFS is recommended for computing-intensive scenarios.
MRS Overview FAQs
- What Is MRS Used For?
- What Types of Distributed Storage Does MRS Support?
- What Are Regions and AZs?
- Can I Change the Network Segment of Nodes in an MRS Cluster?
- Can I Downgrade the Specifications of an MRS Cluster Node?
- Does an MRS Cluster Support Hive on Spark?
- Are Hive Components of Different Versions Compatible with Each Other?
- What Are the Differences Between OBS and HDFS in Data Storage?
- How Do I Obtain the Hadoop Pressure Test Tool?
- Statement About the Public IP Addresses in the Open-Source Third-Party SDK Integrated by MRS
- Does MRS Support Running Hive on Kudu?
- What Are the Solutions for Processing 1 Billion Data Records?
- Can I Change the IP address of DBService?
- Can Sudo Logs of Nodes in an MRS Cluster Be Cleared?
- What Are the Restrictions on the Storm Log Size in an MRS 2.1.0 Cluster?
- What Access Protocols Does Kafka Support?
- What Should I Do If Error 408 Is Reported When an MRS Node Accesses OBS?
- What are the advantages of the compression ratio of zstd?
- Which Python Versions Are Supported by Spark Tasks in MRS 3.1.0 Clusters?
- How Do I Enable Different Service Programs to Use Different Yarn Queues?
- What Are the Differences and Relationships Between the MRS Management Console and MRS Manager?
- How Do I Unbind an EIP from FusionInsight Manager of an MRS Cluster?
- What are the Operating Systems of Hosts in MRS Clusters of Different Versions?
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbotmore