Using OBS Parallel File Systems
Parallel File System (PFS), a sub-product of OBS, is a high-performance file system, with access latency in milliseconds. PFS can support a bandwidth performance up to the TB/s level and supports millions of IOPS, which makes it ideal for running high-performance computing (HPC) workloads. PFS is more stable than object storage. For details, see About Parallel File System.
In commercial deployments, you are advised to use parallel file systems instead of object storage.
Technical Description
CCE allows you to mount OBS parallel file systems by using obsfs. For details about obsfs, see Introduction to obsfs.
An obsfs resident process is generated each time an object storage volume generated from the parallel file system is attached. Example:
Recommended Usage
You are advised to reserve 1 GB memory for each obsfs process. For example, for a node with 4 CPUs and 8 GB memory, the obsfs parallel file systems should be mounted to no more than eight pods.
obsfs resident processes run on the node. If the consumed memory exceeds the upper limit of the node, the node becomes abnormal.
On a node with 4 CPUs and 8 GB memory, if more than 100 pods are mounted with parallel file systems, the node will be unavailable.
You are advised to control the number of pods mounted with parallel file systems on a single node.
Performance Metrics
Table 1 lists the performance test result of obsfs resident processes (for reference only).
Verification Environment
Cluster version: 1.15.11
Add-on version: 1.2.0
obsfs version: 1.83 (commit:97e919f)
Last Article: Upgrading s3fs of Nodes in a CCE Cluster (CentOS 7.6)
Next Article: Custom Storage Classes
Did this article solve your problem?
Thank you for your score！Your feedback would help us improve the website.