Can I Deploy Multiple Services on One Dedicated Resource Pool Node?
Yes. This operation is allowed.
When deploying a service, select a small custom flavor. If a resource pool node can run multiple instance flavors, multiple services can be deployed on the node. If you use this method to deploy a model for inference, ensure that the selected flavor complies with the minimum model requirements for inference. Otherwise, the deployment or prediction may fail.
Did this article solve your problem?
Thank you for your score!Your feedback would help us improve the website.