Overview

Node Fault Detection (ModelArts Node Agent)

ModelArts Node Agent is a plug-in for monitoring cluster node exceptions, also, a component for connecting to third-party monitoring platforms. It is a daemon that runs on each node to collect node problems from different daemon processes.

ModelArts Metric Collector

The metric-collector, a default built-in plug-in of ModelArts, runs as a node daemon to collect node and job metrics and report them to AOM.

AI Suite (Modelarts Device Plugin)

The AI suite, Ascend NPU, is a device management plug-in that supports Huawei NPUs in containers.

When you create a dedicated resource pool, this plug-in is automatically installed only when the instance specification type is set to Ascend.

Volcano Scheduler

Volcano is a batch scheduling platform based on Kubernetes. It provides a series of features required by machine learning, deep learning, bioinformatics, genomics, and other big data applications, as a powerful supplement to Kubernetes capabilities.

When you create a dedicated resource pool, this plug-in is automatically installed when Job Type is set to Training Jobs.

NodeLocal DNSCache

NodeLocal DNSCache is a set of daemons running on cluster nodes. It improves cluster DNS performance by using DNS cache proxies.

Cloud Native Log Collection

Log Collect is used to collect cloud native logs and Kubernetes events based on open-source fluent-bit and opentelemetry. log-agent supports CRD-based log collection policies. Based on your configured policy rules, it can collect container standard output logs, container file logs, node logs, and Kubernetes event logs in a cluster and forward them to Log Tank Service (LTS). It also reports all abnormal Kubernetes events and some normal Kubernetes events to Application Operations Management (AOM) for event alarm configuration.

Installing

Intermediate

The plug-in is being deployed.

If all instances cannot be scheduled due to incorrect plug-in configuration or insufficient resources, the system sets the plug-in status to Unavailable 10 minutes later.

Running

Stable

The plug-in is running, all plug-in instances are deployed, and the plug-in can be used properly.

Upgrading

Intermediate

The plug-in is being upgraded.

Not available

Stable

The plug-in is abnormal and cannot be used. You can click the status to view the failure cause.

Deleting

Intermediate

The plug-in is being deleted.

If this state stays for a long time, an exception occurred.

Searching for and viewing a plug-in

Search for and view a plug-in.

Log in to the ModelArts console. In the navigation pane on the left, choose Add-ons.

Choose a resource type from the drop-down list to filter plug-ins, or enter a keyword in the search box to search for a plug-in.

Viewing plug-in details

View the plug-in details, including the plug-in introduction and component list.

1. Log in to the ModelArts console. In the navigation pane on the left, choose Add-ons.
2. Click the plug-in name to view its details.

Installing a plug-in

Certain plug-ins can be manually installed.

1. Log in to the ModelArts console. In the navigation pane on the left, choose Add-ons.

1. Locate the target plug-in and click Install.
2. In the displayed dialog box, select the resource type of the plug-in to be installed. For some plug-ins, you also need to select a plug-in version. Set the information and click Next.
   • Dedicated cluster: Install the plug-in to a resource pool. The supported resource pool types vary depending on the plug-in. See the supported types on the GUI accordingly.
   • Dedicated node: Install the plug-in to a specific node in the resource pool. Perform operations and run commands as prompted.
3. Configure related parameters.

   The configurations vary depending on the plug-in. For details, see section"Plug-ins".

Querying the plug-ins

View all plug-ins of a resource pool. On this page, you can view plug-in details, install, upgrade, and uninstall plug-ins, and manage plug-ins in a centralized manner.

1. Log in to the ModelArts console. In the navigation pane on the left, choose Standard Cluster under Resource Management.
2. Click the resource pool to access its details page.
3. Click the Plug-ins tab.

Viewing plug-in details

View the plug-in details, including the plug-in introduction and component list.

1. Log in to the ModelArts console. In the navigation pane on the left, choose Standard Cluster under Resource Management.
2. Click the resource pool to access its details page.
3. Click the Plug-ins tab.
4. Click the plug-in name to view its details.

Plug-ins installed by default

When you create a resource pool, certain plug-ins are installed by default.

Creating a Standard Dedicated Resource Pool

Installing the plug-in manually

You can manually install a plug-in in a resource pool.

Method 1:

Install the plug-in when you create a standard dedicated resource pool. For details, see Creating a Standard Dedicated Resource Pool.

Method 2:

Install the plug-in on the Plug-in Square. For details, see Searching for a Plug-in on the Plug-in Square.

Method 3:

1. Log in to the ModelArts console. In the navigation pane on the left, choose Standard Cluster under Resource Management.
2. Click the resource pool name to access its details page.
3. Click the Plug-ins tab.
4. Locate the plug-in to be installed and click Install.
5. In the displayed dialog box, configure the parameters.

   The configurations vary depending on plug-ins. For details, see "Plug-ins".

Editing a plug-in

Edit plug-in parameters.

1. On the resource pool details page, click the Plug-ins tab.
2. Locate the plug-in to be edited and click Edit.

   The configurations vary depending on plug-ins. For details, see the configuration description of the plug-ins.

   Only the following plug-in versions can be edited:

   • ModelArts Node Agent 7.2.0 or later
   • AI suite (Ascend NPU) 2.1.53 or later
   • Volcano Scheduler 1.17.11 or later
3. Click OK.

Upgrading a plug-in

Upgrade the plug-in to the latest version.

1. On the resource pool details page, click the Plug-ins tab.
2. Locate the plug-in to be upgraded and click Upgrade.
   The configurations vary depending on plug-ins. For details, see the configuration description of the plug-ins.

   • Table 1
   • Table 1
3. Click OK.

Uninstalling a plug-in

Uninstall a plug-in from the resource pool. This operation cannot be undone.

1. On the resource pool details page, click the Plug-ins tab.
2. Locate the plug-in to be uninstalled and click Uninstall.
3. In the displayed dialog box, enter DELETE and click OK.