Solution Overview

Application Scenarios

This solution is designed to ensure that external users can securely and efficiently access ModelArts real-time services and flexibly integrate ModelArts prediction services. By using the custom domain, you can deploy your model service without daily rate limit.

Architecture

This solution uses Dedicated API Gateway (APIG), Web Application Firewall (WAF), VPC Endpoint (VPCEP) to access ModelArts real-time services over custom domain.

Figure 1 Architecture

This solution will deploy the following resources:

• One Web Application Firewall (WAF) cloud instance will be created to protect inference services from common online attacks.
• One API Gateway (APIG) instance will be created to provide public network access and URL path mapping.
• A security group will be created. By configuring security group rules, it will only allow WAF back-to-source IPs to access APIG.

Advantages

• Unlimited Request Quota

  Bypasses ModelArts' default inference service limit of 10,000 requests per day for external access. With a custom domain, there is no such cap, enabling production-scale workloads without throttling.

• Seamless Enterprise Integration

  Exposes the ModelArts inference service under the organization's own branded domain rather than a generic cloud endpoint. This allows the service to slot directly into existing enterprise API gateways, DNS management, monitoring systems, and CI/CD pipelines without disrupting established infrastructure — making it a drop-in addition to the corporate service mesh rather than an isolated, standalone endpoint.

• Enhanced Security

  Integrates WAF (Web Application Firewall) and SSL/TLS certificates for hardened security. This enables strict access control policies, IP allowlist/blocklist management, and ensures encrypted communication between clients and the inference endpoint.

Constraints

• Before deploying this solution, you need to register a Huawei account, activate Huawei Cloud, complete real-name verification, and ensure the account is not in arrears or frozen. If you select the "Yearly/Monthly" billing mode, please ensure sufficient account balance for automatic payment during one-click resource deployment, or during the one-click deployment process, go to the billing center, find the "Pending Orders" and complete the payment manually.