Function Overview

Huawei HiLens is a multimodal AI application development platform that features device-cloud synergy. It provides an easy-to-use development framework, out-of-the-box development environment, skill market with extensive sets of AI skills, and cloud-based management platform. It connects to multiple types of computing devices and supports video and audio application development, online deployment, and massive device management.

HiLens Kit is a multimedia device with AI inference capabilities. It packs powerful computing, HD camera access, and multiple ports into a compact kit. Its hardware has an integrated Atlas 200 AI Accelerator Module (Atlas 200 for short) for quick access to the maximized computing power of the Ascend 310 AI processor. The HiLens Kit device is perfect for AI developers in pre-research and development as well as video surveillance domains. Its built-in HiLens Framework provides abundant APIs for running skills.

HiLens Framework encapsulates bottom-layer APIs to implement common management functions, enabling developers to easily develop skills and cultivate the AI ecosystem on the Huawei HiLens console.
HiLens Framework encapsulates the bottom-layer multimedia processing library (cameras/microphone driver module Media_mini), the image processing library (DVPP) related to D chips, and the model management library (ModelManager). Developers can also use their familiar visual processing library OpenCV. In addition, Huawei HiLens Framework provides six modules for developers to develop various skills, including human figure detection, facial recognition, and fatigue driving detection.

Huawei HiLens allows you to register a HiLens Kit device with the Huawei HiLens console, so that you can manage its skills, configure its cameras, handle its alarms, and upgrade its firmware on the console.
You can register HiLens Kit devices using SSH.

After a HiLens Kit device is registered with the Huawei HiLens console, you can manage its skills, configure its cameras, handle its alarms, and upgrade its firmware on the console.

Huawei HiLens allows you to view alarms of HiLens Kit devices. The alarms are classified into service alarms and hardware alarms.
· Service alarms: Huawei HiLens monitors services and generates alarms when services are faulty. You can set alarm messages for service alarms. When a skill cannot run properly, an alarm is sent to you in real time, prompting you to check the device or skill.
· Hardware alarms: When a HiLens Kit device is faulty or works abnormally due to certain reasons, Huawei HiLens generates hardware alarms based on the faults on different modules.

A HiLens Kit device has a built-in camera and can connect to multiple IP cameras (the number of cameras cannot be greater than the total number of channels supported by the skills installed on the device). The Huawei HiLens platform allows you to add and manage external cameras connected to HiLens Kit devices.

With continuous service evolution, Huawei HiLens will continuously upgrade the HiLens Framework version. You can upgrade the version on the Huawei HiLens console. To ensure that your device can run newer and better skills, you are advised to upgrade its firmware promptly.

Huawei HiLens allows you to install developed skills on your devices, start the skills, and view the skill running effects, to determine whether the skills can meet service requirements.
The following skills can be installed:
· Skills purchased in the HiLens skill market.
· Skills developed on the Huawei HiLens console or in HiLens Studio.

In addition to HiLens Kit devices, the Huawei HiLens console can also manage cameras running HiSilicon Hi35xx series chips as products.
Users (usually manufacturers) can create a product, download the product certificate, and embed the certificate into (a batch of) devices on the console. Then, the devices are classified into the product.
Huawei HiLens allows the manufacturers to purchase skills applicable to the product in the skill market, distribute skills to the product, and download and embed the skill SDKs to corresponding devices. Then, the devices can use the distributed skills.

Huawei HiLens allows manufacturers to purchase skills oriented to HiSilicon Hi35xx series chips in the skill market, distribute the skills to products, and download and embed the skill SDKs to devices running HiSilicon Hi35xx series chips. Then, the devices can use the distributed skills.
A maximum of five skills can be distributed due to performance restrictions.

Huawei HiLens allows you to develop skills used on HiLens Kit devices on the console or in HiLens Studio to meet requirements of various scenarios.
You can use skill templates or empty templates to create skills.

Huawei HiLens provides skill templates that preset logic code and models, with which you can quickly create skills, improving development efficiency.

To support skill development, Huawei HiLens provides the model import function. That is, models developed locally or on ModelArts can be directly imported to Huawei HiLens for quick skill development.
Huawei HiLens supports models trained by TensorFlow, Caffe, and MindSpore deep learning frameworks. TensorFlow and Caffe models can be converted into the OM format and then imported to Huawei HiLens.

The skill market is an ecological community built by Huawei HiLens to provide users with extensive skills.
You can purchase required skills from the skill market to equip your devices with AI capabilities. You can also release self-developed skills to the skill market for other users to use.