Updated on 2022-03-13 GMT+08:00

Introduction

Tensor Engine, abbreviated as TE, is a development framework for custom operators based on the Tensor Virtual Machine (TVM). The TVM is an open source project of the community. It aims to further abstract the generation rules of operators by dividing the operators into operation primitives and combining the operators when necessary. According to the definition of the computation process of operators, the TVM uses the Schedule technology and the Codegen technology to generate the operators for the specified hardware.

Schedule is used to describe the computation process for implementing an operator on hardware, which requires profound hardware knowledge. To reduce the difficulty in writing operators, the writing of schedules is simplified based on the TVM. The concept of "auto schedule" is used to provide a group of TE APIs to combine the computation of operators. By combination using APIs, you can define the computation process of an operator and hand over the schedule to "auto schedule". This document describes microprocess APIs defined based on the TVM. You can use these APIs to develop operators.