Overview

Introduction

DLI supports clusters deployed in containers. In a container cluster, components related to Spark jobs and Flink jobs run in containers. You can download custom images provided by DLI to change the container running environments of Spark jobs and Flink jobs. For example, you can add a Python package or C library related to machine learning to a custom image to help you extend functions.

Use Restrictions

• The DLI container queue must be used and it must be a dedicated queue.
• The basic image provided by DLI must be used.
• You cannot modify the DLI components and directories in the basic image.
• Only Spark jobs and Flink Jar jobs are supported.

Use Process

Figure 1 Process of using a custom image