Updated on 2026-07-06 GMT+08:00

Getting Started

Add a model using the backend Web UI

  1. Log in according to the instructions in Step 5 of the "Quick Deployment", using the initial username admin and the initial password (master_key) set in the "Quick Deployment".

    Figure 1 Logging into the LiteLLM Management Web UI

    If you forget your password, you can check the configured master_key in the config.yaml file on the server.

  2. Click "Models+Endpoints" on the left to enter the model configuration interface. There are some system-provided example configurations that can be saved or deleted as needed.

    Figure 2 Model Configuration Interface

  3. Click "Add Model" to configure the following parameters.

    Figure 3 Add Model

    Parameters

    Description

    Example

    provider

    Model Provider (e.g., OpenAI, Bedrock, etc.)

    Custom OpenAI

    LiteLLM Model Name

    Model Name sent to the API by LiteLLM

    deepseekv3.2

    Model Mappings

    Model Mapping

    deepseekv3.2

    Mode

    Interface Mode

    Chat - /chat/completions

    API Base

    URL of the API Address

    https://api.modelarts-maas.com/v2

    API Key

    API Key

    API Key

  4. Click "Test Connect". When the content shown in the figure below appears, you can click "Add Model" to add the model.

    Figure 4 Test Connect successful

Create a Virtual Key for model management and authentication. The

The owner of the Virtual Key can be yourself, a specific account, or an individual user.

  1. Click "Virtual Key" and select "Create New Key".
    Figure 1 Create Virtual Key
  2. Fill in the required information according to the table below, then click OK and copy the Virtual Key information.

    Module

    Parameter Name

    Options/Example

    Meaning Description

    Key Ownership

    Owned By

    You / Service Account / Another User

    Key Owner Entity - determines who owns the key:

    • You: Current logged-in user (individual developer scenarios)
    • Service Account: For CI/CD pipelines or automated scripts
    • Another User: Assign to existing LiteLLM team members
      

    Team

    Search or select a team

    used for multi-tenant/team scenarios. The key inherits the team's budget, model permissions, and other configurations, enabling cost and permission management at the team level.

    Key Details

    Key Name

    deepseek-v3.2

    Custom Alias for the Key - used only for administrative identification, making it easier to distinguish keys for different purposes (e.g., project name, application name). It does not affect API calls.

      

    Models

    deepseek-v3.2

    List of Models Accessible by the Key - multiple selections allowed. Restricts the key to calling only specified models, preventing unauthorized use of model resources.

      

    Key Type

    LLM API

    Key Type - defines the category of API endpoints it can access:

    • LLM API: General large language model interfaces (e.g., chat/completions, completions)
    • Other optional values typically include specialized API types such as embedding, image, audio, etc., for granular control.
  3. In the "Playground", select "Virtual Key" in the "Virtual Key Source" field, then enter the Virtual Key and other related information. In the dialog box, type "hello" to test if it can respond to your message correctly.
    Figure 2 enter the Virtual Key and other related information

The Virtual Key is generated only once, please make sure to save it promptly.

For more advanced usage tutorials, refer to the official LiteLLM repository.