Help Center/ MapReduce Service/ User Guide/ Configuring a Cluster/ Quick Configuration/ Quickly Buying a Kafka Streaming Cluster
Updated on 2024-04-11 GMT+08:00
View PDF

Quickly Buying a Kafka Streaming Cluster

This section describes how to quickly buy a Kafka streaming cluster. The Kafka cluster uses the Kafka and Storm components to provide an open source messaging system with high throughput and scalability. It is widely used in scenarios such as log collection and monitoring data aggregation to implement efficient streaming data collection and real-time data processing and storage.

The Kafka streaming cluster consists of the following components:

  • MRS 1.9.2: Kafka 1.1.0 and Storm 1.2.1

Quickly Buying a Kafka Streaming Cluster

  1. Go to the Buy Cluster page.
  2. On the displayed page, click the Quick Config tab.
  3. Configure basic cluster information. For details about the parameters, see Buying a Custom Cluster.

    • Region: Use the default value.
    • Billing Mode: Pay-per-use. If you select this mode, a prepaid balance will be frozen.
    • Cluster Name: You can use the default name. However, you are advised to include a project name abbreviation or date for consolidated memory and easy distinguishing, for example, mrs_20200321.
    • Cluster Type: Select Streaming cluster.
    • Version Type: Select Normal.
    • Cluster Version: Select a cluster version as you need.
    • Component: Select Kafka streaming cluster.
    • AZ: Use the default value.
    • Enterprise Project: Retain the default value.
    • VPC: Use the default value. If there is no available VPC, click View VPC to access the VPC console and create a new VPC.
    • Subnet: Use the default value.
    • CPU Architecture: Use the default value. This parameter is unavailable in MRS 3.x.
    • Cluster Node: Select the number of cluster nodes and node specifications based on site requirements. For MRS 3.x or later, the memory of the master node must be greater than 64 GB.
    • LVM: Use the default value. This parameter is not available in MRS 3.x.
    • Kerberos Authentication: Whether to enable Kerberos authentication. This option cannot be changed after you buy a cluster.
    • Username: The default value is root/admin. User root is used to remotely log in to ECSs, and user admin is used to access the cluster management page.
    • Password: Set a password for user root/admin.
    • Confirm Password: Enter the password of user root/admin again.
    Figure 1 Kafka Streaming Cluster
    Figure 2 Cluster node configurations

  4. Select the checkbox to enable secure communications. For details, see Communication Security Authorization.
  5. Click Buy Now.

    If Kerberos authentication is enabled, check whether this function is required. If it is, click Continue. If not, click Back to disable it and then proceed with the subsequent step. This option cannot be changed after you buy a cluster.

    For any doubt about the pricing, click Pricing details in the lower left corner.

  6. Click Back to Cluster List to view the cluster status. Click Access Cluster to view cluster details.

    For details about cluster status during creation, see the description of the status parameters in Table 1.

    It takes some time to create a cluster. The initial status of the cluster is Starting. After the cluster has been created successfully, the cluster status becomes Running.

    On the MRS management console, a maximum of 10 clusters can be concurrently created, and a maximum of 100 clusters can be managed.

Parent topic: Quick Configuration