Help Center/ MapReduce Service/ User Guide (Kuala Lumpur Region)/ FAQs/ Big Data Service Development/ What Is the Port for Accessing HDFS Using Python?
Updated on 2022-12-14 GMT+08:00
View PDF
Share

What Is the Port for Accessing HDFS Using Python?

The default port of open source HDFS is 50070 for versions earlier than MRS 3.0.0, and 9870 for MRS 3.0.0 or later. Common HDFS Ports describes the common ports of HDFS.

Common HDFS Ports

The protocol type of all ports in the table is TCP.

Parameter

Default Port

Port Description

dfs.namenode.rpc.port
  • 9820 (versions earlier than MRS 3.x)
  • 8020 (MRS 3.x and later)

NameNode RPC port

This port is used for:

1. Communication between the HDFS client and NameNode

2. Connection between the DataNode and NameNode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.namenode.http.port

9870

HDFS HTTP port (NameNode)

This port is used for:

1. Point-to-point NameNode checkpoint operations.

2. Connecting the remote web client to the NameNode UI

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.namenode.https.port

9871

HDFS HTTPS port (NameNode)

This port is used for:

1. Point-to-point NameNode checkpoint operations

2. Connecting the remote web client to the NameNode UI

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.ipc.port

9867

IPC server port of DataNode

This port is used for:

Connection between the client and DataNode to perform RPC operations.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.port

9866

DataNode data transmission port

This port is used for:

1. Transmitting data from HDFS client from or to the DataNode

2. Point-to-point DataNode data transmission

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.http.port

9864

DataNode HTTP port

This port is used for:

Connecting to the DataNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.https.port

9865

HTTPS port of DataNode

This port is used for:

Connecting to the DataNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.JournalNode.rpc.port

8485

RPC port of JournalNode

This port is used for:

Client communication to access multiple types of information

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.journalnode.http.port

8480

JournalNode HTTP port

This port is used for:

Connecting to the JournalNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.journalnode.https.port

8481

HTTPS port of JournalNode

This port is used for:

Connecting to the JournalNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

httpfs.http.port

14000

Listening port of the HttpFS HTTP server

This port is used for:

Connecting to the HttpFS from the remote REST API

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes