Help Center/ MapReduce Service/ User Guide (ME-Abu Dhabi Region)/ Connecting to Clusters/ Accessing Web Pages of Open Source Components Managed in MRS Clusters/ List of Open Source Component Ports
Updated on 2022-02-22 GMT+08:00
View PDF

List of Open Source Component Ports

Common HBase Ports

Parameter

Default Port

Port Description

hbase.master.port

16000

HMaster RPC port. This port is used to connect the HBase client to HMaster.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hbase.master.info.port

16010

HMaster HTTPS port. This port is used by the remote web client to connect to the HMaster UI.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hbase.regionserver.port

16020

RegoinServer (RS) RPC port. This port is used to connect the HBase client to RegionServer.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hbase.regionserver.info.port

16030

HTTPS port of the Region server. This port is used by the remote web client to connect to the RegionServer UI.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hbase.thrift.info.port

9095

Thrift Server listening port of Thrift Server.

This port is used for:

Listening when the client is connected

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hbase.regionserver.thrift.port

9090

Thrift Server listening port of RegionServer.

This port is used for:

Listening when the client is connected to the RegionServer

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hbase.rest.info.port

8085

Port of the RegionServer RESTServer native web page

-

21309

REST port of RegionServer RESTServer

Common HDFS Ports

Parameter

Default Port

Port Description

dfs.namenode.rpc.port

9820 (For open-source versions earlier than 3.0.0, the default value is 8020.)

NameNode RPC port.

This port is used for:

1. Communication between the HDFS client and NameNode

2. Connection between the DataNode and NameNode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.namenode.http.port

9870 (The default value is 50070 in versions earlier than open-source 3.0.0.)

HDFS HTTP port (NameNode).

This port is used for:

1. Point-to-point NameNode checkpoint operations.

2. Connect the remote web client to the NameNode UI.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.namenode.https.port

9871 (50470 is the default value in versions earlier than open-source 3.0.0.)

HDFS HTTPS port (NameNode).

This port is used for:

1. Point-to-point NameNode checkpoint operations

2. Connecting the remote web client to the NameNode UI

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.ipc.port

9867 (50020 is the default value in versions earlier than open-source 3.0.0.)

IPC server port of DataNode.

This port is used for:

Connection between the client and DataNode to perform RPC operations.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.port

9866 (50010 is the default value in versions earlier than open-source 3.0.0.)

DataNode data transmission port.

This port is used for:

1. Transmitting data from HDFS client from or to the DataNode

2. Point-to-point DataNode data transmission

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.http.port

9864 (50075 is the default value in versions earlier than open-source 3.0.0.)

DataNode HTTP port.

This port is used for:

Connecting to the DataNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.datanode.https.port

9865 (50475 is the default value in versions earlier than open-source 3.0.0.)

HTTPS port of DataNode.

This port is used for:

Connecting to the DataNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.JournalNode.rpc.port

8485

RPC port of JournalNode.

This port is used for:

Client communication to access multiple types of information

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.journalnode.http.port

8480

JournalNode HTTP port

This port is used for:

Connecting to the JournalNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

dfs.journalnode.https.port

8481

HTTPS port of JournalNode.

This port is used for:

Connecting to the JournalNode from the remote web client in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

httpfs.http.port

14000

Listening port of the HttpFS HTTP server.

This port is used for:

Connecting to the HttpFS from the remote REST API

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common Hive Ports

Parameter

Default Port

Port Description

templeton.port

9111

Port used by WebHCat for providing the REST service.

This port is used for:

Communication between the WebHCat client and WebHCat server

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hive.server2.thrift.port

10000

Port for HiveServer to provide Thrift services.

This port is used for:

Communication between the HiveServer and HiveServer client

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hive.metastore.port

9083

Port for MetaStore to provide Thrift services.

This port is used for:

Communication between the MetaStore client and MetaStore, that is, communication between HiveServer and MetaStore.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

hive.server2.webui.port

10002

Web UI port of Hive.

This port is used for: HTTPS/HTTP communication between Web requests and the Hive UI server

Common Hue Ports

Parameter

Default Port

Port Description

HTTP_PORT

8888

Port for Hue to provide HTTPS services.

This port is used for: providing web services in HTTPS mode (The port can be modified.)

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common Kafka Ports

Parameter

Default Port

Port Description

port

9092

Port for a broker to receive data and obtain services

ssl.port

9093

SSL port used by a broker to receive data and obtain services

sasl.port

21007

SASL security authentication port provided by a broker, which provides the secure Kafka service

sasl-ssl.port

21009

Port used by a broker to provide encrypted service based on the SASL and SSL protocols

Common Loader Ports

Parameter

Default Port

Port Description

LOADER_HTTPS_PORT

21351

This port is used for: providing REST APIs for configuration and running of Loader jobs

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common Manager Ports

Parameter

Default Port

Port Description

-

8080

Port provided by WebService for user access.

This port is used to access the web UI over HTTP.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

-

28443

Port provided by WebService for user access.

This port is used to access the web UI over HTTPS.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common MapReduce Ports

Parameter

Default Port

Port Description

mapreduce.jobhistory.webapp.port

19888

Web HTTP port of the JobHistory server.

This port is used for: viewing the web page of the JobHistory server

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

mapreduce.jobhistory.port

10020

Port of the JobHistory server.

This port is used for:

1. Task data restoration in the MapReduce client

2. Obtaining task report in the Job client

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

mapreduce.jobhistory.webapp.https.port

19890

Web HTTPS port of the JobHistory server.

This port is used for: viewing the web page of the JobHistory server

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common Spark Ports

Parameter

Default Port

Port Description

hive.server2.thrift.port

22550

JDBC thrift port.

This port is used for:

Socket communication between Spark2.1.0 CLI/JDBC client and server

NOTE:

If hive.server2.thrift.port is occupied, an exception indicating that the port is occupied is reported.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

spark.ui.port

4040

Web UI port of JDBC

This port is used for: HTTPS/HTTP communication between Web requests and the JDBC Server Web UI server

NOTE:

The system verifies the port configuration. If the port is invalid, the value of the port plus 1 is used till the calculated value is valid. (A maximum number of 16 attempts are allowed. The number of attempts is specified by spark.port.maxRetries.)

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

spark.history.ui.port

18080

JobHistory Web UI port

This port is used for: HTTPS/HTTP communication between Web requests and Spark2.1.0 History Server

NOTE:

The system verifies the port configuration. If the port is invalid, the value of the port plus 1 is used till the calculated value is valid. (A maximum number of 16 attempts are allowed. The number of attempts is specified by spark.port.maxRetries.)

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common Storm Ports

Parameter

Default Port

Port Description

nimbus.thrift.port

6627

Port for Nimbus to provide thrift services

supervisor.slots.ports

6700,6701,6702,6703

Port for receiving service requests that are forwarded from other servers

logviewer.https.port

29248

Port for the logviewer to provide HTTPS services

ui.https.port

29243

Port for the Storm UI to provide HTTPS services (ui.https.port)

Common Yarn Ports

Parameter

Default Port

Port Description

yarn.resourcemanager.webapp.port

8088

Web HTTP port of the ResourceManager service.

yarn.resourcemanager.webapp.https.port

8090

Web HTTPS port of the ResourceManager service.

This port is used for: accessing the Resource Manager web applications in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

yarn.nodemanager.webapp.port

8042

NodeManager Web HTTP port

yarn.nodemanager.webapp.https.port

8044

NodeManager Web HTTPS port.

This port is used for:

Accessing the NodeManager web application in security mode

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common ZooKeeper Ports

Parameter

Default Port

Port Description

clientPort

2181

ZooKeeper client port.

This port is used for:

Connection between the ZooKeeper client and server.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common Kerberos Ports

Parameter

Default Port

Port Description

kdc_ports

21732

Kerberos server port.

This port is used for:

Performing Kerberos authentication for components This parameter may be used during the configuration of mutual trust between clusters.

NOTE:

The port ID is a recommended value and is specified based on the product. The port range is not restricted in the code.

  • Is the port enabled by default during the installation: Yes
  • Is the port enabled after security hardening: Yes

Common OpenTSDB Ports

Parameter

Default Port

Port Description

tsd.network.port

4242

Web UI port of OpenTSDB.

This port is used for: HTTPS/HTTP communication between web requests and the OpenTSDB UI server

Common Tez Ports

Parameter

Default Port

Port Description

tez.ui.port

28888

Web UI port of Tez

Common KafkaManager Ports

Parameter

Default Port

Port Description

kafka_manager_port

9099

Web UI port of KafkaManager.

Common Presto Ports

Parameter

Default Port

Port Description

http-server.http.port

7520

HTTP port of Presto coordinator to provide services for external entities

http-server.https.port

7521

HTTPS port of Presto coordinator to provide services for external entities

http-server.http.port

7530

HTTP port used by Presto worker to provide services for external entities

http-server.https.port

7531

HTTPS port used by Presto worker to provide services for external entities

Common Flink Ports

Parameter

Default Port

Port Description

jobmanager.web.port

32261-32325

Web UI port of Flink.

This port is used for: HTTP/HTTPS communication between the client web requests and Flink server