Updated on 2024-11-29 GMT+08:00

Configuring Pipeline

  1. Configure files.
    • nettyconnector.registerserver.topic.storage: (Mandatory) Configures the path (on a third-party server) to information about IP address, port numbers, and concurrency of NettySink. For example:
      nettyconnector.registerserver.topic.storage: /flink/nettyconnector
    • nettyconnector.sinkserver.port.range: (Mandatory) Configures the range of port numbers of NettySink. For example:
      nettyconnector.sinkserver.port.range: 28444-28843
    • nettyconnector.ssl.enabled: Configures whether to enable SSL encryption between NettySink and NettySource. The default value is false. For example:
      nettyconnector.ssl.enabled: true
  2. Configure security authentication.
    • SASL authentication of ZooKeeper depends on the HA configuration in the flink-conf.yaml file.
    • SSL configurations such as keystore, truststore, keystore password, truststore password, and password inherit from flink-conf.yaml. For details, see Encrypted Transmission.