Redis Result Table

Function

DLI exports the output data of the Flink job to Redis. Redis is a storage system that supports multiple types of data structures such as key-value. It can be used in scenarios such as caching, event pub/sub, and high-speed queuing. Redis supports direct read/write of strings, hashes, lists, queues, and sets. Redis works with in-memory dataset and provides persistence. For more information about Redis, visit https://redis.io/.

Prerequisites

An enhanced datasource connection with Redis has been established, so that you can configure security group rules as required.

• You have set up an enhanced datasource connection. For details, see Enhanced Datasource Connections in the Data Lake Insight User Guide.
• For details about how to configure security group rules, see Security Group Overview in the Virtual Private Cloud User Guide.

Syntax

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13

create table dwsSink (
  attr_name attr_type 
  (',' attr_name attr_type)* 
  (','PRIMARY KEY (attr_name, ...) NOT ENFORCED)
)
with (
'connector.type' = 'redis',
  'connector.host' = '',
  'connector.port' = '',
  'connector.password' = '',
  'connector.table-name' = '',
  'connector.key-column' = ''
);

Parameters

Precautions

Either connector.table-name or connector.data-type must be set.

Example

• Configure the table storage pattern when you configure connector.table-name.
  In table storage pattern, data is stored in hash mode, which is different from the basic hash pattern in which the three fields of a table are used as the key, hash_key, and hash_value. The key in table pattern can be specified by connector.table-name and connector.key-column parameters, all field names in the table are used as hash_key, and the field values are written to the hash table as hash_value.

  create table redisSink(
    car_id STRING,
    car_owner STRING,
    car_brand STRING,
    car_speed INT
  ) with (
    'connector.type' = 'redis',
    'connector.host' = 'xx.xx.xx.xx',
    'connector.port' = '6379',
    'connector.password' = 'xx',
    'connector.table-name'='car_info',
    'connector.key-column'='car_id'
  );
  
  insert into redisSink
    (car_id,car_owner,car_brand,car_speed)
    VALUES
    ("A1234","OwnA","A1234",30);

• The following example shows how to create a table when connector.data-type is set to string, list, hash, or set, respectively.
  • String type
    The table contains two columns: key and value.

    create table redisSink(
      attr1 STRING,
      attr2 STRING
    ) with (
      'connector.type' = 'redis',
      'connector.host' = 'xx.xx.xx.xx',
      'connector.port' = '6379',
      'connector.password' = 'xx',
      'connector.data-type' = 'string'
    );
    
    insert into redisSink
      (attr1,attr2)
      VALUES
      ("car_id","A1234");

  • List type
    The table contains two columns: key and value.

    1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

    create table redisSink( attr1 STRING, attr2 STRING ) with ( 'connector.type' = 'redis', 'connector.host' = 'xx.xx.xx.xx', 'connector.port' = '6379', 'connector.password' = 'xx', 'connector.data-type' = 'list' ); insert into redisSink (attr1,attr2) VALUES ("car_id","A1234");

  • Set type
    The table contains two columns: key and value.

    create table redisSink(
      attr1 STRING,
      attr2 STRING
    ) with (
      'connector.type' = 'redis',
      'connector.host' = 'xx.xx.xx.xx',
      'connector.port' = '6379',
      'connector.password' = 'xx',
      'connector.data-type' = 'set'
    );
    
    insert into redisSink
      (attr1,attr2)
      VALUES
      ("car_id","A1234");

  • Hash type
    The table contains three columns: key, hash_key, and hash_value.

    create table redisSink(
      attr1 STRING,
      attr2 STRING,
      attr3 STRING
    ) with (
      'connector.type' = 'redis',
      'connector.host' = 'xx.xx.xx.xx',
      'connector.port' = '6379',
      'connector.password' = 'xx',
      'connector.data-type' = 'hash'
    );
    
    insert into redisSink
      (attr1,attr2,attr3)
      VALUES
      ("car_info","car_id","A1234");