HFile and WAL Encryption

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh <path>/hbase.jks <type> <length> <alias>

• /<path>/hbase.jks indicates the path for storing the generated JKS file.
• <type> indicates the encryption type, which can be SMS4 or AES.
• <length> indicates the key length. SMS4 supports 16-bit and AES supports 128-bit.
• <alias> indicate the alias of the key file. When you create the key file for the first time, retain the default value omm.

For example, to generate an SMS4 encryption key, run the following command:

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh /home/hbase/conf/hbase.jks SMS4 16 omm

To generate an AES encryption key, run the following command:

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh /home/hbase/conf/hbase.jks AES 128 omm

• To ensure operations can be successfully performed, the <path>/hbase.jks directory needs to be created in advance, and the cluster operation user must have the rw permission of this directory.
• After running the command, enter the same <password> four times. The password encrypted in 3 is the same as the password in this step.

• The format of hbase.crypto.keyprovider.parameters.uri is jceks://<key_Path_Name>.

  <key_Path_Name> indicates the path of the key file. For example, if the path of the key file is /home/hbase/conf/hbase.jks, set this parameter to jceks:///home/hbase/conf/hbase.jks.

• The format of hbase.crypto.keyprovider.parameters.encryptedtext is <encrypted_password>.

  <encrypted_password> indicates the encrypted password generated during the key file creation. The parameter value is displayed in ciphertext. Run the following command as user omm to obtain the related encrypted password on the nodes where HBase service is installed:

  sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh

  

  After running the command, you need to enter <password>. The password is the same as that entered in 1.

• When you create an HBase table through CLI, set the encryption mode to SMS4 or AES for the column family.

  create '<table name>', {NAME => 'd', ENCRYPTION => '<type>'}

• When you create an HBase table using code, set the encryption mode to SMS4 or AES by adding the following information to the code:

  public void testCreateTable() 
  { 
      String tableName = "user"; 
      Configuration conf = getConfiguration();    
      HTableDescriptor htd = new HTableDescriptor(TableName.valueOf(tableName)); 
       
      HColumnDescriptor hcd = new HColumnDescriptor("d"); 
      //Set the encryption mode to SMS4 or AES.
      hcd.setEncryptionType("<type>"); 
      htd.addFamily(hcd); 
   
      HBaseAdmin admin = null; 
      try 
      { 
          admin = new HBaseAdmin(conf); 
           
          if(!admin.tableExists(tableName)) 
          { 
              admin.createTable(htd); 
          } 
      } 
      catch (IOException e) 
      { 
          e.printStackTrace(); 
      } 
      finally 
      { 
          if(admin != null) 
          { 
              try 
              { 
                  admin.close(); 
              } 
              catch (IOException e) 
              { 
                  e.printStackTrace(); 
              } 
          } 
      } 
  }

In this case, you can perform the following steps to encrypt the inserted data:

1. Run the flush command for the table to import the data in the memory to the HFile.

   flush'<table_name>'

2. Run the following commands to modify the table properties:

   disable'<table_name>'

   alter'<table_name>',NAME=>'<column_name>',ENCRYPTION => '<type>'

   enable'<table_name>'

3. Insert a new data record and flush the table.
   

   A new data record must be inserted so that the HFile will generate a new HFile and the unencrypted data inserted previously will be rewritten and encrypted.

   put'<table_name>','id2','f1:c1','value222222222222222222222222222222222'

   flush'<table_name>'

4. Perform the following step to rewrite the HFile:
   major_compact'<table_name>'

   

   During this step, the HBase table is disabled and cannot provide services. Exercise caution when you perform this step.

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh <path>/hbase.jks <type> <length> <alias-new>

• <path>/hbase.jks: indicates the path for storing the generated hbase.jks file. The path and file name must be consistent with those of the key file generated in HFile and WAL Encryption.
• <alias-new>: indicates the alias of the key file. The alias must be different with that of the old key file.
• <type>: indicates the encryption type, which can be SMS4 or AES.
• <length> indicates the key length. SMS4 supports 16-bit and AES supports 128-bit.

For example, to generate an SMS4 encryption key, run the following command:

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh /home/hbase/conf/hbase.jks SMS4 16 omm_new

To generate an AES encryption key, run the following command:

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh /home/hbase/conf/hbase.jks AES 128 omm_new

• To ensure operations can be successfully performed, the <path>/hbase.jks directory needs to be created in advance, and the cluster operation user must have the rw permission of this directory.
• After running the command, you need to enter the same <password> for three times. This password is the password of the key file. You can use the password of the old file without any security risk.

major_compact '<table_name>'

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh <path>/hbase.jks <alias-old>

• <path>/hbase.jks: indicates the path for storing the generated hbase.jks file. The path and file name must be consistent with those of the key file generated in HFile and WAL Encryption.
• <alias-old>: indicates the alias of the old key file to be deleted.

For example:

sh ${BIGDATA_HOME}/FusionInsight_HD_8.3.1/install/FusionInsight-HBase-*/hbase/bin/hbase-encrypt.sh /home/hbase/conf/hbase.jks omm

To ensure operations can be successfully performed, the <path>/hbase.jks directory needs to be created in advance, and the cluster operation user must have the rw permission of this directory.