Help Center > > Performance White Paper> RDS for SQL Server> Test Method

Test Method

Updated at: May 28, 2019 GMT+08:00

HUAWEI CLOUD SQL Server is an online Microsoft SQL Server-compatible relational database service. RDS for SQL Server can provide more secure, reliable, stable services than the open source database of the Community Edition. Based on the primary/standby architecture, it provides all necessary functions you need, including backup, restoration, monitoring, and migration. It supports two billing mode: yearly/monthly and pay-per use.

Test Environment

  • Region: CN North-Beijing1
  • AZ: AZ1
  • Elastic Cloud Server (ECS) specifications: hc2 flavor with 8 vCPUs, 16 GB of memory, SSD disk, 200 GB storage, and Windows Server 2012 R2 Standard 64bit image. The network type is VPC.

Test Tool

HammerDB is a graphical open source database load testing and benchmarking tool for Linux and Windows to test databases running on any operating system. HammerDB is automated, multi-threaded and extensible with dynamic scripting support. You can use HammerDB to create a test schema, load data, and simulate workloads of multiple virtual users on databases in online transaction processing (OLTP) and online analytical processing (OLAP) scenarios.

HammerDB 2.19 is used as an example. Download the latest version.

HammerDB started

Test Benchmarks

The Transaction Processing Performance Council (TPC) is a non-profit corporation founded to define transaction processing and database benchmarks and to disseminate objective, verifiable performance data to the industry. TPC provides multiple test benchmarks, such as TPC-A, TPC-C, and TPC-H. For details, see the official document. TPC-C is an OLTP benchmark. It is different and more complex than TPC-A because of its multiple transaction types, more complex database, and overall execution structure.

This test uses the TPC-C test benchmark.

The test model is developed by HUAWIE CLOUD based on HammerDB without any optimization and modification on the model structure.

Test Procedure

  1. Open HammerDB.

    Figure 1 HammerDB started

  2. In the Benchmark area, double-click SQL Server. In the displayed dialog box, select MSSQL Server and TPC-C, and click OK.

    Figure 2 Benchmark Options

  3. Configure the connection information and create the object database tpcc.

    Choose SQL Server > TPC-C > Schema Build and double-click Options.

    In the displayed dialog box, select Updated for Schema.

    Figure 3 Microsoft SQL Server TPC-C Build Options

  4. Choose SQL Server > TPC-C > Schema Build > Build. In the displayed dialog box, click Yes to create a schema.

    Figure 4 Build

    Wait until the initialization is complete.

    Figure 5 Initialization completed

  5. Click to stop the execution.

    Figure 6 Execution stopped

  6. Select SQL Server > TPC-C > Driver Script and double-click Options to ensure that the connection information is correct.

    Figure 7 Checking the connection information

  7. Choose SQL Server > TPC-C > Driver Script and double-click Load.

    Figure 8 Load

  8. Choose SQL Server > TPC-C > Virtual User and double-click Options. In the displayed dialog box, you can adjust the number of virtual users repeatedly to generate test results until the TPM values become consistent. Transactions Per Minute (TPM) is an important benchmark for measuring database performance.

    You are advised not to select Show Output because the client may not respond.

  9. Click Yes.

  10. Choose Virtual User and double-click Run until the TPM peak value is stable.

    Figure 9 Stable TPM peak value

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?

Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel