微软提供的性能测试用例模版-UML软件工程组织-火龙果软件

测试用例模板

测试用例 (Test case)

用例名称

用例编号重要程度

用例设计人代码负责人

测试人测试时间

English version

Title

Case ID Level

Designer Developer

Tester Time

测试场景描述 (Case scenario)

场景描述

子场景(可选)

子场景1 例如，返回10条记录

子场景2 例如，返回100条记录

测试流程 (Testing process)

描述被测试应用场景的商业流程，流程必须在实际测试中发挥良好的导航作用，使不熟悉该系统的使用者能够对商业流程有清晰的了解。

(被测的商业流程应该事先通过检测，以确保功能的顺利运行。应用程序代码在测试阶段应该被冻结)

1．

2．

3．

测试条件和要求 (Requirements)

环境要求

硬件要求：

WEB服务器 - 配置1.2 (详细配置信息见测试计划文档，或附录)

软件要求：

补丁要求：

网络要求：

性能基线和衡量指标 (Testing baseline & metrics)

前提 (测试结果有效的先决条件)

1. 例如：无内存泄漏；HTTP错误个数为0

2. 数据库数据要求

例如：流水表已有20万条记录

3. 并发连接数要求

4. 测试周期或测试次数

性能基线

1. 例如：每秒钟完成XXX笔交易

监视参数 (详情见附录)

1. 例如：Performance Monitor: Private Byte

性能计算方式

1. 例如：数据库交易表增加纪录数 / 总时间(秒)

测试数据和脚本 (Testing data, Scripts)

测试数据准备

包括登陆账号组，输入数据；可以事先保存在某个文本文件中

测试数据库

数据库、表、存储过程、视图、用户帐号、相关数据

测试脚本

根据测试工具编写相应脚本或编写手工测试脚本

for Example

1LBrowser

1. Navigate to the home page of the Online Shopping site.

2. Click “Help.”

3. Click “FAQ.”

4. Click “Shopping” on FAQ.

5. Click “Shopping/Our Products” on the main menu.

6. Click “Product Search.”

7. Click “Special Offers.”

8. Click “Store Finder.”

9. Click Central Scotland to view shop addresses.

10. Click “Edinburgh” to see details.

11. Click “After Sales.”

12. Click “Basket.”

13. Navigate to the home page of the Online Shopping site.

14. Click on Advert at bottom of page.

测试手段 (Testing instrument)

例如：编写自动测试工具

或使用专用测试工具。

备注 (Remarks)

附录A – 应用软件性能数据分类

4.1 应用软件性能数据概述

在企业级应用的负载测试过程中，测试工具通过部署一整套性能监视器，来收集和显示各个架构层次、服务器和组件上的性能数据，包括网络、操作系统、应用服务器、中间件、应用程序、.NET服务器、Web服务器和数据库服务器。在进行负载测试时，这些数据用来精确测量系统各个方面的性能，从而用户可以快速、简便地定位问题和瓶颈的来源。最终，这些数据用来生成各种文档和图表，并判断出应用程序的性能是否满足业务的需要。

4.2 应用软件常用性能数据描述

1. Number of Concurrent Users (NCU)

并发用户数 – 在指定时刻，系统观察到的并发用户连接数。

2. Request Per Second (RPS)

每秒处理请求数 – 指示服务器平均每秒钟能处理的用户事务请求数量。

3. Response Time

响应时间 – 指从客户发出一个事务请求到收到处理结果的最后一个字节的时间长度。

4. Time to First Byte (TTFB)

客户端收到响应的第一个字节的平均毫秒数。

5. Time to Last Byte (TTLB)

客户端收到响应的最后一个字节的平均毫秒数。

6. Think Time

思考时间 – 用户在发送下一个请求前花在浏览页面上的时间。

7. Hits per Second

每秒点击次数

8. Throughput

吞吐量 – 以kilobyte为单位，客户每秒接收的数据总量。

9. Pages per Second

每秒下载页数 – 每秒内从Web服务器上下载到客户端的Web页面数量。

10. User-define Data Point (supported by LoadRunner)

用户自定义性能指标 – 由LoadRunner支持的自定义性能指标，比如: Transaction Response Time, Transaction Per Second Passed, Failed。

11. %Processor Time:CPU平均利用率

12. %User Time:用户态CPU平均利用率

13. % Privileged Time:核心态CPU平均利用率

14. Processor Queue Length:处理器队列中的线程数

15. Context Switches per Second:每秒线程切换次数

16. Interrupts/Sec:每秒中断数

17. Page Faults / sec:每秒内存换页数

18. Memory, Available Bytes:平均剩余的可用内存

19. Private Bytes:进程分配内存数

20. Process, Handle Count:进程使用系统句柄数

21. Memory, Pool Paged Bytes:可交换到硬盘的系统物理内存byte数。

22. Memory, Pool Non-paged Bytes:不可交换到硬盘的系统物理内存byte数。

23. Network Interface, bytes total/sec:网络带宽利用率

24. Network Interface, Output Queue Length:网络适配器输出队列长度

25. Physical Disk, %Disk Time:物理磁盘利用率

26. Physical Disk, Avg Disk Queue Length:物理磁盘平均磁盘I/O队列长度

27. Physical Disk, Current Disk Queue Length:物理磁盘当前磁盘I/O队列长度

28. Physical Disk, Disk Read/Sec, Disk Write/Sec:物理磁盘每秒读/写操作次数

29. COM+ Authenticate (by LoadRunner):COM+ 调用级别验证成功频率

30. COM+ Authenticate Failed (by LoadRunner):COM+ 调用级别验证失败的频率

31. COM+ Activation (by LoadRunner):COM+ 应用激活频率

32. COM+ Failed (by LoadRunner):COM+ 应用关闭频率

33. COM+ Thread Start (by LoadRunner):STA的线程启动的比率

34. COM+ Thread Terminate (by LoadRunner):STA的线程中止的比率

35. Transaction Duration (by LoadRunner):COM+事务的平均周期

36. Transaction Start (by LoadRunner):COM+事务启动比率

37. Transaction Prepared (by LoadRunner):COM+事务进入准备阶段的比率

38. Transaction Aborted (by LoadRunner):COM+事务回滚的比率

39. Transaction Commited (by LoadRunner):COM+事务提交的比率

40. Object LifeTime(by LoadRunner):COM+组件平均生命期

41. Object Create (by LoadRunner):创建COM+组件实例的比率

42. Object Destroy (by LoadRunner):释放COM+组件实例的比率

43. Object Activate (by LoadRunner):COM+ JIT-actived对象激活的比率

44. Object Deactivate (by LoadRunner):COM+ JIT-actived对象失活的比率

45. Disable Commit (by LoadRunner):COM+对象处于DisableCommit状态的比率

46. Enable Commit (by LoadRunner):COM+对象处于Enable状态的比率

47. Set Complete (by LoadRunner):COM+对象处于SetComplete状态的比率

48. Set Abort (by LoadRunner)COM+对象处于SetAbort状态的比率

49. COM+ Method Duration (by LoadRunner):COM+方法调用平均持续时间

50. COM+ Method Frequency (by LoadRunner):COM+方法调用频率

51. COM+ Method Failed (by LoadRunner):COM+方法失败的频率

52. COM+ Method Exception (by LoadRunner):COM+方法抛出异常的频率

53. Active Server Page, Request per Second:ASP每秒执行请求数

54. Active Server Page, Request Queue:ASP请求队列长度

55. Active Server Page, Requests Execute Time:ASP平均请求执行时间

56. Active Server Page, Requests Wait Time:ASP平均请求等待时间

57. Active Server Page, Session Current:当前活动Session计数

58. .NET CLR Data, SqlClient, Current # Pooled Connection:当前被连接池缓存的数据库连接

59. .NET CLR Data, SqlClient, Current # Pooled and Non-pooled Connection

当前所有的数据库连接，缓存和未缓存的

60. .NET CLR Memory, Gen 0、1、2 heap size:.NET中0、1、2代虚拟堆的大小

61. .NET CLR Memory, # bytes in all Heaps:.NET中托管内存的总数

62. ASP.NET, Application Restarts:ASP.NET中应用重新启动的次数

63. ASP.NET, Work Process Restarts:ASP.NET中工作进程重新启动的次数

64. ASP.NET, Request Execution Time:ASP.NET平均请求执行时间毫秒数

65. ASP.NET, Request Wait Time:ASP.NET平均请求等待时间毫秒数

66. ASP.NET, Requests Queued:ASP.NET平均请求队列长度

67. ASP.NET Application, Requests/Sec:ASP.NET某特定应用每秒钟处理的请求数

68. ASP.NET Application, Requests Executing:ASP.NET某特定应用正在执行的请求数

69. ASP.NET Application Sessions Active:ASP.NET某特定应用中活动的Session数

70. Web Service, Get Requests per Second:HTTP的GET方法每秒请求数

71. Web Service, Post Requests per Second:HTTP的POST方法每秒请求数

72. Distributed Transaction Coordinator, Transactions/Sec

每秒的分布式事务数

73. Distributed Transaction Coordinator, Committed Transactions

提交的分布式事务总数

74. Distributed Transaction Coordinator, Aborted Transactions

回滚的分布式事务总数

75. Distributed Transaction Coordinator, Active Transactions

当前活动的分布式事务数

76. Distributed Transaction Coordinator, Response Time – Average

分布式事务从开始到提交的平均时间间隔

77. SQL Server, Cache Manager, Cache Hit Ratio:SQL Server的缓存区命中率

78. SQL Server, Cache Manager, Cache Used Counts per Second

SQL Server每秒内使用的缓存对象数

79. SQL Server, Locks, Exclusive/Shared & Users blocked

SQL Server 每秒内用户由于表级锁被阻塞数

80. SQL Server, % Procedure Cache Used & % Procedure Cache Active

SQL Server存储过程缓存使用率

81. SQL Server, Transaction/Sec:SQL Server每秒的事务数

82. SQL Server, General statistics, User Connections

SQL Server 当前用户连接数

83. SQL Profiler, Audit Login/Logout

SQL Profiler中跟踪用户登入/登出数

84. SQL Profiler, Stored Procedure, RPC Completed

SQL Profiler中跟踪存储过程的调用

85. SQL Profiler, TSQL, Batch Completed:SQL Profiler中跟踪TSQL语句的调用

86. SQL Profiler, SQL Transaction:SQL Profiler 中跟踪事务的提交。

4.3 应用软件性能数据分类

企业应用程序可以根据系统架构分成以下类型

Client/Server – 客户机/服务器架构 l 基于浏览器/Web服务器的三层架构 l 基于中间件应用服务器的三层架构 l 基于Web服务器和中间件的多层架构

以上架构都由客户机、Web服务器、中间层应用服务器、数据库服务器组成。通过针对不同层次的性能指标监测，可以分析出整体架构的性能指标和性能瓶颈。

1．数据库服务器的性能指标监测

l Processor, %Processor Time

Processor, %User Timel

Processor, %l Privileged Time

Processor, Processor Queue Lengthl

System, Contextl Switches per Second

Memory, Page Faults/secl

Memory, Availablel Bytes

Memory, Pool Paged Bytesl

Network Interface, bytes total/secl

l Network Interface, Output Queue Length

Physical Disk, %Disk Timel

l Physical Disk, Current Disk Queue Length

Physical Disk, Avg Disk Queuel Length

Physical Disk, Disk Read/Sec, Disk Write/Secl

SQL Server,l General statistics, User Connections

SQL Server, Transaction/Secl

SQLl Server, Cache Manager, Cache Hit Ratio

SQL Server, Cache Manager, Cachel Used Counts per Second

SQL Server, Locks, Exclusive/Sharedl & Users blocked

SQL Server, % Procedure Cache Usedl & % Procedure Cache Active

SQL Profiler, Audit Login/Logoutl

SQL Profiler, Storedl Procedure, RPC Completed

SQL Profiler, TSQL, Batch Completedl

SQLl Profiler, SQL Transaction

2． Web服务器的性能指标监测

Processor, %Processorl Time

Processor, %User Timel

Processor, % Privileged Timel

l Processor, Processor Queue Length

System, Context Switches per Secondl

l Process, Private Bytes

Memory, Page Faults/secl

Memory, Availablel Bytes

Memory, Pool Paged Bytesl

Network Interface, bytes total/secl

l Network Interface, Output Queue Length

Physical Disk, %Disk Timel

l Physical Disk, Avg Disk Queue Length

Number of Concurrent Users (NCU)l

l Request Per Second (RPS)

Response Timel

Time to First Byte (TTFB)l

l Time to Last Byte (TTLB)

Think Timel

Web Service, Get Requests perl Second

Web Service, Post Requests per Secondl

Active Server Page,l Request per Second

Active Server Page, Request Queuel

Active Serverl Page, Requests Execute Time

Active Server Page, Requests Wait Timel

l Active Server Page, Session Current 。

3．基于ASP.NET的Web服务器或Web Service服务器性能指标监测

Processor, %Processor Timel

Processor, %User Timel

l Processor, % Privileged Time

Processor, Processor Queue Lengthl

System,l Context Switches per Second

Process, Private Bytesl

Memory, Pagel Faults/sec

Memory, Available Bytesl

Memory, Pool Paged Bytesl

l Network Interface, bytes total/sec

Network Interface, Output Queuel Length

Physical Disk, %Disk Timel

Physical Disk, Avg Disk Queuel Length

Number of Concurrent Users (NCU)l

Request Per Second (RPS)l

l Response Time

Time to First Byte (TTFB)l

Time to Last Byte (TTLB)l

l Think Time

Web Service, Get Requests per Secondl

Web Service, Postl Requests per Second

ASP.NET, Application Restartsl

ASP.NET, Workl Process Restarts

ASP.NET, Request Execution Timel

ASP.NET, Request Waitl Time

ASP.NET, Requests Queuedl

ASP.NET Application, Requests/Secl

l ASP.NET Application, Requests Executing

ASP.NET Application Sessionsl Active

4．中间层应用服务器的性能指标监测

Processor, %Processor Timel

Processor,l %User Time

Processor, % Privileged Timel

Processor, Processor Queuel Length

System, Context Switches per Secondl

Process, Private Bytesl

l Memory, Page Faults/sec

Memory, Available Bytesl

Memory, Pool Pagedl Bytes

Network Interface, bytes total/secl

Network Interface, Outputl Queue Length

Physical Disk, %Disk Timel

Physical Disk, Avg Disk Queuel Length

COM+ Authenticate (by LoadRunner)l

COM+ Authenticate Failed (byl LoadRunner)

COM+ Activation (by LoadRunner)l

COM+ Failed (byl LoadRunner)

COM+ Thread Start (by LoadRunner)l

COM+ Thread Terminatel (by LoadRunner)

Transaction Duration (by LoadRunner)l

Transaction Startl (by LoadRunner)

Transaction Prepared (by LoadRunner)l

Transactionl Aborted (by LoadRunner)

Transaction Commited (by LoadRunner)l

Objectl LifeTime(by LoadRunner)

Object Create (by LoadRunner)l

Object Destroyl (by LoadRunner)

Object Activate (by LoadRunner)l

Object Deactivate (byl LoadRunner)

Disable Commit (by LoadRunner)l

Enable Commit (byl LoadRunner)

Set Complete (by LoadRunner)l

Set Abort (byl LoadRunner)

COM+ Method Duration (by LoadRunner)l

COM+ Method Frequencyl (by LoadRunner)

COM+ Method Failed (by LoadRunner)l

COM+ Methodl Exception (by LoadRunner)

.NET CLR Data, SqlClient, Current # Pooledl Connection

.NET CLR Data, SqlClient, Current # Pooled and Non-pooledl Connection

.NET CLR Memory, Gen 0、1、2 heap sizel

.NET CLR Memory, #l bytes in all Heaps

Distributed Transaction Coordinator,l Transactions/Sec

Distributed Transaction Coordinator, Committedl Transactions

Distributed Transaction Coordinator, Aborted Transactionsl

l Distributed Transaction Coordinator, Active Transactions

Distributedl Transaction Coordinator, Response Time – Average

5．客户机的性能指标监测

l Processor, %Processor Time

Process, Private Bytesl

Process, Handlel Counts

Network Interface, bytes total/secl

Network Interface, Outputl Queue Length

Physical Disk, Avg Disk Queue Lengthl

.NET CLR Memory, Genl 0、1、2 heap size

.NET CLR Memory, # bytes in all Heapsl

Number ofl Concurrent Users (NCU)

Request Per Second (RPS)l

Response Timel

l Hits per Second

Throughputl

Pages per Secondl

User-define Datal Point

Time to First Byte (TTFB)l

Time to Last Byte (TTLB)l

Thinkl Time