Reval
Performance Testing and Risk
PTS
Ankush Garg
Functional vs Load Testing
Functional
Example
Test
Do business
processes function
Functionality
properly after
implementation?
Load
Test
Objective
Objective
Stability
Example
Will 100 concurrent
hits crash the server?
Is response time
Performance acceptable according
to specifications?
Do business
Functionality processes function
under load properly under heavy
load?
Performance Testing - Manually
Performance Testing via Tool
Webload and Volume Tests
Webloa
d
Volume
Tests
executed
via Visual
Studio
Tests
executed
via SQL
scripts
Focus Choice,
Core, ITS
Focus - TS
Example
Time taken
to open
dialog
Example
Time taken
by service
5
Risk PTS - Overview
o Hosted in Graz
o Isolated from Reval domain
o Applications available
Choice
Core
C&P
o Login page available
Unified login
Direct C&P
o Update cycle
Every month
On request basis
o Technical setup is similar to c1dev
6
Benefits of Risk PTS
o Bugs that no one internally finds:
Huge databases and loading times
Parallel Execution of Services with parallel users
Separated QA Network/Environment -> no impact from outside!
Monitoring of all components (all hosts -> cpu usage, memory,
disc I/O, processes, etc.)
o
Hardware scalability can be tested (Virtual Machines)
o Number of servers can be increased/decreased
o Flexible changing of settings, licenses, parameters for testing
Sample Results
Cigna Tests of critical dialogs:
Regular Comparison Results:
Microsoft Excel
Worksheet
Bottleneck Analysis of Export:
Microsoft Excel
Worksheet
Risk PTS architecture
Web
Async
Risk
Servers
GSVC
Phoenix
DCE Reporting
ITS Servers
-1
Web
LB
LB
Web
Corba
Database
BG
DBC
ITS Servers
-2
LB
Corba
BG
DBC
9
Questions?
10