Test Results Summary
LoadTest의 고뇌 ( 한번도 못할수도 있지만 한번하면 한번만 하고 싶은 로드 테스트 과정 )
- RampUp/Down Time을 설정하여 피크타임까지 사용자를 실제 시나리오와 유사하게 늘리고 뺌
- 목표 TPS만큼 테스트가 안되면 테스트 통과 실패
- TPS가 높아도 목표 사용자수가 안되면 테스트 통과 실패
- 목표한 API 허용 에러률(1%)보다 높아도 테스트 통과 실패 (스크립트 오류및 테스트 노드장비 문제일수도 있음)
- 로드 테스트를 너무 많이해서 DB FUll이 나서 테스트 통과 실패
- 알수없는 이유로 여러개의 노드중 1개의 노드가 Crash되어도 테스트 통과 실패 ( 에러율이 1%보다 높아짐)
- 에러율이 낮아도 짧은기간에 에러 집중되면 테스트 통과 실패
- 테스트를 모두 통과해도, 평균 허용치 CPU(80%)사용율을 특정시간동안 지속되면 테스트 실패
- 코드수정및 스케일 아웃처리로 모든 로드 테스트를 통과해도, 이미 통과한 QA Sign OFF를 다시 받아야함, 이과정중 Codefix가 발생하면 다시 로드 테스트 수행
- 서버가 대용량 처리가 안정화 되어 ,장시간 테스트시 결국 분산 테스트툴보다 더 오래 버팀 (분산 테스트툴을 주기적으로 리셋해야되는 상황발생)
- 이모든 장벽을 다통과해도 테스트 시나리오때 누락된 테스트항목으로 문제발생 ( 사용자 플래폼 변경에 따른 레거시 → 신규서비스 전환 테스트 미스) - 레거시 테스트 시나리오까지 작성하기 어려움
- 이쯤되면 노하우보다 예지력이 생겨서 HotFix , 신규서비스(html5) 전환 성공 ,
Daily 로드 테스트(스크립트자체 검증과 서버검증을 통과할떄까지 수행)
15,000 accounts | ||||||
---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
Login | 15000 | 1 | - | |||
Get Cash Tables by Filter | 1270710 | 1920 | - | 96 | 238.379 | |
Get Zone Games by Filter | 317442 | 1220 | 0.151 | 21 | 58.887 | |
Get Zone Buyin Info | 11250 | 1699 | 15.10 | 0.75 | 1.799 | |
Request Zone Buyin | 9540 | 831 | 8.710 | 0.75 | 1.640 | |
Launch Game | 84834 | - | - | 5.5 | 15.976 | |
KeepAlive | 660986 | - | - | 50 | 124.479 | |
getTournamentsByFilter | 24520 | 47 | 0.191 | 13 | 4.609 | |
getTournamentsInfo | 5311 | 5 | 0.094 | 4 | 0.999 | |
getTournamentsState | 592242 | 1184 | 0.199 | 300 | 110.067 | |
getTournamentsTables | 1775050 | 3398 | 0.191 | 900 | 329.917 | |
getTournamentsLeaderboard | 1771648 | - | - | 900 | 329.916 | |
getTournamentsRank | 4197 | - | - | 4 | 0.790 | |
getTournamentsBuyinInfo | 5306 | 418 | 7.877 | 4 | 0.921 | |
tournamentsBuyin | 4888 | 691 | 14.136 | 4 | 0.790 | |
unRegister | 226 | - | - | 0.25 | 0.043 | |
Overall error rate | ||||||
Image file |
| |||||
Max Clients | 15,000 | |||||
Ramp up | 15min | |||||
Time to run | 70min | |||||
Ramp down | 5min |
15,000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | ||||||||||||||||||
Get Cash Tables by Filter | 2078521 | 150650 | 7.247 | 96 | 544.596 | |||||||||||||
Get Zone Games by Filter | 521873 | 29815 | 5.713 | 21 | 138.999 | |||||||||||||
Get Zone Buyin Info | 17417 | 2589 | 14.864 | 0.75 | 4.189 | |||||||||||||
Request Zone Buyin | 14798 | 1270 | 8.582 | 0.75 | 3.821 | |||||||||||||
Launch Game | 127716 | 59 | 0.046 | 5.5 | 36.061 | |||||||||||||
KeepAlive | 1002789 | 500 | 0.049 | 50 | 283.132 | |||||||||||||
getTournamentsByFilter | 41953 | 2140 | 5.100 | 13 | 11.247 | |||||||||||||
getTournamentsInfo | 7858 | 12 | 0.152 | 4 | 2.255 | |||||||||||||
getTournamentsState | 966140 | 48345 | 5.003 | 300 | 259.263 | |||||||||||||
getTournamentsTables | 2896970 | 140620 | 4.854 | 900 | 778.630 | |||||||||||||
getTournamentsLeaderboard | 2755991 | 140 | 0.05 | 900 | 778.789 | |||||||||||||
getTournamentsRank | 1077 | - | - | 4 | 0.309 | |||||||||||||
getTournamentsBuyinInfo | 17417 | 2589 | 14.864 | 4 | 1.968 | |||||||||||||
tournamentsBuyin | 6799 | 5723 | 84.174 | 4 | 0.309 | |||||||||||||
unRegister | 51 | 1 | 1.960 | 0.25 | 0.014 | |||||||||||||
Overall error rate | 3.676 | |||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
6,000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 6000 | |||||||||||||||||
Get Cash Tables by Filter | 527067 | 6 | 0.001 | 96 | 98.701 | |||||||||||||
Get Zone Games by Filter | 133017 | 4 | 0.003 | 21 | 24.909 | |||||||||||||
Get Zone Buyin Info | 4698 | 767 | 16.326 | 0.75 | 0.745 | |||||||||||||
Request Zone Buyin | 3925 | 8 | 0.203 | 0.75 | 0.742 | |||||||||||||
Launch Game | 35264 | - | 5.5 | 6.679 | ||||||||||||||
KeepAlive | 274334 | - | 50 | 51.957 | ||||||||||||||
Overall error rate | 0.08 | |||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 6,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
900 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 910 | 10 | ||||||||||||||||
getTournamentsByFilter | 6006 | 10 | 0.165 | 13 | 5.230 | |||||||||||||
getTournamentsInfo | 1830 | 4 | 1.605 | |||||||||||||||
getTournamentsState | 140998 | 285 | 0.202 | 300 | 159.600 | |||||||||||||
getTournamentsTables | 420309 | 666 | 0.158 | 900 | 470.667 | |||||||||||||
getTournamentsLeaderboard | 419630 | 900 | 470.717 | |||||||||||||||
getTournamentsRank | 1770 | 4 | 1.553 | |||||||||||||||
getTournamentsBuyinInfo | 1830 | 4 | 1.605 | |||||||||||||||
tournamentsBuyin | 1828 | 58 | 3.172 | 4 | 1.553 | |||||||||||||
unRegister | 77 | 21 | 0.055 | |||||||||||||||
Overall error rate | ||||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 900 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 5min | 15min | 15min | |||||||||||||||
Time to run | 20min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
6,000 accounts | ||||||
---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
Login | 6000 | |||||
Get Cash Tables by Filter | 527291 | 7 | 0.001 | 96 | 99.864 | |
Get Zone Games by Filter | 132388 | 3 | 0.002 | 21 | 24.791 | |
Get Zone Buyin Info | 4553 | - | 0.75 | 0.853 | ||
Request Zone Buyin | 4546 | 23 | 0.505 | 0.75 | 0.847 | |
Launch Game | 35936 | - | 5.5 | 6.730 | ||
KeepAlive | 274707 | - | 50 | 52.028 | ||
Overall error rate | 0.08 | |||||
Image file |
| |||||
Max Clients | 6,000 | |||||
Ramp up | 15min | |||||
Time to run | 70min | |||||
Ramp down | 5min | |||||
MemoryState(NextDay) |
6,000 accounts | ||||||
---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
Login | 6000 | |||||
Get Cash Tables by Filter | 527832 | 7 | 0.001 | 96 | 98.844 | |
Get Zone Games by Filter | 131642 | 2 | 0.001 | 21 | 24.652 | |
Get Zone Buyin Info | 4620 | - | 0.75 | 0.875 | ||
Request Zone Buyin | 4617 | - | 0.75 | 0.874 | ||
Launch Game | 36051 | - | 5.5 | 6.828 | ||
KeepAlive | 275694 | - | 50 | 51.628 | ||
Overall error rate | ||||||
Image file |
| |||||
Max Clients | 6,000 | |||||
Ramp up | 15min | |||||
Time to run | 70min | |||||
Ramp down | 5min | |||||
MemoryState(NextDay) |
9000 accounts | ||||||
---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
Login | 9000 | |||||
getTournamentsByFilter | 96691 | 23406 | 24.207 | 13 | 13.880 | |
getTournamentsInfo | 295 | - | 4 | 0.056 | ||
getTournamentsState | 2228922 | 82088 | 3.682 | 300 | 406.597 | |
getTournamentsTables | 6687950 | 174619 | 2.610 | 900 | 1233.585 | |
getTournamentsLeaderboard | 6513240 | 6178 | 0.094 | 900 | 1232.398 | |
getTournamentsRank | 294 | 27 | 9.183 | 4 | 0.051 | |
getTournamentsBuyinInfo | 295 | 1 | 0.338 | 4 | 0.056 | |
tournamentsBuyin | 294 | - | - | 4 | 0.056 | |
unRegister | 12 | - | - | 0.25 | 0.002 | |
Overall error rate | ||||||
Image file |
| |||||
Max Clients | 9,000 | |||||
Ramp up | 15min | |||||
Time to run | 70min | |||||
Ramp down | 5min |
90 accounts | 90 accounts | 90 accounts | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 90 | 90 | 90 | |||||||||||||||
KeepAlive | 29401 | 1 | 12.564 | 29288 | 12.516 | 29310 | 12.526 | |||||||||||
getTournamentsByFilter | 297 | 1 | 13 | 0.130 | 334 | 13 | 0.143 | 327 | 13 | 0.144 | ||||||||
getTournamentsInfo | 92 | 4 | 0.033 | 83 | 4 | 0.035 | 95 | 4 | 0.028 | |||||||||
getTournamentsState | 7244 | 2 | 300 | 3.095 | 7295 | 10 | 300 | 3.113 | 7198 | 1 | 300 | 3.076 | ||||||
getTournamentsTables | 21903 | 4 | 900 | 9.359 | 21770 | 9 | 900 | 9.300 | 21860 | 3 | 900 | 9.341 | ||||||
getTournamentsLeaderboard | 21893 | 900 | 9.356 | 21757 | 900 | 9.298 | 21851 | 900 | 9.338 | |||||||||
getTournamentsRank | 74 | 4 | 0.032 | 74 | 43 | 58.102 | 4 | 0.013 | 93 | 48 | 51.6 | 4 | 0.021 | |||||
getTournamentsBuyinInfo | 92 | 17 | 18.478 | 4 | 0.033 | 83 | 4 | 0.035 | 95 | 4 | 0.227 | |||||||
tournamentsBuyin | 74 | 4 | 0.032 | 83 | 7 | 8.433 | 4 | 0.032 | 95 | 4 | 0.227 | |||||||
unRegister | 2 | 0.25 | 0.001 | 1 | 0.25 | 0.001 | 3 | 0.25 | 0.005 | |||||||||
Overall error rate | ||||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 90 | 90 | 90 | |||||||||||||||
Ramp up | 5min | 5min | 5min | |||||||||||||||
Time to run | 30min | 30min | 30min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
9000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 9000 | |||||||||||||||||
KeepAlive | 4063093 | 15886 | 0.390 | 50 | 757.904 | |||||||||||||
getTournamentsByFilter | 47150 | 1154 | 2.447 | 13 | 8.613 | |||||||||||||
getTournamentsInfo | 14272 | 2807 | 19.667 | 4 | 2.147 | |||||||||||||
getTournamentsState | 1070917 | 82858 | 7.737 | 300 | 185.030 | |||||||||||||
getTournamentsTables | 3215601 | 121068 | 3.765 | 900 | 579.501 | |||||||||||||
getTournamentsLeaderboard | 3092837 | 58289 | 1.884 | 900 | 568.267 | |||||||||||||
getTournamentsRank | 11338 | 2121 | 18.707 | 4 | 1.726 | |||||||||||||
getTournamentsBuyinInfo | 11463 | 49 | 0.427 | 4 | 2.137 | |||||||||||||
tournamentsBuyin | 11413 | 14 | 0.122 | 4 | 2.135 | |||||||||||||
unRegister | 494 | 1 | 0.204 | 0.25 | 0.093 | |||||||||||||
Overall error rate | ||||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 9000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
Transaction Name | #1 (08:05 ~ 09:35 GMT+9 / 9000 accounts) | #2 (11:30 ~ 13:00 GMT+9 / 9000 accounts) | #3 (17:00 ~ 17:30 GMT+9 / 9000 accounts) | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | |||||||
Target | MaxLoad Avg | Overall Avg | Target | MaxLoad Avg | Overall Avg | Target | MaxLoadAvg | Overall | ||||||||||
Avg | ||||||||||||||||||
Login | 9011 | 0 | 9000 | 9000 | ||||||||||||||
KeepAlive | 137391 | 7518 | 5.47% | 50 | 25.768 | 135800 | 457 | 0.34 | 50 | 26.853 | 29975 | 298 | 0.99 | 50 | 20.609 | |||
getTournamentsByFilter | 103124 | 5871 | 5.69% | 13 | 18.212 | 67244 | 212 | 0.32 | 13 | 12.553 | 19457 | 169 | 0.87 | 13 | 11.085 | |||
getTournamentsInfo | 28475 | 2 | 0.01% | 4 | 5.332 | 20749 | 20749 | 0.02 | 4 | 3.885 | 5857 | 2 | 0.03 | 4 | 3.365 | |||
getTournamentsState | 2401161 | 747960 | 31.15% | 300 | 309.588 | 1534201 | 142457 | 9.29 | 300 | 260.626 | 457459 | 6962 | 1.52 | 300 | 258.906 | |||
getTournamentsTables | 7222946 | 2243172 | 31.06% | 900 | 932.542 | 4597309 | 20058 | 0.44 | 900 | 857.163 | 1368389 | 20189 | 1.48 | 900 | 774.828 | |||
getTournamentsLeaderboard | 4978618 | 1775 | 0.04% | 900 | 931.993 | 4575967 | 3034 | 0.07 | 900 | 856.354 | 1345459 | 1321 | 0.10 | 900 | 772.493 | |||
getTournamentsRank | 28119 | 15 | 0.05% | 4 | 5.263 | 1738 | 12 | 0.69 | 4 | 0.323 | 5795 | 24 | 0.41 | 4 | 3.317 | |||
getTournamentsBuyinInfo | 28473 | 4 | 0.01% | 4 | 5.331 | 20744 | 6 | 0.03 | 4 | 3.884 | 5857 | 2 | 0.03 | 4 | 3.362 | |||
tournamentsBuyin | 28469 | 313 | 1.10% | 4 | 5.273 | 20712 | 18974 | 91.61 | 4 | 0.325 | 5846 | 4 | 0.07 | 4 | 3.357 | |||
unRegister | 1402 | 1 | 0.07% | 0.25 | 0.262 | 76 | - | - | 0.25 | 0.014 | 303 | 1 | 0.33 | 0.25 | 0.180 | |||
Overall error rate | 14958178 | 3006631 | 20.10% | |||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 9,000 | 9000 | 9000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 70min | 10min | |||||||||||||||
Ramp down | 5min | 5min | 5min | |||||||||||||||
Server Config | parallelism = 300 guestModeSocketCount = 300 CodeChanged: Fix : Cache Rule( Status ALL ) | parallelism = 100 guestModeSocketCount = 300 CodeChanged: Fix : Cache Rule+(Status 200,204) -https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/3b183af36bd887e86efe67c01d7d41db86d5962a | parallelism = 300 guestModeSocketCount = 300 CodeChanged: Fix : Cache Rule+(Status 200,204,412) FixBug : Match Exception 412(https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/4b4300b91a6801480c3e7984d5b361440a515756) |
100 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | ||||||||||||||||||
KeepAlive | 137366 | 4483 | 3.264 | 50 | 26.366 | 102968 | 1654 | 1.61 | 50 | 20.102 | 137248 | 4444 | 3.238 | 50 | 26.350 | |||
getTournamentsByFilter | 104462 | 3374 | 3.230 | 13 | 18.930 | 71765 | 1252 | 1.74 | 13 | 13.205 | 100525 | 3495 | 3.477 | 13 | 18.377 | |||
getTournamentsInfo | 31525 | 3 | 0.010 | 4 | 5.903 | 21753 | 4 | 0.02 | 4 | 4.073 | 29798 | 10 | 0.034 | 4 | 5.642 | |||
getTournamentsState | 2468929 | 99618 | 4.035 | 300 | 443.691 | 1667812 | 39492 | 2.37 | 300 | 304.929 | 2352326 | 105295 | 4.476 | 300 | 420.792 | |||
getTournamentsTables | 7435181 | 1019362 | 13.710 | 900 | 1201.464 | 4995724 | 116889 | 2.34 | 900 | 913.640 | 7087461 | 315630 | 4.453 | 900 | 1268.133 | |||
getTournamentsLeaderboard | 6414498 | 1379 | 0.021 | 900 | 1200.959 | 4876514 | 1255 | 0.03 | 900 | 912.910 | 6770395 | 1991 | 0.029 | 900 | 1267.491 | |||
getTournamentsRank | 31454 | 25 | 0.019 | 4 | 5.886 | 21695 | 12 | 0.06 | 4 | 4.060 | 29712 | 31 | 0.104 | 4 | 5.621 | |||
getTournamentsBuyinInfo | 31525 | 3 | 0.010 | 4 | 5.903 | 21748 | 6 | 0.03 | 4 | 4.072 | 29788 | 4 | 0.013 | 4 | 5.641 | |||
tournamentsBuyin | 31518 | 4 | 0.013 | 4 | 5.301 | 21739 | 2 | 0.1 | 4 | 4.071 | 29782 | 8 | 0.027 | 4 | 5.639 | |||
unRegister | 1573 | 3 | 0.191 | 0.25 | 0.297 | 1069 | 2 | 0.19 | 0.25 | 0.207 | 1486 | 2 | 0.135 | 0.25 | 0.284 | |||
Overall error rate | ||||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 9,000 | 9000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
9000 accounts | 3000 account + websocket | 6000 account + websocket | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 9,000 | 3,000 | 6,000 | |||||||||||||||
KeepAlive | 136130 | 12987 | 9.540 | 50 | 24.433 | 9750 | 589 | 6.041 | 50 | 6.107 | 19496 | 1283 | 6.58 | 50 | 12.648 | |||
getTournamentsByFilter | 71636 | 1489 | 2.079 | 13 | 13.136 | 6161 | 8 | 0.130 | 13 | 3.536 | 11508 | 95 | 0.83 | 13 | 6.793 | |||
getTournamentsInfo | 21504 | 4 | 0.019 | 4 | 4.026 | 1870 | 4 | 1.075 | 3466 | 4 | 2.063 | |||||||
getTournamentsState | 1660707 | 46793 | 2.818 | 300 | 302.231 | 150582 | 345 | 0.229 | 300 | 83.465 | 264976 | 3097 | 1.17 | 300 | 150.505 | |||
getTournamentsTables | 4985179 | 138934 | 2.787 | 900 | 907.537 | 448114 | 1038 | 0.232 | 900 | 248.376 | 792577 | 9615 | 1.21 | 900 | 449.978 | |||
getTournamentsLeaderboard | 4844613 | 1457 | 0.030 | 900 | 906.958 | 446488 | 900 | 248.049 | 781432 | 900 | 449.099 | |||||||
getTournamentsRank | 21463 | 23 | 0.107 | 4 | 4.015 | 1859 | 4 | 1.068 | 3466 | 4 | 2.063 | |||||||
getTournamentsBuyinInfo | 21500 | 3 | 0.014 | 4 | 4.026 | 1870 | 4 | 1.075 | 3466 | 4 | 2.063 | |||||||
tournamentsBuyin | 21497 | 4 | 0.019 | 4 | 4.025 | 1870 | 4 | 1.075 | 3445 | 4 | 2.051 | |||||||
unRegister | 1113 | 1 | 0.090 | 0.25 | 0.213 | 88 | 0.25 | 0.052 | 184 | 0.25 | 0.118 | |||||||
Overall error rate | ||||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 9000 | 3,000 | 6000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 10min | 10min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
9000 accounts + websocket | 9000 account + websocket | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 9000 | 9000 | ||||||||||||||||
KeepAlive | 29187 | 2048 | 7.02 | 50 | 18.847 | 29999 | 100 | 0.33 | 50 | 20.763 | ||||||||
getTournamentsByFilter | 16320 | 228 | 1.40 | 13 | 9.248 | 21890 | 74 | 0.34 | 13 | 12.538 | ||||||||
getTournamentsInfo | 4905 | 7 | 0.14 | 4 | 2.815 | 6790 | 0 | 0 | 4 | 3.902 | ||||||||
getTournamentsState | 370032 | 7331 | 1.98 | 300 | 208.449 | 511021 | 41959 | 8.21 | 300 | 269.576 | ||||||||
getTournamentsTables | 1111262 | 21064 | 1.90 | 900 | 626.551 | 1531760 | 6669 | 0.44 | 900 | 876.489 | ||||||||
getTournamentsLeaderboard | 1088236 | 936 | 0.09 | 900 | 624.885 | 1525043 | 0 | 0 | 900 | 876.461 | ||||||||
getTournamentsRank | 4850 | 12 | 0.25 | 4 | 2.880 | 6740 | 0 | 0 | 4 | 3.874 | ||||||||
getTournamentsBuyinInfo | 4897 | 0 | 4 | 2.814 | 6790 | 0 | 0 | 4 | 3.902 | |||||||||
tournamentsBuyin | 4896 | 0 | 4 | 2.814 | 6788 | 0 | 0 | 4 | 3.901 | |||||||||
unRegister | 233 | 0 | 0.25 | 0.144 | 336 | 2 | 0.60 | 0.25 | 0.214 | |||||||||
Overall error rate | ||||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 9,000 | 9000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 10min | 10min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min | |||||||||||||||
Remarks |
|
#1 (15,000 accounts) + websocket | #2 (15,000 accounts) + websocket | #3 (100 accounts) + websocket | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15011 | 8 | 0.05% | 15000 | ||||||||||||||
Get Cash Tables by Filter | 1115254 | 226 | 0.02% | 96 | 211.180 | 640497 | 11587 | 1.809 | 96 | 180.721 | 3792 | 96 | 0.718 | |||||
Get Zone Games by Filter | 279729 | 62 | 0.02% | 21 | 52.372 | 162435 | 2808 | 1.728 | 21 | 45.009 | 903 | 21 | 0.171 | |||||
Get Zone Buyin Info | 9896 | 1 | 0.01% | 0.75 | 1.874 | 5618 | - | 0.75 | 1.614 | 32 | 0.75 | 0.006 | ||||||
Request Zone Buyin | 9890 | 2 | 0.02% | 0.75 | 1.873 | 5614 | - | 0.75 | 1.155 | 32 | 0.75 | 0.006 | ||||||
Launch Game | 77337 | 0 | 5.5 | 14.647 | 43146 | - | 5.5 | 12.398 | 244 | 5.5 | 0.047 | |||||||
KeepAlive | 581315 | 0 | 50 | 110.098 | 3727902 | - | 50 | 94.225 | 1575 | 50 | 0.313 | |||||||
getTournamentsByFilter | 22155 | 1 | 0.01% | 13 | 4.196 | 13517 | 160 | 1.183 | 13 | 3.838 | 544 | 13 | 0.103 | |||||
getTournamentsInfo | 6812 | 0 | 4 | 1.290 | 4125 | 105 | 2.545 | 4 | 1.155 | 163 | 4 | 0.032 | ||||||
getTournamentsState | 521486 | 56024 | 10.74% | 300 | 87.165 | 303726 | 5142 | 1.693 | 300 | 84.346 | 12308 | 300 | 2.305 | |||||
getTournamentsTables | 1570546 | 224 | 0.01% | 900 | 294.068 | 904568 | 12866 | 1.422 | 900 | 251.893 | 37422 | 900 | 7.008 | |||||
getTournamentsLeaderboard | 1570322 | 0 | 900 | 294.068 | 891170 | 2672 | 0.300 | 900 | 250.988 | 37412 | 900 | 7.006 | ||||||
getTournamentsRank | 6789 | 0 | 4 | 1.286 | 4006 | 267 | 6.665 | 4 | 1.074 | 163 | 4 | 0.032 | ||||||
getTournamentsBuyinInfo | 6812 | 0 | 4 | 1.290 | 4020 | - | 4 | 1.155 | 163 | 4 | 0.032 | |||||||
tournamentsBuyin | 6812 | 0 | 4 | 1.290 | 4020 | - | 4 | 1.155 | 163 | 4 | 0.032 | |||||||
unRegister | 357 | 0 | 0.25 | 0.068 | 183 | - | 0.25 | 0.054 | 11 | 0.25 | 0.002 | |||||||
Overall error rate | ||||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 15,000 | 15,000 | 100 | |||||||||||||||
Ramp up | 20min | 20min | 5min | |||||||||||||||
Time to run | 65min | 35min | 800min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
15000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15000 | |||||||||||||||||
Get Cash Tables by Filter | 497541 | 4796 | 0.964 | 96 | 93.323 | |||||||||||||
Get Zone Games by Filter | 124665 | 962 | 0.772 | 21 | 23.165 | |||||||||||||
Get Zone Buyin Info | 4468 | 21 | 0.470 | 0.75 | 0.842 | |||||||||||||
Request Zone Buyin | 4444 | 16 | 0.360 | 0.75 | 0.839 | |||||||||||||
Launch Game | 33816 | 60 | 0.177 | 5.5 | 6.393 | |||||||||||||
KeepAlive | 214382 | 1564 | 0.730 | 50 | 42.226 | |||||||||||||
getTournamentsByFilter | 82204 | 408 | 0.496 | 13 | 15.318 | |||||||||||||
getTournamentsInfo | 25195 | 244 | 0.968 | 4 | 4.672 | |||||||||||||
getTournamentsState | 1910555 | 16591 | 0.868 | 300 | 354.675 | |||||||||||||
getTournamentsTables | 5759993 | 35231 | 0.612 | 900 | 1072.053 | |||||||||||||
getTournamentsLeaderboard | 5724462 | 12012 | 0.210 | 900 | 1069.747 | |||||||||||||
getTournamentsRank | 24885 | 104 | 0.418 | 4 | 4.641 | |||||||||||||
getTournamentsBuyinInfo | 24951 | 12 | 0.048 | 4 | 4.670 | |||||||||||||
tournamentsBuyin | 24938 | 7 | 0.028 | 4 | 4.669 | |||||||||||||
unRegister | 1215 | 99 | 8.148 | 0.25 | 0.211 | |||||||||||||
Overall error rate | 0.458% | |||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 15min | 15min | |||||||||||||||
Time to run | 65min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
#1 (08:00 ~ 09:30 GMT+9) | #2 (14:00 ~ 14:50 GMT+9) | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Get Cash Tables by Filter | 520531 | 19753 | 3.79% | 96 | 94.84 | 249772 | 1167 | 0.467 | 96 | 90.074 | ||||||||
Get Zone Games by Filter | 131463 | 4937 | 3.76% | 21 | 23.69 | 63630 | 329 | 0.517 | 21 | 22.447 | ||||||||
Get Zone Buyin Info | 4509 | 4 | 0.09% | 0.75 | 0.85 | 2271 | 1 | 0.044 | 0.75 | 0.822 | ||||||||
Request Zone Buyin | 4501 | 1 | 0.02% | 0.75 | 0.85 | 2268 | 1 | 0.044 | 0.75 | 0.821 | ||||||||
Launch Game | 34886 | 0 | 5.5 | 6.61 | 17103 | - | - | 5.5 | 6.197 | |||||||||
KeepAlive | 248951 | 9178 | 3.69% | 50 | 47.01 | 123919 | 413 | 0.333 | 50 | 47.871 | ||||||||
getTournamentsByFilter | 87013 | 2538 | 2.92% | 13 | 15.82 | 42630 | 153 | 0.359 | 13 | 15.063 | ||||||||
getTournamentsInfo | 26100 | 0 | 4 | 4.89 | 12768 | 1 | 0.008 | 4 | 4.626 | |||||||||
getTournamentsState | 1971027 | 72106 | 3.66% | 300 | 355.60 | 986977 | 4941 | 0.501 | 300 | 348.240 | ||||||||
getTournamentsTables | 5926291 | 216002 | 3.64% | 900 | 1069.34 | 2952870 | 16359 | 0.554 | 900 | 1041.316 | ||||||||
getTournamentsLeaderboard | 5710128 | 4 | 0.0001% | 900 | 1069.31 | 2936505 | 131 | 0.004 | 900 | 1041.267 | ||||||||
getTournamentsRank | 25830 | 0 | 4 | 4.84 | 12726 | 2 | 0.016 | 4 | 4.610 | |||||||||
getTournamentsBuyinInfo | 26098 | 0 | 4 | 4.89 | 12767 | - | - | 4 | 4.626 | |||||||||
tournamentsBuyin | 26093 | 217 | 0.83% | 4 | 4.85 | 12764 | - | - | 4 | 4.625 | ||||||||
unRegister | 1290 | 178 | 13.8% | 0.25 | 0.21 | 625 | 3 | 0.480 | 0.25 | 0.225 | ||||||||
Overall error rate | 14744711 | 324918 | 2.20% | 0.003% | ||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 20min | 15min | |||||||||||||||
Time to run | 65min | 65min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min | |||||||||||||||
Remarks | Error counts regarding status code
| Test stopped. because load generator(9) stopped. After 45 minutes Error counts regarding status code
|
#1 (07:30 ~ 09:00 GMT+9)15000 accounts | #2 (12:00 ~ 13:30 GMT+9)15000 accounts | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15000 | 15000 | ||||||||||||||||
Get Cash Tables by Filter | 521844 | 2616 | 0.501% | 96 | 98.339 | 525057 | 5050 | 0.962% | 96 | 98.486 | ||||||||
Get Zone Games by Filter | 131102 | 660 | 0.530% | 21 | 24.427 | 132200 | 1209 | 0.915% | 21 | 24.530 | ||||||||
Get Zone Buyin Info | 4545 | 13 | 0.352% | 0.75 | 0.858 | 4709 | 12 | 0.255% | 0.75 | 0.890 | ||||||||
Request Zone Buyin | 4523 | 1 | 0.222% | 0.75 | 0.856 | 4692 | 1 | 0.021% | 0.75 | 0.888 | ||||||||
Launch Game | 35182 | - | - | 5.5 | 6.663 | 35892 | 9 | 0.025% | 5.5 | 6.796 | ||||||||
KeepAlive | 264928 | 1418 | 0.535% | 50 | 51.669 | 267251 | 2493 | 0.933% | 50 | 51.913 | ||||||||
getTournamentsByFilter | 86562 | 346 | 0.400% | 13 | 16.145 | 85906 | 636 | 0.740% | 13 | 16.150 | ||||||||
getTournamentsInfo | 4545 | 16 | 0.352% | 4 | 5.019 | 26375 | 7 | 0.027% | 4 | 4.994 | ||||||||
getTournamentsState | 20106041 | 9864 | 0.489% | 300 | 375.689 | 2031487 | 19107 | 0.941% | 300 | 376.850 | ||||||||
getTournamentsTables | 6079361 | 29670 | 0.488% | 900 | 1132.901 | 6107277 | 56773 | 0.930% | 900 | 1133.053 | ||||||||
getTournamentsLeaderboard | 6049620 | - | - | 900 | 1132.888 | 6050407 | 856 | 0.014 | 900 | 1132.875 | ||||||||
getTournamentsRank | 26400 | - | - | 4 | 5.000 | 26305 | 5 | 0.019% | 4 | 4.981 | ||||||||
getTournamentsBuyinInfo | 26501 | - | - | 4 | 5.019 | 26368 | 5 | 0.19% | 4 | 4.993 | ||||||||
tournamentsBuyin | 26495 | 47 | 0.177% | 4 | 5.009 | 26362 | 9 | 0.034% | 4 | 4.991 | ||||||||
unRegister | 1317 | 201 | 15.262% | 0.25 | 0.211 | 1334 | 213 | 15.967% | 0.25 | 0.215 | ||||||||
Overall error rate | 0.163% | 0.563% | ||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 20min | 15min | |||||||||||||||
Time to run | 65min | 65min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
#1 (13:00 ~ 14:30 GMT+9) 15000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15000 | |||||||||||||||||
Get Cash Tables by Filter | 517178 | 5409 | 1.052% | 96 | 96.358 | |||||||||||||
Get Zone Games by Filter | 129430 | 1344 | 1.038% | 21 | 24.259 | |||||||||||||
Get Zone Buyin Info | 4452 | 5 | 0.112% | 0.75 | 0.842 | |||||||||||||
Request Zone Buyin | 4441 | 1 | 0.023% | 0.75 | 0.841 | |||||||||||||
Launch Game | 34472 | 6 | 0.017% | 5.5 | 6.528 | |||||||||||||
KeepAlive | 263898 | 3202 | 1.213% | 50 | 51.117 | |||||||||||||
getTournamentsByFilter | 848777 | 556 | 0.655% | 13 | 15.970 | |||||||||||||
getTournamentsInfo | 25662 | 1 | 0.004% | 4 | 4.860 | |||||||||||||
getTournamentsState | 1937391 | 15558 | 0.803% | 300 | 359.894 | |||||||||||||
getTournamentsTables | 5828357 | 47512 | 0.815% | 900 | 1082.555 | |||||||||||||
getTournamentsLeaderboard | 5780618 | 86 | 0.001% | 900 | 1082.497 | |||||||||||||
getTournamentsRank | 22230 | 1 | 0.004% | 4 | 4.210 | |||||||||||||
getTournamentsBuyinInfo | 25661 | 2 | 0.008% | 4 | 4.860 | |||||||||||||
tournamentsBuyin | 22291 | 1 | 0.004% | 4 | 4.222 | |||||||||||||
unRegister | 1141 | - | - | 0.25 | 0.219 | |||||||||||||
Overall error rate | 0.502% | |||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 15min | 15min | |||||||||||||||
Time to run | 65min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
15000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | ||||||||||||||||||
Get Cash Tables by Filter | 527095 | 1691 | 0.321% | 96 | 99.508 | |||||||||||||
Get Zone Games by Filter | 132984 | 423 | 0.318% | 21 | 24.824 | |||||||||||||
Get Zone Buyin Info | 4717 | 4 | 0.085% | 0.75 | 0.893 | |||||||||||||
Request Zone Buyin | 4712 | - | - | 0.75 | 0.892 | |||||||||||||
Launch Game | 35998 | - | - | 5.5 | 6.818 | |||||||||||||
KeepAlive | 267639 | 845 | 0.316% | 50 | 52.313 | |||||||||||||
getTournamentsByFilter | 85583 | 221 | 0.258% | 13 | 15.958 | |||||||||||||
getTournamentsInfo | 26300 | - | - | 4 | 4.925 | |||||||||||||
getTournamentsState | 1991990 | 6252 | 0.314% | 300 | 371.861 | |||||||||||||
getTournamentsTables | 5986641 | 19216 | 0.321% | 900 | 1117.495 | |||||||||||||
getTournamentsLeaderboard | 5967339 | - | - | 900 | 1117.479 | |||||||||||||
getTournamentsRank | 19838 | - | - | 4 | 3.715 | |||||||||||||
getTournamentsBuyinInfo | 26300 | 3339 | 12.696% | 4 | 4.300 | |||||||||||||
tournamentsBuyin | 19871 | - | - | 4 | 3.721 | |||||||||||||
unRegister | 1422 | - | - | 0.25 | 0.269 | |||||||||||||
Overall error rate | 0.212% | |||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 15min | 15min | |||||||||||||||
Time to run | 65min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
15000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15000 | |||||||||||||||||
Get Cash Tables by Filter | 520157 | 11870 | 2.282% | 96 | 96.266 | |||||||||||||
Get Zone Games by Filter | 130806 | 2851 | 2.180% | 21 | 23.962 | |||||||||||||
Get Zone Buyin Info | 4488 | 3 | 0.067% | 0.75 | 0.849 | |||||||||||||
Request Zone Buyin | 4479 | - | - | 0.75 | 0.848 | |||||||||||||
Launch Game | 34575 | 7 | 0.020% | 5.5 | 6.547 | |||||||||||||
KeepAlive | 267177 | 6112 | 2.288% | 50 | 51.189 | |||||||||||||
getTournamentsByFilter | 85452 | 1382 | 1.617% | 13 | 15.743 | |||||||||||||
getTournamentsInfo | 25553 | 3 | 0.012% | 4 | 4.785 | |||||||||||||
getTournamentsState | 1945137 | 46859 | 2.409% | 300 | 355.483 | |||||||||||||
getTournamentsTables | 5827439 | 140033 | 2.403% | 900 | 1065.057 | |||||||||||||
getTournamentsLeaderboard | 5687325 | 232 | 0.004% | 900 | 1064.999 | |||||||||||||
getTournamentsRank | 22155 | 3 | 0.014% | 4 | 4.195 | |||||||||||||
getTournamentsBuyinInfo | 25550 | 1 | 0.004% | 4 | 4.784 | |||||||||||||
tournamentsBuyin | 22191 | 1 | 0.005% | 4 | 4.155 | |||||||||||||
unRegister | 1526 | - | - | 0.25 | 0.289 | |||||||||||||
Overall error rate | 1.434% | |||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 15min | 15min | |||||||||||||||
Time to run | 65min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
15000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15000 | |||||||||||||||||
Get Cash Tables by Filter | 9626 | 649 | 6.742% | 96 | 21.374 | |||||||||||||
Get Zone Games by Filter | 2779 | 190 | 6.837% | 21 | 5.394 | |||||||||||||
Get Zone Buyin Info | 83 | 0.75 | 0.198 | |||||||||||||||
Request Zone Buyin | 81 | 0.75 | 0.193 | |||||||||||||||
Launch Game | 540 | 5.5 | 1.286 | |||||||||||||||
KeepAlive | 2554 | 146 | 5.717% | 50 | 10.033 | |||||||||||||
getTournamentsByFilter | 2004 | 78 | 3.892% | 13 | 4.586 | |||||||||||||
getTournamentsInfo | 563 | 4 | 1.340 | |||||||||||||||
getTournamentsState | 47668 | 992 | 2.081% | 300 | 97.242 | |||||||||||||
getTournamentsTables | 144324 | 900 | 300.675 | |||||||||||||||
getTournamentsLeaderboard | 144324 | 900 | 300.675 | |||||||||||||||
getTournamentsRank | 527 | 4 | 1.25 | |||||||||||||||
getTournamentsBuyinInfo | 563 | 4 | 1.340 | |||||||||||||||
tournamentsBuyin | 563 | 4 | 1.340 | |||||||||||||||
unRegister | 31 | 0.25 | 0.074 | |||||||||||||||
Overall error rate | ||||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 65min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
15000 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 15000 | |||||||||||||||||
Get Cash Tables by Filter | 539071 | 35568 | 6.598% | 96 | 95.360 | |||||||||||||
Get Zone Games by Filter | 135323 | 8914 | 6.587% | 21 | 26.672 | |||||||||||||
Get Zone Buyin Info | 4192 | 6 | 0.143% | 0.75 | 0.793 | |||||||||||||
Request Zone Buyin | 4183 | - | 0.75 | 0.792 | ||||||||||||||
Launch Game | 32076 | - | 5.5 | 6.075 | ||||||||||||||
KeepAlive | 267976 | 15423 | 5.755% | 50 | 49.520 | |||||||||||||
getTournamentsByFilter | 85420 | 4099 | 4.799% | 13 | 15.229 | |||||||||||||
getTournamentsInfo | 25268 | - | 4 | 4.732 | ||||||||||||||
getTournamentsState | 1971141 | 49695 | 2.521% | 300 | 359.821 | |||||||||||||
getTournamentsTables | 5913082 | 5254 | 0.089% | 900 | 1106.335 | |||||||||||||
getTournamentsLeaderboard | 5907771 | 689 | 0.012% | 900 | 1106.195 | |||||||||||||
getTournamentsRank | 21975 | - | 4 | 4.115 | ||||||||||||||
getTournamentsBuyinInfo | 25268 | - | 4 | 4.732 | ||||||||||||||
tournamentsBuyin | 22015 | - | 4 | 4.123 | ||||||||||||||
unRegister | 1632 | - | 0.25 | 0.309 | ||||||||||||||
Overall error rate | 0.800% | |||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 15min | 15min | |||||||||||||||
Time to run | 65min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
4000 accounts | 7500 account | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | 4000 | |||||||||||||||||
Get Cash Tables by Filter | 39989 | 96 | 23.803 | 264094 | 1267 | 0.480% | 96 | 49.778 | ||||||||||
Get Zone Games by Filter | 10040 | 1 | 0.001% | 21 | 5.770 | 66980 | 278 | 0.415% | 21 | 12.491 | ||||||||
Get Zone Buyin Info | 393 | 0.75 | 0.234 | 2372 | 0.75 | 0.499 | ||||||||||||
Request Zone Buyin | 392 | 2 | 0.510% | 0.75 | 0.232 | 2369 | 0.75 | 0.499 | ||||||||||
Launch Game | 2762 | 5.5 | 1.644 | 17985 | 5.5 | 3.406 | ||||||||||||
KeepAlive | 18899 | 50 | 12.599 | 133943 | 577 | 0.431% | 50 | 26.150 | ||||||||||
getTournamentsByFilter | 7515 | 13 | 4.319 | 49551 | 186 | 0.375% | 13 | 9.244 | ||||||||||
getTournamentsInfo | 2401 | 4 | 4.129 | 15189 | 4 | 2.844 | ||||||||||||
getTournamentsState | 164662 | 2 | 0.001% | 300 | 94.632 | 1135591 | 5668 | 0.499% | 300 | 211.596 | ||||||||
getTournamentsTables | 496446 | 7 | 0.001% | 900 | 285.310 | 3398910 | 17032 | 0.501% | 900 | 633.310 | ||||||||
getTournamentsLeaderboard | 496431 | 900 | 285.305 | 3381867 | 900 | 633.308 | ||||||||||||
getTournamentsRank | 2346 | 4 | 1.396 | 13947 | 4 | 2.612 | ||||||||||||
getTournamentsBuyinInfo | 2401 | 4 | 1.429 | 15189 | 7 | 0.046% | 4 | 2.843 | ||||||||||
tournamentsBuyin | 2401 | 4 | 1.405 | 13965 | 4 | 2.615 | ||||||||||||
unRegister | 158 | 0.25 | 0.094 | 962 | 0.25 | 0.182 | ||||||||||||
Overall error rate | 0.001% | 0.294% | ||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 4,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 10min | 20min | 15min | |||||||||||||||
Time to run | 15min | 65min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |
#1 (10:15 ~ | #2 | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Get Cash Tables by Filter | 79396 | 5332 | 6.716% | 96 | 96 | |||||||||||||
Get Zone Games by Filter | 20728 | 1365 | 6.585% | 21 | 21 | |||||||||||||
Get Zone Buyin Info | 724 | 0 | 0.75 | 0.75 | ||||||||||||||
Request Zone Buyin | 720 | 2 | 0.278% | 0.75 | 0.75 | |||||||||||||
Launch Game | 4986 | 0 | 5.5 | 5.5 | ||||||||||||||
KeepAlive | 34205 | 1944 | 5.683% | 50 | 50 | |||||||||||||
getTournamentsByFilter | 15424 | 685 | 4.441% | 13 | 13 | |||||||||||||
getTournamentsInfo | 4562 | 0 | 4 | 4 | ||||||||||||||
getTournamentsState | 339022 | 7826 | 2.308% | 300 | 300 | |||||||||||||
getTournamentsTables | 1009935 | 186 | 0.018% | 900 | 900 | |||||||||||||
getTournamentsLeaderboard | 1009698 | 0 | 900 | 900 | ||||||||||||||
getTournamentsRank | 4505 | 0 | 4 | 4 | ||||||||||||||
getTournamentsBuyinInfo | 4562 | 0 | 4 | 4 | ||||||||||||||
tournamentsBuyin | 4550 | 0 | 4 | 4 | ||||||||||||||
unRegister | 288 | 0 | 0.25 | 0.25 | ||||||||||||||
Overall error rate | ||||||||||||||||||
Image file |
| |||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 20min | 20min | 15min | |||||||||||||||
Time to run | 65min | 65min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min | |||||||||||||||
Remarks | Due to DB connection issue in Tour05 box(10.78.193.25), architect requested to stop the test. |
100 accounts | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
Login | ||||||||||||||||||
Get Cash Tables by Filter | 96 | |||||||||||||||||
Get Zone Games by Filter | 21 | |||||||||||||||||
Get Zone Buyin Info | ||||||||||||||||||
Request Zone Buyin | ||||||||||||||||||
Launch Game | ||||||||||||||||||
KeepAlive | ||||||||||||||||||
getTournamentsByFilter | 13 | |||||||||||||||||
getTournamentsInfo | 4 | |||||||||||||||||
getTournamentsState | 300 | |||||||||||||||||
getTournamentsTables | 900 | |||||||||||||||||
getTournamentsLeaderboard | 900 | |||||||||||||||||
getTournamentsRank | 4 | |||||||||||||||||
getTournamentsBuyinInfo | 4 | |||||||||||||||||
tournamentsBuyin | 4 | |||||||||||||||||
unRegister | ||||||||||||||||||
Overall error rate | ||||||||||||||||||
Image file | ||||||||||||||||||
Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
Ramp up | 15min | 15min | 15min | |||||||||||||||
Time to run | 70min | 70min | 70min | |||||||||||||||
Ramp down | 5min | 5min | 5min |