Test Results Summary
LoadTest의 고뇌
한번도 못할수도 있지만 한번하면 한번만 하고 싶은 로드 테스트 과정
다음과 같은 수준을 통과했으며~ 로드테스트도 엄청난 비용이 수반되기때문에
꼭 이것이 표준은 아니며 프로덕트의 규모와 성격에따라 전략수준을 다양하게 채택할수 있습니다.
- RampUp/Down Time을 설정하여 피크타임까지 사용자를 실제 시나리오와 유사하게 늘리고 뺌
- RampUP : 피크타임까지 도달하는 시간을 정하고 최고의 트래픽을 유발
- RampDown : 트래픽이 최소가 되어가는 시간을 설정하고 트래픽이 점진적으로 줄어듬
- 트래픽이 빠지는구간 측정이 중요한 이유는 우리가 만든 시스템에서 자원반환이라는 중요기능을 확인하고 가용성이 복원되는지를 보는것입니다.
- 이용어는 제조업에서 생겼던 용어로 온프레미스에서 주로 사용했던 단어이며 오늘날 클라우드 컴퓨팅에서 탄력(Elastic)적이라는 단어를 사용합니다.
- 목표 TPS만큼 테스트가 안되면 테스트 통과 실패 -
- TPS가 높아도 목표 사용자수가 안되면 테스트 통과 실패 -
- 목표한 API 허용 에러률(1%)보다 높아도 테스트 통과 실패 (스크립트 오류및 테스트 노드장비 문제일수도 있음) -
- 로드 테스트를 너무 많이해서 DB FUll이 나서 테스트 통과 실패 -
- 알수없는 이유로 여러개의 노드중 1개의 노드가 Crash되어도 테스트 통과 실패 ( 에러율이 1%보다 높아짐) -
- 에러율이 낮아도 짧은기간에 에러 집중되면 테스트 통과 실패 -
- 테스트를 모두 통과해도, 평균 허용치 CPU(80%)사용율을 특정시간동안 지속되면 테스트 실패 -
- 코드수정및 스케일 아웃처리로 모든 로드 테스트를 통과해도, 이미 통과한 QA Sign OFF를 다시 받아야함, 이과정중 Codefix가 발생하면 다시 로드 테스트 수행 -
- 서버가 대용량 처리가 안정화 되어 ,장시간 테스트시 결국 분산 테스트툴보다 더 오래 버팀 (분산 테스트툴을 주기적으로 리셋해야되는 상황발생) -
- 이모든 장벽을 다통과해도 테스트 시나리오때 누락된 테스트항목으로 문제발생 ( 사용자 플래폼 변경에 따른 레거시 → 신규서비스 전환 테스트 미스) - 레거시 테스트 시나리오까지 작성하기 어려움 -
위와 같은 수준의 로드(퍼포먼스,스파크,안정성) 테스트 하게되면 노하우보다 예지력이 생길수도있으며
성능테스트는 측정하지 못하면 개선할수 없다가 기본전제이기때문에 고수준의 모니터링 툴이 사실 전제가 되어야합니다.
글로벌 특정 카테고리기준 Top트래픽에 속했던 프로덕트의 측정과정의 수치를 공개합니다.
Daily LoadTest
스크립트자체 검증과 서버검증을 통과할떄까지 수행
15,000 accounts | ||||||
|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
| Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
| Login | 15000 | 1 | - | |||
| Get Cash Tables by Filter | 1270710 | 1920 | - | 96 | 238.379 | |
| Get Zone Games by Filter | 317442 | 1220 | 0.151 | 21 | 58.887 | |
| Get Zone Buyin Info | 11250 | 1699 | 15.10 | 0.75 | 1.799 | |
| Request Zone Buyin | 9540 | 831 | 8.710 | 0.75 | 1.640 | |
| Launch Game | 84834 | - | - | 5.5 | 15.976 | |
| KeepAlive | 660986 | - | - | 50 | 124.479 | |
| getTournamentsByFilter | 24520 | 47 | 0.191 | 13 | 4.609 | |
| getTournamentsInfo | 5311 | 5 | 0.094 | 4 | 0.999 | |
| getTournamentsState | 592242 | 1184 | 0.199 | 300 | 110.067 | |
| getTournamentsTables | 1775050 | 3398 | 0.191 | 900 | 329.917 | |
| getTournamentsLeaderboard | 1771648 | - | - | 900 | 329.916 | |
| getTournamentsRank | 4197 | - | - | 4 | 0.790 | |
| getTournamentsBuyinInfo | 5306 | 418 | 7.877 | 4 | 0.921 | |
| tournamentsBuyin | 4888 | 691 | 14.136 | 4 | 0.790 | |
| unRegister | 226 | - | - | 0.25 | 0.043 | |
| Overall error rate | ||||||
| Image file | | |||||
| Max Clients | 15,000 | |||||
| Ramp up | 15min | |||||
| Time to run | 70min | |||||
| Ramp down | 5min | |||||
_files/1030_lobby.PNG)
_files/1030_lobby_graph.PNG)
15,000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | ||||||||||||||||||
| Get Cash Tables by Filter | 2078521 | 150650 | 7.247 | 96 | 544.596 | |||||||||||||
| Get Zone Games by Filter | 521873 | 29815 | 5.713 | 21 | 138.999 | |||||||||||||
| Get Zone Buyin Info | 17417 | 2589 | 14.864 | 0.75 | 4.189 | |||||||||||||
| Request Zone Buyin | 14798 | 1270 | 8.582 | 0.75 | 3.821 | |||||||||||||
| Launch Game | 127716 | 59 | 0.046 | 5.5 | 36.061 | |||||||||||||
| KeepAlive | 1002789 | 500 | 0.049 | 50 | 283.132 | |||||||||||||
| getTournamentsByFilter | 41953 | 2140 | 5.100 | 13 | 11.247 | |||||||||||||
| getTournamentsInfo | 7858 | 12 | 0.152 | 4 | 2.255 | |||||||||||||
| getTournamentsState | 966140 | 48345 | 5.003 | 300 | 259.263 | |||||||||||||
| getTournamentsTables | 2896970 | 140620 | 4.854 | 900 | 778.630 | |||||||||||||
| getTournamentsLeaderboard | 2755991 | 140 | 0.05 | 900 | 778.789 | |||||||||||||
| getTournamentsRank | 1077 | - | - | 4 | 0.309 | |||||||||||||
| getTournamentsBuyinInfo | 17417 | 2589 | 14.864 | 4 | 1.968 | |||||||||||||
| tournamentsBuyin | 6799 | 5723 | 84.174 | 4 | 0.309 | |||||||||||||
| unRegister | 51 | 1 | 1.960 | 0.25 | 0.014 | |||||||||||||
| Overall error rate | 3.676 | |||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 70min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/1106_Lobby_graph.PNG)
_files/1106_Lobby.PNG)
6,000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 6000 | |||||||||||||||||
| Get Cash Tables by Filter | 527067 | 6 | 0.001 | 96 | 98.701 | |||||||||||||
| Get Zone Games by Filter | 133017 | 4 | 0.003 | 21 | 24.909 | |||||||||||||
| Get Zone Buyin Info | 4698 | 767 | 16.326 | 0.75 | 0.745 | |||||||||||||
| Request Zone Buyin | 3925 | 8 | 0.203 | 0.75 | 0.742 | |||||||||||||
| Launch Game | 35264 | - | 5.5 | 6.679 | ||||||||||||||
| KeepAlive | 274334 | - | 50 | 51.957 | ||||||||||||||
| Overall error rate | 0.08 | |||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 6,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 70min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/1109_lobby_zon+cash_graph.PNG)
_files/1109_lobby.PNG)
900 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 910 | 10 | ||||||||||||||||
| getTournamentsByFilter | 6006 | 10 | 0.165 | 13 | 5.230 | |||||||||||||
| getTournamentsInfo | 1830 | 4 | 1.605 | |||||||||||||||
| getTournamentsState | 140998 | 285 | 0.202 | 300 | 159.600 | |||||||||||||
| getTournamentsTables | 420309 | 666 | 0.158 | 900 | 470.667 | |||||||||||||
| getTournamentsLeaderboard | 419630 | 900 | 470.717 | |||||||||||||||
| getTournamentsRank | 1770 | 4 | 1.553 | |||||||||||||||
| getTournamentsBuyinInfo | 1830 | 4 | 1.605 | |||||||||||||||
| tournamentsBuyin | 1828 | 58 | 3.172 | 4 | 1.553 | |||||||||||||
| unRegister | 77 | 21 | 0.055 | |||||||||||||||
| Overall error rate | ||||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 900 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 5min | 15min | 15min | |||||||||||||||
| Time to run | 20min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/1110_lobby.PNG)
_files/1110_Lobby_graph.PNG)
6,000 accounts | ||||||
|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
| Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
| Login | 6000 | |||||
| Get Cash Tables by Filter | 527291 | 7 | 0.001 | 96 | 99.864 | |
| Get Zone Games by Filter | 132388 | 3 | 0.002 | 21 | 24.791 | |
| Get Zone Buyin Info | 4553 | - | 0.75 | 0.853 | ||
| Request Zone Buyin | 4546 | 23 | 0.505 | 0.75 | 0.847 | |
| Launch Game | 35936 | - | 5.5 | 6.730 | ||
| KeepAlive | 274707 | - | 50 | 52.028 | ||
| Overall error rate | 0.08 | |||||
| Image file | | |||||
| Max Clients | 6,000 | |||||
| Ramp up | 15min | |||||
| Time to run | 70min | |||||
| Ramp down | 5min | |||||
| MemoryState(NextDay) | _files/LOBBAPI_NODE1MEM_1113.png) | |||||
_files/1112_Lobby_graph.PNG)
_files/1112_lobby.PNG)
6,000 accounts | ||||||
|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
| Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
| Login | 6000 | |||||
| Get Cash Tables by Filter | 527832 | 7 | 0.001 | 96 | 98.844 | |
| Get Zone Games by Filter | 131642 | 2 | 0.001 | 21 | 24.652 | |
| Get Zone Buyin Info | 4620 | - | 0.75 | 0.875 | ||
| Request Zone Buyin | 4617 | - | 0.75 | 0.874 | ||
| Launch Game | 36051 | - | 5.5 | 6.828 | ||
| KeepAlive | 275694 | - | 50 | 51.628 | ||
| Overall error rate | ||||||
| Image file | | |||||
| Max Clients | 6,000 | |||||
| Ramp up | 15min | |||||
| Time to run | 70min | |||||
| Ramp down | 5min | |||||
| MemoryState(NextDay) | _files/LOBBAPI_NODE1MEM_1116.png) | |||||
_files/image2015-11-16%2018-13-56.png)
_files/image2015-11-16%2018-14-13.png)
9000 accounts | ||||||
|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | ||
| Target | MaxLoad | Overall | ||||
Avg | Avg | |||||
| Login | 9000 | |||||
| getTournamentsByFilter | 96691 | 23406 | 24.207 | 13 | 13.880 | |
| getTournamentsInfo | 295 | - | 4 | 0.056 | ||
| getTournamentsState | 2228922 | 82088 | 3.682 | 300 | 406.597 | |
| getTournamentsTables | 6687950 | 174619 | 2.610 | 900 | 1233.585 | |
| getTournamentsLeaderboard | 6513240 | 6178 | 0.094 | 900 | 1232.398 | |
| getTournamentsRank | 294 | 27 | 9.183 | 4 | 0.051 | |
| getTournamentsBuyinInfo | 295 | 1 | 0.338 | 4 | 0.056 | |
| tournamentsBuyin | 294 | - | - | 4 | 0.056 | |
| unRegister | 12 | - | - | 0.25 | 0.002 | |
| Overall error rate | ||||||
| Image file | | |||||
| Max Clients | 9,000 | |||||
| Ramp up | 15min | |||||
| Time to run | 70min | |||||
| Ramp down | 5min | |||||
_files/image2015-11-17%2014-23-56.png)
_files/image2015-11-17%2014-24-11.png)
90 accounts | 90 accounts | 90 accounts | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 90 | 90 | 90 | |||||||||||||||
| KeepAlive | 29401 | 1 | 12.564 | 29288 | 12.516 | 29310 | 12.526 | |||||||||||
| getTournamentsByFilter | 297 | 1 | 13 | 0.130 | 334 | 13 | 0.143 | 327 | 13 | 0.144 | ||||||||
| getTournamentsInfo | 92 | 4 | 0.033 | 83 | 4 | 0.035 | 95 | 4 | 0.028 | |||||||||
| getTournamentsState | 7244 | 2 | 300 | 3.095 | 7295 | 10 | 300 | 3.113 | 7198 | 1 | 300 | 3.076 | ||||||
| getTournamentsTables | 21903 | 4 | 900 | 9.359 | 21770 | 9 | 900 | 9.300 | 21860 | 3 | 900 | 9.341 | ||||||
| getTournamentsLeaderboard | 21893 | 900 | 9.356 | 21757 | 900 | 9.298 | 21851 | 900 | 9.338 | |||||||||
| getTournamentsRank | 74 | 4 | 0.032 | 74 | 43 | 58.102 | 4 | 0.013 | 93 | 48 | 51.6 | 4 | 0.021 | |||||
| getTournamentsBuyinInfo | 92 | 17 | 18.478 | 4 | 0.033 | 83 | 4 | 0.035 | 95 | 4 | 0.227 | |||||||
| tournamentsBuyin | 74 | 4 | 0.032 | 83 | 7 | 8.433 | 4 | 0.032 | 95 | 4 | 0.227 | |||||||
| unRegister | 2 | 0.25 | 0.001 | 1 | 0.25 | 0.001 | 3 | 0.25 | 0.005 | |||||||||
| Overall error rate | ||||||||||||||||||
| Image file |
| _files/image2015-11-18%2022-52-5.png) _files/image2015-11-18%2022-51-52.png) | _files/image2015-11-18%2023-7-35.png) _files/image2015-11-18%2023-8-22.png) | |||||||||||||||
| Max Clients | 90 | 90 | 90 | |||||||||||||||
| Ramp up | 5min | 5min | 5min | |||||||||||||||
| Time to run | 30min | 30min | 30min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-18%2022-47-6.png)
_files/image2015-11-18%2022-47-40.png)
9000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 9000 | |||||||||||||||||
| KeepAlive | 4063093 | 15886 | 0.390 | 50 | 757.904 | |||||||||||||
| getTournamentsByFilter | 47150 | 1154 | 2.447 | 13 | 8.613 | |||||||||||||
| getTournamentsInfo | 14272 | 2807 | 19.667 | 4 | 2.147 | |||||||||||||
| getTournamentsState | 1070917 | 82858 | 7.737 | 300 | 185.030 | |||||||||||||
| getTournamentsTables | 3215601 | 121068 | 3.765 | 900 | 579.501 | |||||||||||||
| getTournamentsLeaderboard | 3092837 | 58289 | 1.884 | 900 | 568.267 | |||||||||||||
| getTournamentsRank | 11338 | 2121 | 18.707 | 4 | 1.726 | |||||||||||||
| getTournamentsBuyinInfo | 11463 | 49 | 0.427 | 4 | 2.137 | |||||||||||||
| tournamentsBuyin | 11413 | 14 | 0.122 | 4 | 2.135 | |||||||||||||
| unRegister | 494 | 1 | 0.204 | 0.25 | 0.093 | |||||||||||||
| Overall error rate | ||||||||||||||||||
| Image file |
| |||||||||||||||||
| Max Clients | 9000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 70min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-19%2016-4-20.png)
_files/image2015-11-19%2016-5-1.png)
| Transaction Name | #1 (08:05 ~ 09:35 GMT+9 / 9000 accounts) | #2 (11:30 ~ 13:00 GMT+9 / 9000 accounts) | #3 (17:00 ~ 17:30 GMT+9 / 9000 accounts) | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | |||||||
| Target | MaxLoad Avg | Overall Avg | Target | MaxLoad Avg | Overall Avg | Target | MaxLoadAvg | Overall | ||||||||||
| Avg | ||||||||||||||||||
| Login | 9011 | 0 | 9000 | 9000 | ||||||||||||||
| KeepAlive | 137391 | 7518 | 5.47% | 50 | 25.768 | 135800 | 457 | 0.34 | 50 | 26.853 | 29975 | 298 | 0.99 | 50 | 20.609 | |||
| getTournamentsByFilter | 103124 | 5871 | 5.69% | 13 | 18.212 | 67244 | 212 | 0.32 | 13 | 12.553 | 19457 | 169 | 0.87 | 13 | 11.085 | |||
| getTournamentsInfo | 28475 | 2 | 0.01% | 4 | 5.332 | 20749 | 20749 | 0.02 | 4 | 3.885 | 5857 | 2 | 0.03 | 4 | 3.365 | |||
| getTournamentsState | 2401161 | 747960 | 31.15% | 300 | 309.588 | 1534201 | 142457 | 9.29 | 300 | 260.626 | 457459 | 6962 | 1.52 | 300 | 258.906 | |||
| getTournamentsTables | 7222946 | 2243172 | 31.06% | 900 | 932.542 | 4597309 | 20058 | 0.44 | 900 | 857.163 | 1368389 | 20189 | 1.48 | 900 | 774.828 | |||
| getTournamentsLeaderboard | 4978618 | 1775 | 0.04% | 900 | 931.993 | 4575967 | 3034 | 0.07 | 900 | 856.354 | 1345459 | 1321 | 0.10 | 900 | 772.493 | |||
| getTournamentsRank | 28119 | 15 | 0.05% | 4 | 5.263 | 1738 | 12 | 0.69 | 4 | 0.323 | 5795 | 24 | 0.41 | 4 | 3.317 | |||
| getTournamentsBuyinInfo | 28473 | 4 | 0.01% | 4 | 5.331 | 20744 | 6 | 0.03 | 4 | 3.884 | 5857 | 2 | 0.03 | 4 | 3.362 | |||
| tournamentsBuyin | 28469 | 313 | 1.10% | 4 | 5.273 | 20712 | 18974 | 91.61 | 4 | 0.325 | 5846 | 4 | 0.07 | 4 | 3.357 | |||
| unRegister | 1402 | 1 | 0.07% | 0.25 | 0.262 | 76 | - | - | 0.25 | 0.014 | 303 | 1 | 0.33 | 0.25 | 0.180 | |||
| Overall error rate | 14958178 | 3006631 | 20.10% | |||||||||||||||
| Image file |
|
|
| |||||||||||||||
| Max Clients | 9,000 | 9000 | 9000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 70min | 70min | 10min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
| Server Config | parallelism = 300 guestModeSocketCount = 300 CodeChanged: Fix : Cache Rule( Status ALL ) | parallelism = 100 guestModeSocketCount = 300 CodeChanged: Fix : Cache Rule+(Status 200,204) -https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/3b183af36bd887e86efe67c01d7d41db86d5962a | parallelism = 300 guestModeSocketCount = 300 CodeChanged: Fix : Cache Rule+(Status 200,204,412) FixBug : Match Exception 412(https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/4b4300b91a6801480c3e7984d5b361440a515756) | |||||||||||||||
_files/image2015-11-20%2010-23-51.png)
_files/image2015-11-20%2010-27-16.png)
_files/image2015-11-20%2014-3-55.png)
_files/image2015-11-20%2014-3-34.png)
_files/image2015-11-20%2018-44-29.png)
_files/image2015-11-20%2018-45-53.png)
100 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | ||||||||||||||||||
| KeepAlive | 137366 | 4483 | 3.264 | 50 | 26.366 | 102968 | 1654 | 1.61 | 50 | 20.102 | 137248 | 4444 | 3.238 | 50 | 26.350 | |||
| getTournamentsByFilter | 104462 | 3374 | 3.230 | 13 | 18.930 | 71765 | 1252 | 1.74 | 13 | 13.205 | 100525 | 3495 | 3.477 | 13 | 18.377 | |||
| getTournamentsInfo | 31525 | 3 | 0.010 | 4 | 5.903 | 21753 | 4 | 0.02 | 4 | 4.073 | 29798 | 10 | 0.034 | 4 | 5.642 | |||
| getTournamentsState | 2468929 | 99618 | 4.035 | 300 | 443.691 | 1667812 | 39492 | 2.37 | 300 | 304.929 | 2352326 | 105295 | 4.476 | 300 | 420.792 | |||
| getTournamentsTables | 7435181 | 1019362 | 13.710 | 900 | 1201.464 | 4995724 | 116889 | 2.34 | 900 | 913.640 | 7087461 | 315630 | 4.453 | 900 | 1268.133 | |||
| getTournamentsLeaderboard | 6414498 | 1379 | 0.021 | 900 | 1200.959 | 4876514 | 1255 | 0.03 | 900 | 912.910 | 6770395 | 1991 | 0.029 | 900 | 1267.491 | |||
| getTournamentsRank | 31454 | 25 | 0.019 | 4 | 5.886 | 21695 | 12 | 0.06 | 4 | 4.060 | 29712 | 31 | 0.104 | 4 | 5.621 | |||
| getTournamentsBuyinInfo | 31525 | 3 | 0.010 | 4 | 5.903 | 21748 | 6 | 0.03 | 4 | 4.072 | 29788 | 4 | 0.013 | 4 | 5.641 | |||
| tournamentsBuyin | 31518 | 4 | 0.013 | 4 | 5.301 | 21739 | 2 | 0.1 | 4 | 4.071 | 29782 | 8 | 0.027 | 4 | 5.639 | |||
| unRegister | 1573 | 3 | 0.191 | 0.25 | 0.297 | 1069 | 2 | 0.19 | 0.25 | 0.207 | 1486 | 2 | 0.135 | 0.25 | 0.284 | |||
| Overall error rate | ||||||||||||||||||
| Image file |
| _files/image2015-11-21%2018-5-30.png) _files/image2015-11-21%2018-5-12.png) |
| |||||||||||||||
| Max Clients | 9,000 | 9000 | 15,000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 70min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-21%2013-8-11.png)
_files/image2015-11-21%2013-9-51.png)
_files/image2015-11-22%2012-16-44.png)
_files/image2015-11-22%2012-17-48.png)
9000 accounts | 3000 account + websocket | 6000 account + websocket | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 9,000 | 3,000 | 6,000 | |||||||||||||||
| KeepAlive | 136130 | 12987 | 9.540 | 50 | 24.433 | 9750 | 589 | 6.041 | 50 | 6.107 | 19496 | 1283 | 6.58 | 50 | 12.648 | |||
| getTournamentsByFilter | 71636 | 1489 | 2.079 | 13 | 13.136 | 6161 | 8 | 0.130 | 13 | 3.536 | 11508 | 95 | 0.83 | 13 | 6.793 | |||
| getTournamentsInfo | 21504 | 4 | 0.019 | 4 | 4.026 | 1870 | 4 | 1.075 | 3466 | 4 | 2.063 | |||||||
| getTournamentsState | 1660707 | 46793 | 2.818 | 300 | 302.231 | 150582 | 345 | 0.229 | 300 | 83.465 | 264976 | 3097 | 1.17 | 300 | 150.505 | |||
| getTournamentsTables | 4985179 | 138934 | 2.787 | 900 | 907.537 | 448114 | 1038 | 0.232 | 900 | 248.376 | 792577 | 9615 | 1.21 | 900 | 449.978 | |||
| getTournamentsLeaderboard | 4844613 | 1457 | 0.030 | 900 | 906.958 | 446488 | 900 | 248.049 | 781432 | 900 | 449.099 | |||||||
| getTournamentsRank | 21463 | 23 | 0.107 | 4 | 4.015 | 1859 | 4 | 1.068 | 3466 | 4 | 2.063 | |||||||
| getTournamentsBuyinInfo | 21500 | 3 | 0.014 | 4 | 4.026 | 1870 | 4 | 1.075 | 3466 | 4 | 2.063 | |||||||
| tournamentsBuyin | 21497 | 4 | 0.019 | 4 | 4.025 | 1870 | 4 | 1.075 | 3445 | 4 | 2.051 | |||||||
| unRegister | 1113 | 1 | 0.090 | 0.25 | 0.213 | 88 | 0.25 | 0.052 | 184 | 0.25 | 0.118 | |||||||
| Overall error rate | ||||||||||||||||||
| Image file |
|
|
| |||||||||||||||
| Max Clients | 9000 | 3,000 | 6000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 70min | 10min | 10min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-22%2013-48-47.png)
_files/image2015-11-22%2013-47-54.png)
_files/image2015-11-22%2016-2-14.png)
_files/image2015-11-22%2016-1-49.png)
_files/image2015-11-22%2017-44-54.png)
_files/image2015-11-22%2017-43-55.png)
9000 accounts + websocket | 9000 account + websocket | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 9000 | 9000 | ||||||||||||||||
| KeepAlive | 29187 | 2048 | 7.02 | 50 | 18.847 | 29999 | 100 | 0.33 | 50 | 20.763 | ||||||||
| getTournamentsByFilter | 16320 | 228 | 1.40 | 13 | 9.248 | 21890 | 74 | 0.34 | 13 | 12.538 | ||||||||
| getTournamentsInfo | 4905 | 7 | 0.14 | 4 | 2.815 | 6790 | 0 | 0 | 4 | 3.902 | ||||||||
| getTournamentsState | 370032 | 7331 | 1.98 | 300 | 208.449 | 511021 | 41959 | 8.21 | 300 | 269.576 | ||||||||
| getTournamentsTables | 1111262 | 21064 | 1.90 | 900 | 626.551 | 1531760 | 6669 | 0.44 | 900 | 876.489 | ||||||||
| getTournamentsLeaderboard | 1088236 | 936 | 0.09 | 900 | 624.885 | 1525043 | 0 | 0 | 900 | 876.461 | ||||||||
| getTournamentsRank | 4850 | 12 | 0.25 | 4 | 2.880 | 6740 | 0 | 0 | 4 | 3.874 | ||||||||
| getTournamentsBuyinInfo | 4897 | 0 | 4 | 2.814 | 6790 | 0 | 0 | 4 | 3.902 | |||||||||
| tournamentsBuyin | 4896 | 0 | 4 | 2.814 | 6788 | 0 | 0 | 4 | 3.901 | |||||||||
| unRegister | 233 | 0 | 0.25 | 0.144 | 336 | 2 | 0.60 | 0.25 | 0.214 | |||||||||
| Overall error rate | ||||||||||||||||||
| Image file |
|
| ||||||||||||||||
| Max Clients | 9,000 | 9000 | 15,000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 10min | 10min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
| Remarks |
| |||||||||||||||||
_files/image2015-11-22%2018-11-26.png)
_files/image2015-11-22%2018-10-48.png)
_files/image2015-11-22%2021-8-56.png)
_files/image2015-11-22%2021-10-2.png)
_files/1122_02_ws+9000clinets_2_failure.PNG)
#1 (15,000 accounts) + websocket | #2 (15,000 accounts) + websocket | #3 (100 accounts) + websocket | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15011 | 8 | 0.05% | 15000 | ||||||||||||||
| Get Cash Tables by Filter | 1115254 | 226 | 0.02% | 96 | 211.180 | 640497 | 11587 | 1.809 | 96 | 180.721 | 3792 | 96 | 0.718 | |||||
| Get Zone Games by Filter | 279729 | 62 | 0.02% | 21 | 52.372 | 162435 | 2808 | 1.728 | 21 | 45.009 | 903 | 21 | 0.171 | |||||
| Get Zone Buyin Info | 9896 | 1 | 0.01% | 0.75 | 1.874 | 5618 | - | 0.75 | 1.614 | 32 | 0.75 | 0.006 | ||||||
| Request Zone Buyin | 9890 | 2 | 0.02% | 0.75 | 1.873 | 5614 | - | 0.75 | 1.155 | 32 | 0.75 | 0.006 | ||||||
| Launch Game | 77337 | 0 | 5.5 | 14.647 | 43146 | - | 5.5 | 12.398 | 244 | 5.5 | 0.047 | |||||||
| KeepAlive | 581315 | 0 | 50 | 110.098 | 3727902 | - | 50 | 94.225 | 1575 | 50 | 0.313 | |||||||
| getTournamentsByFilter | 22155 | 1 | 0.01% | 13 | 4.196 | 13517 | 160 | 1.183 | 13 | 3.838 | 544 | 13 | 0.103 | |||||
| getTournamentsInfo | 6812 | 0 | 4 | 1.290 | 4125 | 105 | 2.545 | 4 | 1.155 | 163 | 4 | 0.032 | ||||||
| getTournamentsState | 521486 | 56024 | 10.74% | 300 | 87.165 | 303726 | 5142 | 1.693 | 300 | 84.346 | 12308 | 300 | 2.305 | |||||
| getTournamentsTables | 1570546 | 224 | 0.01% | 900 | 294.068 | 904568 | 12866 | 1.422 | 900 | 251.893 | 37422 | 900 | 7.008 | |||||
| getTournamentsLeaderboard | 1570322 | 0 | 900 | 294.068 | 891170 | 2672 | 0.300 | 900 | 250.988 | 37412 | 900 | 7.006 | ||||||
| getTournamentsRank | 6789 | 0 | 4 | 1.286 | 4006 | 267 | 6.665 | 4 | 1.074 | 163 | 4 | 0.032 | ||||||
| getTournamentsBuyinInfo | 6812 | 0 | 4 | 1.290 | 4020 | - | 4 | 1.155 | 163 | 4 | 0.032 | |||||||
| tournamentsBuyin | 6812 | 0 | 4 | 1.290 | 4020 | - | 4 | 1.155 | 163 | 4 | 0.032 | |||||||
| unRegister | 357 | 0 | 0.25 | 0.068 | 183 | - | 0.25 | 0.054 | 11 | 0.25 | 0.002 | |||||||
| Overall error rate | ||||||||||||||||||
| Image file |
|
|
| |||||||||||||||
| Max Clients | 15,000 | 15,000 | 100 | |||||||||||||||
| Ramp up | 20min | 20min | 5min | |||||||||||||||
| Time to run | 65min | 35min | 800min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-23%2013-47-48.png)
_files/image2015-11-23%2013-47-14.png)
_files/image2015-11-23%2016-29-3.png)
_files/image2015-11-23%2016-28-27.png)
_files/image2015-11-23%2021-18-54.png)
_files/image2015-11-23%2021-18-32.png)
15000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15000 | |||||||||||||||||
| Get Cash Tables by Filter | 497541 | 4796 | 0.964 | 96 | 93.323 | |||||||||||||
| Get Zone Games by Filter | 124665 | 962 | 0.772 | 21 | 23.165 | |||||||||||||
| Get Zone Buyin Info | 4468 | 21 | 0.470 | 0.75 | 0.842 | |||||||||||||
| Request Zone Buyin | 4444 | 16 | 0.360 | 0.75 | 0.839 | |||||||||||||
| Launch Game | 33816 | 60 | 0.177 | 5.5 | 6.393 | |||||||||||||
| KeepAlive | 214382 | 1564 | 0.730 | 50 | 42.226 | |||||||||||||
| getTournamentsByFilter | 82204 | 408 | 0.496 | 13 | 15.318 | |||||||||||||
| getTournamentsInfo | 25195 | 244 | 0.968 | 4 | 4.672 | |||||||||||||
| getTournamentsState | 1910555 | 16591 | 0.868 | 300 | 354.675 | |||||||||||||
| getTournamentsTables | 5759993 | 35231 | 0.612 | 900 | 1072.053 | |||||||||||||
| getTournamentsLeaderboard | 5724462 | 12012 | 0.210 | 900 | 1069.747 | |||||||||||||
| getTournamentsRank | 24885 | 104 | 0.418 | 4 | 4.641 | |||||||||||||
| getTournamentsBuyinInfo | 24951 | 12 | 0.048 | 4 | 4.670 | |||||||||||||
| tournamentsBuyin | 24938 | 7 | 0.028 | 4 | 4.669 | |||||||||||||
| unRegister | 1215 | 99 | 8.148 | 0.25 | 0.211 | |||||||||||||
| Overall error rate | 0.458% | |||||||||||||||||
| Image file |
| |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 15min | 15min | |||||||||||||||
| Time to run | 65min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-24%2013-44-41.png)
_files/image2015-11-24%2013-44-23.png)
#1 (08:00 ~ 09:30 GMT+9) | #2 (14:00 ~ 14:50 GMT+9) | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Get Cash Tables by Filter | 520531 | 19753 | 3.79% | 96 | 94.84 | 249772 | 1167 | 0.467 | 96 | 90.074 | ||||||||
| Get Zone Games by Filter | 131463 | 4937 | 3.76% | 21 | 23.69 | 63630 | 329 | 0.517 | 21 | 22.447 | ||||||||
| Get Zone Buyin Info | 4509 | 4 | 0.09% | 0.75 | 0.85 | 2271 | 1 | 0.044 | 0.75 | 0.822 | ||||||||
| Request Zone Buyin | 4501 | 1 | 0.02% | 0.75 | 0.85 | 2268 | 1 | 0.044 | 0.75 | 0.821 | ||||||||
| Launch Game | 34886 | 0 | 5.5 | 6.61 | 17103 | - | - | 5.5 | 6.197 | |||||||||
| KeepAlive | 248951 | 9178 | 3.69% | 50 | 47.01 | 123919 | 413 | 0.333 | 50 | 47.871 | ||||||||
| getTournamentsByFilter | 87013 | 2538 | 2.92% | 13 | 15.82 | 42630 | 153 | 0.359 | 13 | 15.063 | ||||||||
| getTournamentsInfo | 26100 | 0 | 4 | 4.89 | 12768 | 1 | 0.008 | 4 | 4.626 | |||||||||
| getTournamentsState | 1971027 | 72106 | 3.66% | 300 | 355.60 | 986977 | 4941 | 0.501 | 300 | 348.240 | ||||||||
| getTournamentsTables | 5926291 | 216002 | 3.64% | 900 | 1069.34 | 2952870 | 16359 | 0.554 | 900 | 1041.316 | ||||||||
| getTournamentsLeaderboard | 5710128 | 4 | 0.0001% | 900 | 1069.31 | 2936505 | 131 | 0.004 | 900 | 1041.267 | ||||||||
| getTournamentsRank | 25830 | 0 | 4 | 4.84 | 12726 | 2 | 0.016 | 4 | 4.610 | |||||||||
| getTournamentsBuyinInfo | 26098 | 0 | 4 | 4.89 | 12767 | - | - | 4 | 4.626 | |||||||||
| tournamentsBuyin | 26093 | 217 | 0.83% | 4 | 4.85 | 12764 | - | - | 4 | 4.625 | ||||||||
| unRegister | 1290 | 178 | 13.8% | 0.25 | 0.21 | 625 | 3 | 0.480 | 0.25 | 0.225 | ||||||||
| Overall error rate | 14744711 | 324918 | 2.20% | 0.003% | ||||||||||||||
| Image file | | _files/image2015-11-25%2016-31-33.png) _files/image2015-11-25%2016-31-9.png) | ||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 20min | 15min | |||||||||||||||
| Time to run | 65min | 65min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
| Remarks | Error counts regarding status code
| Test stopped. because load generator(9) stopped. After 45 minutes Error counts regarding status code
| ||||||||||||||||
_files/1125_01_graph.PNG)
_files/1125_01_dd.PNG)
#1 (07:30 ~ 09:00 GMT+9)15000 accounts | #2 (12:00 ~ 13:30 GMT+9)15000 accounts | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15000 | 15000 | ||||||||||||||||
| Get Cash Tables by Filter | 521844 | 2616 | 0.501% | 96 | 98.339 | 525057 | 5050 | 0.962% | 96 | 98.486 | ||||||||
| Get Zone Games by Filter | 131102 | 660 | 0.530% | 21 | 24.427 | 132200 | 1209 | 0.915% | 21 | 24.530 | ||||||||
| Get Zone Buyin Info | 4545 | 13 | 0.352% | 0.75 | 0.858 | 4709 | 12 | 0.255% | 0.75 | 0.890 | ||||||||
| Request Zone Buyin | 4523 | 1 | 0.222% | 0.75 | 0.856 | 4692 | 1 | 0.021% | 0.75 | 0.888 | ||||||||
| Launch Game | 35182 | - | - | 5.5 | 6.663 | 35892 | 9 | 0.025% | 5.5 | 6.796 | ||||||||
| KeepAlive | 264928 | 1418 | 0.535% | 50 | 51.669 | 267251 | 2493 | 0.933% | 50 | 51.913 | ||||||||
| getTournamentsByFilter | 86562 | 346 | 0.400% | 13 | 16.145 | 85906 | 636 | 0.740% | 13 | 16.150 | ||||||||
| getTournamentsInfo | 4545 | 16 | 0.352% | 4 | 5.019 | 26375 | 7 | 0.027% | 4 | 4.994 | ||||||||
| getTournamentsState | 20106041 | 9864 | 0.489% | 300 | 375.689 | 2031487 | 19107 | 0.941% | 300 | 376.850 | ||||||||
| getTournamentsTables | 6079361 | 29670 | 0.488% | 900 | 1132.901 | 6107277 | 56773 | 0.930% | 900 | 1133.053 | ||||||||
| getTournamentsLeaderboard | 6049620 | - | - | 900 | 1132.888 | 6050407 | 856 | 0.014 | 900 | 1132.875 | ||||||||
| getTournamentsRank | 26400 | - | - | 4 | 5.000 | 26305 | 5 | 0.019% | 4 | 4.981 | ||||||||
| getTournamentsBuyinInfo | 26501 | - | - | 4 | 5.019 | 26368 | 5 | 0.19% | 4 | 4.993 | ||||||||
| tournamentsBuyin | 26495 | 47 | 0.177% | 4 | 5.009 | 26362 | 9 | 0.034% | 4 | 4.991 | ||||||||
| unRegister | 1317 | 201 | 15.262% | 0.25 | 0.211 | 1334 | 213 | 15.967% | 0.25 | 0.215 | ||||||||
| Overall error rate | 0.163% | 0.563% | ||||||||||||||||
| Image file |
| _files/image2015-11-26%2015-10-17.png) _files/image2015-11-26%2015-11-9.png) | ||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 20min | 15min | |||||||||||||||
| Time to run | 65min | 65min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-26%2015-19-52.png)
_files/image2015-11-26%2015-20-15.png)
#1 (13:00 ~ 14:30 GMT+9) 15000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15000 | |||||||||||||||||
| Get Cash Tables by Filter | 517178 | 5409 | 1.052% | 96 | 96.358 | |||||||||||||
| Get Zone Games by Filter | 129430 | 1344 | 1.038% | 21 | 24.259 | |||||||||||||
| Get Zone Buyin Info | 4452 | 5 | 0.112% | 0.75 | 0.842 | |||||||||||||
| Request Zone Buyin | 4441 | 1 | 0.023% | 0.75 | 0.841 | |||||||||||||
| Launch Game | 34472 | 6 | 0.017% | 5.5 | 6.528 | |||||||||||||
| KeepAlive | 263898 | 3202 | 1.213% | 50 | 51.117 | |||||||||||||
| getTournamentsByFilter | 848777 | 556 | 0.655% | 13 | 15.970 | |||||||||||||
| getTournamentsInfo | 25662 | 1 | 0.004% | 4 | 4.860 | |||||||||||||
| getTournamentsState | 1937391 | 15558 | 0.803% | 300 | 359.894 | |||||||||||||
| getTournamentsTables | 5828357 | 47512 | 0.815% | 900 | 1082.555 | |||||||||||||
| getTournamentsLeaderboard | 5780618 | 86 | 0.001% | 900 | 1082.497 | |||||||||||||
| getTournamentsRank | 22230 | 1 | 0.004% | 4 | 4.210 | |||||||||||||
| getTournamentsBuyinInfo | 25661 | 2 | 0.008% | 4 | 4.860 | |||||||||||||
| tournamentsBuyin | 22291 | 1 | 0.004% | 4 | 4.222 | |||||||||||||
| unRegister | 1141 | - | - | 0.25 | 0.219 | |||||||||||||
| Overall error rate | 0.502% | |||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 15min | 15min | |||||||||||||||
| Time to run | 65min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-11-27%2014-55-26.png)
_files/image2015-11-27%2014-55-45.png)
15000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | ||||||||||||||||||
| Get Cash Tables by Filter | 527095 | 1691 | 0.321% | 96 | 99.508 | |||||||||||||
| Get Zone Games by Filter | 132984 | 423 | 0.318% | 21 | 24.824 | |||||||||||||
| Get Zone Buyin Info | 4717 | 4 | 0.085% | 0.75 | 0.893 | |||||||||||||
| Request Zone Buyin | 4712 | - | - | 0.75 | 0.892 | |||||||||||||
| Launch Game | 35998 | - | - | 5.5 | 6.818 | |||||||||||||
| KeepAlive | 267639 | 845 | 0.316% | 50 | 52.313 | |||||||||||||
| getTournamentsByFilter | 85583 | 221 | 0.258% | 13 | 15.958 | |||||||||||||
| getTournamentsInfo | 26300 | - | - | 4 | 4.925 | |||||||||||||
| getTournamentsState | 1991990 | 6252 | 0.314% | 300 | 371.861 | |||||||||||||
| getTournamentsTables | 5986641 | 19216 | 0.321% | 900 | 1117.495 | |||||||||||||
| getTournamentsLeaderboard | 5967339 | - | - | 900 | 1117.479 | |||||||||||||
| getTournamentsRank | 19838 | - | - | 4 | 3.715 | |||||||||||||
| getTournamentsBuyinInfo | 26300 | 3339 | 12.696% | 4 | 4.300 | |||||||||||||
| tournamentsBuyin | 19871 | - | - | 4 | 3.721 | |||||||||||||
| unRegister | 1422 | - | - | 0.25 | 0.269 | |||||||||||||
| Overall error rate | 0.212% | |||||||||||||||||
| Image file |
| |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 15min | 15min | |||||||||||||||
| Time to run | 65min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-12-1%2014-4-30.png)
_files/image2015-12-1%2014-5-22.png)
15000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15000 | |||||||||||||||||
| Get Cash Tables by Filter | 520157 | 11870 | 2.282% | 96 | 96.266 | |||||||||||||
| Get Zone Games by Filter | 130806 | 2851 | 2.180% | 21 | 23.962 | |||||||||||||
| Get Zone Buyin Info | 4488 | 3 | 0.067% | 0.75 | 0.849 | |||||||||||||
| Request Zone Buyin | 4479 | - | - | 0.75 | 0.848 | |||||||||||||
| Launch Game | 34575 | 7 | 0.020% | 5.5 | 6.547 | |||||||||||||
| KeepAlive | 267177 | 6112 | 2.288% | 50 | 51.189 | |||||||||||||
| getTournamentsByFilter | 85452 | 1382 | 1.617% | 13 | 15.743 | |||||||||||||
| getTournamentsInfo | 25553 | 3 | 0.012% | 4 | 4.785 | |||||||||||||
| getTournamentsState | 1945137 | 46859 | 2.409% | 300 | 355.483 | |||||||||||||
| getTournamentsTables | 5827439 | 140033 | 2.403% | 900 | 1065.057 | |||||||||||||
| getTournamentsLeaderboard | 5687325 | 232 | 0.004% | 900 | 1064.999 | |||||||||||||
| getTournamentsRank | 22155 | 3 | 0.014% | 4 | 4.195 | |||||||||||||
| getTournamentsBuyinInfo | 25550 | 1 | 0.004% | 4 | 4.784 | |||||||||||||
| tournamentsBuyin | 22191 | 1 | 0.005% | 4 | 4.155 | |||||||||||||
| unRegister | 1526 | - | - | 0.25 | 0.289 | |||||||||||||
| Overall error rate | 1.434% | |||||||||||||||||
| Image file |
| |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 15min | 15min | |||||||||||||||
| Time to run | 65min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-12-2%2013-31-58.png)
_files/image2015-12-2%2013-33-10.png)
15000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15000 | |||||||||||||||||
| Get Cash Tables by Filter | 9626 | 649 | 6.742% | 96 | 21.374 | |||||||||||||
| Get Zone Games by Filter | 2779 | 190 | 6.837% | 21 | 5.394 | |||||||||||||
| Get Zone Buyin Info | 83 | 0.75 | 0.198 | |||||||||||||||
| Request Zone Buyin | 81 | 0.75 | 0.193 | |||||||||||||||
| Launch Game | 540 | 5.5 | 1.286 | |||||||||||||||
| KeepAlive | 2554 | 146 | 5.717% | 50 | 10.033 | |||||||||||||
| getTournamentsByFilter | 2004 | 78 | 3.892% | 13 | 4.586 | |||||||||||||
| getTournamentsInfo | 563 | 4 | 1.340 | |||||||||||||||
| getTournamentsState | 47668 | 992 | 2.081% | 300 | 97.242 | |||||||||||||
| getTournamentsTables | 144324 | 900 | 300.675 | |||||||||||||||
| getTournamentsLeaderboard | 144324 | 900 | 300.675 | |||||||||||||||
| getTournamentsRank | 527 | 4 | 1.25 | |||||||||||||||
| getTournamentsBuyinInfo | 563 | 4 | 1.340 | |||||||||||||||
| tournamentsBuyin | 563 | 4 | 1.340 | |||||||||||||||
| unRegister | 31 | 0.25 | 0.074 | |||||||||||||||
| Overall error rate | ||||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 15min | 15min | 15min | |||||||||||||||
| Time to run | 65min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-12-3%2012-5-17.png)
_files/image2015-12-3%2012-6-34.png)
15000 accounts | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 15000 | |||||||||||||||||
| Get Cash Tables by Filter | 539071 | 35568 | 6.598% | 96 | 95.360 | |||||||||||||
| Get Zone Games by Filter | 135323 | 8914 | 6.587% | 21 | 26.672 | |||||||||||||
| Get Zone Buyin Info | 4192 | 6 | 0.143% | 0.75 | 0.793 | |||||||||||||
| Request Zone Buyin | 4183 | - | 0.75 | 0.792 | ||||||||||||||
| Launch Game | 32076 | - | 5.5 | 6.075 | ||||||||||||||
| KeepAlive | 267976 | 15423 | 5.755% | 50 | 49.520 | |||||||||||||
| getTournamentsByFilter | 85420 | 4099 | 4.799% | 13 | 15.229 | |||||||||||||
| getTournamentsInfo | 25268 | - | 4 | 4.732 | ||||||||||||||
| getTournamentsState | 1971141 | 49695 | 2.521% | 300 | 359.821 | |||||||||||||
| getTournamentsTables | 5913082 | 5254 | 0.089% | 900 | 1106.335 | |||||||||||||
| getTournamentsLeaderboard | 5907771 | 689 | 0.012% | 900 | 1106.195 | |||||||||||||
| getTournamentsRank | 21975 | - | 4 | 4.115 | ||||||||||||||
| getTournamentsBuyinInfo | 25268 | - | 4 | 4.732 | ||||||||||||||
| tournamentsBuyin | 22015 | - | 4 | 4.123 | ||||||||||||||
| unRegister | 1632 | - | 0.25 | 0.309 | ||||||||||||||
| Overall error rate | 0.800% | |||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 15min | 15min | |||||||||||||||
| Time to run | 65min | 70min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-12-4%2012-19-26.png)
_files/image2015-12-4%2012-20-41.png)
4000 accounts | 7500 account | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Login | 4000 | |||||||||||||||||
| Get Cash Tables by Filter | 39989 | 96 | 23.803 | 264094 | 1267 | 0.480% | 96 | 49.778 | ||||||||||
| Get Zone Games by Filter | 10040 | 1 | 0.001% | 21 | 5.770 | 66980 | 278 | 0.415% | 21 | 12.491 | ||||||||
| Get Zone Buyin Info | 393 | 0.75 | 0.234 | 2372 | 0.75 | 0.499 | ||||||||||||
| Request Zone Buyin | 392 | 2 | 0.510% | 0.75 | 0.232 | 2369 | 0.75 | 0.499 | ||||||||||
| Launch Game | 2762 | 5.5 | 1.644 | 17985 | 5.5 | 3.406 | ||||||||||||
| KeepAlive | 18899 | 50 | 12.599 | 133943 | 577 | 0.431% | 50 | 26.150 | ||||||||||
| getTournamentsByFilter | 7515 | 13 | 4.319 | 49551 | 186 | 0.375% | 13 | 9.244 | ||||||||||
| getTournamentsInfo | 2401 | 4 | 4.129 | 15189 | 4 | 2.844 | ||||||||||||
| getTournamentsState | 164662 | 2 | 0.001% | 300 | 94.632 | 1135591 | 5668 | 0.499% | 300 | 211.596 | ||||||||
| getTournamentsTables | 496446 | 7 | 0.001% | 900 | 285.310 | 3398910 | 17032 | 0.501% | 900 | 633.310 | ||||||||
| getTournamentsLeaderboard | 496431 | 900 | 285.305 | 3381867 | 900 | 633.308 | ||||||||||||
| getTournamentsRank | 2346 | 4 | 1.396 | 13947 | 4 | 2.612 | ||||||||||||
| getTournamentsBuyinInfo | 2401 | 4 | 1.429 | 15189 | 7 | 0.046% | 4 | 2.843 | ||||||||||
| tournamentsBuyin | 2401 | 4 | 1.405 | 13965 | 4 | 2.615 | ||||||||||||
| unRegister | 158 | 0.25 | 0.094 | 962 | 0.25 | 0.182 | ||||||||||||
| Overall error rate | 0.001% | 0.294% | ||||||||||||||||
| Image file | | _files/image2015-12-5%2014-30-20.png) _files/image2015-12-5%2014-31-31.png) | ||||||||||||||||
| Max Clients | 4,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 10min | 20min | 15min | |||||||||||||||
| Time to run | 15min | 65min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
_files/image2015-12-5%2011-8-45.png)
_files/image2015-12-5%2011-9-58.png)
#1 (10:15 ~ | #2 | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transaction Name | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | Total Count | Failed Count | Error ratio | TPS | ||||||
| Target | MaxLoad | Overall | Target | MaxLoad | Overall | Target | MaxLoad | Overall | ||||||||||
Avg | Avg | Avg | Avg | Avg | Avg | |||||||||||||
| Get Cash Tables by Filter | 79396 | 5332 | 6.716% | 96 | 96 | |||||||||||||
| Get Zone Games by Filter | 20728 | 1365 | 6.585% | 21 | 21 | |||||||||||||
| Get Zone Buyin Info | 724 | 0 | 0.75 | 0.75 | ||||||||||||||
| Request Zone Buyin | 720 | 2 | 0.278% | 0.75 | 0.75 | |||||||||||||
| Launch Game | 4986 | 0 | 5.5 | 5.5 | ||||||||||||||
| KeepAlive | 34205 | 1944 | 5.683% | 50 | 50 | |||||||||||||
| getTournamentsByFilter | 15424 | 685 | 4.441% | 13 | 13 | |||||||||||||
| getTournamentsInfo | 4562 | 0 | 4 | 4 | ||||||||||||||
| getTournamentsState | 339022 | 7826 | 2.308% | 300 | 300 | |||||||||||||
| getTournamentsTables | 1009935 | 186 | 0.018% | 900 | 900 | |||||||||||||
| getTournamentsLeaderboard | 1009698 | 0 | 900 | 900 | ||||||||||||||
| getTournamentsRank | 4505 | 0 | 4 | 4 | ||||||||||||||
| getTournamentsBuyinInfo | 4562 | 0 | 4 | 4 | ||||||||||||||
| tournamentsBuyin | 4550 | 0 | 4 | 4 | ||||||||||||||
| unRegister | 288 | 0 | 0.25 | 0.25 | ||||||||||||||
| Overall error rate | ||||||||||||||||||
| Image file | | |||||||||||||||||
| Max Clients | 15,000 | 15,000 | 15,000 | |||||||||||||||
| Ramp up | 20min | 20min | 15min | |||||||||||||||
| Time to run | 65min | 65min | 70min | |||||||||||||||
| Ramp down | 5min | 5min | 5min | |||||||||||||||
| Remarks | Due to DB connection issue in Tour05 box(10.78.193.25), architect requested to stop the test. | |||||||||||||||||
_files/image2015-12-10%2011-14-27.png)