Versions Compared

Old Version 1

changes.mady.by.user PSMON

Saved on

compared with

New Version Current

changes.mady.by.user PSMON

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Test Results Summary

 

Scenario

Baseline

LDT Approach Poker Lobby API Load Test Approach
Expand
 

15,000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall
 

Avg

Avg
Login15000 1-    
Get Cash Tables by Filter1270710 1920 - 96 238.379 
Get Zone Games by Filter317442 1220 0.151 21 58.887 
Get Zone Buyin Info11250 1699 15.10 0.75  1.799 
Request Zone Buyin9540 831 8.710 0.75  1.640 
Launch Game84834 - - 5.5  15.976 
KeepAlive660986 - - 50  124.479 
getTournamentsByFilter 2452047  0.19113 4.609 
getTournamentsInfo5311 5 0.094 4  0.999
getTournamentsState592242 1184 0.199300  110.067
getTournamentsTables1775050 3398  0.191900  329.917
getTournamentsLeaderboard1771648  - -900  329.916
getTournamentsRank4197  - -4  0.790
getTournamentsBuyinInfo5306 418  7.8774  0.921
tournamentsBuyin4888 691 14.1364  0.790
unRegister 226 - - 0.25  0.043
Overall error rate    
Image file

 Image RemovedImage Removed

Max Clients15,000
Ramp up15min
Time to run70min
Ramp down5min
Expand
 

15,000 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login                  
Get Cash Tables by Filter20785211506507.247 96 544.596            
Get Zone Games by Filter521873298155.71321 138.999            
Get Zone Buyin Info17417258914.8640.75  4.189            
Request Zone Buyin1479812708.582 0.75  3.821            
Launch Game127716590.0465.5  36.061            
KeepAlive10027895000.04950  283.132            
getTournamentsByFilter4195321405.10013 11.247            
getTournamentsInfo7858120.1524 2.255            
getTournamentsState966140483455.003300 259.263            
getTournamentsTables28969701406204.854900 778.630            
getTournamentsLeaderboard27559911400.05900 778.789            
getTournamentsRank1077--4 

0.309

            
getTournamentsBuyinInfo17417258914.864 4 1.968            
tournamentsBuyin6799572384.1744 0.309            
unRegister5111.960 0.25 0.014            
Overall error rate3.676           
Image file

 Image RemovedImage Removed

  
Max Clients15,00015,00015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min
Expand
 

6,000 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login6000                  
Get Cash Tables by Filter52706760.00196 98.701            
Get Zone Games by Filter13301740.00321 24.909            
Get Zone Buyin Info469876716.3260.75  0.745            
Request Zone Buyin392580.2030.75  0.742            
Launch Game35264- 5.5  6.679            
KeepAlive274334- 50  51.957            
Overall error rate0.08           
Image file

 Image RemovedImage Removed

  
Max Clients6,00015,00015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min
Expand
 

900 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login910 10                
getTournamentsByFilter 600610  0.16513 5.230             
getTournamentsInfo1830   4  1.605            
getTournamentsState140998 285  0.202300 159.600            
getTournamentsTables420309 666  0.158900  470.667            
getTournamentsLeaderboard419630   900  470.717            
getTournamentsRank1770   4 1.553            
getTournamentsBuyinInfo1830   4 1.605             
tournamentsBuyin1828 58  3.1724  1.553            
unRegister 7721    0.055             
Overall error rate            
Image file

 Image RemovedImage Removed

  
Max Clients90015,00015,000
Ramp up5min15min15min
Time to run20min70min70min
Ramp down5min5min5min
Expand
 

6,000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall
 

Avg

Avg
Login6000      
Get Cash Tables by Filter52729170.00196 99.864
Get Zone Games by Filter13238830.00221 24.791
Get Zone Buyin Info4553- 0.75  0.853
Request Zone Buyin4546

23

0.5050.75  0.847
Launch Game35936- 5.5  6.730
KeepAlive274707- 50  52.028
Overall error rate0.08   
Image file

 Image RemovedImage Removed

Max Clients6,000
Ramp up15min
Time to run70min
Ramp down5min
MemoryState(NextDay)Image Removed
Expand
 

6,000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall
 

Avg

Avg
Login6000      
Get Cash Tables by Filter52783270.00196 98.844
Get Zone Games by Filter13164220.00121 24.652
Get Zone Buyin Info4620- 0.75  0.875
Request Zone Buyin4617

-

 0.75  0.874
Launch Game36051- 5.5  6.828
KeepAlive275694- 50  51.628
Overall error rate    
Image file

 Image RemovedImage Removed

Max Clients6,000
Ramp up15min
Time to run70min
Ramp down5min
MemoryState(NextDay)Image Removed
Expand
 

9000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall
 

Avg

Avg
Login9000      
getTournamentsByFilter96691 23406  24.20713 13.880 
getTournamentsInfo 295 - 4 0.056 
getTournamentsState2228922 82088  3.682300 406.597 
getTournamentsTables 6687950174619  2.610900 1233.585 
getTournamentsLeaderboard 65132406178  0.094900 1232.398 
getTournamentsRank 29427  9.1834 0.051 
getTournamentsBuyinInfo 2951  0.3384 0.056 
tournamentsBuyin294- -4  0.056
unRegister12  - - 0.25  0.002
Overall error rate    
Image file

 Image RemovedImage Removed

Max Clients9,000
Ramp up15min
Time to run70min
Ramp down5min
Expand
 

90 accounts

90 accounts 90 accounts 
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login90       90      90     
KeepAlive29401 1    12.564  29288     12.516 29310    12.526
getTournamentsByFilter 2971  13  0.130 334   13 0.143 327   13 0.144
getTournamentsInfo92   4  0.03383   4   0.03595   4 0.028
getTournamentsState7244 2  300  3.0957295 10  300  3.113 7198 1  300 3.076
getTournamentsTables21903 4  900  9.359 217709  900  9.300 21860 3  900 9.341
getTournamentsLeaderboard21893   900  9.356 21757  900  9.29821851   900 9.338
getTournamentsRank74   4  0.032 7443  58.1024   0.01393 48 51.6 4 0.021
getTournamentsBuyinInfo92 17  18.4784  0.033 83  4   0.035 95  4 0.227
tournamentsBuyin74   4  0.032 837  8.4334   0.03295   4 0.227
unRegister 2   0.25  0.001 1  0.25   0.0013   0.25 0.005
Overall error rate            
Image file

 Image Removed

Image Removed

 Image RemovedImage RemovedImage Removed Image Removed
Max Clients909090
Ramp up5min5min5min
Time to run30min30min30min
Ramp down5min5min5min
Expand
 

9000 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login 9000                 
KeepAlive4063093 158860.39050 757.904             
getTournamentsByFilter47150 1154 2.44713 8.613             
getTournamentsInfo14272 2807 19.6674 2.147             
getTournamentsState 107091782858 7.737300 185.030             
getTournamentsTables3215601 121068 3.765900 579.501            
getTournamentsLeaderboard3092837 58289 1.884900 568.267             
getTournamentsRank11338 2121 18.7074 1.726            
getTournamentsBuyinInfo11463 49 0.4274 2.137            
tournamentsBuyin11413 14 0.1224 2.135            
unRegister494 1 0.2040.25 0.093            
Overall error rate            
Image file

Image Removed 

Image Removed

  
Max Clients900015,00015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min
Expand
 Transaction Name 

#1 (08:05 ~ 09:35 GMT+9 / 9000 accounts)

#2 (11:30 ~ 13:00 GMT+9 / 9000 accounts)#3 (17:00 ~ 17:30 GMT+9 / 9000 accounts)

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target 

MaxLoad

Avg

Overall

Avg

Target  

MaxLoad

Avg

Overall

Avg

Target  MaxLoadAvgOverall
Avg
Login90110    9000     9000     
KeepAlive13739175185.47%50 25.7681358004570.3450 26.853299752980.9950 20.609
getTournamentsByFilter10312458715.69%13 18.212672442120.3213 12.553194571690.8713 11.085
getTournamentsInfo2847520.01%4 5.33220749207490.024 3.885585720.034 3.365
getTournamentsState240116174796031.15%300 309.58815342011424579.29300 260.62645745969621.52300 258.906
getTournamentsTables7222946224317231.06%900 932.5424597309200580.44900 857.1631368389201891.48900 774.828
getTournamentsLeaderboard497861817750.04%900 931.993457596730340.07900 856.354134545913210.10900 772.493
getTournamentsRank28119150.05%4 5.2631738120.694 0.3235795240.414 3.317
getTournamentsBuyinInfo2847340.01%4 5.3312074460.034 3.884585720.034 3.362
tournamentsBuyin284693131.10%4 5.273207121897491.614 0.325584640.074 3.357
unRegister140210.07%0.25 0.26276--0.25 0.01430310.330.25 0.180
Overall error rate14958178300663120.10%           
Image file

Image Removed

Image Removed

Image RemovedImage Removed

 

Image Removed

Image Removed

Max Clients9,00090009000
Ramp up15min15min15min
Time to run70min70min10min
Ramp down5min5min5min
Server Config

parallelism = 300

guestModeSocketCount = 300

CodeChanged:

Fix : Cache Rule( Status ALL )

parallelism = 100

guestModeSocketCount = 300

CodeChanged: 

Fix : Cache Rule+(Status 200,204) -https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/3b183af36bd887e86efe67c01d7d41db86d5962a

 

parallelism = 300

guestModeSocketCount = 300

CodeChanged:

Fix : Cache Rule+(Status 200,204,412)

FixBug : Match Exception 412(https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/4b4300b91a6801480c3e7984d5b361440a515756)

Expand
 

100 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login                  
KeepAlive137366 4483 3.264 50  26.366 10296816541.6150  20.10213724844443.23850 26.350
getTournamentsByFilter 1044623374 3.230 13 18.930 7176512521.7413 13.20510052534953.47713 18.377
getTournamentsInfo31525 3 0.010 4 5.903 2175340.024 4.07329798100.0344 5.642
getTournamentsState2468929 99618 4.035 300 443.691 1667812394922.37300 304.92923523261052954.476300 420.792
getTournamentsTables7435181 1019362 13.710 900 1201.464 49957241168892.34900 913.64070874613156304.453900 1268.133
getTournamentsLeaderboard6414498 1379 0.021 900 1200.959 487651412550.03900 912.910677039519910.029900 1267.491
getTournamentsRank31454 25 0.019 4 5.886 21695120.064 4.06029712310.1044 5.621
getTournamentsBuyinInfo31525 3 0.010 4 5.903 2174860.034 4.0722978840.0134 5.641
tournamentsBuyin31518 4 0.013 4 5.301 2173920.14 4.0712978280.0274 5.639
unRegister1573 3 0.191 0.25  0.297 106920.190.25 0.207148620.1350.25 0.284
Overall error rate            
Image file

Image Removed 

Image Removed

Image RemovedImage Removed

Image Removed

Image Removed

Max Clients9,000900015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min
Expand
 

9000 accounts

3000 account + websocket6000 account + websocket
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login9,000     3,000     6,000     
KeepAlive136130129879.54050 24.43397505896.04150 6.1071949612836.5850 12.648
getTournamentsByFilter7163614892.07913 13.136616180.13013 3.53611508950.8313 6.793
getTournamentsInfo2150440.0194 4.0261870  4 1.0753466  4 2.063
getTournamentsState1660707467932.818300 302.2311505823450.229300 83.46526497630971.17300 150.505
getTournamentsTables49851791389342.787900 907.53744811410380.232900 248.37679257796151.21900 449.978
getTournamentsLeaderboard484461314570.030900 906.958446488  900 248.049781432  900 449.099
getTournamentsRank21463230.1074 4.0151859  4 1.0683466  4 2.063
getTournamentsBuyinInfo2150030.0144 4.0261870  4 1.0753466  4 2.063
tournamentsBuyin2149740.0194 4.0251870  4 1.0753445  4 2.051
unRegister111310.0900.25 0.21388  0.25 0.052184  0.25 0.118
Overall error rate            
Image file

Image RemovedImage Removed

Image Removed

Image Removed

 

Image Removed

Image Removed

 

Max Clients90003,0006000
Ramp up15min15min15min
Time to run70min10min10min
Ramp down5min5min5min
Expand
 

9000 accounts + websocket

9000 account + websocket 
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login9000     9000           
KeepAlive2918720487.0250 18.847299991000.3350 20.763      
getTournamentsByFilter163202281.4013 9.24821890740.3413 12.538      
getTournamentsInfo490570.144 2.8156790004 3.902      
getTournamentsState37003273311.98300 208.449511021419598.21300 269.576      
getTournamentsTables1111262210641.90900 626.551153176066690.44900 876.489      
getTournamentsLeaderboard10882369360.09900 624.885152504300900 876.461      
getTournamentsRank4850120.254 2.8806740004 3.874      
getTournamentsBuyinInfo48970 4 2.8146790004 3.902      
tournamentsBuyin48960 4 2.8146788004 3.901      
unRegister2330 0.25 0.14433620.600.25 0.214      
Overall error rate            
Image file

Image Removed

Image Removed

Image Removed

Image Removed

Image Removed

 
Max Clients9,000900015,000
Ramp up15min15min15min
Time to run10min10min70min
Ramp down5min5min5min
Remarks 

  • Errors of Get Tournaments state were increased sharply when right after finishing ramp-up. 

 
Expand
 

#1 (15,000 accounts) + websocket

#2 (15,000 accounts) + websocket#3 (100 accounts) + websocket
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login1501180.05%   15000           
Get Cash Tables by Filter11152542260.02%96 211.180640497115871.80996 180.7213792  96 0.718
Get Zone Games by Filter279729620.02%21 52.37216243528081.72821 45.009903  21 0.171
Get Zone Buyin Info989610.01%0.75 1.8745618- 0.75 1.61432  0.75 0.006
Request Zone Buyin989020.02%0.75 1.8735614- 0.75 1.15532  0.75 0.006
Launch Game773370 5.5 14.64743146- 5.5 12.398244  5.5 0.047
KeepAlive5813150 50 110.0983727902- 50 94.2251575  50 0.313
getTournamentsByFilter2215510.01%13 4.196135171601.18313 3.838544  13 0.103
getTournamentsInfo68120 4 1.29041251052.5454 1.155163  4 0.032
getTournamentsState5214865602410.74%300 87.16530372651421.693300 84.34612308  300 2.305
getTournamentsTables15705462240.01%900 294.068904568128661.422900 251.89337422  900 7.008
getTournamentsLeaderboard15703220 900 294.06889117026720.300900 250.98837412  900 7.006
getTournamentsRank67890 4 1.28640062676.6654 1.074163  4 0.032
getTournamentsBuyinInfo68120 4 1.2904020- 4 1.155163  4 0.032
tournamentsBuyin68120 4 1.2904020- 4 1.155163  4 

0.032

unRegister3570 0.25 0.068183- 0.25 0.05411  0.25 0.002
Overall error rate            
Image file

Image Removed

Image Removed

Image Removed

Image Removed

Image Removed

Image Removed

 

Max Clients15,00015,000100
Ramp up20min20min5min
Time to run65min35min800min
Ramp down5min5min5min


LoadTest의 고뇌

한번도 못할수도 있지만 한번하면 한번만 하고 싶은 로드 테스트 과정

다음과 같은 수준을 통과했으며~ 로드테스트도 엄청난 비용이 수반되기때문에

꼭 이것이 표준은 아니며 프로덕트의 규모와 성격에따라 전략수준을 다양하게 채택할수 있습니다.

  • RampUp/Down Time을 설정하여 피크타임까지 사용자를 실제 시나리오와 유사하게 늘리고 뺌 
    • RampUP : 피크타임까지 도달하는 시간을 정하고 최고의 트래픽을 유발
    • RampDown : 트래픽이 최소가 되어가는 시간을 설정하고 트래픽이 점진적으로 줄어듬
      • 트래픽이 빠지는구간 측정이 중요한 이유는 우리가 만든 시스템에서 자원반환이라는 중요기능을 확인하고 가용성이 복원되는지를 보는것입니다.
    • 이용어는 제조업에서 생겼던 용어로 온프레미스에서 주로 사용했던 단어이며 오늘날  클라우드 컴퓨팅에서 탄력(Elastic)적이라는 단어를 사용합니다.
  • 목표 TPS만큼 테스트가 안되면 테스트 통과 실패 - 
  • TPS가 높아도 목표 사용자수가 안되면 테스트 통과 실패 - 
  • 목표한 API 허용 에러률(1%)보다 높아도 테스트 통과 실패   (스크립트 오류및 테스트 노드장비 문제일수도 있음) - 
  • 로드 테스트를 너무 많이해서 DB FUll이 나서 테스트 통과 실패 - 
  • 알수없는 이유로 여러개의 노드중 1개의 노드가 Crash되어도 테스트 통과 실패 ( 에러율이 1%보다 높아짐)  - 
  • 에러율이 낮아도 짧은기간에 에러 집중되면 테스트 통과 실패 - 
  • 테스트를 모두 통과해도, 평균 허용치 CPU(80%)사용율을 특정시간동안 지속되면 테스트 실패 - 
  • 코드수정및 스케일 아웃처리로 모든 로드 테스트를 통과해도, 이미 통과한 QA Sign OFF를 다시 받아야함, 이과정중 Codefix가 발생하면 다시 로드 테스트 수행 -
  • 서버가 대용량 처리가 안정화 되어 ,장시간 테스트시 결국 분산 테스트툴보다 더 오래 버팀 (분산 테스트툴을 주기적으로 리셋해야되는 상황발생) -
  • 이모든 장벽을 다통과해도 테스트 시나리오때 누락된 테스트항목으로 문제발생 ( 사용자 플래폼 변경에 따른 레거시 → 신규서비스 전환 테스트 미스) - 레거시 테스트 시나리오까지 작성하기 어려움 -



위와 같은 수준의 로드(퍼포먼스,스파크,안정성) 테스트  하게되면  노하우보다 예지력이 생길수도있으며
성능테스트는 측정하지 못하면 개선할수 없다가 기본전제이기때문에 고수준의 모니터링 툴이 사실 전제가 되어야합니다.

글로벌 특정 카테고리기준 Top트래픽에 속했던 프로덕트의 측정과정의 수치를 공개합니다.


Daily LoadTest

스크립트자체 검증과 서버검증을 통과할떄까지 수행


Expand

15,000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall

Avg

Avg
Login15000 1- 


Get Cash Tables by Filter1270710 1920 - 96
238.379 
Get Zone Games by Filter317442 1220 0.151 21
58.887 
Get Zone Buyin Info11250 1699 15.10 0.75 
1.799 
Request Zone Buyin9540 831 8.710 0.75 
1.640 
Launch Game84834 - - 5.5 
15.976 
KeepAlive660986 - - 50 
124.479 
getTournamentsByFilter 2452047  0.19113
4.609 
getTournamentsInfo5311 5 0.094 4
 0.999
getTournamentsState592242 1184 0.199300
 110.067
getTournamentsTables1775050 3398  0.191900
 329.917
getTournamentsLeaderboard1771648  - -900
 329.916
getTournamentsRank4197  - -4
 0.790
getTournamentsBuyinInfo5306 418  7.8774
 0.921
tournamentsBuyin4888 691 14.1364
 0.790
unRegister 226 - - 0.25
 0.043
Overall error rate



Image file

 Image AddedImage Added

Max Clients15,000
Ramp up15min
Time to run70min
Ramp down5min
Expand
Expand
 

15000 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login15000                 
Get Cash Tables by Filter4975414796 0.964 96 93.323            
Get Zone Games by Filter124665962 0.772 21 23.165            
Get Zone Buyin Info446821 0.470  0.75 0.842            
Request Zone Buyin444416 0.360 0.75 0.839            
Launch Game3381660 0.177 5.5 6.393            
KeepAlive21438215640.730 50 42.226            
getTournamentsByFilter 82204408 0.496 13 15.318            
getTournamentsInfo 251952440.9684 4.672            
getTournamentsState1910555165910.868300 354.675            
getTournamentsTables5759993352310.612900 1072.053            
getTournamentsLeaderboard5724462120120.210900 1069.747            
getTournamentsRank248851040.4184 4.641            
getTournamentsBuyinInfo24951120.0484 4.670            
tournamentsBuyin2493870.0284 4.669            
unRegister1215998.148 0.25 0.211            
Overall error rate0.458%           
Image file

Image Removed

Image Removed 

  

15,000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login

















Get Cash Tables by Filter20785211506507.247 96
544.596











Get Zone Games by Filter521873298155.71321
138.999











Get Zone Buyin Info17417258914.8640.75 
4.189











Request Zone Buyin1479812708.582 0.75 
3.821











Launch Game127716590.0465.5 
36.061











KeepAlive10027895000.04950 
283.132











getTournamentsByFilter4195321405.10013
11.247











getTournamentsInfo7858120.1524
2.255











getTournamentsState966140483455.003300
259.263











getTournamentsTables28969701406204.854900
778.630











getTournamentsLeaderboard27559911400.05900
778.789











getTournamentsRank1077--4

0.309













getTournamentsBuyinInfo17417258914.864 4
1.968











tournamentsBuyin6799572384.1744
0.309











unRegister5111.960 0.25
0.014











Overall error rate3.676










Image file

 Image AddedImage Added



Max Clients15,00015,00015,000
Ramp up
20min
15min15min15min
Time to run
65min
70min70min70min
Ramp down5min5min5min
 
Expand
 

#1 (08:00 ~ 09:30 GMT+9)

#2 (14:00 ~ 14:50 GMT+9)

6,000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg 

Avg

AvgGet Cash Tables by Filter520531197533.79%96 94.8424977211670.46796 90.074      Get Zone Games by Filter13146349373.76%21 23.69636303290.51721 22.447      Get Zone Buyin Info450940.09% 0.75 0.85227110.0440.75 0.822      Request Zone Buyin450110.02%0.75 0.85226810.0440.75 0.821      Launch Game348860 5.5 6.6117103--5.5 6.197      KeepAlive24895191783.69%50 47.011239194130.33350 47.871      getTournamentsByFilter8701325382.92%13 15.82426301530.35913 15.063      getTournamentsInfo261000 4 4.891276810.0084 4.626      getTournamentsState1971027721063.66%300 355.6098697749410.501300 348.240      getTournamentsTables59262912160023.64%900 1069.342952870163590.554900 1041.316      getTournamentsLeaderboard571012840.0001%900 1069.3129365051310.004900 1041.267      getTournamentsRank258300 4 4.841272620.0164 4.610      getTournamentsBuyinInfo260980 4 4.8912767--4 4.626      tournamentsBuyin260932170.83%4 4.8512764--4 4.625      unRegister129017813.8% 0.25 0.2162530.4800.25 0.225      Overall error rate147447113249182.20%   0.003%       Image file

 Image RemovedImage Removed

Image RemovedImage Removed Max Clients15,00015,00015,000Ramp up20min20min15minTime to run65min65min70minRamp down5min5min5minRemarks

Error counts regarding status code

  • undefined : 324371
  • 500 : 408
  • 502 : 1

Test stopped. because load generator(9) stopped. After 45 minutes

Error counts regarding status code

  • 500 : 268

  • 502 : 1

 

Avg
AvgAvg
AvgAvg
Login6000 
















Get Cash Tables by Filter52706760.00196
98.701











Get Zone Games by Filter13301740.00321
24.909











Get Zone Buyin Info469876716.3260.75 
0.745











Request Zone Buyin392580.2030.75 
0.742











Launch Game35264-
5.5 
6.679











KeepAlive274334-
50 
51.957











Overall error rate0.08 









Image file

 Image AddedImage Added



Max Clients6,00015,00015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min
Expand

900 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login910 10















getTournamentsByFilter 600610  0.16513
5.230 











getTournamentsInfo1830 

4
 1.605











getTournamentsState140998 285  0.202300
159.600











getTournamentsTables420309 666  0.158900
 470.667











getTournamentsLeaderboard419630 

900
 470.717











getTournamentsRank1770 

4
1.553











getTournamentsBuyinInfo1830 

4
1.605 











tournamentsBuyin1828 58  3.1724
 1.553











unRegister 7721 


0.055 











Overall error rate











Image file

 Image AddedImage Added



Max Clients90015,00015,000
Ramp up5min15min15min
Time to run20min70min70min
Ramp down5min5min5min
Expand

6,000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall

Avg

Avg
Login6000 




Get Cash Tables by Filter52729170.00196
99.864
Get Zone Games by Filter13238830.00221
24.791
Get Zone Buyin Info4553-
0.75 
0.853
Request Zone Buyin4546

23

0.5050.75 
0.847
Launch Game35936-
5.5 
6.730
KeepAlive274707-
50 
52.028
Overall error rate0.08 

Image file

 Image AddedImage Added

Max Clients6,000
Ramp up15min
Time to run70min
Ramp down5min
MemoryState(NextDay)
Image Added
Expand

6,000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall

Avg

Avg
Login6000 




Get Cash Tables by Filter52783270.00196
98.844
Get Zone Games by Filter13164220.00121
24.652
Get Zone Buyin Info4620-
0.75 
0.875
Request Zone Buyin4617

-


0.75 
0.874
Launch Game36051-
5.5 
6.828
KeepAlive275694-
50 
51.628
Overall error rate
 

Image file

 Image AddedImage Added

Max Clients6,000
Ramp up15min
Time to run70min
Ramp down5min
MemoryState(NextDay)
Image Added
Expand

9000 accounts

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

 Target

MaxLoad

Overall

Avg

Avg
Login9000 




getTournamentsByFilter96691 23406  24.20713
13.880 
getTournamentsInfo 295 -
4
0.056 
getTournamentsState2228922 82088  3.682300
406.597 
getTournamentsTables 6687950174619  2.610900
1233.585 
getTournamentsLeaderboard 65132406178  0.094900
1232.398 
getTournamentsRank 29427  9.1834
0.051 
getTournamentsBuyinInfo 2951  0.3384
0.056 
tournamentsBuyin294- -4
 0.056
unRegister12  - - 0.25
 0.002
Overall error rate



Image file

 Image AddedImage Added

Max Clients9,000
Ramp up15min
Time to run70min
Ramp down5min
Expand

90 accounts

90 accounts 90 accounts 
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login90 




 90




 90




KeepAlive29401 1 


12.564  29288



 12.516 29310



12.526
getTournamentsByFilter 2971 
13
 0.130 334

 13
0.143 327 

13
0.144
getTournamentsInfo92 

4
 0.03383 

4 
 0.03595 

4
0.028
getTournamentsState7244 2 
300
 3.0957295 10 
300 
3.113 7198 1 
300
3.076
getTournamentsTables21903 4 
900
 9.359 217709 
900 
9.300 21860 3 
900
9.341
getTournamentsLeaderboard21893 

900
 9.356 21757

900 
9.29821851 

900
9.338
getTournamentsRank74 

4
 0.032 7443  58.1024 
 0.01393 48 51.6 4
0.021
getTournamentsBuyinInfo92 17  18.4784
 0.033 83

4 
 0.035 95

4
0.227
tournamentsBuyin74 

4
 0.032 837  8.4334 
 0.03295 

4
0.227
unRegister 2

 0.25
 0.001 1

0.25 
 0.0013 

0.25
0.005
Overall error rate











Image file

 Image Added

Image Added

 Image AddedImage Added
Image Added Image Added
Max Clients909090
Ramp up5min5min5min
Time to run30min30min30min
Ramp down5min5min5min
15,000
Expand

9000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login 9000
















KeepAlive4063093 158860.39050
757.904 











getTournamentsByFilter47150 1154 2.44713
8.613 











getTournamentsInfo14272 2807 19.6674
2.147 











getTournamentsState 107091782858 7.737300
185.030 











getTournamentsTables3215601 121068 3.765900
579.501











getTournamentsLeaderboard3092837 58289 1.884900
568.267 











getTournamentsRank11338 2121 18.7074
1.726











getTournamentsBuyinInfo11463 49 0.4274
2.137











tournamentsBuyin11413 14 0.1224
2.135











unRegister494 1 0.2040.25
0.093











Overall error rate











Image file

Image Added 

Image Added



Max Clients9000
Expand
 

#1 (07:30 ~ 09:00 GMT+9)15000 accounts

 #2 (12:00 ~ 13:30 GMT+9)15000 accounts 
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login15000     15000           
Get Cash Tables by Filter521844 2616 0.501% 96 98.33952505750500.962%96 98.486      
Get Zone Games by Filter131102 660 0.530% 21 24.42713220012090.915%21 24.530      
Get Zone Buyin Info4545 13 0.352% 0.75 0.8584709120.255%0.75 0.890      
Request Zone Buyin45231 0.222% 0.75 0.856469210.021%0.75 0.888      
Launch Game35182 - -5.5 6.6633589290.025%5.5 6.796      
KeepAlive264928 1418 0.535% 50 51.66926725124930.933%50 51.913      
getTournamentsByFilter 86562346  0.400%13 16.145859066360.740%13 16.150      
getTournamentsInfo4545 16 0.352% 4 5.0192637570.027%4 4.994      
getTournamentsState20106041 98640.489% 300 375.6892031487191070.941%300 376.850      
getTournamentsTables6079361 29670 0.488% 900 1132.9016107277567730.930%900 1133.053      
getTournamentsLeaderboard6049620 --900 1132.88860504078560.014900 1132.875      
getTournamentsRank26400  --4 5.0002630550.019%4 4.981      
getTournamentsBuyinInfo26501  --4 5.0192636850.19%4 4.993      
tournamentsBuyin26495 47  0.177%4 5.0092636290.034%4 4.991      
unRegister 1317201 15.262% 0.25 0.211133421315.967%0.25 0.215      
Overall error rate0.163%   0.563%       
Image file

Image RemovedImage Removed

Image RemovedImage Removed 
Max Clients
15,00015,000
Ramp up
20min
15min
20min
15min15min
Time to run
65min
70min
65min
70min70min
Ramp down5min5min5min
Transaction Name 
Expand
 Transaction Name 

#1 (08:05 ~ 09:35 GMT+9 / 9000 accounts)

#2 (11:30 ~ 13:00 GMT+9 / 9000 accounts)#3 (17:00 ~
14
17:30 GMT+9
) 15000 accounts
  
/ 9000 accounts)

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target
 Target 

MaxLoad

Avg

Overall

Target Overall

Avg

MaxLoad
Target  
Target 

MaxLoad

Overall  

Avg

Avg

Overall

Avg

Avg
Target  
 
MaxLoadAvg
Avg
Overall
Avg
Login
15000 
9011
 
0
 




9000
 





9000
 





KeepAlive
             Get Cash Tables by Filter517178 5409 1.052% 96 96.358             Get Zone Games by Filter129430 1344 1.038% 21 24.259             Get Zone Buyin Info4452 5 0.112% 0.75 0.842             Request Zone Buyin4441 1 0.023% 0.75 0.841             Launch Game34472 6 0.017% 5.5 6.528             KeepAlive263898 3202 1.213% 50 51.117             getTournamentsByFilter848777 556 0.655% 13 15.970             getTournamentsInfo25662 1 0.004% 4 4.860             getTournamentsState1937391 15558 0.803% 300 359.894             getTournamentsTables5828357 47512 0.815% 900 1082.555             getTournamentsLeaderboard5780618 86 0.001% 900 1082.497             getTournamentsRank22230 1 0.004% 4 4.210             getTournamentsBuyinInfo25661 2 0.008% 4 4.860             tournamentsBuyin22291 1 0.004% 4 4.222             unRegister1141 - - 0.25  0.219             Overall error rate0.502%            Image file

 Image RemovedImage Removed

  Max Clients15,00015,00015,000Ramp up20min15min15minTime to run65min70min70minRamp down5min5min5min
Expand
 

15000 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login                  
Get Cash Tables by Filter52709516910.321%96 99.508             
Get Zone Games by Filter1329844230.318%21 24.824             
Get Zone Buyin Info471740.085% 0.75 0.893             
Request Zone Buyin4712-- 0.75 0.892             
Launch Game35998--5.5  6.818             
KeepAlive2676398450.316%50  52.313             
getTournamentsByFilter855832210.258%13 15.958             
getTournamentsInfo26300--4  4.925            
getTournamentsState199199062520.314%300 371.861             
getTournamentsTables5986641192160.321%900 1117.495             
getTournamentsLeaderboard5967339--900 1117.479             
getTournamentsRank19838--4 3.715             
getTournamentsBuyinInfo26300333912.696%4 4.300             
tournamentsBuyin19871--4 3.721             
unRegister1422-- 0.25 0.269             
Overall error rate0.212%           
Image file

Image RemovedImage Removed

  
Max Clients15,00015,00015,000
Ramp up20min15min15min
Time to run65min70min70min
Ramp down5min5min5min
13739175185.47%50
25.7681358004570.3450
26.853299752980.9950
20.609
getTournamentsByFilter10312458715.69%13
18.212672442120.3213
12.553194571690.8713
11.085
getTournamentsInfo2847520.01%4
5.33220749207490.024
3.885585720.034
3.365
getTournamentsState240116174796031.15%300
309.58815342011424579.29300
260.62645745969621.52300
258.906
getTournamentsTables7222946224317231.06%900
932.5424597309200580.44900
857.1631368389201891.48900
774.828
getTournamentsLeaderboard497861817750.04%900
931.993457596730340.07900
856.354134545913210.10900
772.493
getTournamentsRank28119150.05%4
5.2631738120.694
0.3235795240.414
3.317
getTournamentsBuyinInfo2847340.01%4
5.3312074460.034
3.884585720.034
3.362
tournamentsBuyin284693131.10%4
5.273207121897491.614
0.325584640.074
3.357
unRegister140210.07%0.25
0.26276--0.25
0.01430310.330.25
0.180
Overall error rate14958178300663120.10%










Image file

Image Added

Image Added

Image AddedImage Added


Image Added

Image Added

Max Clients9,00090009000
Ramp up15min15min15min
Time to run70min70min10min
Ramp down5min5min5min
Server Config

parallelism = 300

guestModeSocketCount = 300

CodeChanged:

Fix : Cache Rule( Status ALL )

parallelism = 100

guestModeSocketCount = 300

CodeChanged: 

Fix : Cache Rule+(Status 200,204) -https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/3b183af36bd887e86efe67c01d7d41db86d5962a


parallelism = 300

guestModeSocketCount = 300

CodeChanged:

Fix : Cache Rule+(Status 200,204,412)

FixBug : Match Exception 412(https://git.mit.corp-apps.com/local/projects/PKIV/repos/poker-server-lobby-api/commits/4b4300b91a6801480c3e7984d5b361440a515756)

Expand

100 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login

















KeepAlive137366 4483 3.264 50 
26.366 10296816541.6150 
20.10213724844443.23850
26.350
getTournamentsByFilter 1044623374 3.230 13
18.930 7176512521.7413
13.20510052534953.47713
18.377
getTournamentsInfo31525 3 0.010 4
5.903 2175340.024
4.07329798100.0344
5.642
getTournamentsState2468929 99618 4.035 300
443.691 1667812394922.37300
304.92923523261052954.476300
420.792
getTournamentsTables7435181 1019362 13.710 900
1201.464 49957241168892.34900
913.64070874613156304.453900
1268.133
getTournamentsLeaderboard6414498 1379 0.021 900
1200.959 487651412550.03900
912.910677039519910.029900
1267.491
getTournamentsRank31454 25 0.019 4
5.886 21695120.064
4.06029712310.1044
5.621
getTournamentsBuyinInfo31525 3 0.010 4
5.903 2174860.034
4.0722978840.0134
5.641
tournamentsBuyin31518 4 0.013 4
5.301 2173920.14
4.0712978280.0274
5.639
unRegister1573 3 0.191 0.25 
0.297 106920.190.25
0.207148620.1350.25
0.284
Overall error rate











Image file

Image Added 

Image Added

Image AddedImage Added

Image Added

Image Added

Max Clients9,000900015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min
Expand

9000 accounts

3000 account + websocket6000 account + websocket
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login9,000




3,000




6,000




KeepAlive136130129879.54050
24.43397505896.04150
6.1071949612836.5850
12.648
getTournamentsByFilter7163614892.07913
13.136616180.13013
3.53611508950.8313
6.793
getTournamentsInfo2150440.0194
4.0261870

4
1.0753466

4
2.063
getTournamentsState1660707467932.818300
302.2311505823450.229300
83.46526497630971.17300
150.505
getTournamentsTables49851791389342.787900
907.53744811410380.232900
248.37679257796151.21900
449.978
getTournamentsLeaderboard484461314570.030900
906.958446488

900
248.049781432

900
449.099
getTournamentsRank21463230.1074
4.0151859

4
1.0683466

4
2.063
getTournamentsBuyinInfo2150030.0144
4.0261870

4
1.0753466

4
2.063
tournamentsBuyin2149740.0194
4.0251870

4
1.0753445

4
2.051
unRegister111310.0900.25
0.21388

0.25
0.052184

0.25
0.118
Overall error rate











Image file

Image AddedImage Added

Image Added

Image Added


Image Added

Image Added


Max Clients90003,0006000
Ramp up15min15min15min
Time to run70min10min10min
Ramp down5min5min5min
Expand

9000 accounts + websocket

9000 account + websocket
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login9000




9000










KeepAlive2918720487.0250
18.847299991000.3350
20.763





getTournamentsByFilter163202281.4013
9.24821890740.3413
12.538





getTournamentsInfo490570.144
2.8156790004
3.902





getTournamentsState37003273311.98300
208.449511021419598.21300
269.576





getTournamentsTables1111262210641.90900
626.551153176066690.44900
876.489





getTournamentsLeaderboard10882369360.09900
624.885152504300900
876.461





getTournamentsRank4850120.254
2.8806740004
3.874





getTournamentsBuyinInfo48970
4
2.8146790004
3.902





tournamentsBuyin48960
4
2.8146788004
3.901





unRegister2330
0.25
0.14433620.600.25
0.214





Overall error rate











Image file

Image Added

Image Added

Image Added

Image Added

Image Added


Max Clients9,000900015,000
Ramp up15min15min15min
Time to run10min10min70min
Ramp down5min5min5min
Remarks

  • Errors of Get Tournaments state were increased sharply when right after finishing ramp-up. 


 
Expand

#1 (15,000 accounts) + websocket

#2 (15,000 accounts) + websocket#3 (100 accounts) + websocket
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login1501180.05%


15000










Get Cash Tables by Filter11152542260.02%96
211.180640497115871.80996
180.7213792

96
0.718
Get Zone Games by Filter279729620.02%21
52.37216243528081.72821
45.009903

21
0.171
Get Zone Buyin Info989610.01%0.75
1.8745618-
0.75
1.61432

0.75
0.006
Request Zone Buyin989020.02%0.75
1.8735614-
0.75
1.15532

0.75
0.006
Launch Game773370
5.5
14.64743146-
5.5
12.398244

5.5
0.047
KeepAlive5813150
50
110.0983727902-
50
94.2251575

50
0.313
getTournamentsByFilter2215510.01%13
4.196135171601.18313
3.838544

13
0.103
getTournamentsInfo68120
4
1.29041251052.5454
1.155163

4
0.032
getTournamentsState5214865602410.74%300
87.16530372651421.693300
84.34612308

300
2.305
getTournamentsTables15705462240.01%900
294.068904568128661.422900
251.89337422

900
7.008
getTournamentsLeaderboard15703220
900
294.06889117026720.300900
250.98837412

900
7.006
getTournamentsRank67890
4
1.28640062676.6654
1.074163

4
0.032
getTournamentsBuyinInfo68120
4
1.2904020-
4
1.155163

4
0.032
tournamentsBuyin68120
4
1.2904020-
4
1.155163

4

0.032

unRegister3570
0.25
0.068183-
0.25
0.05411

0.25
0.002
Overall error rate











Image file

Image Added

Image Added

Image Added

Image Added

Image Added

Image Added

Expand
 

15000 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login15000                 
Get Cash Tables by Filter520157 11870 2.282%96 96.266            
Get Zone Games by Filter13080628512.180%21 23.962            
Get Zone Buyin Info448830.067%0.75  0.849            
Request Zone Buyin4479--0.75  0.848            
Launch Game3457570.020%5.5  6.547            
KeepAlive26717761122.288%50  51.189            
getTournamentsByFilter8545213821.617%13 15.743            
getTournamentsInfo2555330.012%4 4.785            
getTournamentsState1945137468592.409%300 355.483            
getTournamentsTables58274391400332.403%900 1065.057            
getTournamentsLeaderboard56873252320.004%900 1064.999            
getTournamentsRank2215530.014%4 4.195            
getTournamentsBuyinInfo2555010.004%4 4.784            
tournamentsBuyin2219110.005%4 4.155            
unRegister1526--0.25 0.289            
Overall error rate1.434%           
Image file

Image RemovedImage Removed

 


Max Clients15,00015,000
15,000
100
Ramp up20min
15min
20min
15min
5min
Time to run65min
70min
35min
70min
800min
Ramp down5min5min5min
  
Expand

15000 accounts

 



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg
Avg
 
Avg
AvgAvg
 AvgAvgLogin15000                  Get Cash Tables by Filter9626 649 6.742% 96 21.374             Get Zone Games by Filter2779 190 6.837% 21 5.394             Get Zone Buyin Info83   0.75 0.198             Request Zone Buyin81   0.75 0.193             Launch Game540    5.5 1.286             KeepAlive2554146 5.717%50  10.033             getTournamentsByFilter 2004783.892%13 4.586             getTournamentsInfo 563  4 1.340             getTournamentsState47668 992 2.081% 300 97.242             getTournamentsTables144324   900 300.675             getTournamentsLeaderboard144324   900 300.675             getTournamentsRank527   4 1.25             getTournamentsBuyinInfo563   4 1.340             tournamentsBuyin563   4 1.340             unRegister31   0.25  0.074             Overall error rate            Image file

 Image RemovedImage Removed

  
Login15000
















Get Cash Tables by Filter4975414796 0.964 96
93.323











Get Zone Games by Filter124665962 0.772 21
23.165











Get Zone Buyin Info446821 0.470  0.75
0.842











Request Zone Buyin444416 0.360 0.75
0.839











Launch Game3381660 0.177 5.5
6.393











KeepAlive21438215640.730 50
42.226











getTournamentsByFilter 82204408 0.496 13
15.318











getTournamentsInfo 251952440.9684
4.672











getTournamentsState1910555165910.868300
354.675











getTournamentsTables5759993352310.612900
1072.053











getTournamentsLeaderboard5724462120120.210900
1069.747











getTournamentsRank248851040.4184
4.641











getTournamentsBuyinInfo24951120.0484
4.670











tournamentsBuyin2493870.0284
4.669











unRegister1215998.148 0.25
0.211











Overall error rate0.458%










Image file

Image Added

Image Added 



Max Clients15,00015,00015,000
Ramp up20min15min15min
Time to run65min70min70min
Ramp down5min5min5min
Expand

#1 (08:00 ~ 09:30 GMT+9)

#2 (14:00 ~ 14:50 GMT+9)
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Get Cash Tables by Filter520531197533.79%96
94.8424977211670.46796
90.074





Get Zone Games by Filter13146349373.76%21
23.69636303290.51721
22.447





Get Zone Buyin Info450940.09% 0.75
0.85227110.0440.75
0.822





Request Zone Buyin450110.02%0.75
0.85226810.0440.75
0.821





Launch Game348860
5.5
6.6117103--5.5
6.197





KeepAlive24895191783.69%50
47.011239194130.33350
47.871





getTournamentsByFilter8701325382.92%13
15.82426301530.35913
15.063





getTournamentsInfo261000
4
4.891276810.0084
4.626





getTournamentsState1971027721063.66%300
355.6098697749410.501300
348.240





getTournamentsTables59262912160023.64%900
1069.342952870163590.554900
1041.316





getTournamentsLeaderboard571012840.0001%900
1069.3129365051310.004900
1041.267





getTournamentsRank258300
4
4.841272620.0164
4.610





getTournamentsBuyinInfo260980
4
4.8912767--4
4.626





tournamentsBuyin260932170.83%4
4.8512764--4
4.625





unRegister129017813.8% 0.25
0.2162530.4800.25
0.225





Overall error rate147447113249182.20%


0.003%






Image file

 Image AddedImage Added

Image AddedImage Added

Max Clients15,00015,00015,000
Ramp up
15min
20min
15min
20min15min
Time to run65min
70min
65min70min
Ramp down5min5min5min
Remarks

Error counts regarding status code

  • undefined : 324371
  • 500 : 408
  • 502 : 1

Test stopped. because load generator(9) stopped. After 45 minutes

Error counts regarding status code

  • 500 : 268

  • 502 : 1


 
Expand

#1 (07:30 ~ 09:00 GMT+9)15000 accounts

 #2 (12:00 ~ 13:30 GMT+9)15000 accounts
Expand
 

15000 accounts

 

Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall 

Avg

Avg AvgAvg AvgAvgLogin15000                 

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login15000




15000
 











Get Cash Tables by Filter
539071 
521844 
35568 
2616 
6
0.
598% 
501% 96
 95

98.
360 
339
 
525057
 
5050
 
0.962%
        
96
98.486
 






Get Zone Games by Filter
135323 
131102 
8914 
660 
6
0.
587% 
530% 21
 26

24.
672 
427
 
132200
 
1209
         
0.915%21
24.530
 






Get Zone Buyin Info
4192 
4545 
6 
13 0.
143% 
352% 0.
75  
75
0.
793 
858
 
4709
 
12
         
0.255%0.75
0.890
 






Request Zone Buyin
4183 
4523
-
1 
 
0.222% 0.
75 
75
 

0.
792 
856
 
4692
 
1
          Launch Game32076  - 5.5  6.075             KeepAlive267976 15423 5.755% 50  49.520             getTournamentsByFilter85420 4099 4.799% 13 15.229             getTournamentsInfo25268 -  4 4.732             getTournamentsState1971141 49695 2.521% 300 359.821             getTournamentsTables5913082 5254 0.089% 900 1106.335             getTournamentsLeaderboard5907771 689 0.012% 900 1106.195             getTournamentsRank21975 -  4 4.115             getTournamentsBuyinInfo25268 -  4 4.732             tournamentsBuyin22015 -  4 4.123             unRegister 1632 -  0.25 0.309             Overall error rate0.800%            Image file

 Image RemovedImage Removed

  Max Clients15,00015,00015,000Ramp up20min15min15minTime to run65min70min70minRamp down5min5min5min
0.021%0.75
0.888





Launch Game35182 - -5.5
6.6633589290.025%5.5
6.796





KeepAlive264928 1418 0.535% 50
51.66926725124930.933%50
51.913





getTournamentsByFilter 86562346  0.400%13
16.145859066360.740%13
16.150





getTournamentsInfo4545 16 0.352% 4
5.0192637570.027%4
4.994





getTournamentsState20106041 98640.489% 300
375.6892031487191070.941%300
376.850





getTournamentsTables6079361 29670 0.488% 900
1132.9016107277567730.930%900
1133.053





getTournamentsLeaderboard6049620 --900
1132.88860504078560.014900
1132.875





getTournamentsRank26400  --4
5.0002630550.019%4
4.981





getTournamentsBuyinInfo26501  --4
5.0192636850.19%4
4.993





tournamentsBuyin26495 47  0.177%4
5.0092636290.034%4
4.991





unRegister 1317201 15.262% 0.25
0.211133421315.967%0.25
0.215





Overall error rate0.163%


0.563%






Image file

Image AddedImage Added

Image AddedImage Added

Max Clients15,00015,00015,000
Ramp up20min20min15min
Time to run65min65min70min
Ramp down5min5min5min
Expand

#1 (13:00 ~ 14:30 GMT+9) 15000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login15000 
















Get Cash Tables by Filter517178 5409 1.052% 96
96.358 











Get Zone Games by Filter129430 1344 1.038% 21
24.259 











Get Zone Buyin Info4452 5 0.112% 0.75
0.842 











Request Zone Buyin4441 1 0.023% 0.75
0.841 











Launch Game34472 6 0.017% 5.5
6.528 











KeepAlive263898 3202 1.213% 50
51.117 











getTournamentsByFilter848777 556 0.655% 13
15.970 











getTournamentsInfo25662 1 0.004% 4
4.860 











getTournamentsState1937391 15558 0.803% 300
359.894 











getTournamentsTables5828357 47512 0.815% 900
1082.555 











getTournamentsLeaderboard5780618 86 0.001% 900
1082.497 











getTournamentsRank22230 1 0.004% 4
4.210 











getTournamentsBuyinInfo25661 2 0.008% 4
4.860 











tournamentsBuyin22291 1 0.004% 4
4.222 











unRegister1141 - - 0.25 
0.219 











Overall error rate0.502% 










Image file

 Image AddedImage Added



Max Clients15,00015,00015,000
Ramp up20min15min15min
Time to run65min70min70min
Ramp down5min5min5min
Expand

15000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login

















Get Cash Tables by Filter52709516910.321%96
99.508 











Get Zone Games by Filter1329844230.318%21
24.824 











Get Zone Buyin Info471740.085% 0.75
0.893 











Request Zone Buyin4712-- 0.75
0.892 











Launch Game35998--5.5 
6.818 











KeepAlive2676398450.316%50 
52.313 











getTournamentsByFilter855832210.258%13
15.958 











getTournamentsInfo26300--4
 4.925











getTournamentsState199199062520.314%300
371.861 











getTournamentsTables5986641192160.321%900
1117.495 











getTournamentsLeaderboard5967339--900
1117.479 











getTournamentsRank19838--4
3.715 











getTournamentsBuyinInfo26300333912.696%4
4.300 











tournamentsBuyin19871--4
3.721 











unRegister1422-- 0.25
0.269 











Overall error rate0.212%










Image file

Image AddedImage Added



Max Clients15,00015,00015,000
Ramp up20min15min15min
Time to run65min70min70min
Ramp down5min5min5min
4
Expand

15000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login15000
















Get Cash Tables by Filter520157 11870 2.282%96
96.266











Get Zone Games by Filter13080628512.180%21
23.962











Get Zone Buyin Info448830.067%0.75 
0.849











Request Zone Buyin4479--0.75 
0.848











Launch Game3457570.020%5.5 
6.547











KeepAlive26717761122.288%50 
51.189











getTournamentsByFilter8545213821.617%13
15.743











getTournamentsInfo2555330.012%4
4.785











getTournamentsState1945137468592.409%300
355.483











getTournamentsTables58274391400332.403%900
1065.057











getTournamentsLeaderboard56873252320.004%900
1064.999











getTournamentsRank2215530.014%4
4.195











getTournamentsBuyinInfo2555010.004%4
4.784











tournamentsBuyin2219110.005%4
4.155











unRegister1526--0.25
0.289











Overall error rate1.434%










Image file

Image AddedImage Added



Max Clients15
Expand
 

4000 accounts

7500 account 
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login4000                  
Get Cash Tables by Filter39989   96 23.803 26409412670.480%96 49.778      
Get Zone Games by Filter10040 1 0.001% 21 5.770 669802780.415%21 12.491      
Get Zone Buyin Info393   0.75  0.234 2372  0.75 0.499      
Request Zone Buyin392 2 0.510% 0.75  0.232 2369  0.75 0.499      
Launch Game2762   5.5  1.644 17985  5.5 3.406      
KeepAlive18899   50  12.599 1339435770.431%50 26.150      
getTournamentsByFilter7515   13 4.319 495511860.375%13 9.244      
getTournamentsInfo2401   4 4.129 15189  4 2.844      
getTournamentsState164662 2 0.001% 300 94.632 113559156680.499%300 211.596      
getTournamentsTables496446 7 0.001% 900 285.310 3398910170320.501%900 633.310      
getTournamentsLeaderboard496431   900 285.305 3381867  900 633.308      
getTournamentsRank2346   4 1.396 13947  4 2.612      
getTournamentsBuyinInfo2401   4 1.429 1518970.046%4 2.843      
tournamentsBuyin2401   4 1.405 13965  4 2.615      
unRegister158    0.25 0.094 962  0.25 0.182      
Overall error rate0.001%    0.294%       
Image file

 Image RemovedImage Removed

Image RemovedImage Removed 
Max Clients
,00015,00015,000
Ramp up
10min
20min
20min
15min15min
Time to run
15min
65min
65min
70min70min
Ramp down5min5min5min
Expand
 
Expand

15000 accounts

 

#1 (10:15 ~ 11:4510:37)

#2



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg
Avg
 
Avg
AvgAvg
 Avg
Login
Avg
15000 
















Get Cash Tables by Filter
79396
9626 
5332
649 6.
716% 
742% 96
     96       

21.374 











Get Zone Games by Filter
20728
2779 
1365
190 6.
585%
837% 21
     21         

5.394 











Get Zone Buyin Info
7240  0.75    
83 
 0.75
       

0.198 
 












Request Zone Buyin
720
81 
2

 0.
278%
75
0.
75 
193 
 












Launch Game
 
540 
 
  0.75        Launch Game 49860 5.5      5.5        KeepAlive3420519445.683%50      50        getTournamentsByFilter 154246854.441%13     13        getTournamentsInfo 45620 4     4        getTournamentsState33902278262.308%300     300        getTournamentsTables10099351860.018%900     900        getTournamentsLeaderboard1009698 0 900     900        getTournamentsRank45050 4     4        getTournamentsBuyinInfo45620 4     4        tournamentsBuyin45500 4     4        unRegister2880  0.25     0.25        Overall error rate            Image file

 Image Removed

  Max Clients15,00015,00015,000Ramp up20min20min15minTime to run65min65min70minRamp down5min5min5minRemarks

Due to DB connection issue in Tour05 box(10.78.193.25), architect requested to stop the test.

  
 5.5
1.286 











KeepAlive2554146 5.717%50 
10.033 











getTournamentsByFilter 2004783.892%13
4.586 











getTournamentsInfo 563
 4
1.340 











getTournamentsState47668 992 2.081% 300
97.242 











getTournamentsTables144324 
 900
300.675 











getTournamentsLeaderboard144324 

900
300.675 











getTournamentsRank527 

4
1.25 











getTournamentsBuyinInfo563 

4
1.340 











tournamentsBuyin563 

4
1.340 











unRegister31 

0.25 
0.074 











Overall error rate











Image file

 Image AddedImage Added



Max Clients15,00015,00015,000
Ramp up15min15min15min
Time to run65min70min70min
Ramp down5min5min5min
Expand

15000 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login15000 
















Get Cash Tables by Filter539071 35568 6.598% 96
95.360 











Get Zone Games by Filter135323 8914 6.587% 21
26.672 











Get Zone Buyin Info4192 6 0.143% 0.75 
0.793 











Request Zone Buyin4183 -
0.75 
0.792 











Launch Game32076  -
5.5 
6.075 











KeepAlive267976 15423 5.755% 50 
49.520 











getTournamentsByFilter85420 4099 4.799% 13
15.229 











getTournamentsInfo25268 -  4
4.732 











getTournamentsState1971141 49695 2.521% 300
359.821 











getTournamentsTables5913082 5254 0.089% 900
1106.335 











getTournamentsLeaderboard5907771 689 0.012% 900
1106.195 











getTournamentsRank21975 - 
4
4.115 











getTournamentsBuyinInfo25268 - 
4
4.732 











tournamentsBuyin22015 - 
4
4.123 











unRegister 1632 -
 0.25
0.309 











Overall error rate0.800% 










Image file

 Image AddedImage Added



Max Clients15,00015,00015,000
Ramp up20min15min15min
Time to run65min70min70min
Ramp down5min5min5min
Expand

4000 accounts

7500 account
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login4000 
















Get Cash Tables by Filter39989 

96
23.803 26409412670.480%96
49.778





Get Zone Games by Filter10040 1 0.001% 21
5.770 669802780.415%21
12.491





Get Zone Buyin Info393 

0.75 
0.234 2372

0.75
0.499





Request Zone Buyin392 2 0.510% 0.75 
0.232 2369

0.75
0.499





Launch Game2762 

5.5 
1.644 17985

5.5
3.406





KeepAlive18899 

50 
12.599 1339435770.431%50
26.150





getTournamentsByFilter7515 

13
4.319 495511860.375%13
9.244





getTournamentsInfo2401 

4
4.129 15189

4
2.844





getTournamentsState164662 2 0.001% 300
94.632 113559156680.499%300
211.596





getTournamentsTables496446 7 0.001% 900
285.310 3398910170320.501%900
633.310





getTournamentsLeaderboard496431 

900
285.305 3381867

900
633.308





getTournamentsRank2346 

4
1.396 13947

4
2.612





getTournamentsBuyinInfo2401 

4
1.429 1518970.046%4
2.843





tournamentsBuyin2401 

4
1.405 13965

4
2.615





unRegister158 

 0.25
0.094 962

0.25
0.182





Overall error rate0.001% 


0.294%






Image file

 Image AddedImage Added

Image AddedImage Added

Max Clients4,00015,00015,000
Ramp up10min20min15min
Time to run15min65min70min
Ramp down5min5min5min
Expand

#1 (10:15 ~ 11:4510:37)

#2
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Get Cash Tables by Filter7939653326.716%96




96







Get Zone Games by Filter2072813656.585%21




21







Get Zone Buyin Info7240 
0.75 




0.75







Request Zone Buyin72020.278%0.75 




0.75







Launch Game 49860
5.5 




5.5







KeepAlive3420519445.683%50 




50







getTournamentsByFilter 154246854.441%13




13







getTournamentsInfo 45620
4




4







getTournamentsState33902278262.308%300




300







getTournamentsTables10099351860.018%900




900







getTournamentsLeaderboard1009698 0
900




900







getTournamentsRank45050
4




4







getTournamentsBuyinInfo45620
4




4







tournamentsBuyin45500
4




4







unRegister2880
 0.25




0.25







Overall error rate











Image file

 Image Added



Max Clients15,00015,00015,000
Ramp up20min20min15min
Time to run65min65min70min
Ramp down5min5min5min
Remarks

Due to DB connection issue in Tour05 box(10.78.193.25), architect requested to stop the test.



 
Expand

100 accounts



Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall

Avg

Avg
AvgAvg
AvgAvg
Login

















Get Cash Tables by Filter


96













Get Zone Games by Filter


21













Get Zone Buyin Info

















Request Zone Buyin

















Launch Game

















KeepAlive

















getTournamentsByFilter


13













getTournamentsInfo


4













getTournamentsState


300













getTournamentsTables


900













getTournamentsLeaderboard


900













getTournamentsRank


4













getTournamentsBuyinInfo


4













tournamentsBuyin


4













unRegister

















Overall error rate











Image file
Expand
 

100 accounts

  
Transaction Name 

Total

Count 

Failed

Count 

Error

ratio 

TPS

Total

Count 

Failed

Count

Error

ratio

TPS

Total

Count 

Failed

Count

Error

ratio

TPS
 Target

MaxLoad

OverallTarget MaxLoadOverallTarget MaxLoadOverall
 

Avg

Avg AvgAvg AvgAvg
Login                  
Get Cash Tables by Filter   96              
Get Zone Games by Filter   21              
Get Zone Buyin Info                  
Request Zone Buyin                  
Launch Game                  
KeepAlive                  
getTournamentsByFilter   13              
getTournamentsInfo   4              
getTournamentsState   300              
getTournamentsTables   900              
getTournamentsLeaderboard   900              
getTournamentsRank   4              
getTournamentsBuyinInfo   4              
tournamentsBuyin   4              
unRegister                  
Overall error rate            
Image file

 

 




Max Clients15,00015,00015,000
Ramp up15min15min15min
Time to run70min70min70min
Ramp down5min5min5min