CDMA Drive test for experiencing customer point of view

CDMA Drive test for
experiencing customer point of view
Version 1.a

Table of Contents
A.    Benchmarking Product checking    3
Preliminary:    3
B.    Interoperator Benchmarking Methodology    4
1.    General    4
2.    Coverage benchmarking (idle mode)    5
3.    Voice benchmarking (Qos mode)    5
4.    PDD benchmarking (PDD mode)    5
5.    Data benchmarking (GPRS mode)    6
6.    SMS benchmarking (sms mode)    7



A.    Benchmarking Product checking
Preliminary:
i.    Team should invite regional to supervise before check activity begins.
ii.    The check product should be done with LG chocolate mobile station on a PC running on tems investigation must version 8.0 for CDMA network.
iii.    Check product test should be done at 5 specific place in a city with stationary mobile station in good radio condition for 35 times per simcard for 2 simcards:
a.    Indosat-Starone prepaid
b.    Indosat-Starone postpaid
iv.    If there is problem on the service that being tested, the team must inform indosat regional and headquarter immediately, in order to resolving the problem.
v.    The command sequence for MS in tools should be done in parallel, not allowed in serial sequence.
vi.    All 2 simcards will have to call a specific destination as a summarized in the following table:

√ = Test for minimum 35 times
Location update test    Indosat
Starone postpaid    Indosat
Starone prepaid
Phone Number    0815-12345    0856-123456
Location update    √    √

√ = Test for minimum 35 times
Destination number    Origination
Destination number    Indosat    Indosat
    Starone postpaid    Starone prepaid
Phone Number    0815-12345    0856-123456
Voice test call        
Indosat-mentari    √    √
Indosat-Im3 (510 01)    √    √
Indosat-Im3 (510 21)    √    √
Indosat-matrix    √    √
Fren    √    √
Telkomsel    √    √
Excelcomindo     √    √
Flexy    √    √
Starone    √    √
3    √    √
PSTN local    √    √
* PSTN long distance    √    √
** Call using voip 01016    √    √
*** International call using ‘+’ sign    √    √
*** International call using 008    √    √
*** International call using 001    √    √
Video test call        
Indosat-mentari    √    √
Indosat-Im3 (510 01)    √    √
Indosat-Im3 (510 21)    √    √
Indosat-matrix    √    √
Telkomsel    √    √
Excelcomindo    √    √
3    √    √
SMS test        
Indosat-mentari    √    √
Indosat-Im3 (510 01)    √    √
Indosat-Im3 (510 21)    √    √
Indosat-matrix    √    √
Fren    √    √
Telkomsel    √    √
Excelcomindo     √    √
Flexy    √    √
Starone    √    √
3    √    √
Emergency call        
112    √    √
110    √    √
Data access        
GPRS    √    √
3G    √    √
Internet access via HP    √    √
Video streaming        
Video portal 136    √    √
wap.3g.indosat.com    √    √
Internet access via HP    √    √
I-ring        
Registration    √    √
Change song    √    √
UMB        
*1234#    √    √
         
* Destination city will be included (more than 1 city, can be ask to regional people)   
** Destination city and the country will be included (more than 1 city, can be ask to regional)   
*** Destination country is included (more than 1 country)   
Destination number can be finding in last page


B.    CDMA Interoperator Benchmarking Methodology
1.    General
a.    Team drive test should invite regional to supervise before benchmarking activity begins.
b.    Access permit to do drive test indoor will be issued by region
c.    Simcards used with the following configuration:
i.    MS1- Indosat-starone prepaid
ii.    MS2 – Telkom – Telkom flexi prepaid
iii.    MS3 – (prefer) Bakrie Telkom – Esia prepaid or mobile 8 – Fren prepaid
d.    Drive test should be done using types of measurement listed as follows:
i.    Idle mode (mobile)
ii.    Qos mode (mobile)
iii.    PDD mode (stationary)
iv.    Data mode (stationary)
v.    SMS mode (stationary)
e.    The drive test benchmarking should be done with qualcomm chipset based mobile station on a PC minimum  running on tems investigation version 8.0 connected to a GPS for coordinate data collection for CDMA network.
f.    Only multipurpose vehicle will be used for benchmarking drive test
g.    The drive test routes will cover all cities and intercity roads which will be determined by indosat
h.    All of measurement shall use “in car” mobile station antennas
i.    All mobile station (hand phone) must located in the in the middle seat of vehicle, mobile station do not allow to put in the dashboard
j.    The benchmarking drive test should be performed between Monday and Saturday

2.    Coverage benchmarking (idle mode)
a.    Mobile station1 shall use Indosat-starone prepaid
b.    Mobile station 2 shall use Telkom – Telkom Flexi prepaid
c.    Mobile station 3 shall use (prefer) Bakrie Telkom – Esia prepaid or mobile 8-  Fren prepaid
d.    Idle benchmarking test performed in mobile condition following routes
e.    The idle mode for each mobile station should be done without locking to any specific band

3.    Voice benchmarking (Qos mode)
a.    Mobile station 1 shall use Indosat-starone prepaid simcards and originate a call to test number 111
b.    Mobile station 2 shall use Telkom – Telkom flexi prepaid simcards and originate a call to test number 147
c.    Mobile station 3 shall 3 shall use Bakrie Telkom – Esia prepaid simcards and originate a call to test number 999 or use Mobile 8 – Fren prepaid simcard and originate a call to test number 888
d.    The Qos measurement will have call sequence with 60 seconds connected and 10 seconds idle or wait time
e.    The benchmarking drive test should be performed during working hours from 08.00 to 20.00 on local time
f.    Qos benchmarking test performed in mobile condition following routes
g.    The Qos mode for each mobile station should be done without locking to any specific band

4.    PDD benchmarking (PDD mode)
a.    Post dial delay (PDD) test should be done at a specific place with stationary mobile
Station in good radio condition for 35 times per simcard for 4 simcards:
i.    Indosat-Starone prepaid
ii.    Telkom – Telkom flexi prepaid
iii.    Bakrie Telkom – Esia prepaid
iv.    Mobile 8 – Fren prepaid

b.    All 4 simcards will have to call a specific destination as a summarized in the following table:
    Originating number
Destination number    Indosat
Starone    Telkom
Telkom Flexi     Bakrie Telkom
Esia    Mobile 8
Fren
Indosat-Starone    √    √    √    √
Telkom – Telkom Flexi    √    √    √    √
Bakrie Telkom –Esia    √    √    √    √
Mobile 8 –Fren    √    √    √    √
PSTN local    √    √    √    √
PSTN long distance (Jakarta)    √    √    √    √
International call (Singapore) using ‘+’ sign    √    √    √    √

5.    Data benchmarking (GPRS mode)
Every mobile station should be connecting with dual com port data cable for this Data test. First com port will connect as MS and another com port will connect as DC cable.
Data test should be done at a specific place with stationary mobile station in good radio condition for 35 times per simcard for 4 simcards (Starone, Telkom flexi, Esia, Fren):
The mobile stations will do following test:

A.    Http Load a web page
a.    Domestic Server
a.    http load: http://www.indosat.com
b.    http load: http://www.telkomflexi.com
c.    http load: http://www.esia.co.id or http load: http://mobile-8.com
b.    Overseas Server
i.    http load: http://www.yahoo.com
ii.    http load: http://www.msn.com/
iii.    http load: http://www.bbc.co.uk/

Data HTTP Load will work on DC cable and the logic to create command sequence (*.csq) to data HTTP Load is:
1)    Start
2)    Application testing-data service-connect-dial up (put phone number #777)
3)    Application testing-data service-session-HTTP Load (put web page address)
4)    Application testing-data service-connect-hang up
5)    Repeat step number 2 to number 4 for 35 times
6)    End

B.    Ftp load a file
a.    Required test for ftp upload 200 KB file size on  http://www.drivehq.com/
b.    Required test for ftp download 200 KB file size on  http://www.drivehq.com/

GPRS FTP files will work on DC cable and the logic to create command sequence (*.csq) to GPRS FTP is:
1)    Start
2)    Application testing-data service-connect-dial up (put phone number #777)
3)    Application testing-data service-session-FTP-get/put (fill in the ftp address)
4)    Application testing-data service-connect-hang up
5)    repeat step number 2 to number 4 for 35 times
6)    End

C.    Ping a web site
a.    Domestic Server
i.    http load: http://www.indosat.com
ii.    http load: http://www.telkomflexi.com
iii.    http load: http://www.esia.co.id or http load: http://mobile-8.com
c.    Overseas Server
i.    http load: http://www.yahoo.com
ii.    http load: http://www.msn.com/
iii.    http load: http://www.bbc.co.uk/

GPRS ping test will work on DC cable and the logic to create command sequence (*.csq) to GPRS FTP is:
7)    Start
8)    Application testing-data service-connect-dial up (put phone number #777)
9)    Application testing-data service-session-FTP-get (put web site address, number of ping is 35 )
10)    Application testing-data service-connect-hang up
11)    End

6.    SMS benchmarking (sms mode)
Every mobile station should be connecting with dual com port data cable for this SMS test. First com port will connect as MS and another com port will connect as DC cable.
SMS test should be done at a specific place with stationary mobile station in good radio
Condition for 35 times per simcard for 4 simcards:
The mobile stations will send and receive sms into its own simcards number with following test (on Net):
i.    Mobile station 1 Indosat-starone simcard will send to its own
ii.    Mobile station 2 Telkom-Telkom flexi simcard will send to its own
iii.    Mobile station 3 Bakrie Telkom -Esia simcard will send to its own
iv.    Mobile station 4 Mobile 8 -Fren simcard will send to its own

The SMS command sequence (*.csq) will work on DC cable, and every send sms message should be distinguished by its contents E.g.:
i.    content of indosat-starone : “send sms indosat-starone1”, “send sms indosat-starone2”, “send sms indosat-starone3” etc
ii.    content of Telkom-Telkom flexi : “send sms Telkom-Telkomflexi1”, “send sms Telkom-Telkomflexi2”, “send sms Telkom-Telkomflexi3” etc
iii.    content of Bakrie Telkom -Esia : “send sms Bakrie Telkom-Esia1”, “send sms Bakrie Telkom-Esia2”, “send sms Bakrie Telkom-Esia3” etc
iv.    content of Mobile 8-Fren : “send sms Mobile8-Fren”, “send sms Mobile8-Fren2”, “send Mobile8-Fren3” etc

C.    KPI Benchmarking Formula
Please refer to GSM