Upload
bala-sri
View
24
Download
0
Embed Size (px)
DESCRIPTION
asssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaasssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss
Citation preview
Churn Model Performance Dashboard
Criterion
Count of Subscribers 2,767,960
Scoring Date 9th Apr 2014
Model KPI Refresh Date 7th Apr 2014
No. Of KPIs 10
Deviation Index For KPIs
Model Summary
Key Takeaways
•Gini index values are consistent across out of time validation data and scoring data indicating no significant deviation in model performance
•Deviation index for Model KPIs as well as Churn Propensity score is with in acceptable threshold limit i.e. (+ or -) 1.25
Model KPI Distribution
Criterion Gini index
Out of Time Validation Data 0.67
Current Scoring Data 0.61
Gini index
Lorenz Curve
Descriptive Statistics
KPIs Deviation Index
Input Deviation TOT_SERVICES_DIFF_DAILY_F1_F6 -0.29DREC_STATUS_AVG_DAILY_COUNT_F3F5 0.13TOT_NUM_RECHARGE_AVG_DAILY_F4F6 -0.10IC_AVG_TOT_CALL_CNT_DAILY_F4F6 -0.17DREC_STATUS_DIFF_DAILY_COUNT_F4_F6 0.21SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6 -0.35OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 -0.04SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6 -0.02IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6 0.12IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 -0.04
Output Deviation CHURN_PROPENSITY_SCORE 0.21
Deciles wise distribution of KPIs-Current
KPIs 1 2 3 4 5 6 7 8 9 10
DREC_STATUS_AVG_DAILY_COUNT_F3F5 11.991 11.854 12.363 14.416 14.766 15.079 15.174 14.853 15.268 15.254
DREC_STATUS_DIFF_DAILY_COUNT_F4_F6-
13.319-
13.450-
13.278-
14.351-
13.975-
14.100-
14.266-
14.383-
14.661-
14.146
IC_AVG_TOT_CALL_CNT_DAILY_F4F6 75.733 74.074 60.453116.24
2118.87
9134.53
6105.47
6181.37
1182.79
1147.88
5IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 .054 .169 .138 .098 .111 .097 .112 .111 .112 .116IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6 .166 .157 .161 .183 .178 .185 .180 .180 .179 .183
OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 .041 .223 .154 .093 .097 .092 .116 .129 .127 .109SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6 .037 .068 .080 .063 .068 .074 .073 .080 .077 .081SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6 .181 .172 .175 .183 .182 .190 .181 .174 .173 .175TOT_NUM_RECHARGE_AVG_DAILY_F4F6 9.914 9.371 9.020 13.207 13.295 14.454 13.991 15.963 17.166 15.087TOT_SERVICES_DIFF_DAILY_F1_F6 -1.371 -.505 -.471 -.553 -.482 -.429 -.395 -.375 -.376 -.363
FRACTIONAL RANK OF CHURN_PROPENSITY_SCORE
Case weighted by count
Churn Scoring Data (9th Apr 2014)
Case Summaries
Maximum
Gini
0.61
Segmentation Model Performance Dashboard
CriterionCount of Subscribers 16,792,258Scoring Date 03rd Apr 2014Model KPI Refresh Date 31st Mar 2014No. Of KPIs 8
Deviation Index For KPIs
Model Summary
Key Takeaways
•Cluster distribution values are consistent across out of time validation data and scoring data indicating no significant deviation in model performance
•Deviation index for Model KPIs is with in acceptable threshold limit i.e. (+ or -) 1.25
Model KPI Distribution
Cluster Code Nomenclature
Cluster 1 Consistent UsersCluster 2 Onnet UsersCluster 3 Offnet UsersCluster 4 Internet SavvyCluster 5 VAS UsersCluster 6 SMS Users
Cluster Nomenclature
Out of Time Validation Current Scored Base
Cluster Distribution Summary
Descriptive Statistics
KPIs Deviation Index
Input Deviation
RATIO_OG_OFFNET_VOICE_CALL_DUR_M1M3 0.06RATIO_OG_ROAM_VOICE_CALL_DUR_M1M3 -0.92RATIO_REV_DATA_USAGE_M1M3 0.77RATIO_REV_MMS_USAGE_M1M3 -0.12RATIO_REV_MUSIC_USAGE_M1M3 -0.81RATIO_REV_OTHER_VAS_USAGE_M1M3 -0.09RATIO_REV_SMS_USAGE_M1M3 -0.20RATIO_REV_VAS_SUBSCRIPTION_M1M3 -0.02
Cluster wise distribution of KPIs-Current
KPIs Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5 Cluster 6
RATIO_OG_OFFNET_VOICE_CALL_DUR_M1M3 .393 .150 .727 .389 .416 .432
RATIO_OG_ROAM_VOICE_CALL_DUR_M1M3 .000 .000 .000 .000 .000 .000
RATIO_REV_DATA_USAGE_M1M3 .088 .072 .082 .858 .123 .106
RATIO_REV_MMS_USAGE_M1M3 .003 .002 .002 .006 .002 .006
RATIO_REV_MUSIC_USAGE_M1M3 .001 .000 .001 .000 .000 .001
RATIO_REV_OTHER_VAS_USAGE_M1M3 .712 .036 .038 .036 .056 .048
RATIO_REV_SMS_USAGE_M1M3 .048 .026 .045 .030 .036 .760
RATIO_REV_VAS_SUBSCRIPTION_M1M3 .072 .033 .046 .224 .705 .063