2
Churn Model Performance Dashboard Criterion Count of Subscribers 2,767,960 Scoring Date 9 th Apr 2014 Model KPI Refresh Date 7 th Apr 2014 No. Of KPIs 10 Model Summary •Gini index values are consistent across out of time validation data and scoring data indicating no significant deviation in model performance •Deviation index for Model KPIs as well as Churn Propensity score is with in acceptable threshold limit i.e. (+ or -) 1.25 Model KPI Distribution Criterion Gini index Out of Time Validation Data 0.67 Current Scoring Data 0.61 Gini index Lorenz Curve Descriptive Statistics KPIs Deviation Index Input Deviation TOT_SERVICES_DIFF_DAILY_F1_F6 -0.29 DREC_STATUS_AVG_DAILY_COUNT_F3F5 0.13 TOT_NUM_RECHARGE_AVG_DAILY_F4F6 -0.10 IC_AVG_TOT_CALL_CNT_DAILY_F4F6 -0.17 DREC_STATUS_DIFF_DAILY_COUNT_F4_F6 0.21 SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6 -0.35 OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 -0.04 SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6 -0.02 IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6 0.12 IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 -0.04 Output Deviation CHURN_PROPENSITY_SCORE 0.21 Deciles wise distribution of KPIs-Current KPIs 1 2 3 4 5 6 7 8 9 10 DREC_STATUS_AVG_DAILY_COUNT_F3F5 11.99 1 11.85 4 12.36 3 14.41 6 14.76 6 15.07 9 15.17 4 14.85 3 15.26 8 15.25 4 DREC_STATUS_DIFF_DAILY_COUNT_F4_F6 - 13.31 9 - 13.45 0 - 13.27 8 - 14.35 1 - 13.97 5 - 14.10 0 - 14.26 6 - 14.38 3 - 14.66 1 - 14.14 6 IC_AVG_TOT_CALL_CNT_DAILY_F4F6 75.73 3 74.07 4 60.45 3 116.2 42 118.8 79 134.5 36 105.4 76 181.3 71 182.7 91 147.8 85 IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 .054 .169 .138 .098 .111 .097 .112 .111 .112 .116 IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6 .166 .157 .161 .183 .178 .185 .180 .180 .179 .183 OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 .041 .223 .154 .093 .097 .092 .116 .129 .127 .109 SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6 .037 .068 .080 .063 .068 .074 .073 .080 .077 .081 SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6 .181 .172 .175 .183 .182 .190 .181 .174 .173 .175 TOT_NUM_RECHARGE_AVG_DAILY_F4F6 9.914 9.371 9.020 13.20 7 13.29 5 14.45 4 13.99 1 15.96 3 17.16 6 15.08 7 TOT_SERVICES_DIFF_DAILY_F1_F6 1.371 -.505 -.471 -.553 -.482 -.429 -.395 -.375 -.376 -.363 FRACTIONAL RANK OF CHURN_PROPENSITY_SCORE Case weighted by count Churn Scoring Data (9 th Apr 2014) Case Summaries Maximum Gini 0.61

Dashboard s asssssssssssssssssss sssssssssssssssssssssssssssss aasssssssssssss

Embed Size (px)

DESCRIPTION

asssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaasssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss

Citation preview

Page 1: Dashboard s  asssssssssssssssssss sssssssssssssssssssssssssssss       aasssssssssssss

Churn Model Performance Dashboard

Criterion

Count of Subscribers 2,767,960

Scoring Date 9th Apr 2014

Model KPI Refresh Date 7th Apr 2014

No. Of KPIs 10

Deviation Index For KPIs

Model Summary

Key Takeaways

•Gini index values are consistent across out of time validation data and scoring data indicating no significant deviation in model performance

•Deviation index for Model KPIs as well as Churn Propensity score is with in acceptable threshold limit i.e. (+ or -) 1.25

Model KPI Distribution

Criterion Gini index

Out of Time Validation Data 0.67

Current Scoring Data 0.61

Gini index

Lorenz Curve

Descriptive Statistics

KPIs Deviation Index

Input Deviation TOT_SERVICES_DIFF_DAILY_F1_F6 -0.29DREC_STATUS_AVG_DAILY_COUNT_F3F5 0.13TOT_NUM_RECHARGE_AVG_DAILY_F4F6 -0.10IC_AVG_TOT_CALL_CNT_DAILY_F4F6 -0.17DREC_STATUS_DIFF_DAILY_COUNT_F4_F6 0.21SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6 -0.35OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 -0.04SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6 -0.02IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6 0.12IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 -0.04

Output Deviation CHURN_PROPENSITY_SCORE 0.21

Deciles wise distribution of KPIs-Current

KPIs 1 2 3 4 5 6 7 8 9 10

DREC_STATUS_AVG_DAILY_COUNT_F3F5 11.991 11.854 12.363 14.416 14.766 15.079 15.174 14.853 15.268 15.254

DREC_STATUS_DIFF_DAILY_COUNT_F4_F6-

13.319-

13.450-

13.278-

14.351-

13.975-

14.100-

14.266-

14.383-

14.661-

14.146

IC_AVG_TOT_CALL_CNT_DAILY_F4F6 75.733 74.074 60.453116.24

2118.87

9134.53

6105.47

6181.37

1182.79

1147.88

5IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 .054 .169 .138 .098 .111 .097 .112 .111 .112 .116IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6 .166 .157 .161 .183 .178 .185 .180 .180 .179 .183

OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6 .041 .223 .154 .093 .097 .092 .116 .129 .127 .109SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6 .037 .068 .080 .063 .068 .074 .073 .080 .077 .081SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6 .181 .172 .175 .183 .182 .190 .181 .174 .173 .175TOT_NUM_RECHARGE_AVG_DAILY_F4F6 9.914 9.371 9.020 13.207 13.295 14.454 13.991 15.963 17.166 15.087TOT_SERVICES_DIFF_DAILY_F1_F6 -1.371 -.505 -.471 -.553 -.482 -.429 -.395 -.375 -.376 -.363

FRACTIONAL RANK OF CHURN_PROPENSITY_SCORE

Case weighted by count

Churn Scoring Data (9th Apr 2014)

Case Summaries

Maximum

Gini

0.61

Page 2: Dashboard s  asssssssssssssssssss sssssssssssssssssssssssssssss       aasssssssssssss

Segmentation Model Performance Dashboard

CriterionCount of Subscribers 16,792,258Scoring Date 03rd Apr 2014Model KPI Refresh Date 31st Mar 2014No. Of KPIs 8

Deviation Index For KPIs

Model Summary

Key Takeaways

•Cluster distribution values are consistent across out of time validation data and scoring data indicating no significant deviation in model performance

•Deviation index for Model KPIs is with in acceptable threshold limit i.e. (+ or -) 1.25

Model KPI Distribution

Cluster Code Nomenclature

Cluster 1 Consistent UsersCluster 2 Onnet UsersCluster 3 Offnet UsersCluster 4 Internet SavvyCluster 5 VAS UsersCluster 6 SMS Users

Cluster Nomenclature

Out of Time Validation Current Scored Base

Cluster Distribution Summary

Descriptive Statistics

KPIs Deviation Index

Input Deviation

RATIO_OG_OFFNET_VOICE_CALL_DUR_M1M3 0.06RATIO_OG_ROAM_VOICE_CALL_DUR_M1M3 -0.92RATIO_REV_DATA_USAGE_M1M3 0.77RATIO_REV_MMS_USAGE_M1M3 -0.12RATIO_REV_MUSIC_USAGE_M1M3 -0.81RATIO_REV_OTHER_VAS_USAGE_M1M3 -0.09RATIO_REV_SMS_USAGE_M1M3 -0.20RATIO_REV_VAS_SUBSCRIPTION_M1M3 -0.02

Cluster wise distribution of KPIs-Current

KPIs Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5 Cluster 6

RATIO_OG_OFFNET_VOICE_CALL_DUR_M1M3 .393 .150 .727 .389 .416 .432

RATIO_OG_ROAM_VOICE_CALL_DUR_M1M3 .000 .000 .000 .000 .000 .000

RATIO_REV_DATA_USAGE_M1M3 .088 .072 .082 .858 .123 .106

RATIO_REV_MMS_USAGE_M1M3 .003 .002 .002 .006 .002 .006

RATIO_REV_MUSIC_USAGE_M1M3 .001 .000 .001 .000 .000 .001

RATIO_REV_OTHER_VAS_USAGE_M1M3 .712 .036 .038 .036 .056 .048

RATIO_REV_SMS_USAGE_M1M3 .048 .026 .045 .030 .036 .760

RATIO_REV_VAS_SUBSCRIPTION_M1M3 .072 .033 .046 .224 .705 .063