Evaluation of score functions for selective editing of Annual

Structural Business Statistics

Jeffrey Hoogland

Statistics Netherlands

WP. 42

Selective editing

Select records for manual editing that are likely to contain influential errors

Score functions

– Distance between observed values and reference values of variables

– Influence of record on publication totals

Block score functions– Monitor block of variables in questionnaire – Assess risk and influence of values of

variables

Ratio score functions – Monitor ratios of key variables in questionnaire – Assess risk of ratios

Aims of evaluation study

– Evaluate error detection of current and earlier score functions for ASBS of Statistics Netherlands – Compare results with other evaluation studies – Learn how to optimize parameters of score functions

Conclusions

– Are there structural differences in the size of undetected errors across score functions?

No: - between block score functions

- between ratio score functions

Yes: - between block and ratio score functions

dependent on the variable

– Keep score functions simple – Quality of reference values plays a crucial role