University of Coimbra ● University of Minho ● ONRH Europe Discovery Summit 2017, Prague 21-23 March 2017

World State of Quality (WSQ): Multivariate Statistical Contributions

Marco S. Reis (a), Catarina Cubo (b), Paulo Sampaio (b),

João d’ Orey (c), Pedro M. Saraiva (a)

(a) CIEPQPF, Department of Chemical Engineering, University of Coimbra, Portugal (b) University of Minho, Portugal (c) National Observatory of Human Resources, Portugal

Prague, 21-23 March 2017

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Outline

1. Scope & Motivation i. A Scale Taxonomy of Quality Issues

ii. The European Quality Scoreboard model

2. Analysis & Results i. Exploratory data analysis: PCA/Clustering

ii. Predictive modelling: PLS/Stepwise regression

3. Final remarks

SCOPE & MOTIVATION

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Distance (m)

Time (s)

10-9 10-6

10-3 100

103

Regions Counties

106

World Countries

10-3

100

Minutes, 102

Hours, 103

Months, 106

Years, 107

MicroQuality

MesoQuality

MacroQuality

A Scale Taxonomy of Quality Issues

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Literature review/data collection/brainstorming

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Quality Dimensions: 10

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Indicators (enablers):

Dimensions:

Indicators (results):

21 indicators

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Goal

• Establish an international quality-oriented ranking of performances achieved by different countries – Assess their maturity on quality-related performance

– Characterize the different profiles in terms of contributions to the overall level of quality achieved

• Pilot study: European Union countries: 28 EU countries.

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

World State of Quality Report: 2016 European Quality Scoreboard

• Website: – http://wsq.dps.uminho.pt/

• Report available at: – http://wsq.dps.uminho.pt/eqs_report2016/eqs_report2016.pdf

ANALYSIS & RESULTS

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Data set

• Macroquality data set: 28×21 – 28 EU countries

– 21 indicators of quality (from 10 different dimensions)

• Ranking data – Lead to the (Overall) European Quality Scoreboard Ranking Scores

(OEQS) (weighted average of the ranks in each indicator)

• Scaled data (meaning of the variation is consistent)

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Principal Components Analysis (PCA)

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Principal Components Analysis (PCA)

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Clustering

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Country-specific Quality profiles

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Country-specific Quality profiles

• The Scandinavian way

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Country-specific Quality profiles

• The Central Europe

& British Way

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Exploratory data analysis: Country-specific Quality profiles

• The Southern/Eastern

European way

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Modelling: Predicting the quality of life satisfaction

• PLS

• Excluding: – JOB

SATISFACT. INDEX

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Modelling: Predicting the quality of life satisfaction

• PLS / #LV=1

• Excluding: – JOB SATISFACT. INDEX

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Modelling: Predicting the quality of life satisfaction

• Stepwise

regression

• Excluding: – JOB SATISFACT. INDEX

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Modelling: Predicting the quality of life satisfaction

• Stepwise

regression

• Excluding: – JOB SATISFACT. INDEX

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Modelling: Predicting the quality of life satisfaction

• Stepwise

regression

• Excluding: – GLOBAL

INOVATION INDEX

– GLOBAL COMPETITIVENESS INDEX

– JOB SATISFACTION INDEX

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Modelling: Predicting the quality of life satisfaction

• Stepwise

regression

• Excluding: – GLOBAL

INOVATION INDEX

– GLOBAL COMPETITIVENESS INDEX

– JOB SATISFACTION INDEX

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Analysis of rankings

• Overall EQS* Ranking Scores (OEQS) – Based upon the positions occupied by each country

– Weighted averages of the ranking positions for each indicator

– Weights provided following a survey made to a panel of experts

* European Quality Scoreboard

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Analysis of rankings

• Correlation between OEQS ranking and PC1

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Quality leader

Quality follower

Quality modest

Quality beginner

Classification

Non-EU country

The rankings’ geography

FINAL REMARKS

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Final Remarks

• European Union ranking results:

– “World Class Quality Countries”: Northern countries

– “Developing Quality Countries”: Eastern countries

• No single country outperforms or underperforms the others for all the indicators considered, each of them presenting relative strengths and weaknesses

• Each country or region can easily identify improvement areas according to their WSQ score

• The World State of Quality model is a good approach to compare the MacroQuality level between countries

• The WSQ could be an important input for several institutions, such as worldwide quality associations and promoters, national governments and other organizations (like OECD, ITC, …)

Europe Discovery Summit 2017, Prague 21-23 March 2017 University of Coimbra ● University of Minho ● ONRH

Acknowledgements

http://www.eq.uc.pt/~marco/research/pclab/