25
Motivation Dynamic factor model Real-time dataset Real-time exercise Summary Nowcasting Czech GDP in Real Time Marek Rusnak Czech National Bank, 12 May 2014 (Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 1 / 29

Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Nowcasting Czech GDP in Real Time

Marek Rusnak

Czech National Bank, 12 May 2014

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 1 / 29

Page 2: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Outline

1 Motivation

2 Dynamic factor model

3 Real-time dataset

4 Real-time nowcasting exercise

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 2 / 29

Page 3: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Nowcasting

GDP is the main measure of the state of the economyProblem: GDP is available only with a lag of roughly 70daysagents need to make decisions in real-timeobtaining the accurate estimates of the current quarter isthus importantCNB uses nowcasts as inputs to the G3 modelCNB comments on the releases of GDP data (and thedeviation of the CNB nowcast)

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 4 / 29

Page 4: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Issues when forecasting in real-time1 Ragged ends

financial data and surveys are timely, hard data typicallyavailably only with a delay

2 Mixed frequenciesGDP quarterly, leading indicators monthly, financials daily

3 Curse of dimensionalitymany potential indicators available, time series are short

4 Revisionsrevisions to national accounts are sizeable, using reviseddata might understate forecast errors

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 5 / 29

Page 5: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

We account for these issues by1 estimating dynamic factor model (alleviates the curse of

dimensionality)2 casting the model into state-space framework (deals with

ragged ends and mixed frequencies)3 using multiple vintages of historical data to assess the

performance of the model in real time

SpecificallyWe use Banbura and Modugno (2013) version of DFM andapply it to Czech data.

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 6 / 29

Page 6: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Related LiteratureNowcasting in real-time: Schumacher and Breitung (2008),Camacho and Perez-Quiros (2010), Banbura et al. (2012)Evidence on short-term forecasting Czech GDP: Arnostovaet al. (2011), Havranek et al. (2012), Horvath (2012)

Contributionfirst to use Czech real-time datarevisiting the discussion about the importance of variousgroups of variablesnowcasting the expenditure components of GDP

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 7 / 29

Page 7: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Monthly dynamic factor model

xt = Λft + εt (1)ft = A1ft−1 + · · · + Apft−p + ut , (2)

Quarterly variablesmodeled by approximation of Mariano & Murasawa (2003)

yQt ≈ 1

3(yt + 2yt−1 + 3yt−2 + 2yt−3 + yt−4)

observations assigned to the last month of the quarter,otherwise treated as missing

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 9 / 29

Page 8: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Estimationmodel estimated by Expectation-Maximization algorithmiterations of two steps:

1 estimate the expectation of log-likelihood conditional onprevious iteration parameters

2 re-estimate the parameters conditional on the likelihoodfrom previous step

initial parameters obtained by replacing missingobservations by N(0,1) draws and estimating principalcomponents on the balanced sample.

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 10 / 29

Page 9: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Real-time dataset99 monthly vintages - first October 2004, last December2012most data start in January 2000data transformed to stationarity - mostly log-differencesstandardized to zero mean and unit variance27 headline variables covering hard data, financialvariables, confidence indicators and foreign environment

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 12 / 29

Page 10: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

No. Group Variable Revisions Pub. Lag Unb. Pat. Source

1 Hard Real GDP Y 68 to 71 4,5,3–4,5,3 OECD2 Hard Industrial production index Y 37 to 45 2–2 OECD3 Hard Construction output Y 37 to 45 2–2 OECD4 Hard Retail Sales Y 35 to 49 2–2 OECD5 Hard Unemployment rate N 8 to 11 1–1 MLSA6 Hard CPI total N 8 to 11 1–1 CZSO7 Hard Exports (current prices) Y 35 to 39 2–2 OECD8 Hard Imports (current prices) Y 35 to 39 2–2 OECD9 Hard Export price index N 43 to 47 3–2 CZSO10 Hard Import price index N 43 to 47 3–2 CZSO11 Financials CZK/EUR exchange rate N 0 1–0 CNB12 Financials M2 Y 30 to 31 2–1 OECD13 Financials Credit Y 30 to 31 2–1 CNB MB14 Financials PRIBOR 3M N 0 1–0 CNB15 Financials PRIBOR 1Y N 0 1–0 CNB16 Financials PX-50 stock index N 0 1–0 PSE17 Financials Czech government bond yield (10Y) N 0 1–0 CNB18 Surveys Consumers confidence indicator N -7 to -2 1–0 CZSO19 Surveys Industry confidence indicator N -7 to -2 1–0 CZSO20 Surveys Construction confidence indicator N -7 to -2 1–0 CZSO21 Surveys Trade confidence indicator N -7 to -2 1–0 CZSO22 Surveys Services confidence indicator N -7 to -2 1–0 CZSO23 Exogenous EURIBOR 3M N 0 1–0 ECB24 Exogenous EURIBOR 1Y N 0 1–0 ECB25 Exogenous Oil price (Brent) N 0 1–0 Datastream26 Exogenous The Ifo business climate Germany N -10 to -4 1–0 IFO27 Exogenous Euro area business climate Y -4 to -1 1–0 EC28 Exogenous Germany exports Y 40 2–2 OECD

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 13 / 29

Page 11: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Vintages of Czech GDP growth

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012-5

-4

-3

-2

-1

0

1

2

3

GD

P g

row

th (

q-o

-q)

Previous vintages (Oct 2004 - Nov 2012)Latest vintage (Dec 2012)

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 14 / 29

Page 12: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Design of the nowcasting exercise

31 nowcasting rounds (first nowcasted quarter: 2005Q1,last: 2012Q3)14 nowcast updates, twice a monthfirst nowcast update Q(-1)M1 mid, last nowcast updateQ(+1)M1 endevaluated against first releases of GDP and against lastavailable vintageparsimonious specification with one factor and twoautoregressive lags

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 16 / 29

Page 13: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

In-sample results: factor loadings

-0.3

-0.2

-0.1

0

0.1

0.2

0.3

0.4

Ind

ust

rial

Pro

du

ctio

n

Co

nst

ruct

ion

Ret

ail S

ales

Un

emp

loym

ent

Rat

e

Co

nsu

mer

pri

ce in

dex

Exp

ort

s

Imp

ort

s

Exp

ort

pri

ces

Imp

ort

pri

ces

CZ

K-E

UR

exc

han

ge

rate M2

Cre

dit

PR

IBO

R 3

M

PR

IBO

R 1

Y

PX

-50

sto

ck in

dex

Go

vern

men

t b

on

d y

ield

(10

Y)

Co

nsu

mer

co

nfi

den

ce

Ind

ust

ry c

on

fid

ence

Co

nst

ruct

ion

co

nfi

den

ce

Tra

de

con

fid

ence

Ser

vice

s co

nfi

den

ce

EU

RIB

OR

3M

EU

RIB

OR

1Y

Oil

Pri

ce (

Bre

nt)

Ifo

bu

sin

ess

clim

ate

Ger

man

y

Eu

ro a

rea

bu

sin

ess

clim

ate

Ger

man

y ex

po

rts

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 17 / 29

Page 14: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Nowcasting Czech GDP

-4

-3

-2

-1

0

1

2

320

05Q

1

2005

Q2

2005

Q3

2005

Q4

2006

Q1

2006

Q2

2006

Q3

2006

Q4

2007

Q1

2007

Q2

2007

Q3

2007

Q4

2008

Q1

2008

Q2

2008

Q3

2008

Q4

2009

Q1

2009

Q2

2009

Q3

2009

Q4

2010

Q1

2010

Q2

2010

Q3

2010

Q4

2011

Q1

2011

Q2

2011

Q3

2011

Q4

2012

Q1

2012

Q2

2012

Q3

GD

P g

row

th (

q-o

-q)

GDP growth (First Release)GDP growth (Dec 2012 vintage)CNB nowcastDFM nowcast

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 18 / 29

Page 15: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Out-of-sample performance

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6R

MS

E

Q(-

1) M

1 m

id

Q(-

1) M

1 en

d

Q(-

1) M

2 m

id

Q(-

1) M

2 en

d

Q(-

1) M

3 m

id

Q(-

1) M

3 en

d

Q(0

) M

1 m

id

Q(0

) M

1 e

nd

Q(0

) M

2 m

id

Q(0

) M

2 e

nd

Q(0

) M

3 m

id

Q(0

) M

3 e

nd

Q(+

1) M

1 m

id

Q(+

1) M

1 en

d

DFMBridgeRWAR(2)MA(4)CNB

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

RM

SE

Q(-

1) M

1 m

id

Q(-

1) M

1 en

d

Q(-

1) M

2 m

id

Q(-

1) M

2 en

d

Q(-

1) M

3 m

id

Q(-

1) M

3 en

d

Q(0

) M

1 m

id

Q(0

) M

1 e

nd

Q(0

) M

2 m

id

Q(0

) M

2 e

nd

Q(0

) M

3 m

id

Q(0

) M

3 e

nd

Q(+

1) M

1 m

id

Q(+

1) M

1 en

d

DFMBridgeRWAR(2)MA(4)CNB

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 19 / 29

Page 16: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Out-of-sample performance: subsamples

Full Sample Pre-Crisis Crisis(2005Q1-2012Q3) (2005Q1-2008Q2) (2008Q3-2012Q3)

Q(-1)M3 end Q(0)M3 end Q(-1)M3 end Q(0)M3 end Q(-1)M3 end Q(0)M3 end

Evaluated using first releases of GDP growthRandom Walk (absolute RMSE) 1.23 0.93 0.48 0.39 1.61 1.21RMSE relative to RWBridge 0.82 0.96 1.07 1.22 0.80 0.93DFM 0.63 0.53 1.01 0.94 0.59 0.48CNB 0.56 0.52 0.94 0.84 0.52 0.48Combination CNB & DFM 0.54 0.47 0.91 0.86 0.51 0.42Evaluated using GDP growth in December 2012 vintageRandom Walk (absolute RMSE) 1.27 0.93 0.78 0.74 1.56 1.06RMSE relative to RWBridge 0.92 1.13 1.08 1.12 0.88 1.13DFM 0.75 0.79 1.05 1.04 0.68 0.67CNB 0.67 0.74 1.02 0.96 0.58 0.65Combination CNB & DFM 0.68 0.74 1.01 0.99 0.58 0.61

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 20 / 29

Page 17: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

What drives the performance of the model? (first releases)

0

0.2

0.4

0.6

0.8

1

1.2

1.4

Q(-

1) M

1 m

id

Q(-

1) M

1 en

d

Q(-

1) M

2 m

id

Q(-

1) M

2 en

d

Q(-

1) M

3 m

id

Q(-

1) M

3 en

d

Q(0

) M

1 m

id

Q(0

) M

1 e

nd

Q(0

) M

2 m

id

Q(0

) M

2 e

nd

Q(0

) M

3 m

id

Q(0

) M

3 e

nd

Q(+

1) M

1 m

id

Q(+

1) M

1 en

d

RM

SE

Random WalkBaselineWithout FinancialsWithout SurveysWithout Exogenous

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 21 / 29

Page 18: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

What drives the performance of the model? (Dec 2012 vintage)

0

0.5

1

1.5

Q(-

1) M

1 m

id

Q(-

1) M

1 en

d

Q(-

1) M

2 m

id

Q(-

1) M

2 en

d

Q(-

1) M

3 m

id

Q(-

1) M

3 en

d

Q(0

) M

1 m

id

Q(0

) M

1 e

nd

Q(0

) M

2 m

id

Q(0

) M

2 e

nd

Q(0

) M

3 m

id

Q(0

) M

3 e

nd

Q(+

1) M

1 m

id

Q(+

1) M

1 en

d

RM

SE

Random WalkBaselineWithout FinancialsWithout SurveysWithout Exogenous

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 22 / 29

Page 19: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

News analysisallows to analyze the forecast updates that result from newdata releaseswe decompose the forecast update in 3 parts

1 the effect of reestimation: y ′ − y0

y0 - old data, old unbalancedness pattern, old parametersy ′ - old data, old unbalancedness pattern, new parameters

2 the effect of data revisions: y ′′ − y ′

y ′′ - new data, old unbalancedness pattern, new parameters3 the news: y1 − y ′′

y1 - new data, new unbalancedness pattern, new parameters

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 23 / 29

Page 20: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Contribution of news to nowcast updates: 2012Q3

-1

-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

20

12-

4 m

id

2012

- 4

end

2012

- 5

mid

2012

- 5

end

2012

- 6

mid

2012

- 6

end

2012

- 7

mid

2012

- 7

end

2012

- 8

mid

2012

- 8

end

2012

- 9

mid

2012

- 9

end

2012

-10

mid

2012

-10

end

2012

-11

mid

2012

-12

mid

2013

- 6

mid

Hard dataFinancialsSurveysExo IndicatorsReestRevisionsDFM NowcastCNB NowcastFlash estimateFirst releaseLatest vintage

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 24 / 29

Page 21: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Nowcasting expenditure components of GDP: 2009Q1-2012Q3

GDP Consumption GFCF Gov. Cons. Exports Imports

Evaluated using first releases of GDP growthRandom Walk (absolute RMSE) 1.19 1.01 6.12 2.07 4.86 5.15RMSE relative to RWCNB 0.47 1.28 0.68 0.85 0.80 0.91DFM 0.48 1.14 0.75 0.75 0.96 1.05Combination CNB & DFM 0.42 1.10 0.68 0.66 0.75 0.83Evaluated using GDP growth in December 2012 vintageRandom Walk (absolute RMSE) 0.90 1.64 5.57 1.84 3.96 3.70RMSE relative to RWCNB 0.62 0.80 0.63 0.95 0.89 1.04DFM 0.69 0.78 0.74 0.86 0.90 1.12Combination CNB & DFM 0.58 0.73 0.64 0.75 0.67 0.80

DFM seem to nowcast consumption and gov. cons. better, adds valuealso for exports and imports

of course, different sets of variables might be used depending on acomponent (e.g. based on an experience of relevant sectoral expert)

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 25 / 29

Page 22: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Summarywe evaluated performance of medium-scale DFM modelover 2005-2012 periodperformance of DFM model in real-time is comparable tojudgemental nowcasts by CNBDFM seems to add valuable info in addition to CNBnowcaststhe role of foreign data is crucial for the performance of themodelDFM performance comparable for the expenditurecomponents

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 26 / 29

Page 23: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

Thank you for your attention!

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 27 / 29

Page 24: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

References IARNOSTOVA, K., D. HAVRLANT, L. RUZICKA, & P. TOTH (2011): Short-TermForecasting of Czech Quarterly GDP Using Monthly Indicators.Czech Journal of Economics and Finance (Finance a uver) 61(6): pp. 566–583.

BANBURA, M., D. GIANNONE, M. MODUGNO, & L. REICHLIN (2012): Now-Castingand the Real-Time Data Flow.Working Papers ECARES 2012-026, ULB – Universite Libre de Bruxelles.

BANBURA, M. & M. MODUGNO (2013): Maximum likelihood estimation of factormodels on data sets with arbitrary pattern of missing data.Journal of Applied Econometrics (forthcoming).

CAMACHO, M. & G. PEREZ-QUIROS (2010): Introducing the euro-sting:Short-term indicator of euro area growth.Journal of Applied Econometrics 25(4): pp. 663–694.

HAVRANEK, T., R. HORVATH, & J. MATEJU (2012): Monetary transmission and thefinancial sector in the Czech Republic.Economic Change and Restructuring 45: pp. 135–155.

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 28 / 29

Page 25: Nowcasting Czech GDP in Real Time · performance of the model in real time Specifically We use Banbura and Modugno (2013) version of DFM and apply it to Czech data. (Czech National

Motivation Dynamic factor model Real-time dataset Real-time exercise Summary

References II

HORVATH, R. (2012): Do Confidence Indicators Help Predict Economic Activity?The Case of the Czech Republic.Czech Journal of Economics and Finance (Finance a uver) 62: pp. 398–412.

MARIANO, R. S. & Y. MURASAWA (2003): A new coincident index of businesscycles based on monthly and quarterly series.Journal of Applied Econometrics 18(4): pp. 427–443.

SCHUMACHER, C. & J. BREITUNG (2008): Real-time forecasting of German GDPbased on a large factor model with monthly and quarterly data.International Journal of Forecasting 24(3): pp. 386–398.

(Czech National Bank, 12 May 2014) Nowcasting Czech GDP in Real Time CNB Research Open Day 29 / 29