The ESF Model (ESF: Econometric Semiconductor Forecast) · 2018-11-28 · –Tetlock:...

1©Hilltop Economics, LLC

Please do not redistribute without permission

The ESF Model(ESF: Econometric Semiconductor Forecast)

Real Time Forecasting Lessons-Learned

AUBER ANNUAL MEETINGOctober 2018

Duncan MeldrumHilltop Economics LLC

Duncan.Meldrum@hilltopeconomics.com

*Based on Consensus Economics, Inc. CONSENSUS FORECASTS®

Outline

• Forecast process

• Lessons Learned

• Semiconductor MSI measure– Data analysis – pch, unit roots, trends, etc.

– Seasonal adjustment

• Model philosophy

• Model system & key final demand drivers

• Alternative Models

• ESF historical performance

Forecast Process

• Analyze data after new quarterly MSI data release• Evaluate past forecasts against latest actual data• Validate model and equation structures with latest

actual data• Update Consensus Forecasts for World Economy, key

U.S. inputs• Update non-Consensus forecasts• Produce preliminary forecast for team discussion• Create alternative model quarterly forecast (ARIMA,

Book-to-bill, MIDAS models)• Develop final forecast for MSI

Process

Lessons Learned• I will (almost) always be “wrong” – (but not by much).

– Tetlock: Superforecasting: The Art and Science of Prediction is right: open-mindedness is critical.

• Judgment and flexibility regarding modeling techniques and forecast preparation are essential

• The process is as important as the modeling– A model I can understand almost always produces better forecasts than a

model I can’t understand

• Tracking the forecast and adjusting for errors is key to a good forecast– One quarter ahead: use time-series & Midas to adjust– Downplay anecdotal evidence not substantiated by any data, but… – Pay attention to comments back from the users of the forecasts

• For the MSI and semiconductor industry measures:– Seasonal adjustment gets the variability– Final demand is more important than immediate markets

• There is too much “noise” in the immediate markets• Data availability in immediate markets is questionable

Please do not redistribute without permission 5

96 98 00 02 04 06 08 10 12 14 16 18

SEMIMSI

Fitted Trend (Log)

Million Square Inches

Semiconductor Measure: MSI From SEMI.ORGSemiconductor wafers shipped for semiconductor applications

95Q1-18Q2: 2.2% Average quarter change

12.5% Standard deviation (+/-)5.8% Trendline growth rate per year

Distribution of MSI Quarterly Percent Changes

-40 -30 -20 -10 0 10 20 30 40 50 60 70 80

Series: PCH_SEMIMSI

Sample 1995Q1 2018Q2

Observations 94

Mean 2.271178

Median 2.636729

Maximum 79.36170

Minimum -36.33527

Std. Dev. 12.39935

Skewness 1.947261

Kurtosis 18.68398

Jarque-Bera 1022.855

Probabilit

Census X-13 Analytical Results:MSI: 95-18Q2

Seasonal Factor Analysis

96 98 00 02 04 06 08 10 12 14 16 18

SEMI MSI

Seasonally Adjusted (X-13)

Source: Semi.org

Hilltop Economics LLC seasonal adjustment

Model as of Aug 2018

Q1 Q2 Q3 Q4

Means by Season

SEMI MSI SEASONAL IMPACT

History 1995Q1 to 2018Q2

Becoming Less Seasonal

Model Philosophy• Semiconductors a dynamic but maturing industry

– Technological change (“supply side”) no longer creates large step-changes in MSI demand.

– Chips ubiquitous in products– Products ubiquitous in global regions

• Final Demand a valid driver of MSI– Demand driven by “final demand” – consumers and businesses using

technology products • Consumption • Investment

– Consumers & businesses buy technology products based on economic factors, so MSI can be modeled similar to other dynamic but maturing materials and products.

• Final Demand is best forecast by the global Consensus Forecasts of key (85) economies– “Wall Street credibility”

Some Key Immediate End-use Markets(The “typical” industry forecast drivers)

08 09 10 11 12 13 14 15 16 17 18 19

Smart Phones

Smart Phones (Scenario 2)

Source:

History: Estimated from Gartner & IDC news releases

Forecast: Hilltop Economics, September 2018 Update

Estimated Global Smartphone Sales

Annual Percent Change

2016 2017 2018 2019 2020

5.2% 2.6% - 0.8% -1.7% 4.5%

04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19

Estimated PC Units

September 2018 Update

Source: Hilltop Economics

Shaded area indicates main period of tablet penetration

Estimated Global PC Sales

Annual Percent Change

2016 2017 2018 2019 2020

-7.0% -2.3% 1.1% -0.4% -2.3%

96 98 00 02 04 06 08 10 12 14 16 18

Servers

Source: Gartner news releases

MSI VS “World” Real GDP.94 Correlation From 95Q1 to 18Q2, Level Log-Log

Note, however, penetration moderation 2011-2016

80,000

70,000

60,000

50,000

40,000

96 98 00 02 04 06 08 10 12 14 16 18

SEMIMSI

World Real GDP

94% Correlation

MSI VS Real Investment.952 Correlation From 95Q1 to 17Q3, Level

Slightly better correlation, slightly lower growth multiple

18,000

16,000

14,000

12,000

10,000

96 98 00 02 04 06 08 10 12 14 16

SEMI MSI

Real Investment, 45 Consensus Countries

Million Square InchesBillion 2010 US$

95-17Q3

95.2% correlation

MSI Multiple: 1.7X

MSI Block: The Core Model Structure

• Error Correction Model (ECM) system

– MSI seasonal adjustment model (Census X-13 Tramo/Seats) to capture “typical” seasonal patterns.

– Long run MSI-final demand embedded equation

– Short run MSI-dynamic cyclical equation to capture excursions from underlying long-run relationships

• Driven by exogenous inputs and models of final demand, plus any necessary supply-side developments.

Consensus Forecasts:

Global Real GDPInvestment Consumption

US Real GDP & Potential GDPReal Investment Real ConsumptionInflation & Interest Rates

ESF Model System(ESF: Econometric Semiconductor Forecast)

MSI Block ofEquations

PC & Smartphones

US Investment & ConsumptionEquations

US Tech Goods

Seasonal Factors(Census X-13)

Spending Propensity:Business TechConsumer Tech

Tablet Penetration, WinXP, Win10 Timing, Replacement

Cycles, Financial crash behavior

Economic PolicyUncertainty

(US, EU, China)

Inventory-Shipments:* PCs & Peripherals

* METI Wafers

Semiconductor:Capacity: Total, 300

Reclaim: % Total

Src: Hilltop Economics

Long Run Embedded Equation

• Seasonally-adjusted MSI modeled as a function of key inputs:– “Global” ex US investment and consumption– US technology goods spending (business & consumer)– Global PC and smartphone unit sales– Economic Policy Uncertainty (Global)– Interest rates– Semi wafer capacity estimates (total, VNAND

introduction)– METI I-S ratios (wafers)– Behavioral dummies: financial collapse & 9/11

Short Run Cycle Equation

• Quarterly rate of change in MSI modeled as a function of key inputs:– Deviation from long run embedded equation estimates– Rate of change in key long run inputs:

• Global final demands• US Tech• PCs & smartphones• Economic policy uncertainty

– Rate of change in US inventory-shipments ratio for computers & peripherals, METI I-S ratio

– Special events measures (9/11, Financial Crisis onset, Win10)

– Rate of change in SEMI capacity measure and impacts from 300mm and VNAND intorductions (lagged one Qtr)

Unit Root Test: Log(SEMI MSI) does not

have a unit root

The Long-run Embedded MSI EquationAug 18: Adjusted R-square: .986 D-W: 1.76 SER: 4.2% MAPE: 3.9%

The Long-run Embedded MSI EquationNov 17: Adjusted R-square: .986 D-W: 1.76 SER: 4.2% MAPE: 3.9%

Long-run EmbeddedEquation

Dynamic Error Correction Equation

Dynamic Fit 98Q3-18Q2

In-sample Forecast

Consensus Forecasts®

©Consensus Economics, Inc. produces four major reports covering the world economy:

1) Developed World

2) Asia-Pacific

3) Latin America

4) Eastern Europe

Hilltop Economics, LLC uses these reports with permission to create a global economic forecast of real GDP, real investment and real consumer spending.

ESF customers are encouraged to subscribe to Consensus Forecasts ® for the macroeconomic information needs.

Process

Typical Country Output:

Key concepts for ESF forecast:

• Gross Domestic Product

• Personal Consumption

• Business Investment

• Consumer Prices

• Producer Prices

Interest Rates (on second page of document, not shown)

Process

2014 2015 2016 2017 2018 2019 2020

June Forecast

September Forecast

World* Real GDP Growth

2017: 3.1% 2018: 3.1% 2019: 3.0% 2020: 2.7%%

*W orld: 85 major economies,

Forecast: W orld Bank, Hilltop Economics based on

Consensus Forecasts, June 18/September 18

Examine Changes to Consensus Forecasts

*World: 85 countries in Consensus Forecasts. Source: November Consensus, IMF, Hilltop Economics

Process

Increased Uncertainty Raises Downside Risk

Process

98 00 02 04 06 08 10 12 14 16 18

Europe

Source: Scott Baker, Nicholas Bloom and Steven J. Davis

at www.PolicyUncertainty.com. Data through Sep 18

<- Financial Crisis

Economic Policy Uncertainty

Conservative Projections of U.S. Behavior 15Q4

96 98 00 02 04 06 08 10 12 14 16

Consumer (LEFT SCALE)

Business Investment

Percent of Consumption/Investment

Spent on Technology Goods (US)

Process

Conservative Projections of U.S. BehaviorA judgmental input based on recent trends

Process

90 92 94 96 98 00 02 04 06 08 10 12 14 16 18 20

Business Investment

Consumer Spending

Based on U.S. Bureau of Economic Analysis data to 18Q2

Shaded areas indicate U.S. recessions (NBER)

Updated Monthly For U.S. NIA Releases

Process

06 07 08 09 10 11 12 13 14 15 16 17 18 19

U.S. Business Investment (P&E)

U.S. Technology Equipment

History: U.S. Bureau of Economic Analysis

Sep 2018 Forecast: Hilltop Economics

Shaded areas indicates official U.S. recession

Tracking the Alternatives

Actual

“ESF”

Ranges

2 Std Dev

Book-to-Bill: Latest 3 months

MIDAS: Latest 3 months

Add factors

Seasonal factors

Previous month’s forecast

Actual

“ESF”

Ranges

2 Std Dev

Add factors

Seasonal factors

Actual

“ESF”

Ranges

2 Std Dev

Add factors

Seasonal factors

Actual

“ESF”

Ranges

2 Std Dev

Add factors

Seasonal factors

Actual

“ESF”

Ranges

2 Std Dev

Add factors

Seasonal factors

Graphic Examination of Forecasts

I II III IV I II III IV I II III IV I II III IV I II III IV

2016 2017 2018 2019 2020

SEMIMSI

SEMI MSI (Scenario 2) - ECM

SEMIMSI_2M+SEMIMSI_2S

SEMIMSI_2M-SEMIMSI_2S

SEMIMSI_2M+SEMIMSI_2S*2

SEMIMSI_2M-SEMIMSI_2S*2

SEMIMSI_F_18Q3 - ARIMA

How Well Does this Forecast Process Work?The August ESF forecast a weaker Q3 than developed

II III IV I II III IV I II III IV I II III IV I

2015 2016 2017 2018 2019

SEMI MSI

ESF 2018 Q2

ESF 18Q2 over-forecast by 1.5%

(3207 forecast vs 3160 actual)

History: SEMI to 18Q2

Forecast: ESF 2018 Q2 (May)

Performance

How Well Does this Forecast Process Work?Last November’s Forecast VS Actual

IV I II III IV I II III IV I II III IV I II III IV

2012 2013 2014 2015 2016

SEMI MSI to 16Q3

2015 Q4 Forecast

Performance

Now 23 Forecasts Since the First Forecast (of 2012Q4)

II III IV I II III IV I II III IV I II III IV I II III IV I II III IV I II III IV I

2012 2013 2014 2015 2016 2017 2018 2019

SEMIMSI Q4 2012 ESF Forecast MSI

Q1 2013 ESF Forecast MSI Q2 2013 ESF Forecast MSI

Q3 2013 ESF Forecast MSI Q4 2013 ESF Forecast MSI

SEMI MSI Feb 14 ESF SEMIMSI_MAY14

SEMIMSI_AUG14 SEMIMSI_NOV14

SEMIMSI_FEB15 SEMIMSI_MAY15

Performance

Summary Performance

Cumulative Error on LEVELS (FCST VS ACTUAL)

1 Quarter Ahead

2 Quarters Ahead

3 Quarters Ahead

4 Quarters Ahead

8 Quarters Ahead

ESF: Average % Error

-1.1% -0.8% -0.9% -0.8% -0.6%

ESF: Mean Absolute % Error

2.4% 2.4% 2.6% 2.6% 2.6%

ARIMA Average % Error

-0.5% -0.9% -1.2% -1.3% -2.4%

# Forecasts 23 22 21 20 16

Performance

Lessons Learned• I will (almost) always be “wrong” – (but not by much).

– Tetlock: Superforecasting: The Art and Science of Prediction is right: open-mindedness is critical.

• Judgment and flexibility regarding modeling techniques and forecast preparation are essential

• The process is as important as the modeling– A model I can understand almost always produces better forecasts than a

model I can’t understand

• Tracking the forecast and adjusting for errors is key to a good forecast– One quarter ahead: use time-series & Midas to adjust– Downplay anecdotal evidence not substantiated by any data, but… – Pay attention to comments back from the users of the forecasts

• For the MSI and semiconductor industry measures:– Seasonal adjustment gets the variability– Final demand is more important than immediate markets

• There is too much “noise” in the immediate markets• Data availability in immediate markets is questionable

The ESF Model (ESF: Econometric Semiconductor Forecast) · 2018-11-28 · –Tetlock:...

Documents

The Slavery Debate in Antebellum America: …faculty.haas.berkeley.edu/tetlock/Vita/Philip Tetlock...ANTEBELLUM AMERICA 117 power and disparaging marginal groups within their own soci-ety

Private Banker Ausgabe · Superforecasting In dem 2015 veröffentlichten Buch „Superforecasting. The Art and Science of Prediction“ stellte der kanadische Psychologe und Politikwissenschaftler

ESF 6610ROW NLAFWASAUTOMAAT GEBRUIKSAANWIJZING 2 ESF

Word Power: A new approach for content analysis · PDF fileLiterature Review Bag-of-Words Approach – Tetlock (2007), Tetlock, Saar-Tsechansky, and Macskassy (2008) Harvard Psychosociological

POLO 1 - EXTREMO OESTE - - UNASUS · 9 ESF Angela Guerra Dias ... 13 ESF Eduardo Costa 14 ESF Emanuela Casagrande Piazza ... 18 ESF Karylou Michelle Cipriani Weiss

Critical Review TETLOCK AND COUNTERFACTUALS: SAVING

ESF 2. Communications 1. Purpose 2. Concept of Operations Management/ESF-02-Comm… · ESF 2. Communications ESF 2 Communications_final Dec2009.doc ESF 2-1 ESF 2. Communications 1

How Americans Think About Trade: Reconciling …faculty.haas.berkeley.edu/tetlock/Vita/Philip Tetlock/Phil Tetlock... · How Americans Think About Trade: Reconciling Conflicts Among

· Incumplimientos Registrados Cía. ESF SLI AMX ESF VOI AIJ ESF AMX AMX AMX AMX AMX VOI AMX VOI AMX SLI SLI AMX AMX MCS ESF ESF AMX SLI AIJ ESF

Tetlock 1999 AJPS Th

The Journal of the Australian Institute for Professional … · 2018-04-04 · Superforecasting: The Art and Science of Prediction, by Phillip Tetlock and Dan Gardner Good Hunting:

ESF 2020. Eidgenössische in Luzern ESF 2020 Eidgenössische in Luzern 6. ESF 1832 16. ESF 1853 37. ESF 1901 44. ESF 1939 50. ESF 1979 58. ESF 2020

ANEXO II VAGAS DIPONÍVEIS E RESPECTIVAS ......ESF VARGEM GRANDE 00 + CR 117. ESF VERA CRUZ 03 + CR 118. ESF VILA ANÁLIA 01 + CR 119. ESF VILA ATLÂNTIDA 01 + CR 120. ESF VILA ATLÂNTIDA

Adestella Investment Management 9.39% 97.12%Superforecasting: the Art and Science of Prediction, authors Dan Gardner and Phillip Tetlock recount a comment made by famous psychologist

VITA - Wharton Faculty › wp-content › ... · VITA PHILIP E. TETLOCK Office: Psychology Department and Wharton School University of Pennsylvania Philadelphia, PA, 19104 tetlock@wharton.upenn.edu

Faculty Bios | Berkeley Haasfaculty.haas.berkeley.edu/tetlock/vita/Philip Tetlock... · 2005-06-15 · Created Date: 6/15/2005 9:10:21 PM

ESF-10 Debris Management Support of ESF-3

ESF Funding Workshop Tuesday 7 th April 2015. ESF Funding Mary Irish – ESF Contract Manager

April 30, 2001 17:28 Annual Reviews AR130-04 P1: FUM ...faculty.haas.berkeley.edu/tetlock/Vita/Philip Tetlock/Phil Tetlock... · liﬁes earlier error-and-bias portraits of the foreign

Your name 11/6/2019 - ESF | SUNY ESF