31

How To Avoid Curve Fitting During Back Testing

Embed Size (px)

Citation preview

Page 1: How To Avoid Curve Fitting During Back Testing
Page 2: How To Avoid Curve Fitting During Back Testing
Page 3: How To Avoid Curve Fitting During Back Testing

The process of testing a trading strategy on

relevant historical data to ensure its viability

Page 4: How To Avoid Curve Fitting During Back Testing

Unfortunately with computerized back

testing we also need to deal with the curse of

curve fitting

Page 5: How To Avoid Curve Fitting During Back Testing

Parameters are tuned so that they produce

optimized results for the historical data

Page 6: How To Avoid Curve Fitting During Back Testing
Page 7: How To Avoid Curve Fitting During Back Testing

Same parameters would yield drastically

reduced or even negative results

Page 8: How To Avoid Curve Fitting During Back Testing
Page 9: How To Avoid Curve Fitting During Back Testing
Page 10: How To Avoid Curve Fitting During Back Testing
Page 11: How To Avoid Curve Fitting During Back Testing

There are three back testing strategies we

can use to alleviate the curve fitting issue

Page 12: How To Avoid Curve Fitting During Back Testing

Optimize one variable at a time

Page 13: How To Avoid Curve Fitting During Back Testing

Optimize over several different

historical data sets

Page 14: How To Avoid Curve Fitting During Back Testing

Optimize the variables on a historical set of

data and then validate by applying them to a different set of data

Page 15: How To Avoid Curve Fitting During Back Testing

We'll focus on theout of sample

testing

Page 16: How To Avoid Curve Fitting During Back Testing

We separate the available historical test

data into two sets

Page 17: How To Avoid Curve Fitting During Back Testing

The first set for computerized back

testing and optimization.

This is called the in-sample period

Page 18: How To Avoid Curve Fitting During Back Testing

The optimized test results are applied to the

untested data set referred to as the

out of sample period

Page 19: How To Avoid Curve Fitting During Back Testing

Typically we use the most recent data for

the out of sample testing

Page 20: How To Avoid Curve Fitting During Back Testing
Page 21: How To Avoid Curve Fitting During Back Testing

Begin by adding your strategies and setting

the optimization parameters

Page 22: How To Avoid Curve Fitting During Back Testing
Page 23: How To Avoid Curve Fitting During Back Testing
Page 24: How To Avoid Curve Fitting During Back Testing
Page 25: How To Avoid Curve Fitting During Back Testing

StrategyPerformance Report

Page 26: How To Avoid Curve Fitting During Back Testing
Page 27: How To Avoid Curve Fitting During Back Testing
Page 28: How To Avoid Curve Fitting During Back Testing

Curve Fitted System Optimized System

Page 29: How To Avoid Curve Fitting During Back Testing

The drawback is the testing is performed over a

limited period of time

Page 30: How To Avoid Curve Fitting During Back Testing

The market may have experienced different

levels of price volatility

Page 31: How To Avoid Curve Fitting During Back Testing

Walk forward testing will be covered in a later video