Backtesting Results
-
- Posts: 1221
- Joined: Wed Oct 03, 2018 8:11 pm
Backtesting Results
I've recently used Portfolio Visualizer to backtest different AAs of asset classes (bonds, stock, international, small cap, mid cap, etc.). Seems like the results are entirely dependent on the time period chosen to backtest.
How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?
How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?
Re: Backtesting Results
One of the ways is to test adding more money periodically, you can set how much and whether it goes up with inflation. This is much more like how real people invest than looking at the growth of $10,000 (or whatever), with nothing ever added, and it makes it less critical which starting point you choose.
Re: Backtesting Results
My personal strategy to avoid cherry picking is to not just look at one investing timeframe but to model all of them simultaneously. Any individual timeframe can unfairly hurt or favor a particular portfolio, but I've found you can learn a lot by studying the full spread of returns. Portfolio Charts is my effort to share that idea with other investors, so hopefully you'll find it as interesting as I do. And if you're looking for one place to start, you might like this article: The Avoidable Mistake of Cherry Picking Data
Last edited by Tyler9000 on Thu Jan 10, 2019 11:23 am, edited 1 time in total.
Re: Backtesting Results
The "best" allocation is unknowable, because your investment horizon is just another time period on the data charts (that we don't have data for yet). The optimal strategy for the next 30 years will only be evident 30 years from now. Ex-ante, the optimal strategy is broad diversification and minimizing costs.justsomeguy2018 wrote: ↑Wed Jan 09, 2019 7:59 pm How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?
- Portfolio7
- Posts: 932
- Joined: Tue Aug 02, 2016 3:53 am
Re: Backtesting Results
You might start by reading about the three fund portfolio in the Wiki. https://www.bogleheads.org/wiki/Three-fund_portfolio
You may also read in the wiki how owning the entire market (at market proportions) is considered to be the most efficient form of investing. Bogleheads tend to favor the three fund portfolio for that reason, though there are many 'acceptable' portfolios. Though some people who frequent the site do maintain different portfolios for a variety of reasons, you may want to start with simple and relatively foolproof. Many experienced investors stay with simple and never complicate their portfolio; there are many very good reasons for this behavior described in the wiki. Warren Buffet's investment partner, Charlie Munger, likes to emphasize that a critical factor in successful investing is avoiding dumb mistakes (I have not always succeeded in doing so). Following the guidance in creating a 3-Fund portfolio will help you do so.
There will always be thousands of portfolios better than yours for any particular sequence of years; It's impossible to pick the best performing asset classes in advance. For that reason it makes sense to pick a portfolio that will tend to do well in most time periods.
You may also read in the wiki how owning the entire market (at market proportions) is considered to be the most efficient form of investing. Bogleheads tend to favor the three fund portfolio for that reason, though there are many 'acceptable' portfolios. Though some people who frequent the site do maintain different portfolios for a variety of reasons, you may want to start with simple and relatively foolproof. Many experienced investors stay with simple and never complicate their portfolio; there are many very good reasons for this behavior described in the wiki. Warren Buffet's investment partner, Charlie Munger, likes to emphasize that a critical factor in successful investing is avoiding dumb mistakes (I have not always succeeded in doing so). Following the guidance in creating a 3-Fund portfolio will help you do so.
There will always be thousands of portfolios better than yours for any particular sequence of years; It's impossible to pick the best performing asset classes in advance. For that reason it makes sense to pick a portfolio that will tend to do well in most time periods.
"An investment in knowledge pays the best interest" - Benjamin Franklin
- Taylor Larimore
- Advisory Board
- Posts: 30173
- Joined: Tue Feb 27, 2007 8:09 pm
- Location: Miami FL
Re: Backtesting Results
justsomeguy2018:justsomeguy2018 wrote: ↑Wed Jan 09, 2019 7:59 pm I've recently used Portfolio Visualizer to backtest different AAs of asset classes (bonds, stock, international, small cap, mid cap, etc.). Seems like the results are entirely dependent on the time period chosen to backtest.
How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?
Be very careful about using Portfolio Visualizer for "backtesting." Our mentor, Jack Bogle, wrote:
"The biggest mistake investors make is looking backward at performance and thinking it’ll recur in the future."
Experienced investors agree.
Best wishes.
Taylor
"Simplicity is the master key to financial success." -- Jack Bogle
- arcticpineapplecorp.
- Posts: 6989
- Joined: Tue Mar 06, 2012 9:22 pm
Re: Backtesting Results
investing by looking backwards is like driving only looking through the rear view mirror.
there are 150 portfolios (or more). See below. One of them is bound to be the best. Problem is, you'll never know until after it's already happened.
https://www.whitecoatinvestor.com/150-p ... han-yours/
Best to pick an allocation and stick with it. If you change too often, you'll never get the returns you should have gotten (it's called "chasing performance").
Better yet, just own the total market (stocks and bonds, in the allocation that is appropriate to your need, ability and willingness to take risk) and call it a day. You could do worse. Don't let the perfect be the enemy of the good enough. When you own the market you get the return of the market. When you own something else, you get something else. Could be better, could be worse. Why take unecessary risk?
there are 150 portfolios (or more). See below. One of them is bound to be the best. Problem is, you'll never know until after it's already happened.
https://www.whitecoatinvestor.com/150-p ... han-yours/
Best to pick an allocation and stick with it. If you change too often, you'll never get the returns you should have gotten (it's called "chasing performance").
Better yet, just own the total market (stocks and bonds, in the allocation that is appropriate to your need, ability and willingness to take risk) and call it a day. You could do worse. Don't let the perfect be the enemy of the good enough. When you own the market you get the return of the market. When you own something else, you get something else. Could be better, could be worse. Why take unecessary risk?
It's "Stay" the course, not Stray the Course. Buy and Hold works. You should really try it sometime. Get a plan: www.bogleheads.org/wiki/Investment_policy_statement
Re: Backtesting Results
I started my boglehead education by doing backtesting with Simba's Spreadsheet.
Eventually I internalized what others here were saying about unpossibility of predicting the future. There is so much diffusion of results the effort is futility. monte carlo simulation is probably a better way to do it. save as much as you can. live well below your means, don't overestimate your risk tolerance, always own a good amount of safe assets (ie. bonds) so you can respond by rebalancing aggresively when equities go on sale which they inevitably be during your lifetime markets. Having a balanced stock AND bond port will cushion the blow when stocks decline 50%
If only 50/50 port suffers only a 25% decline when equities decline by half. This is a huge benefit and can be the difference between panic selling at the bottom vs rebalancing and buying at the bottom. it is very good advice to buy when prices are low!!!!!!
IMHO, The three fund portfolio advocated by tayloe is a very good fit for most investors. 30 years from now it WILL BE POSSIBLE to identify the slice and dice portfolio that will outperform the 3 fund port. but the chances are that the "winning" slice and dice port will not be the one you picked based on back testing. if only forward testing was possible.
Eventually I internalized what others here were saying about unpossibility of predicting the future. There is so much diffusion of results the effort is futility. monte carlo simulation is probably a better way to do it. save as much as you can. live well below your means, don't overestimate your risk tolerance, always own a good amount of safe assets (ie. bonds) so you can respond by rebalancing aggresively when equities go on sale which they inevitably be during your lifetime markets. Having a balanced stock AND bond port will cushion the blow when stocks decline 50%
If only 50/50 port suffers only a 25% decline when equities decline by half. This is a huge benefit and can be the difference between panic selling at the bottom vs rebalancing and buying at the bottom. it is very good advice to buy when prices are low!!!!!!
IMHO, The three fund portfolio advocated by tayloe is a very good fit for most investors. 30 years from now it WILL BE POSSIBLE to identify the slice and dice portfolio that will outperform the 3 fund port. but the chances are that the "winning" slice and dice port will not be the one you picked based on back testing. if only forward testing was possible.
Last edited by CaliJim on Fri Jan 18, 2019 10:10 pm, edited 6 times in total.
-
- Posts: 1221
- Joined: Wed Oct 03, 2018 8:11 pm
Re: Backtesting Results
Mr. Larimore, any AA in particular you recommend?Taylor Larimore wrote: ↑Thu Jan 10, 2019 9:01 pmjustsomeguy2018:justsomeguy2018 wrote: ↑Wed Jan 09, 2019 7:59 pm I've recently used Portfolio Visualizer to backtest different AAs of asset classes (bonds, stock, international, small cap, mid cap, etc.). Seems like the results are entirely dependent on the time period chosen to backtest.
How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?
Be very careful about using Portfolio Visualizer for "backtesting." Our mentor, Jack Bogle, wrote:
"The biggest mistake investors make is looking backward at performance and thinking it’ll recur in the future."
Experienced investors agree.
Best wishes.
Taylor
I am 37 years old. I am generally following the current AA, at the moment:
67% U.S. Equity
13% Intl Equity
20% Total US Bond
Thank you
- Taylor Larimore
- Advisory Board
- Posts: 30173
- Joined: Tue Feb 27, 2007 8:09 pm
- Location: Miami FL
Re: Backtesting Results
justsomeguy2018:justsomeguy2018 wrote:
Mr. Larimore, any AA in particular you recommend?
I am 37 years old. I am generally following the current AA, at the moment:
67% U.S. Equity
13% Intl Equity
20% Total US Bond
Thank you
Your Asset-Allocation appears reasonable to me. I like the fact that it reflects The Three-Fund Portfolio. On the other hand, it is impossible for me to recommend your best asset-allocation. Only you know your goal(s), your time-frame, your risk-tolerance, and your personal financial situation.
Use this link to the Vanguard Investor Questionnaire to help you decide your best Asset-Allocation:
https://personal.vanguard.com/us/FundsI ... unds/tools
Best wishes.
Taylor
"Simplicity is the master key to financial success." -- Jack Bogle
- abuss368
- Posts: 22978
- Joined: Mon Aug 03, 2009 2:33 pm
- Location: Where the water is warm, the drinks are cold, and I don't know the names of the players!
- Contact:
Re: Backtesting Results
I think you have a very simple and sophisticated investment portfolio. The portfolio is low cost and very diversified.justsomeguy2018 wrote: ↑Thu Jan 10, 2019 9:53 pm
I am 37 years old. I am generally following the current AA, at the moment:
67% U.S. Equity
13% Intl Equity
20% Total US Bond
Thank you
The most important decision an investor will make is asset allocation. That is the allocation between stocks and bonds based on goals, timeframe, and tolerance for risk.
Keep investing simple.
John C. Bogle: “Simplicity is the master key to financial success."
Re: Backtesting Results
simplicity!!!!! absolutely great advice.abuss368 wrote: ↑Fri Jan 11, 2019 6:59 pmKeep investing simple.justsomeguy2018 wrote: ↑Thu Jan 10, 2019 9:53 pm
I am 37 years old. I am generally following the current AA, at the moment:
67% U.S. Equity
13% Intl Equity
20% Total US Bond
Thank you
- abuss368
- Posts: 22978
- Joined: Mon Aug 03, 2009 2:33 pm
- Location: Where the water is warm, the drinks are cold, and I don't know the names of the players!
- Contact:
Re: Backtesting Results
CaliJim wrote: ↑Fri Jan 18, 2019 10:11 pmsimplicity!!!!! absolutely great advice.abuss368 wrote: ↑Fri Jan 11, 2019 6:59 pmKeep investing simple.justsomeguy2018 wrote: ↑Thu Jan 10, 2019 9:53 pm
I am 37 years old. I am generally following the current AA, at the moment:
67% U.S. Equity
13% Intl Equity
20% Total US Bond
Thank you

John C. Bogle: “Simplicity is the master key to financial success."
- willthrill81
- Posts: 22530
- Joined: Thu Jan 26, 2017 3:17 pm
- Location: USA
Re: Backtesting Results
You can't. It's as simple as that. You don't know which mix is going to be optimal for the sake of helping you reach your goals in the way in which you want to reach them. This is also true of your asset allocation (i.e. stocks vs. fixed income).justsomeguy2018 wrote: ↑Wed Jan 09, 2019 7:59 pm I've recently used Portfolio Visualizer to backtest different AAs of asset classes (bonds, stock, international, small cap, mid cap, etc.). Seems like the results are entirely dependent on the time period chosen to backtest.
How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?
That's a serious problem with factor investing: you are guaranteed to underperform the market at some point, and this underperformance can go on for years. Unless you're prepared to stick with it, then don't invest in factors and buy the whole market.
“It's a dangerous business, Frodo, going out your door. You step onto the road, and if you don't keep your feet, there's no knowing where you might be swept off to.” J.R.R. Tolkien,The Lord of the Rings
Re: Backtesting Results
That's a good way of explaining it. Predicting the past is so easy, any historian can do it. But when it comes to the future, we'd have to turn to someone more knowledgeable - like an astrologer. Hopefully one with long hair who can chantvenkman wrote: ↑Wed Jan 09, 2019 11:51 pmThe "best" allocation is unknowable, because your investment horizon is just another time period on the data charts (that we don't have data for yet). The optimal strategy for the next 30 years will only be evident 30 years from now. Ex-ante, the optimal strategy is broad diversification and minimizing costs.justsomeguy2018 wrote: ↑Wed Jan 09, 2019 7:59 pm How do you get around cherry picking data to decide upon a "best" allocation (e.g. % to midcap, growth stocks, bonds, emerging markets, etc.)?

- Ben Mathew
- Posts: 1401
- Joined: Tue Mar 13, 2018 11:41 am
- Location: Seattle
- Contact:
Re: Backtesting Results
Using recent performance to determine AA can lead you to overweight asset classes that are overpriced (a recent run-up in price = looks good in a backtest). Focusing on valuations and yields, in conjunction with long term performance (over many decades), can help you develop better forward-looking return estimates.