Indexing

 is an investment management strategy that attempts to replicate the investment performance of a market index. An index is a statistical measure of a market's value and performance and serves as a benchmark against which an investment manager's performance is judged. . Today,  a large number of index providers, including S&P, Dow Jones, MSCI, Russell, FTSE, and Morningstar, provide a wide range of indexes covering  US and  International stocks,  bonds, and commodities. A well managed, low cost index fund offers investors an excellent, if not optimal, investment vehicle for investing in the overall stock market, in discrete market segments, in the bond markets, and  in the commodity markets.

Index strategy boxes
Benchmark Index Strategy Box [Stock Basics#Style Boxes | Equity]] and fixed income (bond fund) style boxes provide the investor with insight regarding risk versus return. The equity style box is based on market capitalization, while the fixed income style box is based on investment grade quality. These investment styles cannot adequately represent the diverse selection criteria for index funds.

In place of investment styles, index funds are categorized according to the methodology ("rules") used for investment selection. This index fund selection strategy can be categorized using security selection and security weighting rules. Similar to the style boxes for risk vs. return, a 3 x 3 grid is used to categorize index fund strategies using selection vs. weighting.

The only commonality between investment style and index strategy boxes is an easy to understand 3 x 3 grid designed to help make investment decisions. There is no relation between them otherwise.

For example, benchmark indexes occupy the passively managed, market capitalization security weighted segment of the Index Strategy Box.

Index strategy box background and category breakdown are described in Indexing in the 21st Century: Portfolio Solutions Inc..

Structure
An index fund manager attempts to capture market returns by employing a number of management techniques. These include replicating or sampling the index universe of securities, equitizing cash balances to remain 100 percent invested, and by employing trading strategies that minimize transaction costs.

Replication
Indexes measuring large size and mid size companies usually buy and hold all of the stocks comprising a large cap or mid cap index. These stocks are held proportionally in the percentage weight a stock's market value stands in comparison to the market value of the index. Thus if Exxon Corp. has a value representing 3% of the index, an index fund replicating the index would hold a 3% weighting of Exxon in the fund. A replicated index fund should provide an expected return mirroring its index, reduced by the costs of managing the fund and the costs of transacting asset purchases and sales.

Sampling
Indexes which comprise a large number of small illiquid companies or illiquid bonds often make it very costly to fully replicate the index. Thus many small and micro cap index funds, as well as many bond index funds, sample their universe of securities. The sampling attempts to match the size and valuation metrics of the index. Because a sampled index fund does not hold all of the securities in the underlying index, its returns may vary somewhat from those of the index. Such performance variance is termed "sampling error."

Equitization
In order to reduce tracking error to its underlying index, index fund managers attempt to remain fully invested. Almost all mutual funds hold a cash balance, primarily to meet potential fund redemptions by fund investors.

This holding of cash will be a drag on fund returns during any period when stock returns outpace cash returns. Mutual funds hold cash as a result of shareholder cash flows into the fund (before the manager can purchase securities), as a holding from which to pay shareholder redemption of shares, and for active funds, a usual holding when the manager can not find securities of appealing valuation. Mutual funds tend to average 4 to 6 percent cash in their fund portfolios.

The index manager reduces the tracking error of holding cash balances by buying a futures contract (or sometimes an ETF) with the cash holdings. Since a futures contract is leveraged, an index manager can get an index return on a cash balance while waiting to efficiently invest a cash inflow directly into stocks, or to remain liquid in order to meet redemption of fund shares. Here is a simplified example.
 * 1) The index manager has a $500,000 cash balance.
 * 2) The index manager buys an index futures contract placing a $25,000 cash deposit for holding a $500,000 index futures position.
 * 3) The index manager now receives the index return on the futures ($500,000 worth assuming the futures track the index) while maintaining $475,000 cash liquidity from which to meet shareholder redemption requests.

This procedure is known as equitizing cash.

In another example, a manager might place a $10,000 margin deposit on a futures contract valued at $450,000. The manager can then place the remaining $440,000 into a short term interest paying account and still retain full market exposure from the $450,000 futures position.

Low costs


According to the Investment Company Institute, the average expense ratio for US stock mutual funds in 2008 was 1.46% (weighted average 0.84%}, while the average expense ratio for US bond mutual funds was 1.07% (weighted average 0.63%).  Index funds are available to investors for expense ratios of 0.20% and lower from firms such as Vanguard, Fidelity, Schwab, and many Exchange-traded funds . These low expenses mean that a greater portion of market returns accrue to the mutual fund shareholder where they can continue to compound, as opposed to being siphoned off through intermediaries.  As figure 1. demonstrates, indexing's cost advantage builds steadily over long holding periods.

In addition, indexing's consistent low costs result in greater than average relative performance over long holding periods.

In addition to low expense ratios, index funds can provide low transaction costs, which include brokerage commission costs, bid/ask spreads, and market impact costs (institutional purchases and sales can drive the price of a security up or down before the order is filled.)

Index funds reduce transaction costs through:


 * Low fund turnover. The longer the holding period for fund securities, the less trading is required.
 * Cross trading with other index funds. Whenever a stock migrates from one index to another (such as a small cap stock growing into a mid cap stock) an index manager will often trade the stock directly to another index fund, virtually eliminating transaction costs.
 * Patient (Block) trading. Index managers occasionally have the opportunity to offer to buy or sell a large block of thinly traded small company stocks. They can occasionally place an offer at low, or even negative spread costs and have it filled.

Tax efficiency
 More On Tax Efficiency  Vanguard employs two additional mechanisms which improve index fund tax efficiency:
 * 1) For sales of mutual fund securities, Vanguard has selected a HIFO -highest in, first out-  accounting method. This means that the fund securities with the highest tax basis are sold first. This accounting method usually results in the fund realizing a loss or, at worst, a small gain when it sells securities.
 * 2) Most Vanguard index funds have an  exchange traded fund share class. When institutional creation and redemption of ETF shares occurs, Vanguard will select the lowest basis stock for the ETF creation basket and make an in-kind transfer of the securities out of the portfolio. This process gradually increases the tax basis of the remaining fund securities.


 * The tax distribution history of Vanguard Index funds can be found at Vanguard Funds: Distributions.

Due to lower fund turnover and longer holding periods, index funds tend to exhibit greater tax efficiency than actively managed funds. This is especially true for total market index funds, large cap index funds, and large growth index funds. These funds rarely realize and distribute a capital gain (and any small capital gains distributions are usually long term gains taxed at reduced tax rates.) The deferral of capital gains tax liabilities results in a tax-efficient index fund providing higher after tax returns to investors. In addition, since the advent of the tax regime for qualified dividends in 2004, well-managed total market and large cap indexes have been successful in providing investors with 100% qualified dividends, which are taxed at lower tax rates.

While total market, large cap, and large cap growth funds are very tax efficient, it is important to keep in mind that other size (small cap and mid cap) and style (value) indexes are much more likely to distribute taxable gains. When a small cap company grows into a mid cap or large cap company, or a value company becomes a growth company, an index manager will need to sell the stock once the stock migrates out of its current index. Usually this sale will result in the realization of a capital gain. For this reason (and for Value indexes higher dividend payouts) it is often recommended that these funds be placed in tax deferred or tax free retirement accounts.

The 2000-2002 and 2008 bear markets have improved the fundamental tax efficiency of all index funds, by providing substantial realized losses which can be used to offset future realized gains.

Asset class style consistency
Once an investor has crafted an Investment policy statement and decided upon an asset allocation, the investor must then implement the plan by selecting appropriate mutual funds for the planned allocation. In addition to being low cost and tax efficient, index funds make suitable building blocks for asset allocation purposes because they can be trusted to remain reliably close to their declared style parameters. Thus, a US Total Stock Market Index fund will not hold international stocks; and an International Index fund will not hold US stocks. The tendency for funds to shift their center of style gravity is termed "style drift." Often, for example, an active Large Cap fund manager may invest in mid cap and small cap stocks, or add international stocks to the portfolio, or have the valuation style of the portfolio drift from value to growth. Such style drift takes the asset allocation control of the portfolio away from the investor and places it into the unpredictable hands of the fund manager. Another common example of style drift occurs when an active small cap fund grows exceptionally large. The fund usually must buy larger stocks, and will commonly see its center of style gravitate towards a mid cap style.

Many index providers have established trading bands about their size (large, mid, and small) and style (value and growth) indexes. These bands are designed to help index funds reduce turnover and transaction costs. The bands, however, introduce a modest degree of style drift in size and style index funds. The center of style gravity, however does not change. Thus, index funds allow the investor to control the asset allocation decision.

Reduced manager risk
Actively managed funds expose investors to two manager risks.
 * The risk that the manager will under perform the benchmark return,
 * The risk that the manager will leave the fund. For taxable investors, selling a fund after a manager change could result in a large capital gains tax.

Index funds greatly reduce these risks.
 * The risk of under performing a benchmark return is greatly reduced (although not eliminated, due to sampling and tracking errors.)
 * Index funds are managed by an investment team. The departure of a fund manager does not affect the management of the fund.

Simplicity
The low cost,  high tax efficiency, and long term consistency of performance advantages of indexing greatly simplify the task of fund selection and fund monitoring in an investment plan.

Expenses
A crucial advantage for index funds is low costs. Yet expense ratios on like index funds range from less than 0.20% to over 1.00%. It is therefore advisable for investors to select a low cost index fund over a like high cost index fund.

Front running
The economy and the stock markets are dynamic. An index of the market is not static. As companies merge with and/or acquire other companies or fall into bankruptcy, some stocks must be deleted from indexes. As start up companies grow and mature they are added to indexes. For discrete size and style indexes stocks migrate between small cap, mid cap, and large cap indexes, as well as between value and growth indexes. To insure that indexes accurately reflect the market index providers periodically reconstitute the indexes (quarterly or annually.) For index fund managers tasked with mandates to track an index these reconstitution dates require the fund to either purchase or sell the stocks when they are added or deleted from the index. Since index provider's index changes are rules based and often pre-announced, active fund arbitraguers are able to purchase or short the stocks they believe are going to be added to or deleted from the indexes, knowing that the index fund managers are forced to buy or sell the stocks on the day of reconstitution. This strategy is known as index front running. In practice front running imposes market impact costs on index fund managers. Petajisto (2008) has studied this phenomenon from 1990-2005 and has found that the cost of front running increased from 1990-2000, peaking in 2000, and has declined since peaking. Petajisto (2008) conservatively estimates that over the full period the S&P 500 Index cost index funds an average 21-28 (additions/deletions) basis points per year in front running costs. The costs for the Russell 2000 index are estimated at 38-77 (additions/deletions) basis points.

Among the factors that can limit front running costs are the following:
 * 1) Index providers can add trading bands to their size and style indexes,thereby reducing the amount of turnover in the indexes.
 * 2) Index fund managers can use index benchmarks that do not have much indexed investment capital tied to the index.
 * 3) An index fund manager can be given trading freedom around the replication date so that sales and purchases can be executed both before and after the replication date. Such freedom comes at the expense of dutifully tracking the index.

Tracking error
Tracking error is the ultimate measure of judging an index fund manager's performance. Since an index manager does not engage in security selection with an index fund, it is the manager's transactional skill which distinguishes performance. How well the manager uses index futures, cross trading, block trading, and manages trading around index reconstitution determines how close the manager can track the index benchmark.

The risk of large tracking error is greater for index funds which sample the index benchmark. This is especially true for index funds which track narrow market segments or single country international markets. Often such indexes contain a modest universe of securities and it is not uncommon for a single company to dominate the index. The 1940 Investment Company Act establishes diversification rules for mutual funds, and at times these dominant stocks in an index must be sold down to the regulatory holding limit (five-percent). This will obviously increase a fund's tracking error, not to mention increase the possibility for capital gains realization. Surprise events in the markets can also create tracking error for a sampled index, as was the case with the Vanguard Total Bond Index Fund in 2002. The sudden intensification of credit downgrades in mid 2002 resulted in the fund producing a -2.00% tracking error in 2002. The fund was the first retail bond index product offered. Its fortunes hit a snag in 2002, when it underperformed its benchmark by a full 2.00%. The Vanguard Bond Index Funds' Annual Report of 12/31/2002 discusses the situation. 
 * To understand what happened during 2002, one must focus on the remarkable turmoil that beset the bond market and the credit ratings of corporate bonds last summer. Here are a few points that illustrate the severity of the bond market's difficulties during mid-2002:


 * Lehman Brothers recently ranked the 50 worst credit blowups since 1989. (The list was made up of issues whose bonds had the worst one-month performances throughout the 14 years.) Of the 50 debacles, 32 occurred in 2002--and half of the total in July alone!


 * Many companies that suffered financial difficulties saw their bonds' credit ratings fall several notches from investment-grade status to the 'junk' level in a matter of days. Such rapid declines in credit quality struck even relatively healthy companies in troubled sectors.


 * By late summer, the returns of Baa-rated corporate bonds--the lowest level of investment-grade issues--were more than 8 percentage points below those of comparable Treasury securities, based on rolling two-month returns. This was by far the biggest gap since Lehman began tracking the returns in 1988. On two other occasions--during the deep recession of 1990 and the 1998 bond market turbulence that was precipitated by the collapse of hedge fund operator Long-Term Capital Management-- the underperformance of Baa rated bonds approached just 4 percentage points.


 * Although this extremely challenging market environment does not excuse our funds' shortfalls to their indexes, it does help to explain them. For our funds, the trouble began in June and intensified in July. As we explained in our report to you six months ago, our funds' returns will typically differ from those of the indexes for two primary reasons: The funds incur expenses that the indexes do not, and the funds' holdings do not exactly replicate those held by the indexes. The expense difference will always work against us in our goal of providing close tracking. The difference in holdings arises from our 'sampling' approach to indexing, which is necessary because it would be impractical and very costly to own all the bonds in the target indexes.


 * The sampling strategy--in which we buy some, but not all, of the securities in an index--is designed to provide our funds with characteristics that are similar to those of their targets. Our portfolio managers and analysts carefully select bonds so that the funds' weightings among sectors closely match those of the indexes. However, during June and July, the relative performance of some 'subsectors'--in contrast to historical experience--diverged widely. At that time, our funds had larger stakes than their indexes in several subsectors. In particular, at a subsector level we had heavier weightings in bonds issued by telecommunications and energy-trading companies. These groups were hit extremely hard by the WorldCom bankruptcy, the Enron scandal, and accounting irregularities at a number of other companies.


 * In recognition of the radical change in the market's reaction to credit risk, we have made some adjustments to ensure greater diversification and less exposure to lower-quality bonds. For example, we have taken our tight controls on sectors to the subsector level. These changes have already supported closer tracking of our target indexes. 

Index fund characteristics
According to the CFA Institute, securities 'index' should have the following characteristics:


 * Simple and objective selection criteria: There should be a clear set of rules governing the inclusion of bonds, equities, or markets in an index, and investors should be able to forecast and agree on changes in composition of the securities in an index.
 * Comprehensive: The index should include all opportunities that are realistically available to be purchased by all market participants under normal market conditions. Both new and existing securities should have frequent pricing available so the index level can be accurately measured.
 * Replicable: The total returns reported for an index should be replicable by market participants. Over time, an index must represent a realistic baseline strategy that a passive investor could have followed. Accordingly, information about index composition and historical returns should be readily available. It must also be fair to investment managers who are measured against it, and to sponsors who pay fees or award management assignments based on performance relative to it.
 * Stability: The index should not change composition frequently, and all changes should be easily understood and highly predictable. The index should not be subject to opinions about which bonds or equities to include on any particular day. Conversely, index composition is expected to change occasionally to ensure that it accurately reflects the structure of the market. A key virtue of an index is to provide a passive benchmark. As such, investors should not be forced to execute a significant number of transactions just to keep pace.
 * Relevance: The index should be relevant to investors. At a minimum, it should track those markets and market segments of most interest to investors.
 * Barriers to entry: The markets or market segments included in an index should not contain significant barriers to entry. This guideline is especially applicable to an international index in which an included country may discourage foreign ownership of its bonds or participation in its equity market.
 * Expenses: In the normal course of investing, expenses related to withholding tax, safekeeping, and transactions are incurred. For a market or market segment to be included, these ancillary expenses should be well understood by market participants and should not be excessive. For example, if expenses are unpredictable or inconsistently applied, an index cannot hope to fairly measure market performance.