Case study: the S&P 500
The S&P 500 is the default meaning of "the market": the benchmark every fund is measured against, the underlying of the world's largest funds and deepest derivatives, and the compounding machine most long-term wealth plans quietly assume. This case study takes it apart: what the index actually is, what its record honestly looks like with the disasters left in, why it grows at all, and the mechanics of owning it.
What the index actually is
- A committee's list. S&P's index committee selects ~500 large US companies meeting rules on size, liquidity and profitability (an earnings requirement famously delayed Tesla's entry to late 2020). It is not the 500 largest by decree: judgment is involved, which surprises most people.
- Float-weighted. Each company's weight is its market value of freely tradable shares over the total. Consequence one: winners weight themselves up automatically (a structural momentum tilt, no rebalancing needed to ride a winner). Consequence two: the index's character shifts with leadership eras: energy-heavy in 1980, tech-heavy now.
- A replacement engine. Companies exit by shrinkage, acquisition or failure; new leaders enter. Roughly 20-25 names turn over in a typical year, so the 2026 index shares little with 1980's: the index survives its members, a quiet survivorship machine that individual portfolios do not natively have.
- Price vs total return. The quoted level ignores dividends. Long-run, dividends reinvested are a large fraction of the outcome: always analyze TOTAL return, and distrust any long-horizon chart that does not.
The honest record
long-run CAGR (1926- ): ~10%/yr (~7% real, after inflation)
$1 compounding at 10% for 40y: $45
...but delivered as:
best years: +30 to +50% worst years: -37% (2008), -43% ('31)
1966-1982: ~0% REAL for 16 years (the inflation grinder)
2000-2013: ~0% price return for 13 years (two 50% crashes inside)
frequency: ~-10% most years; -20%+ every ~4-6y; -50% ~2x/generationBoth halves of the record matter equally. The 10% is real, and so are the 13 years of nothing: an investor who needs the money on a schedule the market does not honor experiences the same index entirely differently, which is why the portfolio-construction guide starts from objectives and horizon, not from the average.
Why it grows: the engine, itemized
nominal GDP growth flowing to revenues ~5-6% + margin expansion (secular, esp. post-1990) ~1% <- may not repeat + buybacks shrinking share counts ~1-2% + dividend yield ~2-4% historically, ~1.3% now + the replacement engine (losers out, leaders in) +/- valuation change the joker on any horizon
Nothing mystical: aggregate earnings per share compound, and price follows earnings over long horizons even though it ignores them over short ones. The honest caveats professionals attach: today's starting dividend yield is historically low and margins historically high, so decomposition math argues for expecting somewhat BELOW the historical 10% from today's starting point; and the valuation term dominates any single decade, which is why the same machine produced 18%/yr in the 1990s and ~0% in the 2000s.
The crashes, catalogued
| Event | Drawdown | Recovery, and the lesson |
|---|---|---|
| 1929-1932 | -86% | The generational tail case; leverage turned a crash into ruin |
| 1973-74 + inflation era | -48%, then years of real erosion | Inflation is the equity killer that price charts hide |
| Oct 1987 | -34% (one day: -20%) | Liquidity events need no recession; recovery took ~2 years |
| 2000-2002 dot-com | -49% | Valuation matters: the index at ~25x+ delivered a lost decade |
| 2007-2009 GFC | -57% | Correlations go to one; the system itself can be the risk |
| Mar 2020 COVID | -34% in 23 days | Fastest bear ever, fastest recovery ever: policy response now part of the system |
| 2022 rate shock | -25% | Bonds fell WITH stocks: the diversification regime flipped with inflation |
Every entry was, at the time, a plausible reason to exit permanently, and the investors who did locked in the one outcome the index itself never delivered. The behavior-gap studies (see the Behavioral Finance guide) estimate ordinary investors captured meaningfully less than the index earned, mostly by selling inside this table's rows and rebuying above them. The index's record is only available to whoever can hold through the column marked drawdown.
Concentration: today's live issue
Float weighting means the index IS its leaders, and by the mid-2020s the top ten names, dominated by the AI-era platforms, reached roughly a third or more of the total weight, with the top name alone at times above 7%: levels at or beyond every prior concentration era (the Nifty Fifty, 2000). Two honest readings coexist: this is the replacement engine WORKING (the biggest weights are the era's most profitable companies, not speculative shells), and simultaneously a buyer of "the diversified market" now holds a substantial single-theme position in AI infrastructure. The equal-weight version of the same 500 stocks has at times diverged from the cap-weighted index by double digits in a year, which IS the concentration, measured. An index holder today should at least know which bet they are carrying; the factor-regression habit from the Quant track answers it in one afternoon.
How people actually own it
- Index funds and ETFs. The core instruments track the index for expense ratios of a few basis points, with tracking differences near zero: the cheapest large financial product in history. The ETF checklist from the funds guide still applies (spread, securities lending, the exact index tracked).
- Dollar-cost averaging vs lump sum. Historically, lump-sum investing beat spreading it out about two-thirds of the time (markets rise more often than not), but averaging in buys regret insurance that keeps real humans invested: a behavioral trade, and often the right one.
- Derivatives around it. The index carries the world's deepest futures and options markets, which is where the hedging ladder's explicit-insurance rung (index puts, collars) is actually implemented.
- Variants. Equal-weight (dilutes the concentration, tilts smaller), the total-market funds (add the small/mid tail; behave nearly identically), and global ex-US complements for the home-bias question the FX guide raises.
- The tax detail. ETF structure (in-kind creation/redemption) makes index ETFs unusually tax-efficient for taxable accounts: part of why the wrapper won.
What it is not
The index is not a savings account (see the drawdown table), not a guarantee (Japan's index needed ~34 years to reclaim its 1989 peak: the US record is one country's sample), not diversification across asset classes (it is one asset class, concentrated in one country's largest firms), and not passive in effect: buying it today is an active bet on continued US large-cap dominance and on its current leaders. It has simply been the best default equity engine available, at the lowest cost, for anyone with a horizon long enough to pay volatility's toll, which is exactly how the portfolio-construction guide slots it: the core, sized by objectives, hedged by the ladder, held through the table above.
- Index methodology
- The rulebook an index fund tracks: what qualifies, how it weights, when it rebalances. The rulebook IS the strategy; the fund's name is marketing.
- CAGR
- Compound annual growth rate: the single yearly rate that turns the starting value into the ending one. The honest summary of a track record, unlike the average of yearly returns, which volatility inflates.
- Maximum drawdown
- The deepest peak-to-trough loss in a period. The risk number investors quit over, and the one with cruel arithmetic: -50% needs +100% to repair.
- Volatility drag
- The gap between average and compound returns, roughly half the variance: +50% then -33% averages +8.5% and compounds to nothing. The mathematical reason wild rides underperform their marketing.
- Survivorship bias
- Testing on today's members means testing only on survivors; the delisted and bankrupt are missing, and they are what a strategy would have bought on the way down.
- Expense ratio
- The fund's annual fee as a share of assets. The visible cost; tracking difference and trading spreads are the rest of the bill.
- Tracking difference
- What a fund actually lagged (or beat) its index over a period, netting fees, replication choices and securities-lending income. The honest cost number, and often smaller OR larger than the expense ratio.
- Creation / redemption
- The ETF mechanism: hand in the basket, receive shares, or the reverse. It is why ETF liquidity is really the underlying market's liquidity wearing a ticker.
- Behavior gap
- The measured difference between fund returns and what investors in those funds actually capture, several points a year in some studies: the cost of buying euphoria and selling panic, on a schedule.
- Equal weight (1/N)
- The zero-estimation allocation: same weight to everything. Has repeatedly embarrassed sophisticated optimizers out of sample, because no estimation means no estimation error.
- Fund flows
- Money moving into and out of funds, published weekly. Flows chase performance with a lag, so extreme inflows into a theme often date its late innings; index inclusion flows are forced buying on a schedule.
- Nominal vs real
- Nominal counts dollars; real counts purchasing power, which is nominal with inflation removed. The rule: discount nominal cash flows at nominal rates and real at real, never mixed.