Aly, the breadth data from past is useful, but I do not think it compares exactly to the ones today. Due to the computerized trading, the order flow is very even now and they can push all stocks together without an amazing amount of liquidity. Although the liquidity in this market place is pretty strong. Given that the breadth measures the broad flow of liquidity, it is obvious how the computerized trading of today cannot possibly compare to the data from past.
For example, if you can find the data, find the program trading volume on NYSE over the past 10 years and see how the breadth thrusts behave in proportion to the program trading. For one there was less volume today than any day of the week [edit: for the points gained], and we had a record reading on NYSE. I am not saying the market will not go higher or the market is weak, I am only saying from a quantitative perspective, the past stats do not seem to be a good comp to me going forward.
Probably the data from 2004 and on is a good comparison. Why? If you get a chance, examine the VOLUME of tick data from 2004 until today and you will see, the amount of tick activity has grown exponentially, the exchanges are trading almost all instruments now although the volume has not proportionally grown the same way. This tells me that, once again, the computerized trading is evenly distributing the liquidity very very efficiently today than say merely 5 years ago, and it is exponentially better than say 10 years ago...
There are some problems with your argument that "this time is different," arbman. Here are a few of them:
Due to the computerized trading, the order flow is very even now and they can push all stocks together without an amazing amount of liquidity. Although the liquidity in this market place is pretty strong. Given that the breadth measures the broad flow of liquidity, it is obvious how the computerized trading of today cannot possibly compare to the data from past.
1. You're contradicting yourself here. On the one hand, you say the market can be pushed at once. However, this should not be possible in a very liquid market - which you concede this is. So, which is it? I think we need to be clear on the fact that high-frequency traders and other liquidity providers are normally delta neutral by the time the market closes each day - and that is also when breadth numbers are compiled. The exception to this is that some liquidity providers will take an active position overnight or longer if they have an extremely strong edge based off of what professional buy-side money is doing - however, this has been the case throughout market history.
2. Between the beginning of 1988 and the end of 2007, there was, for the most part, a distinct absence of breadth thrusts on the SPX despite a massive increase in computerized trading. This includes your 2004 period.
3. Recent breadth thrusts have been performing as well as they were prior to their long absence during the '90s and for most of the '00s.
This is my biggest problem with your argument, and the only one that really matters. The proof is in the pudding. So far, the performance numbers do not back up what you have to say.
By the way, keep in mind that an extreme move in breadth based on the last 40+ years of historical data will also qualify as an extreme move (more extreme, in fact) on historical data since 2004 or whatever year you'd like to choose. We are talking about breadth changes that are more than two standard deviations from the mean on data going back to 1970. They are extremely rare in the big picture, although, not unlike today, there were clusters of them in the late '70s and early '80s as well (near the end of the last secular bear market) - interestingly enough.
Also, I have yet to see a useful or meaningful relationship between volume during the occurrence of a breadth thrust and the success of that breadth thrust when looking at backtests. Perhaps the thresholds for meeting breadth thrust requirements are so high so as to not cause an issue in this regard. Or perhaps its because the shortest time frame in which a breadth thrust can occur is two days, and that multiple days of low volume market activity are still sufficiently meaningful. Whatever may be the case, there is simply lack of evidence of a meaningful relationship.
Let's talk more facts and less opinions, folks - or at least back up your opinions with facts.