Is It Better To Be Peaky or Consistent?
Posted by Neil Paine on January 8, 2010
Recently I was reading Bill James' 1994 book The Politics of Glory, about the baseball hall of fame, and he devoted a chapter to the debate of Don Drysdale vs. Milt Pappas. If you're unfamiliar with the players, all you need to know is that Pappas and Drysdale had virtually identical won-loss records (209-166 for Drysdale, 209-164 for Pappas), Drysdale had an ERA+ of 121 vs. Pappas' 110, and Drysdale was inducted into the Hall of Fame with 78.4% of the vote in 1984 after 10 years on the ballot (never receiving less than 21% of the vote), while Pappas received 1.2% of the vote in 1979 and dropped off the ballot forever.
Knowing what sabermetricians know now, there's no doubt Drysdale was a better pitcher than Pappas -- his ERA, FIP, and other component elements of skill and performance were superior to Pappas'. But in the dark ages of the late seventies, the BBWAA was still pretty obsessed with pitcher W-L records when it came to HoF voting, and Pappas actually had the superior record. Besides, even looking back now, was Drysdale that much better than Pappas, to the point that the former starts with 20 times as much HoF support and builds to induction a decade later while the latter drops off the ballot as an afterthought? Why was the perception so markedly different between the two pitchers?
James claims that the difference lies in Drysdale's "peakiness" -- that although Drysdale and Pappas had equal W-L records, Drysdale was able to cluster a larger portion of that production in a handful of seasons (25 wins in 1962, 23 in '65, 6 straight shutouts in '68) which proved far more memorable to the writers than Pappas' 15-ish wins year in and year out were. On the face, this seems unfair, a case of popular perception being dictated more by flash than substance. But James wanted to know if "peaky" pitchers like Drysdale actually contributed more to their teams' pennant chances than a consistent pitcher like Pappas, so he built a simulation that ran fictional careers for two pitchers like Drysdale/Pappas, one of whom had a high peak but little production aside from those seasons, the other with a moderate peak but the same win total because of a longer, more consistent career. In James' study, it turned out that the peaky pitchers, the Drysdales, actually led their team to more pennants than the Pappases, validating the BBWAA's perception that Drysdale was better despite equal career W-L records.
What does any of this have to do with basketball, you ask? Well, I wanted to answer the same question, except instead of a star pitcher, we'll look at an all-star player. I took every player in the Win Shares era who was named to at least 1 All-Star team in their career, and split them into two groups based on the "peakedness" of their career Win Shares distribution. The two groups looked like this after I made sure they both had the same # of career WS:
Peaky | Consistent | |||
---|---|---|---|---|
Year# | MP | WS | MP | WS |
1 | 1980.6 | 4.3 | 1970.3 | 4.2 |
2 | 2279.0 | 5.8 | 2405.6 | 6.6 |
3 | 2535.5 | 7.1 | 2478.8 | 7.5 |
4 | 2498.4 | 7.2 | 2557.9 | 8.0 |
5 | 2580.7 | 7.8 | 2541.4 | 8.1 |
6 | 2601.8 | 7.9 | 2517.3 | 7.8 |
7 | 2462.9 | 7.5 | 2455.8 | 7.4 |
8 | 2505.8 | 7.5 | 2333.6 | 6.6 |
9 | 2370.0 | 7.1 | 2183.9 | 6.0 |
10 | 2356.5 | 6.7 | 2116.6 | 5.9 |
11 | 2278.8 | 6.7 | 2041.3 | 5.6 |
12 | 2175.4 | 6.4 | 1951.5 | 5.3 |
13 | 2028.1 | 5.6 | 1849.0 | 4.9 |
14 | 1904.7 | 4.6 | 1745.4 | 4.6 |
15 | 1979.9 | 4.8 | 1886.2 | 5.2 |
16 | 1719.6 | 4.3 | 1872.7 | 4.7 |
17 | 1373.2 | 3.4 | 1493.8 | 4.4 |
18 | 2095.7 | 6.4 | 1706.6 | 4.9 |
19 | 1373.0 | 4.0 | 1978.3 | 5.6 |
20 | 618.0 | 0.9 | 1390.5 | 2.5 |
Total | 115.8 | 115.8 |
As you can see, both players have the same career value, but the consistent player's career rises, peaks, and winds down gradually, while the peaky player is hot and cold, mixing big years with abruptly mediocre ones, culminating in a big drop-off at the end of his career. Which player do you think would add more to his team's chances of winning an NBA title if he was the lead dog on a team surrounded by average teammates?
Well, like James, I put together a Monte Carlo simulation in which the both players would play out 20-year careers according to the distributions above (with some random fluctuation built into both playing time and per-minute performance) and tracked how many times their teams won the NBA championship. I did this 10,000 times and then tallied the results for both our peaky player and our consistent one. Which one led their team to more titles in 10,000 careers?
Player | Peaky | Consistent |
---|---|---|
#Careers | 10000 | 10000 |
Titles Won | 1751 | 1861 |
% of Years | 0.88% | 0.93% |
Contrary to James' findings in baseball, my simulation found that building around a consistent player whose peaks are not as strong as some of his fellow All-Stars, but whose valleys are not as low, actually led to a greater # of championships than a peaky player whose career was up and down and who couldn't be counted on to be an All-Star caliber player in any given season, especially late in his career. This makes sense if you remember that The Politics of Glory was written before there were wild card teams and an extra round of the playoffs -- in baseball prior to the strike, peak performances often meant the difference between making the playoffs and sitting at home, because teams had very little margin for error (only 4 out of 28 teams made the playoffs in 1993, and for the majority of MLB history only 2 teams advanced beyond the regular season -- you either won the pennant or nothing).
In today's NBA, however, 16 of 30 teams make the playoffs; even when the league only had 23 teams in 1984, 16 made the postseason. So flukish peak performances are not really necessary to carry a team into the postseason, and once there, every team has at least some chance of going all the way. That's why consistency is key -- when surrounded by average teammates (as our All-Stars were in this simulation), you're going to make the playoffs a great deal of the time no matter what, so the ability to not hurt your team once you get to the playoffs is as important as carrying them there in the first place.
Then again, the difference between the two groups was incredibly small, 110 titles in 200,000 seasons. In a 20-year career, that's a difference of just 0.011 championships, essentially negligible. And if you look back at NBA history, maybe the real moral of the story is that it's best to have a player who's "consistently peaky" -- that is, a superstar who plays at an insanely high level every year. Probably the only titles in my lifetime that were led specifically by a Drysdale or a Pappas, and not a freakish megastar hybrid, were a trio of Detroit Pistons championships: 2004 by Chauncey Billups (Pappas), and 1989-90 by Isiah Thomas (Drysdale). Thomas is in the Hall of Fame already, while Billups has just a 25% chance of making it according to our HoF Probability metric. So what do you think, will Mr. Big Shot suffer the same fate as Milt Pappas?
January 8th, 2010 at 11:36 am
Maybe I am looking at your chart too simplistically, but it seems interesting that the "consistent" player's best seasons are better (2 +) than the "peaky" players best seasons (0 8+). In the baseball situation mentoned above, it seemed as though the peaky player had significantly better seasons in his "prime than the consistent player. In general, it seems after all the averaging, the two groups aren't entirely different. I know I am missing something here, but maybe someone can elaborate.
January 8th, 2010 at 11:37 am
Sorry, I meant to say 2 seasons of 8+ WS for the "consistent" player as opposed to 0 seasons of 8+ WS for the "peaky" players
January 8th, 2010 at 11:50 am
No, I noticed that, too. It's almost like, from looking at the numbers, it's hard to tell which was peaky and which was consistent. When I first ran the numbers, the peaky players had the higher, well, peak, but I had to drop their total down to make sure both groups had the same # of WS.
January 8th, 2010 at 1:00 pm
Is this about Reggie Miller?
January 8th, 2010 at 4:49 pm
And yes, it looks like in combining peaky players, who peak at different points in their careers, you've created a model consistent player.
January 8th, 2010 at 5:33 pm
I was going to note the same thing. I think by using large groups of real players, you've lost their unique characteristics. If the peaky player has a lower peak than the consistent player, it seems to defeat the purpose.
It might be worth trying to experiment with invented numbers. How many titles is a player who gets 10 WS a year for 10 years likely to win in comparison with one who gets 5 WS a year for 20 years. Or different variations of that.
January 8th, 2010 at 5:57 pm
I was thinking the same thing, too. I'll do a sequel to this post next week where I create an exaggerated version of each player type and then re-run the simulation. I would imagine we'll see much better results with realistic but fictional career arcs instead of this overly-averaged version.
January 8th, 2010 at 6:29 pm
hmmm maybe i should run the BBR blog.
*kidding* Neil you're the man eff tha haterz
January 8th, 2010 at 7:00 pm
it'd be interesting to have an actual player comparison to make the point, a peaky player who made the hall against a consistent player that didn't... I'm trying to think of two...
January 9th, 2010 at 3:47 am
Neat study, and I hardly think you need to run it again to see that your results tend to match up with James's.
The group that has the two highest single season win shares totals--which is to say the group with the higher peaks--won more championships.
Do you have a season-by-season break down? How many championships did the "peaky" group win in season 1? And how many did the "consistent" group? etc.
I would think you'd see a non-linear relationship: the years where a player has 7 win shares would win more than twice as many championships as the years with a player with 3.5 win shares.
It's been a long time since I read Politics of Glory, but I remember James's point as basically being that you have to be exceptionally good to win a championship, and that--in terms of championships--it's no big difference if you're a little above average or if you suck: in both cases you don't win the ring. That's kind of what you say in the last paragraph about needing a player playing at an insanely high level to win a ring.
January 11th, 2010 at 11:20 am
I don't like peaky as an adjective. Meteoric is apt and is already a word. Nonetheless, I enjoyed the article.