Showing posts with label secret sauce. Show all posts
Showing posts with label secret sauce. Show all posts

Monday, September 28, 2009

Partial Postseason Prognostication

With only a week remaining in the MLB regular season and only two races still undecided - the AL Central and NL Wild Card - we're seeing more and more articles seeking historical trends that predict postseason success. Last week, we linked to Lisa Swan's article about strong Septembers and Flip Flop Fly Ball's chart displaying the correlation (or lack thereof) between the having the best record during the regular season and winning the World Series.

Well late last week and over the weekend a few more of these pieces popped up and here are three of them (all via BBTF):

Similar to the chart at FFFB, Tom Verducci sorted the last 9 World Series winners by their regular season record and found an almost perfectly even distribution of League Championship pennants and World Series Victories. One championship came from each of the top 7 seeds and two came from teams seeded 8 or higher, such as the 2006 Cardinals who had the 13th best record in the league that year but still won the WS.

It's a pretty rough measure for a couple of reasons. The first, which Verducci points out himself, is that the teams don't play balanced schedules so teams get as much credit for the record in the NL Central as they do in the AL East, and so forth. Secondly, in 2006 for instance, four of the best 5 records came out of the American League. As a result there was an artificially higher chance of a low seed winning a pennant and a World Series (which happened with the Cardinals) since three of them were on one side of the bracket.

----

Next up, Dave Cameron wrote a piece for Wall Street Journal's website which showed that over the last 7 years, the teams that won the World Series have had a relatively small amount of meaningless games leading up to the postseason.

Dave quantifies "meaningless" games as ones that were played after their team has locked up a postseason berth either by winning their division or securing the Wild Card, but doesn't count ones that factor in the race for homefield advantage or are played against potential postseason opponents. Those certainly are played with a higher level of effort and urgency that the ones the Yankees are about to play against the Royals, one would assume. As Rob Neyer points out, 7 years is also a pretty small sample size.

----

Lastly, we have a piece by Lincoln Mitchell in The Faster Times which would seem to fly directly in the face of the half-baked theory proposed by Jeff Pearlman that we took issue with last week. Mitchell attempts to identify the team with the best two starters each year and concludes that since 1995, that club has won the World Series only twice.

There are problems with this methodology as well. ERA+ is not a bad measure but it certainly is not conclusive in determining the team with the best two starters when the postseason rolled around. Furthermore, if we wanted to do more of a complete assessment, we would rank each team's top two pitchers, or better yet give them a score on a scale of, say, 1-10 which would more accurately display the difference between each duo. In some years the top two hurlers for the best team might get a "9" and the next best team only receives a 6, but a straight ranking wouldn't convey that. Once the scores were determined then we could look at the results and see how they correlated with postseason success. Then we might have a better picture of how having two dominant starters predicts playoff series victories.

----

Do you notice a theme developing here? These methodologies are all pretty incomplete. A huge part of the problem is that baseball is littered with variables, there is no control group and you can't just create situations and run them over and over. Of course it's much easier to point out the deficiencies of these findings than take the time to complete the analysis.

All of these writers are admittedly taking a "quick and dirty" type of approach to their analysis and that's completely understandable. At one point, I started a post that was similar to Lisa Swan's about finishing the regular season on a high note (but I wanted to look over the last 10, 15 and 20 games as opposed to the final month) but as soon as I figured out how many tedious calculations I was going to have to do and how much time it would take me to do even a couple years worth of analysis, I scrapped it.

Another factor that makes it difficult to go more in-depth is that, ideally, you want to have a point when you are done with your research. These pieces were written for online outlets where time is always of the essence. You don't want to spend a bunch of time and at the end of the post have to say, "Through all of this research I determined that there is no noticeable correlation in the data."

And this brings me back to a piece that we looked at back at the end of August by Jay Jaffe of Baseball Prospectus. Jaffe brought up the research conducted by Nate Silver and Dayn Perry that lead to the creation of BP's Secret Sauce and applied it to this year's playoff picture. The difference here is that the Silver and Perry went into their research testing all sorts of variables and determined that strong defense, a pitching staff with a high K/9 and strong closer all had high correlation to postseason success. The Secret Sauce is the closest thing we have to a scientific study of what teams are "built for the playoffs" and it's still fairly incomplete.

In all likelihood the Yankees will take the long ALDS, so we still have over nine days before the first postseason pitch is thrown. We're to see more attempts at unlocking the postseason code and they'll probably be pretty interesting. But I highly doubt any of them are going to take the time to shift our thinking with a truly in-depth study of what October baseball really comes down to. Let's just try to enjoy the fact that the Yanks can coast home, throw out their B and C line ups and take things as they come.

Monday, August 24, 2009

About Those Chickens...

Jay Jaffe of Baseball Prospectus did not heed Matt's advice from this morning when penning this column for New York Magazine, applying BP's "Secret Sauce" for postseason success to this year's Yankees. The formula, developed by Nate Silver and Dayn Perry, isolates three key variables that have predicted team's outcomes in the postseason more accurately than others over the past 30 years:
They found that age and postseason experience had no effect on a team’s chances; surprisingly, they also found no significant correlation between any measure of team offense (including bunting and stealing) and postseason success. What they did find important were three measures of pitching and defense, which they called the “Secret Sauce”.
The best predictors of October glory are a pitching staff with a high strikeout ratio, a strong team defense and a solid closer. Since scoring is depressed in the postseason, it's valuable to have a pitching staff that avoids bats, a defense that can save runs and a closer than can lock down victories. Jaffe does a great job of explaining in detail why these factors increase in importance in the playoffs and concludes (emphasis mine):
None of this is meant to knock the offense, which has helped make them a near-lock for the playoffs. But it’s the Secret Sauce that bodes well for their chances once they get there. The last time the team made such a drastic leap in the Sauce rankings was 1996—which, fans will remember, was the end of their last excruciatingly long World Series drought.
Since Jaffe is a BP guy, he's not concerned with jinxes and is speaking in no uncertain terms because their odds have the Yanks' odds of making the postseason are at 99.4%.

The leap he's talking about comes mainly from a jump from 26th to 3rd in Fielding Runs Above Average and a big boost in K/9. The increase in strikeouts is obviously driven by the acquisitions of CC Sabathia and A.J. Burnett but the cosmic leap in defense is harder to explain. Even with Derek Jeter suddenly above average at short and Hideki Matsui, Jason Giambi, and Bobby Abreu out of the field all together it's hard to imagine the Yankees jumping 23 slots in that ranking.

Do I trust the rankings implicitly? No, but it certainly is encouraging to know that the Yanks have a team built for success not only in the regular season, but into October as well. Whether or not that translates into anything this year remains to be seen. Those are the chickens that Jaffe doesn't dare to count either.