Batter's Box Interactive Magazine Batter's Box Interactive Magazine Batter's Box Interactive Magazine
I'm sure you all know by now that the Jays lost 3-2 to the Stinky Devil Fish because of a blown save by Miguel Batista.

I think it's time I admitted to something that a few of you already know: Miguel Batista is my least favourite player in all of baseball. I can't stand watching him.

Then why am I always defending his performance? Because he never stinks as bad as I expect him to, so I'm quite often pleasantly surprised.

That doesn't really make sense - I admit it's a complete blind spot on my part. My dislike of Batista goes back to his days as an Expo. He was possibly the most inconsistent pitcher I've ever seen in a Montreal uniform. Some games, he'd look like Cy Young reincarnate. Other games, I don't think he could get me out. And I stink. This assessment is probably unfair - Craig B has pointed out that Felipe Alou was continually jerking Batista around from starting to short relief to long relief. It's possible that Batista would have found consistency if he had been left in a role for longer than a month. But he never was and after a couple painful years he was traded to the Royals for the immortal Brad Rigby.

I think we all have these blind spots, even us objective seamhead types. In fact, there's a number of really bad statistical arguments many of us have given in the past. I thought I'd illustrate a few of them. I've probably committed all of these in the past, so if you think I'm taking shots at you, I'm not. Honest! :) (If I wanted to make fun of the BBox crew, I'd mock their politics).

Anyhow, on to the bad arguments!

Using OPS when there are far better metrics available

It's pretty common knowledge that OPS puts far too much weight on slugging and not nearly enough on on base percentage. Yet it's constantly used, when far better metrics are available on Baseball Prospectus and The Hardball Times.

The one place where I think using OPS is defensible is when discussing splits, such as "Close and Late" or "vs. left", since Prospectus doesn't offer a VORP vs. Lefties stat. Even then, it's probably more helpful to offer the entire AVG/OBP/SLG line.

Using Rate Stats to Show the Value over an Often Injured Player

I have to admit, this one drives me right up the wall. You often see things like:

Player A: .300/.400/.520
Player B: .280/.375/.490

With the conclusion that Player A is obviously better. But he's not necessarily. I'd rather have 160 games from B than 70 from A, all else being equal. You see this argument a lot from fans of guys like Nick Johnson and Corey Koskie.

The only really fair comparison between an everyday player and an often injured one is achieved through a counting stat, such as VORP or Win Shares. It may be that 120 games of Nick Johnson is more valuable than 160 games from almost anyone else. VORP will tell you that - you don't need to resort to an apples vs. oranges comparison.

Of course, maybe you're using the rate stats to say "If oft injured Player X played a full season, look how valuable he'd be!", which is valid. Then again, imagine how valuable David Bush would be if he had another 5 mph on his fastball!

Using a Single Component Stat to Argue the Value of a Player

You see this most often with pitchers, though occasionally you'll get it with hitters too. Sure, John-Ford Griffin's 60 walks are impressive. But his 138 strikeouts and .252 batting average have to count against him - you need to know more than how many times he's walked.

The most common argument is "such and such a pitcher is great because of his high K/IP ratio". Strikeouts are possibly the most important stat for a pitcher, but you need to consider other ones, such as walks and homeruns allowed. You can be a Hall of Fame level talent and still be less than spectacular in any one component. Nolan Ryan walked everyone and their brother. Bert Blyleven had years where he couldn't keep the ball in any park. Including Yellowstone. Jim Palmer *never* struck out more than 200 guys in a season.

If you want to judge the value of a pitcher in a single stat, you need to use something that takes into all kinds of different factors. DIPS is a minimum, something like VORP is probably a lot more valuable.

Discounting Performance Due to Park

This is something I'm often guilty of. Yes, park effects are important. But at the same time, there is no park in the major leagues that will turn in a scrub into a superstar. If you hit .330 in Coors, then chances are you're going to hit for a high average somewhere else. If you play a full year in Comerica and only hit 3 homeruns, it's not all the park's fault.

By using a rate or counting stat that takes into account park effects, you won't end up mentally overcompensating for parks, like I so often do.

Your Thoughts

Are there any blind spots (statisical or otherwise) that you're willing to own up to? Are there any you see on the Inter-web that drive you nuts?
Miguel Batista and Blind Spots | 13 comments | Create New Account
The following comments are owned by whomever posted them. This site is not responsible for what they say.
Andrew K - Sunday, September 04 2005 @ 09:53 AM EDT (#127366) #
But is VORP an accurate measure either? I'm thoroughly unconvinced. Sure, it might be somewhat better than OPS or DIPS or whatever, and it might have park adjustment built in, but it's an additional error to assume that *any* of these statistical measures captures the full worth of a player, even the really complicated ones. Personally, I do believe in "intangibles" such as character, and I think they count for a fair amount.

Anyway, for me (with my statistician hat on) the most egregious baseball analysis error is

a. ignoring sample size,

or even worse,

b. pointing out to the reader that the sample size is small, and then using the data anyway.

And the second most egregious error is to ignore type II errors (i.e. not performing a power analysis) when drawing a negative conclusion. It's these reasons, I believe, which give sabermetricians a bad name with statisticians.
Rob - Sunday, September 04 2005 @ 10:02 AM EDT (#127368) #
I thought for sure you would mention the "batting average to 3 decimal places" thing, Andrew. :)

As for blind spots, I have Chris Carpenter and Jeff Kent as players I cannot stand. (They're both ex-Jays, which I assure you is a coincidence.) Two players with relatively bad numbers who I will defend as All-Stars until the end of time are Paul Byrd and Craig Grebeck.

Wait, Byrd actually was an All-Star? In 1999? When Schilling and Lieberthal already represented the Phillies? Wacky.
Paul D - Sunday, September 04 2005 @ 10:38 AM EDT (#127372) #
Interesting game report. 2 points:

Are the other stats (like VORP) really far superior to OPS? My understanding was that they were slightly better, and that the extra weight OPS puts on slugging is a minor, not major, issue. Are there many players whose OPS would tell you a different story than their VORP or RC?

and...
Why would we count JFG's strikeouts against him? They're essentially just outs, aren't they? If Adam Dunn turned his strikeouts into groundouts, would he be any more valuable? My understanding was taht the answer to that question is no, because while you can't advance a runner on a strike out, you also can't hit into a double play.
RhyZa - Sunday, September 04 2005 @ 10:48 AM EDT (#127373) #
That's funny because Batista is my least favourite player as well... to be honest I just don't think he cares enough, his talent or luck gets him by on some days and on others it doesn't. I know it sounds like a gross simplification but that's how it always strikes me when he takes the mound.
Named For Hank - Sunday, September 04 2005 @ 11:03 AM EDT (#127374) #
I don't know about not caring enough -- ever seen him leave the mound when he's gotten out of a jam? He's about as pumped as anyone I've ever seen. He's usually shouting to himself, punching his fists, and the veins in his neck stick out. I tried to photograph him in that state last time I was shooting, but the whole series of images just look like he's having a fit or freaking out, it's not very cool to look at when it's frozen.

But damn he gets pumped up when he succeeds.
Pepper Moffatt - Sunday, September 04 2005 @ 11:12 AM EDT (#127375) #
Are the other stats (like VORP) really far superior to OPS... Are there many players whose OPS would tell you a different story than their VORP or RC?

Yes. Any player who plays in Colorado, for one, since OPS isn't park adjusted.

Overall, though, OPS just kills high OBP and low SLG guys like Willie Harris.

Why would we count JFG's strikeouts against him? They're essentially just outs, aren't they?

Yes. An out is an out is an out.

However they're vitally important when you're projecting minor league players. Guys who strike out a lot in the minors almost never succeed in the major leagues, even if they hit 45 homers in AAA. That's why, IMO, Ryan Howard is so vastly overrated by many.

Paul D - Sunday, September 04 2005 @ 11:18 AM EDT (#127376) #
Oops.

Moffatt, I meant to say something about using OPS+ instead of OPS, which is what I like to do. Not so easy in the middle of the season though. OPS+ is park adjusted. I'm still not convinced that using VORP will tell you that much more than OPS+, but I see your point.

Would the high strike out players be guys like Jack Cust and Carlos Pena? I didn't realize you were referring specifically to minor league players in that section.
Chuck - Sunday, September 04 2005 @ 11:22 AM EDT (#127377) #
Are the other stats (like VORP) really far superior to OPS?

The advantages of VORP over OPS are: (1) it doesn't overvalue SLG (and hence undervalue OBP), (2) the numbers are park adjusted and (3) it is relative to position.

[re Batista] to be honest I just don't think he cares enough

Some players wear their hearts on their sleeves. Some don't. To make assumptions about what's in a man's head based on his physical behaviour is foolhardy. I do concede that it is frustrating when a man with physical tools seems incapable of harnessing them, but to suggest he is failing because he doesn't care is awfully presumptuous.

Personally, I do believe in "intangibles" such as character, and I think they count for a fair amount.

Not to be a smartass Andrew, but how do they count? Surely if intangibles are to be brought into the discussion when evaluating a player's contributions, then they must somehow be reflected on the bottom line, either in that player's performance (in which case standard metrics will measure them) or the performance of teammates whom he has presumably inspired (admittedly, a much more difficult thing to measure and an effect I am highly dubious of).

I agree that it's easier to root for a grounded, humble man like Halladay than a selfish, arrogant SOB like Clemens or a head-up-his-ass dufus like Manny Ramirez, and it may very well be easier to be a teammate to a player like Halladay, but ultimately it's the bottom line (I'm talking wins, not revenue) that counts. Isn't it?

Andrew K - Sunday, September 04 2005 @ 11:37 AM EDT (#127378) #
Personally, I do believe in "intangibles" such as character, and I think they count for a fair amount.

Not to be a smartass Andrew, but how do they count? Surely if intangibles are to be brought into the discussion when evaluating a player's contributions, then they must somehow be reflected on the bottom line, either in that player's performance (in which case standard metrics will measure them) or the performance of teammates whom he has presumably inspired (admittedly, a much more difficult thing to measure and an effect I am highly dubious of).

I agree with you about the former. It's exactly the latter that I mean. A good clubhouse veteran might (and should) teach younger players, developing them faster and better, possibly even stopping problems before they start. And set an example to the non-stars around him, so that they are encouraged to work harder, run down every ground ball, hustle, and all the other things you hear about from commentators.

There are a lot more players than coaches on a team, and the players have the advantage of being able to lead by example. I don't think there's any question that a settled, focussed team, working together, can create a certain amount of synergy. This affects all their numbers, not just the guys who bring the attitude to start with.

Named For Hank - Sunday, September 04 2005 @ 12:02 PM EDT (#127379) #
Not to be a smartass Andrew, but how do they count? Surely if intangibles are to be brought into the discussion when evaluating a player's contributions, then they must somehow be reflected on the bottom line, either in that player's performance (in which case standard metrics will measure them) or the performance of teammates whom he has presumably inspired (admittedly, a much more difficult thing to measure and an effect I am highly dubious of).
I think an excellent example here is Frank Catalanotto's video meetings -- his own dedication and devotion to his pre-game video room studies has led to a number of players who were not doing it before joining him in the room to study the upcoming pitchers. Is there a way to measure this in terms of team performance? I suppose you could try to evaluate players before and after they joined the video room meetings, but how would we know exactly who and exactly when? And how would we rule out... well, every other factor?

This is the kind of thing that's an "intangible" basically because it's virtually impossible to quantize without being with the team day-in and day-out.

But anyways, that's an improvement that Cat brings to the team through his own work ethic that theoretically should pay dividends in team performance. Just because we're unable to separate the data so that we can measure it, that doesn't make the effect non-existent.

I think that's a blind spot for a lot of people: I can't measure it so it's not there. I don't quibble with the non-absolute of "I can't measure it so I doubt that it's there", mind you. But I think that a lot of things that fall under the umbrella of "intangibles" are just really really really hard to measure. Cat effect could be measured by someone with a couple of years to spend on it, following players around, but not without more data than what is usually used to work out all these fancy numbers.
Chuck - Sunday, September 04 2005 @ 12:37 PM EDT (#127381) #
I think that's a blind spot for a lot of people: I can't measure it so it's not there.

Just playing devil's advocate here, but the flipside of your argument is also flawed. I believe that it should be there, ergo I believe it is there. A bunch of guys watching videotape should perform better as a result and hence I believe they do. Having Delgado bat behind Wells should make Wells a better hitter so I believe it does.

Named For Hank - Sunday, September 04 2005 @ 12:39 PM EDT (#127382) #
I believe that it should be there, ergo I believe it is there. A bunch of guys watching videotape should perform better as a result and hence I believe they do.

That's certainly a valid point. But I think that "studying videotape of pitchers probably makes hitters better" is a stronger argument than "I can't measure how watching videotape of pitchers makes hitters better, so it doesn't make them better".
Chuck - Sunday, September 04 2005 @ 12:49 PM EDT (#127383) #
That's certainly a valid point. But I think that "studying videotape of pitchers probably makes hitters better" is a stronger argument than "I can't measure how watching videotape of pitchers makes hitters better, so it doesn't make them better".

Agreed. But I don't think anyone here has made such a claim. I, personally, admitted to being dubious about the ripple effect of one player's character on another's performance, though don't summarily dismiss the possibility of such, even in the absence of quantifiability.

Miguel Batista and Blind Spots | 13 comments | Create New Account
The following comments are owned by whomever posted them. This site is not responsible for what they say.