7 ms·
Developing MLB’s Automated Ball/Strike System
- spike021 6y agoCannot come soon enough. This season in particular has seen way too many poor ball/strike calls.
- ilaksh 6y agoWell, it's not actually just one bad season. They did a study over several years using the ball tracking data which MLB has had for a long time, and found that 12 percent of calls were incorrect. This system should have been fully in place many years ago. The fact that the deployment is still dragging along is amazing.
- spike021 6y agoYeah, of course it's been a historical problem. But there have been at-bats that are just completely eliminated by an umpire either just being awful or making ball/strike calls emotionally. Some this season have been particularly egregious. I think there needs to be a fine line, however. We can keep umpires in some capacity, but still make use of an automated system.
- ytdytvhxgydvhh 6y agoInteresting bit about relaying the ball/strike call to the umpires using walkie talkie or iPhone solutions. I’d have thought the hard part would be making the ball/strike determination, not getting it to the ump in a timely fashion. I wonder if they considered having a couple of big lights in center field for the ump to get this info visually. Also, are there any deaf umps? Will MLB need the ability to make accommodations if so?
- chrishas35 6y ago> I wonder if they considered having a couple of big lights in center field for the ump to get this info visually. I think having the automated call kept semi-private is part of the design. Umps aren’t big fans of getting shown up. Maybe in future iterations, but the only way this is getting adopted up front is if the ump still has some “control.”
- NoNotTheDuo 6y ago> I wonder if they considered having a couple of big lights in center field for the ump to get this info visually. Another thing to consider is that the ump also has other responsibilities than just ball/strike. Keeping it audio only allows the ump to focus on check swings, catcher interference, and anything else that requires his eyesight. > Also, are there any deaf umps? Will MLB need the ability to make accommodations if so? Since they developed an iOS app, they could feasibly develop a watchOS app as well, and relay the call via vibrations on the wrist
- kart23 6y agoPart of me is sad about this. Of course there are horrible calls that sometimes result in runs being scored, but the game loses a lot with robo-umps as well. The dynamic of the pitcher and ump would go away, the pitcher learns what the ump likes and doesn't like, and has to pitch for them. The inconsistency can be annoying, but its part of the game to me, you really never 100% know whether a pitch will be a ball or strike. Also catchers framing pitches would go away entirely, something I really enjoy watching, heres a video on that. https://www.youtube.com/watch?v=kQdkeYXHh6Y https://www.youtube.com/watch?v=kQdkeYXHh6Y
- Spooky23 6y agoIMO the issue isn’t solving a problem with the game, it’s implementation of systems that enable sports betting. At least I hope so. The folks running baseball now like to twiddle with stuff.
- ipaddr 6y agoI look forward to the same strike zone every game. As a fan seeing calls outside being called strikes and seeing strikes being called balls based on who is the ump tonight is something I could do away with. The framing of the ball to make it appear as a strike is a fraud.
- dap 6y agoPeople said the same about the curveball.
- GavinMcG 6y agoI agree. The idea that there is always a right answer has been a fiction for the entire history of the game. Take away the box on the screen and there are still some obviously bad calls, but there are many more calls that no one but the batter, catcher, and umpire could credibly debate about. There are measurable differences in the skill with which a catcher catches the ball. [0] And frankly, without the box there, many people wouldn't have batted an eye at this pitch [1] (watch the video). No one in the game did! It's sad to me that many people care more about the box than about that human experience of the game. One of the great things about sports is that it isn't fair—it teaches us about life in that and other ways. And particularly in baseball, with 162 games and 24,000 pitches in a season [2], variations tend to come out in the wash, even as individual games and pitches feel really meaningful. [0] https://baseballsavant.mlb.com/catcher_framing?year=2019&team=&min=q&sort=4,1 https://baseballsavant.mlb.com/catcher_framing?year=2019&tea... [1] https://blogs.fangraphs.com/the-worst-called-ball-on-record/ https://blogs.fangraphs.com/the-worst-called-ball-on-record/ [2] https://www.baseball-reference.com/leagues/MLB/2019-pitches-pitching.shtml https://www.baseball-reference.com/leagues/MLB/2019-pitches-...
- Guest42 6y agoI’d go for a tennis-like approach whereby a team gets 3 challenges and if a challenge is correct it goes unused.
- Moosdijk 6y agoIn MLB it's one.
- CryptoBanker 6y agoYou actually get a second challenge if you win your first one.
- Moosdijk 6y agoTrue, but it might also be one.
- spike021 6y agoIn addition to my prior comment, I've always thought the best path would be an automated "assist". So you get the human calls from the ump, but at the same time there's a way of signaling if any are egregious. If so, you can override the human call. Problem is, that process would happen often and need to take less time than a standard play review, which already can drag, and it has to be agreeable.
- ec109685 6y agoThis seems the other way. The umpire hears what the machine said and I guess makes final determination?
- spike021 6y agoMaybe, but I figure the typical "#umpshow" issues would continue to play into it if the umps still make a decision with whatever they're given by the machine. The way I see it with what I initially posted, the ump can make a call but with the machine backing every pitch, it'll be easy to stop emotional calls from continuing.
- modeless 6y agoHow on earth could a web page receiving push notifications over cellular or WiFi in a crowded stadium and then playing audio over Bluetooth have consistently lower latency than a walkie-talkie? What kind of slow walkie-talkie were they using? I'm also surprised that all you need to define the strike zone is two heights which are pre-determined per player. I guess I assumed you would need to track the batter's actual knees and torso to define it dynamically. If this is really being used by the actual umpires, wouldn't that be important to get right?
- culturestate 6y agoI haven't messed with this but I'd guess they couldn't have the walkie-talkies transmit continuously for whatever reason, and the short delay between the time you "push the button" on a walkie-talkie and the time it actually starts transmitting was the problem. > I'm also surprised that all you need to define the strike zone is two heights which are pre-determined per player The strike zone is determined when the batter first gets set in their stance so that batters can't shrink the zone after the pitcher starts their motion. If you watch, you'll notice a lot of guys crouch when they start to load up and step in the bucket, so there can be a huge difference in the apparent strike zone from the time a pitcher lets the ball go to the time the ball arrives at the plate.
- modeless 6y agoSure, but their starting stance could still change from day to day or even pitch to pitch, couldn't it? Fixing the strike zone at the start of the season seems like a rule change to me.
- culturestate 6y agoTechnically you're right, but the differences would be so small that I can't imagine they would materially change the zone. The mechanics of a batting stance and swing aren't something you really want to screw around with once you've got them figured out. I haven't played organized baseball in 10 years, but having played for a long time before that my body still automatically does its thing when I pick up a bat.
- tardismechanic 6y agoIn cricket, having a legal ball hit the stumps (three vertical sticks behind the batsman/batter) is an unambiguous way to get out. A leg-before-wicket (LBW) out on the other hand happens if the umpire deems the ball would have struck the stumps if the batsman hadn't put their legs (really pads) in the way (there are other technicalities involved but thats the gist). A MLB ball/strike judgement seems similar in nature. Cricket has been using ball-tracking technology for over a decade now for determining LBW. See: https://en.wikipedia.org/wiki/Leg_before_wicket https://en.wikipedia.org/wiki/Leg_before_wicket https://www.espncricinfo.com/story/ball-tracking-and-the-unique-nature-of-lbw-619979 https://www.espncricinfo.com/story/ball-tracking-and-the-uni...
- omegabravo 6y agoIt is also worth noting the standard of umpiring increased dramatically with the introduction of the DRS system. It has been a massive success. Recently the automated front foot no ball system was introduced too, and it has too been a success.
- remarkEon 6y agoIf anyone from MLB or BAM reads HN and is in this thread ... Do Not Do This. Here's why: Right now, all of the criticism about the calls of balls and strikes - criticism that might seem unique for this season but isn't - is directed at individual umps. You do this, and build an automation tool to replace them, and you've just redirected the entire fan rage from an ump who makes a bad call or two at a critical point in the game and aimed it at the institution of baseball. While you may feel like this season has seen a lot of criticism of balls and strike calls, it only seems that way because of, well, the internet. You may also think "if we just make this thing uniform, with math and automation, then it really will be fair", but it won't be. This is important to note because, again, if you take the human element out of this and replace it with a machine you are signing yourself up for constant criticism and risk. Moreover, you are introducing a new kind of risk into the game (an attack surface that hasn't existed before). Think of the Houston Trash Can Scandal, but instead of an analog signal based on an auditory input, it's some paid bad actor who manipulates the system making calls at critical points in the game. I hesitate to use the word "hack" but is it really that outside the realm of possibility? With a World Series on the line, Houston did what they did out in the open. You don't think someone would lose their scruples and try to do it on the backend if this existed? Third, and this may be a bit "old man yells at cloud", but if you do this you are removing one of the best parts of the game. The human element, where a reasonable person can watch a ball go across the plate, and it's just outside that little box the broadcast booth puts on, the ump calls strike three, and you as a fan let it go because, ya know what, "ehh he coulda hit that I think".
- Dylan16807 6y ago> The human element, where a reasonable person can watch a ball go across the plate, and it's just outside that little box the broadcast booth puts on, the ump calls strike three, and you as a fan let it go because, ya know what, "ehh he coulda hit that I think". I am baffled because I don't understand how that is "the human element" at all. I don't know if you can explain that in a different way? And you could still have the same situation happen with a machine calling it a strike, couldn't you?
- swang 6y agoah yes, if technology is vulnerable to hacking don't ever use technology ever. and i too don't understand your third bit. when the human element that gets involved is the umpire that is terrible for the game. the umpire should only be there to properly referee balls/strikes, safe/out as they are. not to just decide a ball is now a strike and a strike a ball. no thanks. sign me up for robot umps.