On the Sloan Sports Analytics Conference and Adopting Advanced Stats
This feels a bit strange as I didn't actually attend the fifth annual Sloan Sports Analytics Conference - even though it's practically held in my backyard - but I went last year and streamed it live this time around and wanted to share my thoughts. For those that aren't aware, MIT has been hosting this forum since 2007 for the purpose of discussing the role of analytics and stats in the sports industry. It's no secret now that the field of sports analytics, particularly in basketball, has expanded tremendously in scale the past few years. Teams have implemented it, dedicating entire staffs to gathering data. Writers have used it to help guide analysis. And fans, at least those reading internet content, reference it in discussion.
If you're familiar with my writing, it's clear that I'm a proponent of using advanced stats in analyzing basketball. That has everything to do with my personality. I pay my bills being web/business analyst. I live data. This makes it incredibly easy for me to adopt sports analytics but I understand that it's difficult for others to accept as a valid form of analysis in sports. Kevin Pritchard, who was in this year's Basketball Analytics panel, said that 20 of the 30 NBA teams utilized advanced stats to some degree. I won't speculate on why the other ten teams haven't adopted it but I do want to discuss the reluctance among fans.
Acceptance is a dominant topic throughout the conference each year. Mike Zarren, Assistant Executive Director of Basketball Operations and stat evangelist for the Celtics, said that Moneyball created a dichotomy between those that believe in using numbers and those that don't. The problem, as with any belief, is that the polar extremes tend to dominate the conversation. Many stat supporters defend it staunchly with a "numbers don't lie" undertone on an already confusing topic. It turns people off. On the other extreme are those that don't trust data because it can be manipulated or believe so strongly in using their eyes that they dismiss the field altogether. From that comes this perception that advanced stat supporters don't "watch" the game enough. Stats are law, rather than complementary information. Attending Sloan gives you the proper perspective, though.
We tend to think that star players determine success. We think that general managers trusting their guts is what matters when targeting players. And we're absolutely right. Rockets GM Daryl Morey, who's widely known for running a stats driven franchise, takes a lot of flack for fielding a 31-32 team. How can he be considered a "genius" for assembling that kind of production? He addressed that in a panel about natural talent vs work ethic. He said all the stats in the world result in .500 teams without stars like Tracy McGrady and Yao Ming. Obtaining the rest of the parts is what requires using every bit of information available.
It's similar from a coaching perspective. Del Harris said he used per possession scoring stats all the way back in the 1970s. He had a better understanding of how his college team was performing because he calculated where its scoring should be per ten minute interval and would adjust the pace accordingly. Later in his career, as an assistant to Don Nelson, who he said dismissed stats, Harris used them to find two- and three-player combinations that played well together and suggested those lineups.
Stats to these successful basketball operators are a tool, another methodology. They have hunches and "see" things just as we do but they also have the prudence to validate their questions with more information. Zarren goes so far as to say that statistical analysis and video analysis need each other even though video analysis is more accurate. That's the Celtics' stat guy saying that what you see is more reliable.
As fans, it's naive to think that multi-million dollar businesses aren't exhausting every form of analysis to better their products. So, stats vs gut is not a case of either/or. It's about gaining a competitive advantage by understanding the entire picture. As Mark Cuban said, "analytics is risk management at the end of the day."
But even with the reluctance to adopt sports analytics, what I've noticed is that the influence of advanced stats is so widespread now that even those that dismiss them are aware of the vocabulary. True shooting percentage, total rebounding rate, pace, efficiency - they're common terms in today's NBA. So, why are they still dismissed?
I had the realization that regardless of resistance, advanced NBA stats are now mainstream and pedestrian, and in turn, no longer all that insightful. I can tell you that Carmelo Anthony's TS% isn't close to elite but it adds little in ways of analysis because he scores a lot and his teams win. What's important is why he wins despite that fact.
What people actually want from advanced stats is advanced segmentation because that's when we finally have context. Published material is getting much better with this. In my own work, I try to provide per quarter numbers, efficiency differentials, positional production - anything that provides clarity for a 2% change in shooting percentage. A common rebuttal is that game situations change so dramatically that averages aren't reliable, which is valid. At Sloan, Cuban, Zarren and Pritchard all said that their departments account for this and eliminate averages entirely. They're able to exclude the "noise" and identify actionable consistencies.
Writers don't have the money or bandwidth to do this, but teams are doing it every half of every game. How segmented can they get? Just have a look at the new data from STATS, LLC. So, as sports analytics continues to influence basketball discussion, think about it as just another methodology. General managers rank analytics with many other factors on their board. Why? Because they're trying to answer complex questions with information their eyes may have missed. As fans and as writers, we'll find usefulness in analytics by doing the same.
19 comments
|
3 recs |
Do you like this story?
Comments
I should mention that the Knicks sent two representatives.
Mark Warkentien and Jamie Mathews, VP of Basketball Operations. Marky Wark spoke on a gambling analytics panel.
I wonder if the Knicks were one of those 10 teams that didn't use it
but now are after they got Marky Wark
Last night, a comedian died in New York. Somebody knows why. Somebody knows
Great read, Gian
I’ve been wrestling with my ambivalence toward the current, popular advanced metrics for quite some time now. I was first completely turned off by them, mostly because of the arrogance it took for a guy like Hollinger to reference a formula that he himself made up to argue why one player is better than others. I understood that guys like him and Berri needed to at least appear unwavering in their beliefs in the validity of their systems, but man those guys were condescending, and sometimes just completely wrong. But most times, they were right (specifically Hollinger) and I was begrudgingly forced to admit that certain advanced metrics were actually quite effective, almost to the point of trusting them as gospel.
Now I’ve gotten to the point where I place significant importance on metrics I trust, like PER, but also acknowledge the possibility for sample-size based “noise” and shortcomings in the formula itself. The first rumblings of acquiring Melo were an important point for me in trying to make sense of these things. I usually read every box score for every game and found that whether consciously or subconsciously, I would internalize the box score stats to, more often than not, reach very similar conclusions to those of PER. But with Melo, my personal ranking and scouting report was much more flattering than his advances stats. It’ll be very interesting, once Melo settles in and the team hits its stride, to see how the new situation affects his advanced stats. For me, it serves as an important test case.
"But when he saw it, he just put his hands up and they couldn’t give it to him. It just fell to the ground, I-I don’t, you know … So, that showed me he had great experience..." - Jeff Van Gundy
by Anthony Bonner's Subpoena on Mar 5, 2011 11:44 AM EST reply actions
I can’t stand people who stick solely to observational analysis or statistical analysis. They are both vital, important, and imperfect. One without the other is absolutely useless. Anyone who can’t see that is foolhardy. Now from there, advanced statistical analysis is just… statistical analysis. It makes no sense to think PPG, FG%, etc all are useful and not think TS% is useful. Some advanced stats are misguided and more commonly some pass themselves off, intentionally or not, as the final word, which causes people to misuse them. But they’re all just numbers and are subject to the same proper or manipulated analysis as traditional numbers. And observational analysis can be done properly or be obscenely manipulated just the same.
The numbers don’t lie and the eyes don’t lie, but one’s rationality can in either case.
Wonderful post Gian
Like paxon said above, everything goes together. We don’t have a chance to see every single player every day so we need to use the best statistical tools available. Also, we may misremember certain things so why not go back & review the data to refresh your memory? At the same time, we have to use the numbers in context. It’s not enough to just say he has a PER of X & a WP of Y. In most cases, we have to see how they reached the number.
But even with the reluctance to adopt sports analytics, what I’ve noticed is that the influence of advanced stats is so widespread now that even those that dismiss them are aware of the vocabulary. True shooting percentage, total rebounding rate, pace, efficiency – they’re common terms in today’s NBA. So, why are they still dismissed?
I think they’re dismissed for 2 reasons. The first one is an overreliance on traditional counting stats. As an example, we’ve been hearing all season that Tim Duncan is “declining.” And if we go by PPG & RPG, then yeah it’s down. But his rate stats such as TS% & rebounding rates are all right around his career marks.
The second one is probably just resistance to new stats. I’m not sure how it’s like in the NBA circles, but in baseball, sabermetrics is still frowned upon by analysts & is usually dismissed with “you gotta use YOUR EYES” and whatnot. It’s easier to go back on what you’re accustomed to instead of getting with this new line of thinking.
In relation to your Melo statement, his TS% isn’t elite & that by itself doesn’t tell you much, but when you pair it with his high usage rate it gives a reason as to why he isn’t considered a superstar by some advanced metrics.
I think the most important thing for users of advanced metrics(myself included) is how you explain the metrics & how it relates to your team. Guys like Berri & Hollinger don’t do a good job of this IMO while places like Fangraphs, Beyond the Box Score in MLB do a very good job of it.
And speaking of advanced metrics, Dean Oliver is trying to come up with some new(er) statistics.
What's that about?
Berri and Hollinger should be ignored completely
they are (nowadays, at least) to good analysts what Dr. Phil is to Jung, what Rand is to Nietzsche
"I feel like this: You can't hate me." -Toney Douglas
Well said, Gian
In my ultimately uninformed opinion, Melo has an opportunity to revolutionize the field, or at least cause a massive paradigm shift in how the masses interpret and apply advanced metrics. Melo presents a strong counterargument to the now-common practice of evaluating the individual, and calls for a statistical inquiry into how each team member is but a sum of both 1) his individual skill and mental makeup, but also 2) his surrounding parts. The ultimate imperfection of the entire process is really the whole point.
The rise of popular metric analysis has all too unfortunately risen alongside ESPN’s sensationalist online empire, but hopefully that doesn’t stop conclusions from eventually becoming less rash, dichotomies becoming rightfully nonexistent, and analysis becoming ultimately more honest.
"I feel like this: You can't hate me." -Toney Douglas
Outside the walls of intelligence, life is defined – NAS
by mightykingcrayon on Mar 6, 2011 6:59 AM EST reply actions
Great article
My biggest problem with advanced stats is the writers who use them. Statistics can obviously tell you a lot about a team, but I’m tired of the smug and condescending tone that guys like Henry Abbott and John Hollinger take, when it seems like they have just as much of a hard time predicting results as anyone else.
Regarding Melo and advanced stats, there have been said a lot, and i have already written in couple of posts.
The most important thing to understand about Melo is, that he played in a laisezz fare offensive system, that decreased his effeciency significantly, but in some ways increased effeciency of a whole team. Karls approach didnt tried to put Melo in the best position to score, pass or generally execute a play (beside Isos who can be considered good oppurtunity for melo). But in general isos can become very inefficient from individual efficieny standpont if used too much, teams adopt by cloging the lane and takin away lanes, forcing jump shoots. And Karl never adopted (changed) this strategy, he didnt believe in actaul offensive system and running plays. This is not reflected in statystical anylisis,and thats way is important to actually wattch games and especially to have a coaching perspective when analysing pšlayers or teams.
Stats (or empericism) in general is important part of scientific analysis in social sciences, but you have to be careful and selective (you have to narrow the topic of you anilisys), cause you could easily change corelation for causation, make oversimplifiing conclusions (Melo is selfish etc.) or manipulate data to fit your a priori beliefs (critical thinkin is a must).
Regarding basketball, you have to include coaching perspective, role players play in particular system, difference between regular vs playoffs basketball (mantra defense wins championship is only partly correct, cause it is hafl-court defense and offense that wins it) and offcours individual characteristics like work rate, talent, killer instict, etc.
I know Melo is selfish and has poor shot selection
Even if he is doing isos, he doesn’t have to shoot when triple teamed and fading away, making 30% of jump shots.
Your strategy of cherry-picking stats, ignoring more logical conclusions that stand in the way of your predetermined agenda
is not unlike the strategy of an inefficient, selfish iso scorer on the basketball court.
Does your Melo hate stem from self-loathing?
"I feel like this: You can't hate me." -Toney Douglas
nnnnnnnnnnnnnnneeeeeeeeeeeeeeeeeeeeerrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrdddddddddddddddddddddddddddddddddddddddddddd
but at the same time rather insightful.

by 





















