The play-in games and the first round of the NCAA tournament featured a number of upsets. The Bradley-Terry model predictions from my previous post took a beating the first two days but somehow managed to make a number of good predictions later in the first round.
Accuracy of Play-in and Round 1 Predictions
Overall, the model was correct on 72% of all predictions. I’m pretty sure the model and most peoples’ brackets took a beating in the same places- the big upsets of the first day of the round of 64.
The table also lists proportion correct by probability. These are helpful to see if the model’s probabilities are either over- or under-confident. If neither were to happen, we should expect that over the long run, the model will have a proportion correct equal to it’s predicted probability. That is, for all predictions of winning with probability of .9, we would expect the model to predict 90% of the games correctly. The table shows a rough alignment with proportion correct and predicted probability, but then again, our sample of games is very small so far.
Predicted Probability | Proportion Correct | Number of Predictions |
---|---|---|
All | 0.72 | 36 |
0.5-0.6 | 0.55 | 11 |
0.6-0.7 | 0.67 | 6 |
0.7-0.8 | 0.67 | 6 |
0.8-0.9 | 1.00 | 4 |
0.9-1 | 0.89 | 9 |
Updated NCAA Tournament Probabilities
Using the methods described on the previous post, the updated probabilities for winning are listed in the table below. Of note: the team with the biggest increase in probability for winning the tournament was Gonzaga, which was aided by two upsets in their half of the South bracket. Also interesting is that despite winning their first game, Kansas has a decreased chance of winning in each of the next rounds, likely due to the Big 12 having a terrible showing in the tournament so far.
In the table, the last three columns represent the change in championship winning probability, change in Bradley-Terry effect, and change in expected number of wins over the pre-tournament predictions.
Team | BT Effect | Sweet 16 | Elite 8 | Final 4 | Final Game | Winner | Expected # Wins | Change WinProb | Change BT Effect | Change # Wins |
---|---|---|---|---|---|---|---|---|---|---|
Kentucky | 6.371 | 0.937 | 0.802 | 0.670 | 0.535 | 0.414 | 4.358 | 0.004 | 0.017 | 0.103 |
Virginia | 5.348 | 0.812 | 0.674 | 0.390 | 0.260 | 0.112 | 3.248 | 0.007 | 0.068 | 0.128 |
Villanova | 5.270 | 0.869 | 0.579 | 0.344 | 0.223 | 0.098 | 3.113 | 0.018 | 0.069 | 0.313 |
Wisconsin | 5.211 | 0.801 | 0.655 | 0.443 | 0.173 | 0.098 | 3.170 | 0.013 | 0.061 | -0.030 |
Gonzaga | 4.836 | 0.773 | 0.690 | 0.403 | 0.181 | 0.066 | 3.113 | 0.046 | -0.028 | 0.658 |
Arizona | 4.831 | 0.836 | 0.678 | 0.359 | 0.115 | 0.054 | 3.042 | -0.006 | 0.073 | 0.317 |
Duke | 4.896 | 0.772 | 0.547 | 0.335 | 0.151 | 0.049 | 2.853 | 0.014 | 0.070 | 0.178 |
Northern Iowa | 4.583 | 0.608 | 0.256 | 0.128 | 0.071 | 0.024 | 2.087 | -0.026 | 0.081 | 0.127 |
Notre Dame | 4.510 | 0.650 | 0.353 | 0.089 | 0.044 | 0.019 | 2.155 | -0.011 | 0.086 | 0.135 |
Kansas | 4.477 | 0.575 | 0.304 | 0.072 | 0.034 | 0.013 | 1.999 | -0.002 | -0.067 | -0.096 |
Maryland | 4.411 | 0.696 | 0.144 | 0.074 | 0.031 | 0.012 | 1.958 | 0.002 | 0.073 | 0.273 |
Wichita St | 4.172 | 0.425 | 0.206 | 0.049 | 0.022 | 0.009 | 1.710 | -0.006 | 0.110 | 0.365 |
Louisville | 4.089 | 0.392 | 0.131 | 0.049 | 0.023 | 0.005 | 1.599 | -0.005 | 0.087 | 0.214 |
Utah | 3.792 | 0.486 | 0.169 | 0.070 | 0.020 | 0.004 | 1.749 | -0.001 | 0.106 | 0.379 |
Georgetown DC | 3.851 | 0.514 | 0.182 | 0.077 | 0.020 | 0.004 | 1.796 | -0.001 | 0.088 | 0.386 |
Oklahoma | 3.832 | 0.676 | 0.169 | 0.046 | 0.018 | 0.004 | 1.913 | -0.016 | -0.050 | 0.453 |
Butler | 3.857 | 0.350 | 0.137 | 0.027 | 0.010 | 0.003 | 1.526 | -0.002 | 0.106 | 0.466 |
North Carolina | 3.661 | 0.530 | 0.130 | 0.052 | 0.009 | 0.002 | 1.723 | -0.003 | 0.109 | 0.488 |
Oregon | 3.576 | 0.199 | 0.105 | 0.037 | 0.007 | 0.002 | 1.350 | 0.002 | 0.123 | 0.600 |
San Diego St | 3.571 | 0.228 | 0.102 | 0.040 | 0.008 | 0.002 | 1.380 | 0.002 | 0.090 | 0.650 |
Xavier OH | 3.373 | 0.655 | 0.178 | 0.046 | 0.007 | 0.001 | 1.887 | 0.001 | 0.106 | 1.072 |
Iowa | 3.413 | 0.227 | 0.166 | 0.051 | 0.009 | 0.001 | 1.454 | 0.001 | 0.096 | 0.614 |
Michigan St | 3.677 | 0.188 | 0.108 | 0.028 | 0.010 | 0.001 | 1.335 | 0.001 | 0.118 | 0.570 |
West Virginia | 3.493 | 0.304 | 0.035 | 0.013 | 0.003 | 0.001 | 1.355 | 0.001 | -0.026 | 0.465 |
Arkansas | 3.506 | 0.470 | 0.110 | 0.037 | 0.005 | 0.001 | 1.623 | 0.001 | 0.061 | 0.578 |
Cincinnati | 3.090 | 0.064 | 0.019 | 0.006 | 0.002 | 0.001 | 1.090 | 0.001 | 0.083 | 0.605 |
Ohio State | 3.009 | 0.164 | 0.081 | 0.015 | 0.002 | 0.001 | 1.262 | 0.001 | 0.144 | 0.752 |
Georgia St | 2.737 | 0.345 | 0.063 | 0.011 | 0.001 | 0.000 | 1.421 | 0.000 | 0.189 | 1.166 |
Dayton | 3.044 | 0.324 | 0.050 | 0.007 | 0.002 | 0.000 | 2.383 | 0.000 | 0.034 | 1.733 |
Alabama-Birmingham | 1.740 | 0.282 | 0.024 | 0.002 | 0.000 | 0.000 | 1.309 | 0.000 | 0.188 | 1.219 |
North Carolina St | 3.194 | 0.131 | 0.035 | 0.008 | 0.002 | 0.000 | 1.175 | 0.000 | 0.111 | 0.510 |
UCLA | 2.718 | 0.718 | 0.120 | 0.024 | 0.003 | 0.000 | 1.865 | 0.000 | 0.181 | 1.540 |