Weekly Models Check

Week of 2026-09-07 · performance + feature importances for every live model.

⚾ MLB: 61-57 (51.7%) · ⚽ Soccer: 52-43 (54.7%) · 🎓 College Football: 73-9 (89.0%) · 🏈 NFL: off season (back 2026-09) · 🏀 NBA: off season (back 2026-10)

⚾ MLB

WindowRecordAccuracyLog lossBrier
Season to date61/11851.7%0.69670.2516
Last 7 graded days44/8850.0%0.6923—

Edge vs. always-pick-home: Δlog-loss +0.0047 ± 0.0129 per game (positive = model beats the baseline). Graded through 2026-08-15. The MLB model is betting-blind Elo + home advantage + the starting-pitcher adjustment — it has no ML feature vector, so there are no SHAP/permutation importances to report; the record vs. baseline above is the model check.

⚽ Soccer

Window / leagueGradedPick accuracyLog loss
Last 7 days5100.0%0.5615
Last 30 days9554.7%0.9548
Season to date9554.7%0.9548
  bundesliga955.6%0.8712
  championship2343.5%1.0805
  epl1952.6%1.0098
  la_liga1957.9%0.8519
  ligue_1944.4%1.1113
  serie_a1675.0%0.7903

Outcome-model feature importances

FeaturePermutation Δlog-lossMean |SHAP|Home-win coef (association)
elo_gap+0.0614 ± 0.00150.1591+0.003 (raises home-win odds)
value_diff_z+0.0109 ± 0.00020.0559+0.070 (raises home-win odds)
xg_net_diff+0.0029 ± 0.00060.0175+0.132 (raises home-win odds)
spend_diff_z+0.0000 ± 0.00000.0000+0.042 (raises home-win odds)
net_diff_z+0.0000 ± 0.00000.0000+0.003 (raises home-win odds)
wage_diff_z+0.0000 ± 0.00000.0000+0.000 (lowers home-win odds)

Multinomial logistic refit on matches before 2024-04-06 and evaluated on the 8855 most recent (15%) held-out matches. Permutation = how much held-out log loss degrades when the feature is shuffled (5 repeats); SHAP is the exact linear attribution |coef · (x − x̄)| averaged over rows and classes. The coefficient column is the H-class weight on the z-scored feature — its sign is the direction of association.

🏈 NFL

ModelGamesAccuracyLog lossBrierCal slopeECE
production (qb+talent Elo)301866.5%0.61400.21270.9780.013
previous (base Elo)301866.5%0.61400.21280.9810.015
market (closing line)301866.1%0.61210.21221.0560.018
qb+talent Elo alone301865.2%0.63190.22020.8060.034
always base rate301855.0%0.68820.24750.0380.000

Walk-forward out-of-sample scorecard (NFL/model/v2). The market row is the closing line — the bar the model is judged against.

Top 15 features — uniform ranking across 5 model families

#FeatureAvg (perm+SHAP) rankNorm. score
1spread_line1.60.856
2market_home_prob2.30.847
3elo_diff3.90.359
4roll_margin_diff6.00.212
5elo_vs_spread10.30.227
6elo_spread12.60.279
7elo_home_prob13.40.240
8away_roll_pf13.80.110
9away_ppg_diff_std15.90.103
10total_line17.40.068
11home_roll_total_vs_line17.60.065
12travel_miles18.00.069
13home_roll_margin18.20.119
14away_roll_ats19.00.069
15away_winpct_std19.60.054

Production family (LGBM) — top 10 by permutation

FeaturePermutation Δlog-lossMean |SHAP|
spread_line+0.0260 ± 0.00480.3091
market_home_prob+0.0253 ± 0.00420.2860
roll_margin_diff+0.0023 ± 0.00180.0634
elo_diff+0.0021 ± 0.00160.1043
away_roll_total_vs_line+0.0020 ± 0.00180.0621
home_roll_total_vs_line+0.0019 ± 0.00140.0472
total_line+0.0019 ± 0.00180.0622
travel_miles+0.0013 ± 0.00210.0606
elo_home_prob+0.0007 ± 0.00080.0461
home_rest+0.0004 ± 0.00030.0052

Fit 2002–2023 with production recency weighting, measured on a held-out 2024–25 window the model never saw. Regenerated offline by NFL/model/v2/feature_importance.py; beeswarm plots showing each feature's direction of association live in NFL/model/v2/artifacts/importance/.

Can Tre Beat Vegas · whosyurgoat.app/vegas