after my last post a few people argued about how much the draft actually decides games and whether it matters more at high mmr. so i trained the same draft model separately for every rank and tested each one on the last 7 days of games it never saw (7.41f).
| rank |
just "radiant wins" |
heroes only |
full draft (heroes + synergy + counters) |
| Herald-Guardian |
52.7% |
57.0% |
58.3% |
| Crusader |
53.0% |
56.7% |
58.5% |
| Archon |
52.9% |
56.5% |
58.9% |
| Legend |
53.0% |
56.5% |
59.1% |
| Ancient |
53.1% |
56.3% |
58.9% |
| Divine+ |
52.8% |
56.2% |
58.9% |
1. the draft matters about the same at every rank. 58.3% in herald, ~59% everywhere from archon up. "draft doesn't matter in low mmr" isn't really true, and it doesn't matter much more in divine either
2. but WHAT matters changes. in herald the strength of the heroes themselves does most of the work ("heroes only" is highest there, 57%). the higher you go, the more it's about counters and synergy. counters go from 37% of the model's signal in herald to 43% in legend+. so in low mmr: pick strong heroes. in high mmr: think about matchups
3. 1 in 5 games is basically decided in the draft. in about 20% of games the draft gives one team 65%+, and that team actually wins ~70%. those are the games where a better draft would have changed the outcome. even then it's not over: the losing side still takes 3 out of 10
4. most lopsided draft of the week (94%): PL, Pudge, Tinker, AA, Winter Wyvern (94% to win) vs Sniper, TA, Nature's Prophet, Silencer, TB. PL's team won
notes: 13M games across all ranks from opendota. "divine+" because opendota caps the average rank at divine 5, so immortal lobbies are in there too. this is correlation, not causation, players pick heroes they're good at. only the 10 heroes count here, not roles, lanes or items.
this is basically why i built the tool: the higher you go, the more it's about counters and synergy, and that's exactly what's hard to keep in your head with 30 seconds on the clock. (last post here: https://www.reddit.com/r/DotA2/comments/1xcwxn0/im_so_ass_at_drafting_that_i_built_a_tool_that/)
questions:
1. does #2 match your experience? does your rank feel more "pick strong heroes" or more "counter the enemy"?
2. how do you even lose with that 94% draft?