GDC 2010: Sid Meier Keynote - "Everything You Know is Wrong"
Why Hacker News recommends it
HN points to it as the best talk on how people misunderstand probabilities and how designers handle that.
What it is
Sid Meier's GDC 2010 keynote on how players perceive probability in games, including how Civilization's odds were adjusted because players misjudged them.
Recommended by 2 HN commenters across 3 different months, 2014 to 2019.
What Hacker News said
Strong rec corysama · 2017-01 · on “How Designers Engineer Luck into Video Games”
Sid Meier (Civilization) gave a great GDC keynote in 2010 where he describes his multi-decade struggle to convey to users ideas like "Stuff that only has a 10% chance of happening still happens sometimes." [this video] Multiply that by a million daily active users and it really works out to "Stuff that has a 1-in-a-million chance of happening will happen to somebody every day". Leading to player reviews like "The game rolled me a 1-out-of-10 SIX TIMES IN A ROW!!! The game is explicitly cheating me!!!" every day. Thus games tend to use random shuffles rather than independent random numbers so as to better align with common misunderstandings about statistics...
Recommends jcrites · 2018-07 · on “If You Say Something Is “Likely,” How Likely Do People Think It Is?”
This article, and some of the comments here, reminded me of another article (and GDC talk) by Civilization game designer Sid Meier, about his experience with players' perception of probability in games. Sid's talk grapples with the issue "If the game says you have 3-to-1 odds to win a battle, how often do players actually expect to win?" > When designing the combat system in Civilization: Revolution, Sid Meier found himself up against some interesting design problems. His players didn't understand math. In Civ Rev, the strength of units were displayed up front to players before battle to show the odds of victory. For example, an attacking unit might be rated at 1.5 with the defending unit at
Recommends jcrites · 2019-12 · on “Paean to Sid Meier's Alpha Centauri (2016)”
I believe you're thinking of Sid Meier's GDC 2010 keynote "Everything You Know Is Wrong" [1]. The entire talk is interesting, but section on player perception of probability is about 20 minutes in. One takeaway is to be careful about how strength numbers translate into odds. If your strength is 100 and mine is 1, does that mean I have a 1% chance to out-and-out beat you? Your armored tank shouldn't have an even 1% chance of being completely annihilated by my club-wielding warrior (that's somehow still around by then). The later Civ games have taken odds out of the equation, and I think it's for the better. Instead, the amount of damage each unit takes per combat depends on the difference in
Cites Fizzer · 2014-02 · on “Why is quality of pseudorandom number generators important?”
"Civilization Revolution" does this. Say the player loses a 75% roll, then attempts another identical 75% roll. The game will actually give you better odds for the second roll. I think it's silly -- the game basically lies to you about your odds on the second attempt. Sid Meier talked about it at length in this video: [this video] . It starts around 18:25.
Cites espadrine · 2016-11 · on “How an accused drug dealer revealed Jacksonville's facial recognition network”
The worst part is that even if the algorithm perfectly computed probabilities and was completely open, humans would take away incorrect information. I am reminded of this talk by Sid Meier: [this video] People don't understand probabilities. They don't accept that if someone has a 75% chance of being guilty, they may very well not be. It happened again with FiveThirtyEight when everybody accused their "70% chance of Mrs Clinton winning" of being wrong, when it doesn't preclude Mr Trump winning.