Quantcast

«

»

Jun 29 2007

Evolution-5: How probability intuition can lead us astray

(See part 1, part 2, part 3, and part 4.)

One of life’s ironies is that the difficulty in understanding the mathematics of Darwin’s theory of natural selection may actually be caused by natural selection itself.

As we saw earlier, natural selection does not try for maximum benefit but instead works on a ‘just good enough for now’ principle. Steven Pinker in his book How the Mind Works (1997) is a cognitive scientist who believes that natural selection has been the driver for most aspects of our bodies and our behavior, and that the brain, being just another organ, has evolved to do what it does to effectively meet the challenges it faced at various times in our somewhat distant past. Pinker points out that humans, when compared with other animals, have unusually large brains compared to body size but that this rapid expansion in brain size occurred more than 100,000 years (or about 5,000 generations) ago (Pinker, p. 198) and then leveled off after that. This means that the structure of our present brains has been largely determined by a time when humans were hunter-gatherers and foragers.

This means that although modern life is undoubtedly very complex and require us to meet a vast array of challenges, our brains are best suited to meet the challenges of our ancient forebears, not those of driving on a highway or learning to operate a computer or solving sudoku puzzles. Thus we are very good at identifying faces and shapes, seeing things in depth, reacting to predatory dangers, and acting on instincts such as ducking when an object is thrown at our heads, etc, because our brains have probably evolved modules that handle such things efficiently. But we are not so good at solving quadratic equations. The kind of mathematics that helped our hunter-gatherer ancestors survive did not require much beyond an elementary sense of number. As for probability, simple concepts largely based on induction and extrapolating from past experiences, are sufficient.

But as culture developed in the last 10,000 years with the advent of more settled agrarian societies and written language, we now find ourselves having to struggle a bit to master the concepts needed to face today’s challenges. They do not come ‘naturally’ to us, by which I mean that there are no brain modules that have evolved to enable us to quickly grasp and understand and respond to them.

This is especially true of probability and statistics. There was no need for our ancestors to develop modules to make Bayes’ Theorem or the Central Limit Theorem easily understandable, which explains why our intuitions are so often led astray. For example, many people fall prey and lose money because of the ‘gambler’s fallacy’ because they put their faith in a spurious ‘law of averages’, believing that the more repeated occurrences you have of the same thing (say getting heads on a coin toss or coming up black in a roulette wheel), the more likely a different outcome becomes on the next play. Similarly people who play the lottery numbers tend to avoid numbers that have won recently.

While mathematical sophisticates may look down on such na├»vete , Pinker points out that such expectations are perfectly consistent with the kinds of probability experiences our hunter-gatherer ancestors experienced and which we still experience in most everyday life. After several days of rain, a dry day is more likely. After seeing several elephants appear in a line, it was more likely not to see one. In fact, event repetitions that are finite and terminate and change are the norm in nature, not the exception. Hence believing such things and acting upon such beliefs has some survival value that makes it plausible that our brains evolved modules that encoded those expectations, making us instinctively sympathetic towards believing things like the gambler’s fallacy.

The reason that so many are fooled by the gambler’s fallacy is that the creators of the gambling devices go to great lengths to make each event independent of the previous ones, thus violating our natural expectations. We thus have to consciously learn to sometimes go against our ‘natural’ instincts and this takes effort and is not easy.

Even though I consider myself fairly adept at mathematical manipulations, I am often humbled by how easily my intuition is led astray when confronted with a novel statistics problem. Take for example this case, which may be familiar to people who have taken an elementary statistics course, but fooled me when I first encountered it.

Suppose the incidence of some disease is fairly rare in a population, say about one in a thousand. You are told that there is a test for this disease that is pretty good in that it that has a ‘false positive’ rate of only 5%, meaning that if a randomly selected group is tested, only 5% of the people who do not have the disease will have test results that come out positive. Also you are told that the false negative rate is zero, meaning that if someone does have the disease, the test will definitely come out positive.

Suppose you are among those who are part of this random testing. To your dismay, the result is positive. What do you think are your chances of actually having the disease?

Most people would think that it is very high. They may put it as high as 95%, thinking that if there is a 5% false positive rate and 0% false negative rate, that means that the likelihood of someone testing positive having the disease is 95%. This sounds eminently reasonable.

But the actual chance of you having the disease despite testing positive is just 1 in 51 or less than 2%! How come? This becomes easier to understand if we shift from talking in terms of probabilities (which I have pointed out are not so intuitive) to talking about numbers. Suppose you are one of 1000 people being randomly tested. (Any size will do. I have chosen 1000 because it is a nice round number.) Then an incidence of 1 in 1000 means that we expect only one person to actually have the disease (and who will test positive), and 999 to be free of the disease. But a 5% false positive rate will result in about 50 of the 999 people who do not have the disease also testing positive. So your chance of actually having the disease is the chance that you happen to be that one person with the disease out of the 51 testing positive.

What the positive test result has done is provide a twenty-fold increase in the odds of your having the disease from 1 in 1000 (or 0.1%) to 1 in 51 (or slightly less than 2%), but your chances are still extremely good (over 98%) of not having the disease. I suspect a lot of people get unduly terrified by test results of this kind because doctors may not know how to present the data in ways that give them a better sense of estimating the probability. (Of course, I am assuming that you were selected randomly for this test. If the doctor recommended that you get the test because you had other symptoms that caused her to suspect you had the disease, then that would further increase the odds of you having the disease.)

The lesson here is to be wary of our ‘gut’ feelings when dealing with certain mathematics concepts, especially involving probability and statistics. This may partially explain why Darwin’s theory of natural selection, dealing as it does with small probabilities and long time scales, is so hard for many to digest because they are outside the range of things we experience on a daily basis. In future postings, I will look at some of the issues that come up.

POST SCRIPT: Sicko opening nationwide on Friday

Michael Moore’s new documentary on the health care system Sicko will be at the Cedar-Lee (2163 Lee Rd) in Cleveland Heights starting on Friday, June 29, 2007. The show times are noon, 2:30, 5:00, 7:30, and 10:00 but you should check before you go.

Moore also appeared on The Daily Show to point out once again what a scandal the health care system in the US is, where it is actually in the interests of the profit-driven health insurance companies to deny health care to patients.

9 comments

Skip to comment form

  1. 1
    James

    Hi Mano,
    I just wanted to say that I really enjoy reading your blog entries, as they address the exact issues I often have debates about with some of my religious friends. I usually tried to keep clear of the religious/political discussions with them, as it sometimes became emotionally charged/uninformed (on both sides). I’ve recently felt comfortable enough to bring it up with one of my good friends. The probability issue of evolution actually came up last week in a discussion I had with him.

    He is skeptical of the idea that the “simple” proteins and amino acids happened to take the exact route and changes to create the complex life forms we see today. His research into the idea took him to statisticians who claimed the probabilities were so small that they basically claimed there was a zero chance. He also mentioned that simplicity cannot beget complexity and that mutations are often harmful, not beneficial (I didn’t really know how to refute that, as he wasn’t entirely sure of the source, either).

    I found it hard to explain to him what you mentioned as the gambler’s fallacy; our gut feelings are ill-equipped to deal with the relatively astronomical probabilities of the evolutionary process. Sorry for the long-winded post and I look forward to your next entry!

  2. 2
    Mano

    James,

    I will be addressing exactly those points your friend raised in the posts to come. This series is turning out to be a bit longer than I initially anticipated!

    I am glad that you are enjoying the blog and finding it useful.

  3. 3
    Edmund

    It is said that the average person only uses 1-3% of their brain while some of the world’s greatest scientist uses 5%.

    If somebody can somehow commercialize the ability to track a person’s usage of the brain, there will be a definite market.

  4. 4
    Nueslim

    The human brain isn’t wasteful. It’s all used, just not 100% at any one time.

  5. 5
    John Tan

    Research found out that we just use 10% of our brain where 90% of our brain power are untapped.

    Imagine our powerful human are if they are using 100% of their brain.

  6. 6
    Tom Low

    I would imagine if we were to utilise 100% of my brain power, we could possibly control objects around us with our mind.

  7. 7
    Hunter leveling guide

    What if we are utilising 100% already just not at the same time? I don’t see why according to evolution theorem we would still have redundant parts in the brain if we are indeed only using 10-20%. I believe we use 100% but only 10-20% at a time and then using another part for dedicated purposes.

  8. 8
    Mano

    The mistaken idea that we are using only a small fraction of our brain comes from misunderstanding the nature of redundancy. Our brain has quite a bit of redundancy built in so that if parts are destroyed or removed, it can find ways to work around it. But that does not mean that those parts of the brain were not being used.

    It is kind of like the internet where removing several nodes does not destroy communication since the system finds alternative routes.

  9. 9
    Mark "The Intuitive Coach"

    I find it interesting how we can evaluate how much of our brain we are in fact using, especially when we consider we are using the same brain to measure its utilization. It would be like someone with mental illness being asked to evaluate how mentally well they are. I think as we head into the future especially when we talk about perception versus reality we will find that the amount of our brain we are using is exactly the amount we are supposed to use. To me it is more about how your brain is wired than how the capacity is used. I can write a program that does more useful work on a 386 when you get rid of all the stuff you don’t need versus a bloated program on a larger modern computer.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>