Anisha Riggs
The base rate fallacy, also known as insensitivity to base rates, is a common psychological bias. It occurs when we make estimations but fail to consider the influence of base rates, which is the probability of an event happening. For example, in a city of 1 million people, if there are 100 terrorists and 999,900 non-terrorists, the probability of a randomly selected person being a terrorist is 0.0001. If the city installs a facial recognition system with a 99% accuracy rate, it will still produce more false positives than true positives because there are far more non-terrorists than terrorists. This is an example of how ignoring the base rate can lead to incorrect conclusions.
| Characteristics | Values |
|---|---|
| Other names | Base rate fallacy, base rate neglect |
| Definition | A common psychological bias where people ignore or assign less value to base rate information, which is objective, statistical information, and make judgments based on specific data |
| Synonyms | Prior probabilities (used in Bayesian Probabilities) |
| Example | Participants were asked whether it was more likely that Tom W. was studying computer science, education, or humanities. 95% said computer science, based on a personality sketch, without considering that there are far more students of education and humanities than computer science |
| Related terms | Representativeness heuristic, extension neglect, prosecutor's fallacy |
| Introduced by | William C. Thompson and Edward Schumann in 1987 |
| Related names | Kahneman and Amos Tversky, Richard Nisbett |
| Related concepts | Overreaction to market events, behavioural finance |
Explore related products
What You'll Learn
Base rate fallacy in probability judgments
The base rate fallacy, also known as base rate neglect or base rate bias, is a type of fallacy in which people tend to ignore the base rate (e.g. general prevalence) in favour of individuating information (i.e. information pertaining only to a specific case). In other words, when provided with both general and specific information, people tend to assign greater value to the specific information and often ignore the base rate information altogether. This tendency has important implications for understanding judgment phenomena in many clinical, legal, and social-psychological settings.
An example of the base rate fallacy is the false positive paradox (also known as the accuracy paradox). This paradox describes situations where there are more false positive test results than true positives, meaning the classifier has low precision. For example, a city with a population of 1 million has 100 terrorists and 999,900 non-terrorists. To catch the terrorists, the city installs a facial recognition system that can identify wanted criminals 99% of the time. However, because of the high number of non-terrorists, the program's list of criminals will likely have far more innocents (false positives) than criminals (true positives). In this case, someone making the base rate fallacy would infer that there is a 99% probability that a person detected by the system is a terrorist, when in reality, the probability is much lower, at approximately 1%.
Another example is provided by renowned behavioural scientists Daniel Kahneman and Amos Tversky, who conducted a study where participants were presented with a personality sketch of a fictional graduate student named Tom W. They were given a list of nine areas of graduate studies and asked to rank them in order of likelihood that Tom W. was pursuing them. At the time, far more students were enrolled in education and the humanities than in computer science. However, 95% of participants said it was more likely that Tom W. was studying computer science than education or the humanities. Their predictions were based purely on the personality sketch, with total disregard for the base rate information.
A similar example involves Donald Jones, who is either a librarian or a salesman. Someone who is described as "retiring" is more likely to be a librarian, as salesmen usually have outgoing personalities. However, this logic neglects the fact that there are far more salesmen than male librarians. Therefore, the odds that Donald Jones is a librarian are closer to 10% than 90%.
Overall, the base rate fallacy arises from confusing the natures of two different failure rates and pitting what seem to be merely coincidental, low-relevance base rates against more specific, high-relevance information. Correct Bayesian reasoning can help to overcome this fallacy, and expressing problems in frequentist terms has been shown to elicit correct Bayesian reasoning in a majority of subjects.
The Base of Incense: Natural Ingredients for Aromatic Bliss
You may want to see also
Explore related products
Base rate neglect in relation to consensus information
Base rate neglect, also known as the base rate fallacy or insensitivity to base rates, is a type of fallacy in which people tend to ignore the base rate (e.g., general prevalence) in favour of individuating information (i.e., information pertaining only to a specific case). For example, if someone hears that a friend is very shy and quiet, they might think their friend is more likely to be a librarian than a salesperson. However, since there are far more salespeople than librarians, it is more likely that their friend is a salesperson, even if a greater proportion of librarians fit the description of being shy and quiet. This tendency to underweight or even ignore base rate information when estimating probabilities for events is a common psychological bias related to the representativeness heuristic.
Base rate neglect is an important bias in estimating the probability of uncertain events. It refers to the tendency to underweight the base rate (prior information) relative to individuating information (likelihood). For instance, in a study, participants chose between uncertain prospects where estimating reward probability was essential. When the variability of prior and likelihood information about reward probability was manipulated, prior variability significantly impacted the degree to which participants underweighted the base rate of reward probability.
The neural mechanisms underlying base rate neglect are not yet fully understood. However, research has found that activity in certain brain regions, such as the orbitofrontal cortex, medial prefrontal cortex, and putamen, is associated with the degree of underweighting of the base rate and sensitivity to information variability.
Empirical studies have shown that people's inferences align more closely with Bayes' rule when information is presented in a way that helps overcome base-rate neglect. Organisations like the Cochrane Collaboration recommend using this format for communicating health statistics. Teaching individuals to translate Bayesian reasoning problems into natural frequency formats is more effective than simply instructing them to plug probabilities into Bayes' theorem. Graphical representations of natural frequencies, such as icon arrays or hypothetical outcome plots, also aid in making better inferences.
Base rate neglect can have significant implications in various contexts, such as college admissions or legal proceedings. For example, when given relevant statistics about GPA distribution, students tended to ignore them if provided with descriptive information about a particular student, even if the new information was irrelevant to academic performance. Similarly, in legal contexts, the prosecutor's fallacy arises when the prior probability of a random match is assumed to be equal to the probability of the defendant's innocence. Presenting information in a way that accounts for base rates can help mitigate these biases.
Coffin Incense Burner: A Step-by-Step Guide to Usage
You may want to see also
Explore related products
The impact of insensitivity to base rates on decision-making
Insensitivity to base rates bias, also known as the base rate fallacy or base rate neglect, is a common psychological bias that affects decision-making. It occurs when people make estimations or judgements without adequately considering the influence of base rates, which refer to the original probability or rate of possibility of an event occurring. This bias can lead to errors in probability judgments and decision-making.
One example of insensitivity to base rates bias is the "librarian or salesman" problem. In this scenario, individuals are asked to estimate the likelihood that a man named Donald Jones, described as "retiring," is either a librarian or a salesman. Many people might assume that he is more likely to be a librarian because librarians are typically associated with a reserved personality. However, this estimation neglects the base rate, which is the prevalence or proportion of each occupation in the population. In reality, salesmen outnumber male librarians significantly, so the probability of Donald Jones being a salesman is much higher, even if his personality doesn't perfectly match the stereotype.
Another example of the impact of insensitivity to base rates on decision-making can be found in behavioural finance. Investors often exhibit this bias by focusing on new or event-specific information, such as a company's quarterly earnings report, while ignoring the broader context or base rates, such as the company's solid financial position, consistent growth rates, and strong industry demand. This can lead to overreactions to market events and irrational financial decisions.
The base rate fallacy also has implications for areas like criminal justice and facial recognition technology. In a scenario where a city installs facial recognition cameras to identify wanted criminals, the high accuracy of the technology can be outweighed by the large number of people analysed. As a result, the list of identified criminals may include far more innocent people (false positives) than actual criminals due to the low base rate of criminality in the general population.
Furthermore, insensitivity to base rates can influence our perceptions and stereotypes. For example, certain majors in college are associated with specific stereotypes, such as engineering students being hardworking but cocky, or arts students being activists with an edgy fashion sense. However, these stereotypes may not accurately represent the base rates or actual proportions of students in each major who match those descriptions.
In summary, insensitivity to base rates bias can significantly impact decision-making by leading us to ignore relevant statistical information and make judgements based on specific or individuating information. By recognising this bias, we can strive to make more informed and accurate decisions by considering both base rates and specific details when estimating probabilities.
Burning Incense in Aluminum Cans: Safe or Not?
You may want to see also
Explore related products
The false positive paradox and its implications
The false positive paradox is a type of base rate fallacy, where our minds tend to ignore base rate information and focus on specific information. Base rate fallacy refers to the tendency to ignore general statistical information (base rates) and instead rely on too specific information when making judgements.
The false positive paradox describes situations where there are more false positive test results than true positives, meaning the classifier has low precision. This paradox is especially relevant when testing for rare occurrences or diseases. For example, a facial recognition camera that can identify wanted criminals 99% of the time will likely produce more false positives than true positives because there are far more innocent people than criminals.
In the context of disease testing, a test with a 99.9% accuracy rate may still yield more false positives than true positives if the prevalence of the disease is very low. For instance, a test for tuberculosis with a 99.9% accuracy rate and a 5% false positive rate will yield almost all false positives because so few people have the disease.
The false positive paradox has important implications for the use of data mining and predictive algorithms in identifying rare events, such as terrorism. As the base rate of terrorism is extremely low, the use of such algorithms may not be feasible due to the high number of false positives. This also applies to disease testing, where a high false positive rate can lead to incorrect diagnoses and unnecessary treatment.
The false positive paradox highlights the importance of considering base rates and the characteristics of the sampled population when interpreting test results or making judgements. It serves as a reminder that high accuracy rates do not necessarily translate to accurate classifications when dealing with rare occurrences.
Burning Cinnamon Incense: Safe or Not?
You may want to see also
Explore related products
The role of cognitive errors in the base rate fallacy
The base rate fallacy, also known as insensitivity to base rates, is a common psychological bias. It is a cognitive error where individuals place too little weight on the base rate of possibility, favouring individuating information (specific to a certain person or event) over base rate information (objective, statistical information).
For example, in a city of 1 million inhabitants, there are 100 terrorists and 999,900 non-terrorists. The city installs an alarm system with a surveillance camera and automatic facial recognition software that can identify a terrorist 99% of the time and will fail to do so 1% of the time. If the camera scans a non-terrorist, it will not ring 99% of the time but will ring 1% of the time. When the alarm sounds, someone making the base rate fallacy would infer that there is a 99% probability that the detected person is a terrorist. However, this is incorrect reasoning, and the probability of the detected person being a terrorist is actually near 1%. This is because there are many more non-terrorists than terrorists, and the number of false positives (non-terrorists scanned as terrorists) is much larger than the true positives.
Another example is a thought experiment by Kahneman and Tversky, where participants were given a personality sketch of a fictional graduate student named Tom W. and a list of nine areas of graduate studies. They were told to rank the likelihood of Tom W. pursuing each field of study. At the time, far more students were enrolled in education and the humanities than in computer science. However, 95% of participants said it was more likely that Tom W. was studying computer science than education or the humanities. Their predictions were based solely on the personality sketch, ignoring the base rate information.
In behavioural finance, the base rate fallacy is seen as the tendency for people to erroneously judge the likelihood of a situation by not taking into account all relevant data. Instead, investors might focus more on new information without considering how it changes their original assumptions. This can lead to market participants overreacting to new information, such as a change in interest rates, which can cause a larger-than-appropriate effect on the price of a security or asset class.
Overall, the base rate fallacy is a common cognitive error where individuals ignore the base rate or probability of an event occurring in favour of more specific information. This can lead to incorrect inferences and decisions that are not based on all the relevant data.
Burning Incense While Sleeping: Is it Safe or Risky?
You may want to see also
Frequently asked questions
Insensitivity to base rates bias, also known as the base rate fallacy or base rate neglect, is a common psychological bias where people tend to ignore base rates and instead rely on specific or individuating information to make judgements. Base rates refer to the probability of an event occurring without intervention.
When provided with both individuating information, which is specific to a certain person or event, and base rate information, which is objective and statistical, we tend to assign greater value to the specific information. This often happens because the specific information seems more relevant or because we are not well-versed in the technical rules of probability.
Sure, here's an example from a study by renowned behavioural scientists Daniel Kahneman and Amos Tversky. Participants were presented with a personality sketch of a fictional graduate student named Tom W. and were told to rank the likelihood of Tom W. pursuing different fields of graduate study. At the time, far more students were enrolled in education and the humanities than in computer science. However, 95% of participants said it was more likely that Tom W. was studying computer science than education or the humanities. Their predictions were based purely on the personality sketch, with total disregard for the base rate information.
