search

Become an active member of our fallacy-discussing community (or just become a lurker!)

Biased Sample Fallacy

(also known as: biased statistics, loaded sample, prejudiced statistics, prejudiced sample, loaded statistics, biased induction, biased generalization, biased generalizing, unrepresentative sample, unrepresentative generalization)

Description: Drawing a conclusion about a population based on a sample that is biased, or chosen in order to make it appear the population on average is different than it actually is.

This differs from the hasty generalization fallacy, where the biased sample is specifically chosen from a select group, and the small sample is just a random sample, but too small to get any accurate information.

Logical Form:

Sample S, which is biased, is taken from population P.

Conclusion C is drawn about population P based on S.

Example #1:

Based on a survey of 1000 American homeowners, 99% of those surveyed have two or more automobiles worth on average $100,000 each.  Therefore, Americans are very wealthy.

Explanation: Where did these homeowners live?  Beverly Hills, CA.  If the same survey was taken in Detroit, the results would be quite different.  It is fallacious to accept the conclusion about the American population in general based on not just the geographical sample, but also the fact that homeowners were only surveyed.

Example #2:

Pastor Pete: People are turning to God everywhere!  9 out of 10 people I interviewed said that they had a personal relationship with Jesus Christ.

Fred: Where did you find these people you interviewed?

Pastor Pete: In my church.

Explanation: Pastor Pete has drawn a conclusion about religious beliefs from people “everywhere” based on people he has interviewed in his church.  That’s like concluding that the world likes to dance naked in front of strangers after interviewing a group of strippers.

Exception: What exactly is “biased” is subjective, but some biases are very clear.

Tip: Be very wary of statistics.  Look at the source and details of the studies which produced the statistics.  Very often you will find some kind of bias.

References:

Halverson, W. H. (1984). A Concise Logic. McGraw-Hill Higher Education.

Questions about this fallacy? Ask our community!

Uncomfortable Ideas: Facts don't care about feelings. Science isn't concerned about sensibilities. And reality couldn't care less about rage.

This is a book about uncomfortable ideas—the reasons we avoid them, the reasons we shouldn’t, and discussion of dozens of examples that might infuriate you, offend you, or at least make you uncomfortable.

Many of our ideas about the world are based more on feelings than facts, sensibilities than science, and rage than reality. We gravitate toward ideas that make us feel comfortable in areas such as religion, politics, philosophy, social justice, love and sex, humanity, and morality. We avoid ideas that make us feel uncomfortable. This avoidance is a largely unconscious process that affects our judgment and gets in the way of our ability to reach rational and reasonable conclusions. By understanding how our mind works in this area, we can start embracing uncomfortable ideas and be better informed, be more understanding of others, and make better decisions in all areas of life.

Get 20% off this book and all Bo's books*. Use the promotion code: websiteusers

* This is for the author's bookstore only. Applies to autographed hardcover, audiobook, and ebook.

Get the Book