Probably Overthinking It - by Allen B Downey (Hardcover)

About the Book

"Teacher, data scientist, and blogger Allen B. Downey knows well that the human mind has both an innate ability to understand statistics and to be fooled by them. Statistically speaking, you will be less popular than your friends, arrive at a train station during a gap in service, and fail to find a running mate in a race. But more than surprising us, errors in statistical thinking, Downey shows, can have a huge impact. Statistical confusion has led to incorrect patient prognoses, caused mistakes in predicting disasters like earthquakes, hurt vaccination programs, hindered social justice efforts, and led to dubious policy decisions. Written for those who may have once taken a statistics course, but now forget almost everything they've learned, the book includes a diversity of examples that use real data and have real world impacts. Building understanding incrementally, Downey engagingly and accessibly helps readers understand what we might learn when we get the mathematics right, and the consequences when we get it all wrong"--

Book Synopsis

An essential guide to the ways data can improve decision making.

Statistics are everywhere: in news reports, at the doctor's office, and in every sort of forecast, from the stock market to the weather. Blogger, teacher, and computer scientist Allen B. Downey knows well that people have an innate ability both to understand statistics and to be fooled by them. As he makes clear in this accessible introduction to statistical thinking, the stakes are big. Simple misunderstandings have led to incorrect medical prognoses, underestimated the likelihood of large earthquakes, hindered social justice efforts, and resulted in dubious policy decisions. There are right and wrong ways to look at numbers, and Downey will help you see which are which.

Probably Overthinking It uses real data to delve into real examples with real consequences, drawing on cases from health campaigns, political movements, chess rankings, and more. He lays out common pitfalls--like the base rate fallacy, length-biased sampling, and Simpson's paradox--and shines a light on what we learn when we interpret data correctly, and what goes wrong when we don't. Using data visualizations instead of equations, he builds understanding from the basics to help you recognize errors, whether in your own thinking or in media reports. Even if you have never studied statistics--or if you have and forgot everything you learned--this book will offer new insight into the methods and measurements that help us understand the world.

Review Quotes

"By delving into the realms of probability and causality in an accessible, even enjoyable way, Downey provokes important questions. Readers of this book will not become data scientists overnight, but they will be able to begin asking questions like a statistician, taking a skeptical probe to the many oversimplified presentations of data available today."

-- "Mathematical Intelligencer"

"Each statistical paradox is illustrated using a cluster of interesting and concrete examples. . . . Apart from making abstract concepts easier to grasp, the examples and illustrations used help to train readers to identify statistical paradoxes. As Downey claims at several points in the book, once you understand a statistical paradox, you will see it everywhere."-- "Metascience"

"[Downey] employs principles of mathematics and statistics to give insights into everyday phenomena . . . None of my teachers ever explained how practical and relevant math can be for gaining, solving, and understanding real-world problems. How I wish Downey had been my teacher!"-- "Sekar Writes"

"Downey presents a large assortment of graphs and numerical results drawn from legitimate databases and provides clear-cut examples to demonstrate how interpretive pitfalls arise. His style is lively and designed to appeal to the curious reader, and his choice of graphical formats skillfully illustrates his points. He explains challenging issues fully in a clear, logical manner." -- "Choice"

"While it eschews the technical density of a textbook, it demands more intellectual engagement than a typical pop science book, drawing readers in with its broad scope of topics and colorful storytelling."-- "Implicit Assumptions"

"Mark Twain once observed that 'facts are stubborn things, but statistics are more pliable.' Downey understands just how that happens, even to people who are not trying to obfuscate. It was an honest researcher who in 1971 found data that seemed to indicate smoking by pregnant women might be good for their babies--a misinterpretation that may have delayed anti-smoking measures by a decade. In this clear and cogent analysis, Downey explains why the data was misunderstood, as well as much else. It is a valuable book."--Floyd Norris, Johns Hopkins University, former chief financial correspondent for the New York Times

"Probably Overthinking It is a delightful exposition of commonly-encountered statistical fallacies and paradoxes and why they matter. The illustrations are powerful and the prose is exceptionally clear. There are few domains of human activity to which the lessons of this volume are not applicable."--Samuel H. Preston, coauthor of Demography: Measuring and Modeling Population Processes

"Probably Overthinking It shows how fascinating and interesting statistics can be. Readers don't need to be expert mathematicians. They just need to bring their curiosity about the world."--Ravin Kumar, data scientist at Google

"Downey's pure love for the subject shines through abundantly, as does his social conscience and belief in the importance of statistical methods to illuminate the greatest, most challenging issues of our time."--Aubrey Clayton, author of Bernoulli's Fallacy: Statistical Illogic and the Crisis of Modern Science