Statistics Book Reviews - Best Textbooks for Stats

by cazort

Reviews of introductory textbooks in statistics, from more general-audience books to mathy books for advanced or graduate students.

Statistics is a subject that many students find challenging. I have a master's in Statistics from Yale University, and have worked as a statistical consultant, and I still find it hard. I found it tough as a student, even though I had a strong mathematical background.

The good news is that there are wonderful books out there that can help students of statistics at all levels.

This page aims to connect students and teachers with the textbooks best suited for people of varying ability levels and different learning styles. I begin reviewing two intro books that do not require much math background. The second section then presents the more "mathy" books for people who want to learn statistics in depth. Lastly, I present two supplemental books that are in closely-related subjects, which I think can greatly enhance people's understanding of the subject.

Intro Stats vs. Mathematical Statistics

A full explanation of the different difficulty levels in this subject

Statistics textbooks are usually divided into two levels: introductory books and mathematical statistics books (usually containing phrases like "mathematical statistics" or "statistical inference" in the title). If you're not sure whether you're looking for an introductory statistics book, this section explains.

Intro stats books do not require knowledge of calculus. The math required for them is minimal--basic arithmetic and a little bit of algebra is necessary for calculations, but no more.

Mathematical statistics books go more into the theory of the mathematics behind statistics. These books typically require a strong mathematical background, including calculus, set theory, and probability theory. Some of these books may require familarity with logic and proof. These books are quite diverse in difficulty level, but generally require calculus and good general math skills. Other books require extensive advanced topics like advanced calculus, measure theory, or even topology.

If you want to locate some books to master these subjects, check out my book reviews in calculus or probability theory.

With the exception of the two supplemental books, this page is arranged roughly in the order of level of mathematical sophistication required...the more basic books are shown first.

What sorts of statistics books are you looking for?

Beginner Intro (Non-math) Statistics Books

For people who do not like math or have weak math backgrounds, but want a working knowledge of statistics.

Statistics in Plain English by Timothy C. Urdan

A word-oriented statistics book, covering the basics for non-math people
Statistics in Plain English, Third Edition

This inexpensive paperback provides a brief, simple overview of statistics to help readers gain a better understanding of how statistics work and how to interpret them correctly...

View on Amazon

If you are not a math person, but are intelligent and a deep thinker, and want to develop a fairly thorough understanding of statistics, I would point to this book, Statistics in Plain English. It does not water down ideas, and emphasizes deep thinking

Pros: I think this book would make a good textbook for an introductory statistics book for a stat course that does not require prior math background. It would also be useful for self-study. This book is probably all one would need to obtain a working knowledge of statistical concepts, to where one could understand most basic statistical information and handle a few basic calculations.

Cons: Verbose. Strongly math-oriented people may want a more advanced text, and people who are slow readers may find the volume of writing a bit intimidating, especially if they have to work through this book at the pace of a course. Like most intro textbooks, this book does not cover much probability theory and does not provide a rigorous mathematical foundation for the subject.

Statistics by Freedman, Pisani and Purves

A book for people who want to learn statistics without much math
Statistics, 4th Edition

Renowned for its clear prose and no-nonsense emphasis on core concepts, Statistics covers fundamentals using real examples to illustrate the techniques. The Fourth Edition has b...

View on Amazon

Statistics 4th (Fourth) Edition byFreedman

Renowned for its clear prose and no-nonsense emphasis on core concepts, Statistics covers fundamentals using real examples to illustrate the techniques. The Fourth Edition has b...

View on Amazon

Freedman is one of my favorite statistics authors. This book is very non-math oriented, and a bit goofy and off the wall. I recommend this but with a word of caution: this is a "love it or hate it" textbook that evokes strong opinions on both sides.

Pros: Highly accessible to people without a statistics background and with a weak math background. Funny and interesting. Helps develop accurate, rigorous thinking and sound reasoning without the need for rigorous mathematics.

Cons: As a book that is very wordy and humor oriented, this book tends to reach some students better than others. A common complaint I hear is that it is annoying and the authors don't get to the point soon enough. People who like math may find this book frustrating in how few equations it presents.

Mathematical Statistics Books

Books explaining statistical theory in depth, for people with a strong math background.

Mathematical Statistics and Data Analysis by John A. Rice

My favorite book on mathematical statistics; quite accessible"
Mathematical Statistics and Data Analysis (with CD Data Sets) (Available 2010 Titles Enhanced Web...

This is the first text in a generation to re-examine the purpose of the mathematical statistics course. The book's approach interweaves traditional topics with data analysis and...

View on Amazon

Rice's book Mathematical Statistics and Data Analysis is a book I would choose for an introduction to mathematical statistics for a student with a strong background in calculus.

Pros: Integrates data analysis in with presentation of theory, making the text ultimately more useful for preparing people for real world applications. Rich explanation of set theory, sample spaces, and basic probability theory, making this book self-contained and allowing it to be accessible to someone without the strongest mathematics background. Easy to skip around in. Includes some philosophical discussion, and explanation of where a lot of the mathematical structures and probability distributions come from.

Cons: Parts of this book would likely be tough to understand for people without a strong background in calculus. I also think the book might seem to go too fast for someone without at least some familiarity with basic probability theory.

All of Statistics by Larry Wasserman

Concise, an excellent reference, but not thorough
All of Statistics: A Concise Course in Statistical Inference (Springer Texts in Statistics)

Taken literally, the title "All of Statistics" is an exaggeration. But in spirit, the title is apt, as the book does cover a much broader range of topics than a typical introduc...

View on Amazon

Larry Wasserman's All of Statistics is subtitled A Concise Course in Statistical Inference, and I think it is just that. It is a mathy book, starting with abstract notions like sample spaces and events. If you're comfortable with set theory, summation notation, and have taken a course in calculus, this book will probably seem pretty accessible; otherwise it might be over your head.

Pros: Very concise, clear writing. Does a remarkable job of painting a complete picture of the field of statistics, covering topics that are often omitted, including nonparametric inference, Bayesian inference, decision theory, and even causal inference, as well as the usual topics like point estimation, hypothesis testing, and regression. Its combination of clarity and minimal presentation makes it an outstanding reference.

Cons: Omits proofs, extended explanations, and is sparse on examples. Mathematical notation can be dense at times. For self-study or a course textbook, I think this book is best supplemented by additional texts.

Statistical Inference by Casella and Berger

A specialized book, very math and equation-oriented, not for all
Statistical Inference

This book builds theoretical statistics from the first principles of probability theory. Starting from the basics of probability, the authors develop the theory of statistical i...

View on Amazon

This book is widely used, but it is not one of my favorites. It was used in an introductory graduate-level course I took, and I thought it was a poor choice for that course. It does have some strengths, so I thought it important to review. I would exercise caution before using this book as a course textbook, however. Please read my comments below about the book's weaknesses before using it!

Pros: Excellent exposition of probability theory at the beginning. Clean and thorough use of mathematics throughout.

Cons: Completely theoretical, and divorced from applications: very little data is presented in the book and exercises, and there is very little discussion of applications (even the chapters on ANOVA and regression are highly theoretical) or real-world considerations. Barely mentions the Bayesian paradigm. Distributions presented without any discussion of how or why these distributions arise in the real world (i.e. no connection at all is made to the theory of stochastic processes). Very little discussion or explanation is given of the meaning or motivation behind the various equations. Both text and exercises heavily emphasize symbolic manipulation, without developing intuition. Exercises are very tough, but can usually be solved by mechanical / brute force work, without developing deeper understanding.

Introduction to Mathematical Statistics by Hogg and Craig

An old-fashioned, classical book on mathematical statistics
Introduction to Mathematical Statistics

This classic book retains its outstanding ongoing features and continues to provide readers with excellent background material necessary for a successful understanding of mathem...

View on Amazon

I used this as a supplementary reference and learning book when I was learning statistics--it was not used in one of my classes but I've read it in depth. This book presents a very classical view of the subject of Mathematical Statistics. I would recommend a prior course in probability, a strong background in calculus, and substantial exposure to abstract math, before tackling this book.

Pros: A clearly written book, accessible to a person with sufficient math background. Unlike many books, I find this book retains its clarity as it gets into later, more advanced chapters.

Cons: Old-fashioned in its choice of topics and presentation style. Does not adequately discuss Bayesian statistics.

Reference vs. Learning Text

Here's why I think not all books are suited for both purposes

When you are learning a subject for the first time, it is more important that the exposition of the material that you are reading is clear and thorough. To people who have not seen material before, a wordier explanation is often better. Also, if you are working the whole way through a book, it is often not a problem if one chapter depends on the previous ones in a logical way.

For a reference, however, it is more important that you are able to look up a given topic, such as a techniques, a probability distribution, or terminology, in a concise and self-contained manner.

This is why I prefer texts like the Wasserman as a quick reference for the shelf, and books like the Rice for initial learning.

Key Supplemental Books

These two books can radically change how you think and are immensely valuable for statisticians and people looking for deeper understanding.

Information Theory, Inference and Learning Algorithms by David J. C. MacKay

A radical text offering a genuinely novel perspective
Information Theory, Inference and Learning Algorithms

Information theory and inference, often taught separately, are here united in one entertaining textbook. These topics lie at the heart of many exciting areas of contemporary sci...

View on Amazon

This book on information theory and inference is highly atypical, as much among books about information theory as about books on statistical inference. It is quite unique in that it integrates the subjects, and presents both of them in a way that is quite different from any other presentation I've encountered.

Pros: Outstanding for self-study; written primarily for self-study. Very fun presentations. Rich, thorough explanations, but with ample challenge. Communicates outside-the-box thinking, nuanced thinking, and does an outstanding job of teaching intuition and rigorous reasoning in a casual framework. Contains applications to coding theory and neural networks, and integrates the Bayesian paradigm throughout the text.

Cons: I find this book follows a pretty linear course and is hard to jump around in. In spite of the clarity of explanations, this book covers tough material and presents a novel perspective, and thus can be deceptively challenging to work through. I find that it also increases in difficulty level as one works through it, which may be frustrating for some students.

Statistical Decision Theory and Bayesian Analysis by James O. Berger

A deep, philosophical text with lucid prose, always provoking thought
Statistical Decision Theory and Bayesian Analysis (Springer Series in Statistics)

In this new edition the author has added substantial material on Bayesian analysis, including lengthy new sections on such important topics as empirical and hierarchical Bayes a...

View on Amazon

This is one of my favorite books on statistics, and one that I wish every statistician would read. It is deep and philosophical, and I found it to be not only very easy to understand, but highly thought-provoking.

Pros: A terrible pun, but the best part of this book is its prose. This book is always philosophical and deep, and I find it is a book that can change the way you think (and much for the better). It gets at the question of subjectivity vs. objectivity. The book makes sparse use of mathematical equations, which will please people like me who love working with data and love reading and writing, but tire of working with long, tedious manipulations of symbols. I find this book to be extraordinarily accessible. Although the book is broken into sections, with Bayesian

Cons: Requires a very solid background in calculus and some prior exposure to probability theory to work through; probably best for students who have also already studied some mathematical statistics. I also found that the material on Bayesian Analysis was at times a tiny bit more mathematically tedious than the material on decision theory, but this is a very minor complaint--this book has a much more clean and accessible presentation of this material than other books.

Did you find this page helpful?

Here I review textbooks in probability theory, from the introductory level through more advanced texts. I have chosen only books I consider to be the best of the best.
Reviews and recommendations of textbooks in Calc I, II, and III/Multivariable, as well as supplemental books for self-study or enrichment.
Recommendations and reviews of textbooks for linear algebra at both undergraduate (college) and graduate levels.
Updated: 04/01/2015, cazort
 
Thank you! Would you like to post a comment now?
2

Questions? Comments? Feedback?

Only logged-in users are allowed to comment. Login

You might also like

Probability Theory Books - Best Textbooks for Probability

Here I review textbooks in probability theory, from the introductory level th...

Calculus Books - Best Textbooks for Calculus

Reviews and recommendations of textbooks in Calc I, II, and III/Multivariable...


Disclosure: This page generates income for authors based on affiliate relationships with our partners, including Amazon, Google and others.
Loading ...
Error!