Probabilistic World

  • Home
  • About
  • Contact

Alternative Variance Formulas and Their Derivation

Posted on November 15, 2020 Written by The Cthaeh Leave a Comment

The equations of three alternative variance formulas

In today’s post I want to show you two alternative variance formulas to the main formula you’re used to seeing (both on this website and in other introductory texts).

Not only do these alternative formulas come in handy for the derivation of certain proofs and identities involving variance, they also further enrich our intuitive understanding of variance as a measure of dispersion for a finite population or a probability distribution.

[Read more…]

Filed Under: Probability Distributions, Statistics Tagged With: Arithmetic, Expected value, Mean, Variance

The Variance: Measuring Dispersion

Posted on December 8, 2018 Written by The Cthaeh Leave a Comment

Small pawn-shaped magnets of different color, representing varianceA few posts ago I introduced you to the “three M’s” of statistics — the concepts of mean, mode, and median. Today I want to talk to you about a related concept called variance.

While the three M’s measure the central tendency of a collection of numbers, the variance measures their dispersion. That is, it measures how different the numbers are from each other.

Measuring dispersion is another fundamental topic in statistics and probability theory. On the one hand, it tells you how much you can trust the central tendency measures as good representatives of the collection. High variance usually means a lot of the numbers in the collection will be far away from those measures.

[Read more…]

Filed Under: Statistics Tagged With: Mean, Parameter estimation, Variance

The Mean, the Mode, And the Median

Posted on October 1, 2018 Written by The Cthaeh 2 Comments

Mean, median, and mode of a distribution shown on a Spaghetti Western background

The concepts of mean, median, and mode are fundamental to statistics, probability theory, and anything related to data analysis as a whole. Being this important, they deserve their own introduction.

In statistics, these 3 concepts are examples of measures of central tendency. This is a fancy way of saying that they are single values that summarize collections of values.

Let’s unpack the last sentence. What exactly do I mean by ‘values’ and ‘collections of values’?

[Read more…]

Filed Under: Statistics Tagged With: Mean, Parameter estimation

Frequentist and Bayesian Approaches in Statistics

Posted on June 16, 2016 Written by The Cthaeh 52 Comments

Dennis Lindley vs. Ronald Fisher

What is statistics about?

Well, imagine you obtained some data from a particular collection of things. It could be the heights of individuals within a group of people, the weights of cats in a clowder, the number of petals in a bouquet of flowers, and so on.

Such collections are called samples and you can use the obtained data in two ways. The most straightforward thing you can do is give a detailed description of the sample. For example, you can calculate some of its useful properties:

  • The average of the sample
  • The spread of the sample (how much individual data points differ from each other), also known as its variance
  • The number or percentage of individuals who score above or below some constant (for example, the number of people whose height is above 180 cm)
  • Etc.

You only use these quantities to summarize the sample. And the discipline that deals with such calculations is descriptive statistics.

But what if you wanted to learn something more general than just the properties of the sample? What if you wanted to find a pattern that doesn’t just hold for this particular sample, but also for the population from which you took the sample? The branch of statistics that deals with such generalizations is inferential statistics and is the main focus of this post.

The two general “philosophies” in inferential statistics are frequentist inference and Bayesian inference. I’m going to highlight  the main differences between them — in the types of questions they formulate, as well as in the way they go about answering them.

But first, let’s start with a brief introduction to inferential statistics.

[Read more…]

Filed Under: Bayes' Theorem, Statistics Tagged With: Confidence interval, Null hypothesis, P-value, Parameter estimation

An Intuitive Explanation of P-Values

Posted on March 14, 2016 Written by The Cthaeh 12 Comments

"P-values are tricky to understand, p

If you ever took an introductory course in statistics or attempted to read a publication in a scientific journal, you know what p-values are. Оr at least you’ve seen them. Most of the time they appear in the “results” section of a paper, attached to claims that need verification. For example:

  • “Ratings of the target person’s ‘dating desirability’ showed the predicted effect of prior stimuli, […], p < 002.”

The stuff in the square brackets is usually other relevant statistics, such as the mean difference between experimental groups. If the p-value is below a certain threshold, the result is labeled “statistically significant” and otherwise it’s labeled “not significant”. But what does that mean? What is the result significant for? And for whom? What does all of that say about the credibility of the claim preceded by the p-value?

There are common misinterpretations of p-values and the related concept of “statistical significance”. In this post, I’m going to properly define both concepts and show the intuition behind their correct interpretation.

If you don’t have much experience with probabilities, I suggest you take a look at the introductory sections of my post about Bayes’ theorem, where I also introduce some basic probability theory concepts and notation.

[Read more…]

Filed Under: Statistics Tagged With: Null hypothesis, P-value

Sign Up For The Probabilistic World Newsletter

Enter your email below to receive updates and be notified about new posts.

Follow Probabilistic World

  • Facebook
  • Twitter

Recent posts

  • Alternative Variance Formulas and Their Derivation
  • The Sum Operator: Everything You Need to Know
  • Natural Numbers and Arithmetic: Intuition
  • The Birthday Problem: Python Simulation
  • The Birthday Problem: Analytic Solution

Probabilistic World