In probability theory and statistics, kurtosis (from the Greek word κυρτός, kyrtos or kurtos, meaning curved, arching) is any measure of the "peakedness" of the probability distribution of a real-valued random variable.^{[1]} In a similar way to the concept of skewness, kurtosis is a descriptor of the shape of a probability distribution and, just as for skewness, there are different ways of quantifying it for a theoretical distribution and corresponding ways of estimating it from a sample from a population. There are various interpretations of kurtosis, and of how particular measures should be interpreted; these are primarily peakedness (width of peak), tail weight, and lack of shoulders (distribution primarily peak and tails, not in between).
One common measure of kurtosis, originating with Karl Pearson, is based on a scaled version of the fourth moment of the data or population, but it has been argued that this really measures heavy tails, and not peakedness.^{[2]} For this measure, higher kurtosis means more of the variance is the result of infrequent extreme deviations, as opposed to frequent modestly sized deviations. It is common practice to use an adjusted version of Pearson's kurtosis, the excess kurtosis, to provide a comparison of the shape of a given distribution to that of the normal distribution. Distributions with negative or positive excess kurtosis are called platykurtic distributions or leptokurtic distributions respectively.
Alternative measures of kurtosis are: the L-kurtosis, which is a scaled version of the fourth L-moment; measures based on 4 population or sample quantiles.^{[3]} These correspond to the alternative measures of skewness that are not based on ordinary moments.^{[3]}
Pearson moments
The fourth standardized moment is defined as
- $$
{\beta_2=}\frac{\operatorname{E}[(X-{\mu})^4]}{(\operatorname{E}[(X-{\mu})^2])^2} {=} \frac{\mu_4}{\sigma^4}
where μ_{4} is the fourth moment about the mean and σ is the standard deviation. This is sometimes used as the definition of kurtosis in older works, but is not the definition used here.
Kurtosis is more commonly defined as the fourth cumulant divided by the square of the second cumulant, which is equal to the fourth moment around the mean divided by the square of the variance of the probability distribution minus 3,
- $\backslash gamma\_2\; =\; \backslash frac\{\backslash kappa\_4\}\{\backslash kappa\_2^2\}\; =\; \backslash frac\{\backslash mu\_4\}\{\backslash sigma^4\}\; -\; 3$
which is also known as excess kurtosis. The "minus 3" at the end of this formula is often explained as a correction to make the kurtosis of the normal distribution equal to zero. Another reason can be seen by looking at the formula for the kurtosis of the sum of random variables. Suppose that Y is the sum of n identically distributed independent random variables all with the same distribution as X. Then
- $\backslash operatorname\{Kurt\}[Y]\; =\; \backslash frac\{\backslash kappa\_4(Y)\}\{\backslash kappa\_2(Y)^2\}\; =\; \backslash frac\{n\; \backslash kappa\_4(X)\}\{(n\; \backslash kappa\_2(X))^2\}\; =\; \backslash frac\{1\}\{n\}\; \backslash frac\{\backslash kappa\_4(X)\}\{\backslash kappa\_2(X)^2\}\; =\; \backslash frac\{1\}\{n\}\backslash operatorname\{Kurt\}[X]\; .$
This formula would be much more complicated if kurtosis were defined just as μ_{4} / σ^{4} (without the minus 3).
More generally, if X_{1}, ..., X_{n} are independent random variables, not necessarily identically distributed, but all having the same variance, then
- $\backslash operatorname\{Kurt\}\backslash left(\backslash sum\_\{i=1\}^n\; X\_i\; \backslash right)\; =\; \{1\; \backslash over\; n^2\}\; \backslash sum\_\{i=1\}^n\; \backslash operatorname\{Kurt\}(X\_i),$
whereas this identity would not hold if the definition did not include the subtraction of 3.
The fourth standardized moment must be at least 1, so the excess kurtosis must be −2 or more. This lower bound is realized by the Bernoulli distribution with p = ½, or "coin toss". There is no upper limit to the excess kurtosis and it may be infinite.
Interpretation
The exact interpretation of the Pearson measure of kurtosis (or excess kurtosis) is disputed. The "classical" interpretation, which applies only to symmetric and unimodal distributions (those whose skewness is 0), is that kurtosis measures both the "peakedness" of the distribution and the heaviness of its tail.^{[4]} Various statisticians have proposed other interpretations, such as "lack of shoulders" (where the "shoulder" is defined vaguely as the area between the peak and the tail, or more specifically as the area about one standard deviation from the mean) or "bimodality".^{[5]} Balanda and MacGillivray assert that the standard definition of kurtosis "is a poor measure of the kurtosis, peakedness, or tail weight of a distribution"^{[6]} and instead propose to "define kurtosis vaguely as the location- and scale-free movement of probability mass from the shoulders of a distribution into its center and tails".^{[4]}
Terminology and examples
A high kurtosis distribution has a sharper peak and longer, fatter tails, while a low kurtosis distribution has a more rounded peak and shorter, thinner tails.
Distributions with zero excess kurtosis are called mesokurtic, or mesokurtotic. The most prominent example of a mesokurtic distribution is the normal distribution family, regardless of the values of its parameters. A few other well-known distributions can be mesokurtic, depending on parameter values: for example the binomial distribution is mesokurtic for $p\; =\; 1/2\; \backslash pm\; \backslash sqrt\{1/12\}$.
A distribution with positive excess kurtosis is called leptokurtic, or leptokurtotic. "Lepto-" means "slender".^{[7]} In terms of shape, a leptokurtic distribution has a more acute peak around the mean and fatter tails. Examples of leptokurtic distributions include the Student's t-distribution, Rayleigh distribution, Laplace distribution, exponential distribution, Poisson distribution and the logistic distribution. Such distributions are sometimes termed super Gaussian.
A distribution with negative excess kurtosis is called platykurtic, or platykurtotic. "Platy-" means "broad".^{[8]} In terms of shape, a platykurtic distribution has a lower, wider peak around the mean and thinner tails. Examples of platykurtic distributions include the continuous or discrete uniform distributions, and the raised cosine distribution. The most platykurtic distribution of all is the Bernoulli distribution with p = ½ (for example the number of times one obtains "heads" when flipping a coin once, a coin toss), for which the excess kurtosis is −2. Such distributions are sometimes termed sub-Gaussian.^{[9]}
Graphical examples
The Pearson type VII family
The effects of kurtosis are illustrated using a parametric family of distributions whose kurtosis can be adjusted while their lower-order moments and cumulants remain constant. Consider the Pearson type VII family, which is a special case of the Pearson type IV family restricted to symmetric densities. The probability density function is given by
- $f(x;\; a,\; m)\; =\; \backslash frac\{\backslash Gamma(m)\}\{a\backslash ,\backslash sqrt\{\backslash pi\}\backslash ,\backslash Gamma(m-1/2)\}\; \backslash left[1+\backslash left(\backslash frac\{x\}\{a\}\backslash right)^2\; \backslash right]^\{-m\},\; \backslash !$
where a is a scale parameter and m is a shape parameter.
All densities in this family are symmetric. The kth moment exists provided m > (k + 1)/2. For the kurtosis to exist, we require m > 5/2. Then the mean and skewness exist and are both identically zero. Setting a^{2} = 2m − 3 makes the variance equal to unity. Then the only free parameter is m, which controls the fourth moment (and cumulant) and hence the kurtosis. One can reparameterize with $m\; =\; 5/2\; +\; 3/\backslash gamma\_2$, where $\backslash gamma\_2$ is the kurtosis as defined above. This yields a one-parameter leptokurtic family with zero mean, unit variance, zero skewness, and arbitrary positive kurtosis. The reparameterized density is
- $g(x;\; \backslash gamma\_2)\; =\; f(x;\backslash ;\; a=\backslash sqrt\{2+6/\backslash gamma\_2\},\backslash ;\; m=5/2+3/\backslash gamma\_2).\; \backslash !$
In the limit as $\backslash gamma\_2\; \backslash to\; \backslash infty$ one obtains the density
- $g(x)\; =\; 3\; \backslash left(2\; +\; x^2\backslash right)^\{-5/2\},\; \backslash !$
which is shown as the red curve in the images on the right.
In the other direction as $\backslash gamma\_2\; \backslash to\; 0$ one obtains the standard normal density as the limiting distribution, shown as the black curve.
In the images on the right, the blue curve represents the density $x\; \backslash mapsto\; g(x;\; 2)$ with kurtosis of 2. The top image shows that leptokurtic densities in this family have a higher peak than the mesokurtic normal density. The comparatively fatter tails of the leptokurtic densities are illustrated in the second image, which plots the natural logarithm of the Pearson type VII densities: the black curve is the logarithm of the standard normal density, which is a parabola. One can see that the normal density allocates little probability mass to the regions far from the mean ("has thin tails"), compared with the blue curve of the leptokurtic Pearson type VII density with kurtosis of 2. Between the blue curve and the black are other Pearson type VII densities with γ_{2} = 1, 1/2, 1/4, 1/8, and 1/16. The red curve again shows the upper limit of the Pearson type VII family, with $\backslash gamma\_2\; =\; \backslash infty$ (which, strictly speaking, means that the fourth moment does not exist). The red curve decreases the slowest as one moves outward from the origin ("has fat tails").
Kurtosis of well-known distributions
Several well-known, unimodal and symmetric distributions from different parametric families are compared here. Each has a mean and skewness of zero. The parameters have been chosen to result in a variance equal to 1 in each case. The images on the right show curves for the following seven densities, on a linear scale and logarithmic scale:
- D: Laplace distribution, also known as the double exponential distribution, red curve (two straight lines in the log-scale plot), excess kurtosis = 3
- U: uniform distribution, magenta curve (shown for clarity as a rectangle in both images), excess kurtosis = −1.2.
Note that in these cases the platykurtic densities have bounded support, whereas the densities with positive or zero excess kurtosis are supported on the whole real line.
There exist platykurtic densities with infinite support,
and there exist leptokurtic densities with finite support.
- e.g., a distribution that is uniform between −3 and −0.3, between −0.3 and 0.3, and between 0.3 and 3, with the same density in the (−3, −0.3) and (0.3, 3) intervals, but with 20 times more density in the (−0.3, 0.3) interval
Sample kurtosis
For a sample of n values the sample excess kurtosis is
- $g\_2\; =\; \backslash frac\{m\_4\}\{m\_\{2\}^2\}\; -3\; =\; \backslash frac\{\backslash tfrac\{1\}\{n\}\; \backslash sum\_\{i=1\}^n\; (x\_i\; -\; \backslash overline\{x\})^4\}\{\backslash left(\backslash tfrac\{1\}\{n\}\; \backslash sum\_\{i=1\}^n\; (x\_i\; -\; \backslash overline\{x\})^2\backslash right)^2\}\; -\; 3$
where m_{4} is the fourth sample moment about the mean, m_{2} is the second sample moment about the mean (that is, the sample variance), x_{i} is the i^{th} value, and $\backslash overline\{x\}$ is the sample mean.
The variance of the sample kurtosis of a sample of size n from the normal distribution is^{[10]}
- $\backslash frac\{24n(n-1)^2\}\{(n-3)(n-2)(n+3)(n+5)\}$
An approximate alternative is 24/n but this is inaccurate for small samples.
Estimators of population kurtosis
Given a sub-set of samples from a population, the sample excess kurtosis above is a biased estimator of the population excess kurtosis. The usual estimator of the population excess kurtosis (used in DAP/SAS, Minitab, PSPP/SPSS, and Excel but not by BMDP) is G_{2}, defined as follows:
- $$
\begin{align}
G_2 & = \frac{k_4}{k_{2}^2} \\
& = \frac{n^2\,((n+1)\,m_4 - 3\,(n-1)\,m_{2}^2)}{(n-1)\,(n-2)\,(n-3)} \; \frac{(n-1)^2}{n^2\,m_{2}^2} \\
& = \frac{n-1}{(n-2)\,(n-3)} \left( (n+1)\,\frac{m_4}{m_{2}^2} - 3\,(n-1) \right) \\
& = \frac{n-1}{(n-2) (n-3)} \left( (n+1)\,g_2 + 6 \right) \\
& = \frac{(n+1)\,n\,(n-1)}{(n-2)\,(n-3)} \; \frac{\sum_{i=1}^n (x_i - \bar{x})^4}{\left(\sum_{i=1}^n (x_i - \bar{x})^2\right)^2} - 3\,\frac{(n-1)^2}{(n-2)\,(n-3)} \\
& = \frac{(n+1)\,n}{(n-1)\,(n-2)\,(n-3)} \; \frac{\sum_{i=1}^n (x_i - \bar{x})^4}{k_{2}^2} - 3\,\frac{(n-1)^2}{(n-2) (n-3)}
\end{align}
where k_{4} is the unique symmetric unbiased estimator of the fourth cumulant, k_{2} is the unbiased estimate of the second cumulant (identical to the unbiased estimate of the sample variance), m_{4} is the fourth sample moment about the mean, m_{2} is the second sample moment about the mean, x_{i} is the i^{th} value, and $\backslash bar\{x\}$ is the sample mean. Unfortunately, $G\_2$ is itself generally biased. For the normal distribution it is unbiased.
For computationally efficient ways of calculating the sample kurtosis see Algorithms for calculating higher-order statistics.
Applications
D'Agostino's K-squared test is a goodness-of-fit normality test based on a combination of the sample skewness and sample kurtosis, as is the Jarque–Bera test for normality.
For non-normal samples, the variance of the variance depends on the kurtosis; for details, please see variance.
Pearson's definition of kurtosis is used as an indicator of intermittency in turbulence.^{[11]}
Other measures of kurtosis
A different measure of "kurtosis", that is of the "peakedness" of a distribution, is provided by using L-moments instead of the ordinary moments.^{[12]}^{[13]}
See also
References
Further reading
- Joanes, D. N. & Gill, C. A. (1998) Comparing measures of sample skewness and kurtosis. 10.1111/1467-9884.00122
- Kim, Tae-Hwan; & White, Halbert. (2003/4). Alternative source (Comparison of kurtosis estimators)
- Seier, E. & Bonett, D.G. (2003). Two families of kurtosis measures. Metrika, 58, 59–70.
External links
- Template:Springer
- Free Online Software (Calculator) computes various types of skewness and kurtosis statistics for any dataset (includes small and large sample tests)..
- Earliest known uses of some of the words of mathematics
- Celebrating 100 years of Kurtosis a history of the topic, with different measures of kurtosis.
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.