Pareto distribution: Difference between revisions
imported>49ersBelongInSanFrancisco m Reverted 1 edit by 2001:DF4:E000:3FC1:BD67:744:8564:16ED (talk) to last revision by 130.233.200.220 |
imported>Explicit m Removing link(s) Wikipedia:Articles for deletion/SegReg closed as delete (XFDcloser) |
||
| Line 30: | Line 30: | ||
0 & \dfrac{1}{\alpha^2} | 0 & \dfrac{1}{\alpha^2} | ||
\end{bmatrix}</math> | \end{bmatrix}</math> | ||
| ES =<math>\frac{ x_m \alpha }{ (1-p)^{\frac{1}{\alpha}} (\alpha-1)}</math><ref name="norton">{{cite journal |last1=Norton |first1=Matthew |last2=Khokhlov |first2=Valentyn |last3=Uryasev |first3=Stan |year=2019 |title=Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation |journal=Annals of Operations Research |volume=299 |issue=1–2 |pages=1281–1315 |publisher=Springer|doi=10.1007/s10479-019-03373-1 |arxiv=1811.11301 |s2cid=254231768 |url=http://uryasev.ams.stonybrook.edu/wp-content/uploads/2019/10/Norton2019_CVaR_bPOE.pdf |access-date=2023-02-27}}</ref> | | ES =<math>\frac{ x_m \alpha }{ (1-p)^{\frac{1}{\alpha}} (\alpha-1)}</math><ref name="norton">{{cite journal |last1=Norton |first1=Matthew |last2=Khokhlov |first2=Valentyn |last3=Uryasev |first3=Stan |year=2019 |title=Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation |journal=Annals of Operations Research |volume=299 |issue=1–2 |pages=1281–1315 |publisher=Springer |doi=10.1007/s10479-019-03373-1 |arxiv=1811.11301 |s2cid=254231768 |url=http://uryasev.ams.stonybrook.edu/wp-content/uploads/2019/10/Norton2019_CVaR_bPOE.pdf |access-date=2023-02-27 |archive-date=2023-03-31 |archive-url=https://web.archive.org/web/20230331230821/http://uryasev.ams.stonybrook.edu/wp-content/uploads/2019/10/Norton2019_CVaR_bPOE.pdf |url-status=dead }}</ref> | ||
| bPOE =<math>\left( \frac{x_m \alpha}{x(\alpha-1) } \right)^\alpha </math><ref name="norton"/> | | bPOE =<math>\left( \frac{x_m \alpha}{x(\alpha-1) } \right)^\alpha </math><ref name="norton"/> | ||
}} | }} | ||
The '''Pareto distribution''', named after the Italian [[civil engineer]], [[economist]], and [[sociologist]] [[Vilfredo Pareto]],<ref>{{cite journal |last=Amoroso |first=Luigi|date=January 1938 |title=Vilfredo Pareto |journal=Econometrica (Pre-1986) | The '''Pareto distribution''', named after the Italian [[civil engineer]], [[economist]], and [[sociologist]] [[Vilfredo Pareto]],<ref>{{cite journal |last=Amoroso |first=Luigi|date=January 1938 |title=Vilfredo Pareto |journal=Econometrica (Pre-1986) |volume=6 |issue=1 }}</ref> is a [[power-law]] [[probability distribution]] that is used in description of [[social]], [[quality control]], [[scientific]], [[geophysical]], [[actuarial science|actuarial]], and many other types of observable phenomena; the principle originally applied to describing the [[distribution of wealth]] in a society, fitting the trend that a large portion of wealth is held by a small fraction of the population.<ref>{{cite journal |last=Pareto |first=Vilfredo |year=1898 |title=Cours d'economie politique |journal=Journal of Political Economy |volume=6 |doi=10.1086/250536 |url=https://zenodo.org/record/2144014 }}</ref><ref name=":1"/> | ||
The ''[[Pareto principle]]'' or "80:20 rule" stating that 80% of outcomes are due to 20% of causes was named in honour of Pareto, but the concepts are distinct, and only Pareto distributions with shape value ({{math|''α''}}) {{nobr|of   {{math|log {{sub|4}} 5 ≈ 1.16}}}} precisely reflect it. Empirical observation has shown that this 80:20 distribution fits a wide range of cases, including natural phenomena<ref>{{cite journal |last=van Montfort |first=M.A.J. |year=1986 |title=The generalized Pareto distribution applied to rainfall depths |journal=Hydrological Sciences Journal |volume=31 |issue=2 |pages=151–162 |doi=10.1080/02626668609491037 |doi-access=free |bibcode=1986HydSJ..31..151V }}</ref> and human activities.<ref>{{cite journal |last=Oancea |first=Bogdan |year=2017 |title=Income inequality in Romania: The exponential-Pareto distribution |journal=Physica A: Statistical Mechanics and Its Applications |volume=469 |pages=486–498 |doi=10.1016/j.physa.2016.11.094 |bibcode=2017PhyA..469..486O }}</ref><ref>{{cite web |last=Morella |first=Matteo |title=Pareto distribution |url=https://www.academia.edu/59302211 |website=academia.edu}}</ref> | The ''[[Pareto principle]]'' or "80:20 rule" stating that 80% of outcomes are due to 20% of causes was named in honour of Pareto, but the concepts are distinct, and only Pareto distributions with shape value ({{math|''α''}}) {{nobr|of   {{math|log {{sub|4}} 5 ≈ 1.16}}}} precisely reflect it. Empirical observation has shown that this 80:20 distribution fits a wide range of cases, including natural phenomena<ref>{{cite journal |last=van Montfort |first=M.A.J. |year=1986 |title=The generalized Pareto distribution applied to rainfall depths |journal=Hydrological Sciences Journal |volume=31 |issue=2 |pages=151–162 |doi=10.1080/02626668609491037 |doi-access=free |bibcode=1986HydSJ..31..151V }}</ref> and human activities.<ref>{{cite journal |last=Oancea |first=Bogdan |year=2017 |title=Income inequality in Romania: The exponential-Pareto distribution |journal=Physica A: Statistical Mechanics and Its Applications |volume=469 |pages=486–498 |doi=10.1016/j.physa.2016.11.094 |bibcode=2017PhyA..469..486O }}</ref><ref>{{cite web |last=Morella |first=Matteo |title=Pareto distribution |url=https://www.academia.edu/59302211 |website=academia.edu}}</ref> | ||
| Line 41: | Line 41: | ||
If ''X'' is a [[random variable]] with a Pareto (Type I) distribution,<ref name=arnold>{{cite book |first=Barry C. |last=Arnold |year=1983 |title=Pareto Distributions |publisher=International Co-operative Publishing House |isbn= 978-0-89974-012-6}}</ref> then the probability that ''X'' is greater than some number ''x'', i.e., the [[survival function]] (also called tail function), is given by | If ''X'' is a [[random variable]] with a Pareto (Type I) distribution,<ref name=arnold>{{cite book |first=Barry C. |last=Arnold |year=1983 |title=Pareto Distributions |publisher=International Co-operative Publishing House |isbn= 978-0-89974-012-6}}</ref> then the probability that ''X'' is greater than some number ''x'', i.e., the [[survival function]] (also called tail function), is given by | ||
<math display="block">\overline{F}(x) = \Pr(X>x) = \begin{cases} | |||
\left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x\ge x_\mathrm{m}, \\ | \left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x\ge x_\mathrm{m}, \\ | ||
1 & x < x_\mathrm{m}, | 1 & x < x_\mathrm{m}, | ||
| Line 52: | Line 52: | ||
From the definition, the [[cumulative distribution function]] of a Pareto random variable with parameters ''α'' and ''x''<sub>m</sub> is | From the definition, the [[cumulative distribution function]] of a Pareto random variable with parameters ''α'' and ''x''<sub>m</sub> is | ||
<math display="block">F_X(x) = \begin{cases} | |||
1-\left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x \ge x_\mathrm{m}, \\ | 1-\left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x \ge x_\mathrm{m}, \\ | ||
0 & x < x_\mathrm{m}. | 0 & x < x_\mathrm{m}. | ||
| Line 60: | Line 60: | ||
It follows (by [[Derivative|differentiation]]) that the [[probability density function]] is | It follows (by [[Derivative|differentiation]]) that the [[probability density function]] is | ||
<math display="block">f_X(x)= \begin{cases} \frac{\alpha x_\mathrm{m}^\alpha}{x^{\alpha+1}} & x \ge x_\mathrm{m}, \\ 0 & x < x_\mathrm{m}. \end{cases} </math> | |||
When plotted on linear axes, the distribution assumes the familiar J-shaped curve which approaches each of the orthogonal axes [[asymptotically]]. All segments of the curve are self-similar (subject to appropriate scaling factors). When plotted in a [[log–log plot]], the distribution is represented by a straight line. | When plotted on linear axes, the distribution assumes the familiar J-shaped curve which approaches each of the orthogonal axes [[asymptotically]]. All segments of the curve are self-similar (subject to appropriate scaling factors). When plotted in a [[log–log plot]], the distribution is represented by a straight line. | ||
| Line 66: | Line 66: | ||
==Properties== | ==Properties== | ||
===Moments and characteristic function=== | ===Moments and characteristic function=== | ||
* The [[expected value]] of a [[random variable]] following a Pareto distribution is | * The [[expected value]] of a [[random variable]] following a Pareto distribution is <math display="block">\operatorname{E}(X) = \begin{cases} | ||
\infty & \alpha\le 1, \\ | |||
\frac{\alpha x_{\mathrm{m}}}{\alpha-1} & \alpha>1. | \frac{\alpha x_{\mathrm{m}}}{\alpha-1} & \alpha>1. | ||
\end{cases}</math> | \end{cases}</math> | ||
* The [[variance]] of a [[random variable]] following a Pareto distribution is | * The [[variance]] of a [[random variable]] following a Pareto distribution is <math display="block">\operatorname{Var}(X)= \begin{cases} | ||
\infty & \alpha\in(1,2], \\ | \infty & \alpha\in(1,2], \\ | ||
\left(\frac{x_\mathrm{m}}{\alpha-1}\right)^2 \frac{\alpha}{\alpha-2} & \alpha>2. | \left(\frac{x_\mathrm{m}}{\alpha-1}\right)^2 \frac{\alpha}{\alpha-2} & \alpha>2. | ||
\end{cases}</math> | \end{cases}</math> (If ''α'' ≤ 1, the variance does not exist.) | ||
* The raw [[moment (mathematics)|moments]] are <math display="block">\mu_n'= \begin{cases} \infty & \alpha\le n, \\ \frac{\alpha x_\mathrm{m}^n}{\alpha-n} & \alpha>n. \end{cases}</math> | |||
* The [[Moment-generating function|moment generating function]] is only defined for non-positive values ''t'' ≤ 0 as <math display="block">M\left(t;\alpha,x_\mathrm{m}\right) = \operatorname{E} \left [e^{tX} \right ] = \alpha(-x_\mathrm{m} t)^\alpha\Gamma(-\alpha,-x_\mathrm{m} t)</math> <math display="block">M\left(0,\alpha,x_\mathrm{m}\right)=1.</math> Thus, since the expectation does not converge on an [[open interval]] containing <math>t=0</math> we say that the moment generating function does not exist. | |||
* The raw [[moment (mathematics)|moments]] are | * The [[Characteristic function (probability theory)|characteristic function]] is given by <math display="block">\varphi(t;\alpha,x_\mathrm{m})=\alpha(-ix_\mathrm{m} t)^\alpha\Gamma(-\alpha,-ix_\mathrm{m} t),</math> where Γ(''a'', ''x'') is the [[incomplete gamma function]]. | ||
* The [[Moment-generating function|moment generating function]] is only defined for non-positive values ''t'' ≤ 0 as | |||
Thus, since the expectation does not converge on an [[open interval]] containing <math>t=0</math> we say that the moment generating function does not exist. | |||
* The [[Characteristic function (probability theory)|characteristic function]] is given by | |||
The parameters may be solved for using the [[Method of moments (statistics)|method of moments]].<ref>S. Hussain, S.H. Bhatti (2018). | The parameters may be solved for using the [[Method of moments (statistics)|method of moments]].<ref>S. Hussain, S.H. Bhatti (2018). | ||
| Line 99: | Line 84: | ||
The [[conditional probability distribution]] of a Pareto-distributed random variable, given the event that it is greater than or equal to a particular number <math>x_1</math> exceeding <math>x_\text{m}</math>, is a Pareto distribution with the same Pareto index <math>\alpha</math> but with minimum <math>x_1</math> instead of <math>x_\text{m}</math>: | The [[conditional probability distribution]] of a Pareto-distributed random variable, given the event that it is greater than or equal to a particular number <math>x_1</math> exceeding <math>x_\text{m}</math>, is a Pareto distribution with the same Pareto index <math>\alpha</math> but with minimum <math>x_1</math> instead of <math>x_\text{m}</math>: | ||
<math display="block"> | |||
\text{Pr}(X \geq x | X \geq x_1) = | \text{Pr}(X \geq x | X \geq x_1) = | ||
\begin{cases} | \begin{cases} | ||
\left(\frac{x_1}{x}\right)^\alpha & x \geq x_1, \\ | \left(\frac{x_1}{x}\right)^\alpha & x \geq x_1, \\ | ||
1 & x < x_1. | 1 & x < x_1. | ||
\end{cases} | \end{cases}</math> | ||
</math> | |||
This implies that the conditional expected value (if it is finite, i.e. <math>\alpha>1</math>) is proportional to <math>x_1</math>: | This implies that the conditional expected value (if it is finite, i.e. <math>\alpha>1</math>) is proportional to <math>x_1</math>: | ||
<math display="block">\text{E}(X | X \geq x_1) \propto x_1.</math> | |||
In case of random variables that describe the lifetime of an object, this means that life expectancy is proportional to age, and is called the [[Lindy effect]] or Lindy's Law.<ref name=":02">{{cite journal|last1=Eliazar|first1=Iddo|date=November 2017|title=Lindy's Law|journal=Physica A: Statistical Mechanics and Its Applications|volume=486|pages=797–805|bibcode=2017PhyA..486..797E|doi=10.1016/j.physa.2017.05.077|s2cid=125349686 }}</ref> | In case of random variables that describe the lifetime of an object, this means that life expectancy is proportional to age, and is called the [[Lindy effect]] or Lindy's Law.<ref name=":02">{{cite journal|last1=Eliazar|first1=Iddo|date=November 2017|title=Lindy's Law|journal=Physica A: Statistical Mechanics and Its Applications|volume=486|pages=797–805|bibcode=2017PhyA..486..797E|doi=10.1016/j.physa.2017.05.077|s2cid=125349686 }}</ref> | ||
| Line 119: | Line 103: | ||
The [[geometric mean]] (''G'') is<ref name=Johnson1994>Johnson NL, Kotz S, Balakrishnan N (1994) Continuous univariate distributions Vol 1. Wiley Series in Probability and Statistics.</ref> | The [[geometric mean]] (''G'') is<ref name=Johnson1994>Johnson NL, Kotz S, Balakrishnan N (1994) Continuous univariate distributions Vol 1. Wiley Series in Probability and Statistics.</ref> | ||
<math display="block"> G = x_\text{m} \exp \left( \frac{1}{\alpha} \right).</math> | |||
===Harmonic mean=== | ===Harmonic mean=== | ||
The [[harmonic mean]] (''H'') is<ref name="Johnson1994"/> | The [[harmonic mean]] (''H'') is<ref name="Johnson1994"/> | ||
<math display="block"> H = x_\text{m} \left( 1 + \frac{ 1 }{ \alpha } \right).</math> | |||
===Graphical representation=== | ===Graphical representation=== | ||
The characteristic curved '[[long tail]]' distribution, when plotted on a linear scale, masks the underlying simplicity of the function when plotted on a [[log-log graph]], which then takes the form of a straight line with negative gradient: It follows from the formula for the probability density function that for ''x'' ≥ ''x''<sub>m</sub>, | The characteristic curved '[[long tail]]' distribution, when plotted on a linear scale, masks the underlying simplicity of the function when plotted on a [[log-log graph]], which then takes the form of a straight line with negative gradient: It follows from the formula for the probability density function that for ''x'' ≥ ''x''<sub>m</sub>, | ||
<math display="block">\log f_X(x)= \log \left(\alpha\frac{x_\mathrm{m}^\alpha}{x^{\alpha+1}}\right) = \log (\alpha x_\mathrm{m}^\alpha) - (\alpha+1) \log x.</math> | |||
Since ''α'' is positive, the gradient −(''α'' + 1) is negative. | Since ''α'' is positive, the gradient −(''α'' + 1) is negative. | ||
| Line 179: | Line 163: | ||
|} | |} | ||
The shape parameter ''α'' is the [[tail index]], ''μ'' is location, ''σ'' is scale, ''γ'' is an inequality parameter. Some special cases of Pareto Type (IV) are | The shape parameter ''α'' is the [[shape parameter|tail index]], ''μ'' is location, ''σ'' is scale, ''γ'' is an inequality parameter. Some special cases of Pareto Type (IV) are | ||
<math display="block"> P(IV)(\sigma, \sigma, 1, \alpha) = P(I)(\sigma, \alpha),</math> | |||
<math display="block"> P(IV)(\mu, \sigma, 1, \alpha) = P(II)(\mu, \sigma, \alpha),</math> | |||
<math display="block"> P(IV)(\mu, \sigma, \gamma, 1) = P(III)(\mu, \sigma, \gamma).</math> | |||
The finiteness of the mean, and the existence and the finiteness of the variance depend on the tail index ''α'' (inequality index ''γ''). In particular, fractional ''δ''-moments are finite for some ''δ'' > 0, as shown in the table below, where ''δ'' is not necessarily an integer. | The finiteness of the mean, and the existence and the finiteness of the variance depend on the tail index ''α'' (inequality index ''γ''). In particular, fractional ''δ''-moments are finite for some ''δ'' > 0, as shown in the table below, where ''δ'' is not necessarily an integer. | ||
| Line 201: | Line 185: | ||
|| <math>\alpha > 1</math> | || <math>\alpha > 1</math> | ||
|| <math> \frac{ \sigma^\delta \Gamma(\alpha-\delta)\Gamma(1+\delta)}{\Gamma(\alpha)}</math> | || <math> \frac{ \sigma^\delta \Gamma(\alpha-\delta)\Gamma(1+\delta)}{\Gamma(\alpha)}</math> | ||
|| <math>0 < \delta < \alpha</math> | || <math>0 < \delta < \alpha, \mu=0</math> | ||
|- | |- | ||
| Type III | | Type III | ||
| Line 221: | Line 205: | ||
Feller<ref name=jkb94/><ref name=feller/> defines a Pareto variable by transformation ''U'' = ''Y''<sup>−1</sup> − 1 of a [[beta distribution|beta random variable]] ,''Y'', whose probability density function is | Feller<ref name=jkb94/><ref name=feller/> defines a Pareto variable by transformation ''U'' = ''Y''<sup>−1</sup> − 1 of a [[beta distribution|beta random variable]] ,''Y'', whose probability density function is | ||
<math display="block"> f(y) = \frac{y^{\gamma_1-1} (1-y)^{\gamma_2-1}}{B(\gamma_1, \gamma_2)}, \qquad 0<y<1; \gamma_1,\gamma_2>0,</math> | |||
where | where B( ) is the [[beta function]]. If | ||
<math display="block"> W = \mu + \sigma(Y^{-1}-1)^\gamma, \qquad \sigma>0, \gamma>0,</math> | |||
then ''W'' has a Feller–Pareto distribution FP(''μ'', ''σ'', ''γ'', ''γ''<sub>1</sub>, ''γ''<sub>2</sub>).<ref name=arnold/> | then ''W'' has a Feller–Pareto distribution FP(''μ'', ''σ'', ''γ'', ''γ''<sub>1</sub>, ''γ''<sub>2</sub>).<ref name=arnold/> | ||
| Line 231: | Line 215: | ||
If <math>U_1 \sim \Gamma(\delta_1, 1)</math> and <math>U_2 \sim \Gamma(\delta_2, 1)</math> are independent [[Gamma distribution|Gamma variables]], another construction of a Feller–Pareto (FP) variable is<ref>{{cite book |last=Chotikapanich |first=Duangkamon |title=Modeling Income Distributions and Lorenz Curves |chapter=Chapter 7: Pareto and Generalized Pareto Distributions |date=16 September 2008 |pages=121–22 |publisher=Springer |isbn=9780387727967 |chapter-url=https://books.google.com/books?id=fUJZZLj1kbwC}}</ref> | If <math>U_1 \sim \Gamma(\delta_1, 1)</math> and <math>U_2 \sim \Gamma(\delta_2, 1)</math> are independent [[Gamma distribution|Gamma variables]], another construction of a Feller–Pareto (FP) variable is<ref>{{cite book |last=Chotikapanich |first=Duangkamon |title=Modeling Income Distributions and Lorenz Curves |chapter=Chapter 7: Pareto and Generalized Pareto Distributions |date=16 September 2008 |pages=121–22 |publisher=Springer |isbn=9780387727967 |chapter-url=https://books.google.com/books?id=fUJZZLj1kbwC}}</ref> | ||
<math display="block">W = \mu + \sigma \left(\frac{U_1}{U_2}\right)^\gamma</math> | |||
and we write ''W'' ~ FP(''μ'', ''σ'', ''γ'', ''δ''<sub>1</sub>, ''δ''<sub>2</sub>). Special cases of the Feller–Pareto distribution are | and we write ''W'' ~ FP(''μ'', ''σ'', ''γ'', ''δ''<sub>1</sub>, ''δ''<sub>2</sub>). Special cases of the Feller–Pareto distribution are | ||
<math display="block">FP(\sigma, \sigma, 1, 1, \alpha) = P(I)(\sigma, \alpha)</math> | |||
<math display="block">FP(\mu, \sigma, 1, 1, \alpha) = P(II)(\mu, \sigma, \alpha)</math> | |||
<math display="block">FP(\mu, \sigma, \gamma, 1, 1) = P(III)(\mu, \sigma, \gamma)</math> | |||
<math display="block">FP(\mu, \sigma, \gamma, 1, \alpha) = P(IV)(\mu, \sigma, \gamma, \alpha).</math> | |||
===Inverse-Pareto Distribution / Power Distribution === | ===Inverse-Pareto Distribution / Power Distribution === | ||
When a random variable <math>Y</math> follows a pareto distribution, then its inverse <math>X=1/Y</math> follows a Power distribution. | When a random variable <math>Y</math> follows a pareto distribution, then its inverse <math>X=1/Y</math> follows a Power distribution. | ||
Inverse Pareto distribution is equivalent to a Power distribution <ref>Dallas | Inverse Pareto distribution is equivalent to a Power distribution<ref>{{cite journal |last=Dallas |first=A. C. |title=Characterizing the Pareto and power distributions |journal=Annals of the Institute of Statistical Mathematics |volume=28 |issue=1 |year=1976 |pages=491–497 |doi=10.1007/BF02504764 }}</ref> | ||
<math display="block">Y\sim \mathrm{Pa}(\alpha, x_m) = \frac{\alpha x_m^\alpha}{y^{\alpha+1}} \quad (y \ge x_m) \quad \Leftrightarrow \quad X\sim \mathrm{iPa}(\alpha, x_m) = \mathrm{Power}(x_m^{-1}, \alpha) = \frac{\alpha x^{\alpha-1}}{(x_m^{-1})^\alpha} \quad (0< x \le x_m^{-1})</math> | |||
===Relation to the exponential distribution=== | ===Relation to the exponential distribution=== | ||
The Pareto distribution is related to the [[exponential distribution]] as follows. If ''X'' is Pareto-distributed with minimum ''x''<sub>m</sub> and index ''α'', then | The Pareto distribution is related to the [[exponential distribution]] as follows. If ''X'' is Pareto-distributed with minimum ''x''<sub>m</sub> and index ''α'', then | ||
<math display="block"> Y = \log\left(\frac{X}{x_\mathrm{m}}\right) </math> | |||
is [[exponential distribution|exponentially distributed]] with rate parameter ''α''. Equivalently, if ''Y'' is exponentially distributed with rate ''α'', then | is [[exponential distribution|exponentially distributed]] with rate parameter ''α''. Equivalently, if ''Y'' is exponentially distributed with rate ''α'', then | ||
<math display="block"> x_\mathrm{m} e^Y</math> | |||
is Pareto-distributed with minimum ''x''<sub>m</sub> and index ''α''. | is Pareto-distributed with minimum ''x''<sub>m</sub> and index ''α''. | ||
| Line 260: | Line 244: | ||
This can be shown using the standard change-of-variable techniques: | This can be shown using the standard change-of-variable techniques: | ||
<math display="block"> | |||
\begin{align} | \begin{align} | ||
\Pr(Y<y) & = \Pr\left(\log\left(\frac{X}{x_\mathrm{m}}\right)<y\right) \\ | \Pr(Y<y) & = \Pr\left(\log\left(\frac{X}{x_\mathrm{m}}\right)<y\right) \\ | ||
| Line 269: | Line 253: | ||
The last expression is the cumulative distribution function of an exponential distribution with rate ''α''. | The last expression is the cumulative distribution function of an exponential distribution with rate ''α''. | ||
Pareto distribution can be constructed by hierarchical exponential distributions.<ref>{{Cite thesis|title=Bayesian semiparametric spatial and joint spatio-temporal modeling| | Pareto distribution can be constructed by hierarchical exponential distributions.<ref>{{Cite thesis|title=Bayesian semiparametric spatial and joint spatio-temporal modeling|hdl=10355/4450|publisher=University of Missouri–Columbia|date=2006|degree=Phd|first=Gentry|last=White}} section 5.3.1.</ref> Let <math>\phi | a \sim \text{Exp}(a)</math> and <math>\eta | \phi \sim \text{Exp}(\phi) </math>. Then we have <math>p(\eta | a) = \frac{a}{(a+\eta)^2}</math> and, as a result, <math>a+\eta \sim \text{Pareto}(a, 1)</math>. | ||
<math>\phi | a \sim \text{Exp}(a)</math> and | |||
<math>\eta | \phi \sim \text{Exp}(\phi) </math>. Then we have <math>p(\eta | a) = \frac{a}{(a+\eta)^2}</math> and, as a result, <math>a+\eta \sim \text{Pareto}(a, 1)</math>. | |||
More in general, if <math>\lambda \sim \text{Gamma}(\alpha, \beta)</math> (shape-rate parametrization) and <math>\eta | \lambda \sim \text{Exp}(\lambda) </math>, then <math>\beta + \eta \sim \text{Pareto}(\beta, \alpha)</math>. | More in general, if <math>\lambda \sim \text{Gamma}(\alpha, \beta)</math> (shape-rate parametrization) and <math>\eta | \lambda \sim \text{Exp}(\lambda) </math>, then <math>\beta + \eta \sim \text{Pareto}(\beta, \alpha)</math>. | ||
| Line 300: | Line 282: | ||
| cdf =<math>\frac{1-L^\alpha x^{-\alpha}}{1-\left(\frac{L}{H}\right)^\alpha}</math> | | cdf =<math>\frac{1-L^\alpha x^{-\alpha}}{1-\left(\frac{L}{H}\right)^\alpha}</math> | ||
| mean = | | mean = | ||
<math>\frac{L^\alpha}{1 - \left(\frac{L}{H}\right)^\alpha} | <math>\begin{cases} | ||
\frac{L^\alpha}{1 - \left(\frac{L}{H}\right)^\alpha} \left(\frac{\alpha}{\alpha-1}\right) \left(\frac{1}{L^{\alpha-1}} - \frac{1}{H^{\alpha-1}}\right), & \alpha\neq 1 \\ | |||
| median =<math> L \left(1- \frac{1}{2}\left(1-\left(\frac{L}{H}\right)^\alpha\right)\right)^{-\frac{1}{\alpha}}</math> | \frac{{H}{L}}{{H}-{L}}\ln\frac{H}{L}, & \alpha=1 | ||
\end{cases}</math> | |||
| median = <math> L \left(1- \frac{1}{2}\left(1-\left(\frac{L}{H}\right)^\alpha\right)\right)^{-\frac{1}{\alpha}}</math> | |||
| mode = | | mode = | ||
| variance = | | variance = | ||
<math>\frac{L^\alpha}{1 - \left(\frac{L}{H}\right)^\alpha} | <math>\begin{cases} | ||
\frac{L^\alpha}{1 - \left(\frac{L}{H}\right)^\alpha} \left(\frac{\alpha}{\alpha-2}\right) \left(\frac{1}{L^{\alpha-2}} - \frac{1}{H^{\alpha-2}}\right), & \alpha\neq 2 \\ | |||
\frac{2{H}^2{L}^2}{{H}^2-{L}^2}\ln\frac{H}{L}, & \alpha=2 | |||
\end{cases}</math> | |||
(this is the second raw moment, not the variance) | (this is the second raw moment, not the variance) | ||
| skewness = <math>\frac{L^{\alpha}}{1-\left(\frac{L}{H}\right)^{\alpha}} \cdot \frac{\alpha (L^{k-\alpha}-H^{k-\alpha})}{(\alpha-k)}, \alpha \neq j </math> | | skewness = <math>\frac{L^{\alpha}}{1-\left(\frac{L}{H}\right)^{\alpha}} \cdot \frac{\alpha (L^{k-\alpha}-H^{k-\alpha})}{(\alpha-k)}, \alpha \neq j </math> | ||
| Line 320: | Line 306: | ||
The [[probability density function]] is | The [[probability density function]] is | ||
<math display="block">\frac{\alpha L^\alpha x^{-\alpha - 1}}{1-\left(\frac{L}{H}\right)^\alpha},</math> | |||
where ''L'' ≤ ''x'' ≤ ''H'', and ''α'' > 0. | where ''L'' ≤ ''x'' ≤ ''H'', and ''α'' > 0. | ||
| Line 327: | Line 313: | ||
If ''U'' is [[uniform distribution (continuous)|uniformly distributed]] on (0, 1), then applying inverse-transform method <ref>{{Cite web |url=http://www.cs.bgu.ac.il/~mps042/invtransnote.htm |title=Inverse Transform Method |access-date=2012-08-27 |archive-date=2012-01-17 |archive-url=https://web.archive.org/web/20120117042753/http://www.cs.bgu.ac.il/~mps042/invtransnote.htm |url-status=dead }}</ref> | If ''U'' is [[uniform distribution (continuous)|uniformly distributed]] on (0, 1), then applying inverse-transform method <ref>{{Cite web |url=http://www.cs.bgu.ac.il/~mps042/invtransnote.htm |title=Inverse Transform Method |access-date=2012-08-27 |archive-date=2012-01-17 |archive-url=https://web.archive.org/web/20120117042753/http://www.cs.bgu.ac.il/~mps042/invtransnote.htm |url-status=dead }}</ref> | ||
<math display="block">U = \frac{1 - L^\alpha x^{-\alpha}}{1 - (\frac{L}{H})^\alpha}</math> | |||
<math display="block">x = \left(-\frac{U H^\alpha - U L^\alpha - H^\alpha}{H^\alpha L^\alpha}\right)^{-\frac{1}{\alpha}}</math> | |||
is a bounded Pareto-distributed. | is a bounded Pareto-distributed. | ||
| Line 334: | Line 320: | ||
===Symmetric Pareto distribution=== | ===Symmetric Pareto distribution=== | ||
The purpose of the Symmetric and Zero Symmetric Pareto distributions is to capture some special statistical distribution with a sharp probability peak and symmetric long probability tails. These two distributions are derived from the Pareto distribution. Long probability tails normally means that probability decays slowly, and can be used to fit a variety of datasets. But if the distribution has symmetric structure with two slow decaying tails, Pareto could not do it. Then Symmetric Pareto or Zero Symmetric Pareto distribution is applied instead.<ref name=":0">{{Cite journal|last=Huang|first=Xiao-dong|date=2004|title=A Multiscale Model for MPEG-4 Varied Bit Rate Video Traffic|journal=IEEE Transactions on Broadcasting|volume=50|issue=3|pages=323–334|doi=10.1109/TBC.2004.834013}}</ref> | The purpose of the Symmetric and Zero Symmetric Pareto distributions is to capture some special statistical distribution with a sharp probability peak and symmetric long probability tails. These two distributions are derived from the Pareto distribution. Long probability tails normally means that probability decays slowly, and can be used to fit a variety of datasets. But if the distribution has symmetric structure with two slow decaying tails, Pareto could not do it. Then Symmetric Pareto or Zero Symmetric Pareto distribution is applied instead.<ref name=":0">{{Cite journal|last=Huang|first=Xiao-dong|date=2004|title=A Multiscale Model for MPEG-4 Varied Bit Rate Video Traffic|journal=IEEE Transactions on Broadcasting|volume=50|issue=3|pages=323–334|doi=10.1109/TBC.2004.834013 |bibcode=2004ITBE...50..323H }}</ref> | ||
The Cumulative distribution function (CDF) of Symmetric Pareto distribution is defined as following:<ref name=":0" /> | The Cumulative distribution function (CDF) of Symmetric Pareto distribution is defined as following:<ref name=":0" /> | ||
<math>F(X) = P(x < X ) = \begin{cases} | <math display="block">F(X) = P(x < X ) = \begin{cases} | ||
\tfrac{1}{2}({b \over 2b-X}) ^a & X<b \\ | \tfrac{1}{2}({b \over 2b-X}) ^a & X<b \\ | ||
1- \tfrac{1}{2}(\tfrac{b}{X})^a& X\geq b | 1- \tfrac{1}{2}(\tfrac{b}{X})^a& X\geq b | ||
| Line 345: | Line 331: | ||
The corresponding probability density function (PDF) is:<ref name=":0" /> | The corresponding probability density function (PDF) is:<ref name=":0" /> | ||
<math>p(x) = {ab^a \over 2(b+\left\vert x-b \right\vert)^{a+1}},X\in R</math> | <math display="block">p(x) = {ab^a \over 2(b+\left\vert x-b \right\vert)^{a+1}},X\in R</math> | ||
This distribution has two parameters: a and b. It is symmetric about b. Then the mathematic expectation is b. When, it has variance as following: | This distribution has two parameters: a and b. It is symmetric about b. Then the mathematic expectation is b. When, it has variance as following: | ||
<math>E((x-b)^2)=\int_{-\infty}^{\infty} (x-b)^2p(x)dx={2b^2 | <math display="block">E((x-b)^2)=\int_{-\infty}^{\infty} (x-b)^2p(x)dx = \frac{2b^2}{(a-2)(a-1) }</math> | ||
</math> | |||
The CDF of Zero Symmetric Pareto (ZSP) distribution is defined as following: | The CDF of Zero Symmetric Pareto (ZSP) distribution is defined as following: | ||
<math>F(X) = P(x < X ) = \begin{cases} | <math display="block">F(X) = P(x < X ) = \begin{cases} | ||
\tfrac{1}{2}({b \over b-X}) ^a & X<0 \\ | \tfrac{1}{2}({b \over b-X}) ^a & X<0 \\ | ||
1- \tfrac{1}{2}(\tfrac{b}{b+X})^a& X\geq 0 | 1- \tfrac{1}{2}(\tfrac{b}{b+X})^a& X\geq 0 | ||
| Line 362: | Line 346: | ||
The corresponding PDF is: | The corresponding PDF is: | ||
<math>p(x) = {ab^a \over 2(b+\left\vert x \right\vert)^{a+1}},X\in R</math> | <math display="block">p(x) = {ab^a \over 2(b+\left\vert x \right\vert)^{a+1}},X\in R</math> | ||
This distribution is symmetric about zero. Parameter a is related to the decay rate of probability and (a/2b) represents peak magnitude of probability.<ref name=":0" /> | This distribution is symmetric about zero. Parameter a is related to the decay rate of probability and (a/2b) represents peak magnitude of probability.<ref name=":0" /> | ||
| Line 378: | Line 362: | ||
The [[likelihood function]] for the Pareto distribution parameters ''α'' and ''x''<sub>m</sub>, given an independent [[sample (statistics)|sample]] ''x'' = (''x''<sub>1</sub>, ''x''<sub>2</sub>, ..., ''x<sub>n</sub>''), is | The [[likelihood function]] for the Pareto distribution parameters ''α'' and ''x''<sub>m</sub>, given an independent [[sample (statistics)|sample]] ''x'' = (''x''<sub>1</sub>, ''x''<sub>2</sub>, ..., ''x<sub>n</sub>''), is | ||
<math display="block">L(\alpha, x_\mathrm{m}) = \prod_{i=1}^n \alpha \frac {x_\mathrm{m}^\alpha} {x_i^{\alpha+1}} = \alpha^n x_\mathrm{m}^{n\alpha} \prod_{i=1}^n \frac {1}{x_i^{\alpha+1}}.</math> | |||
Therefore, the logarithmic likelihood function is | Therefore, the logarithmic likelihood function is | ||
<math display="block">\ell(\alpha, x_\mathrm{m}) = n \ln \alpha + n\alpha \ln x_\mathrm{m} - (\alpha + 1) \sum_{i=1} ^n \ln x_i.</math> | |||
It can be seen that <math>\ell(\alpha, x_\mathrm{m})</math> is monotonically increasing with ''x''<sub>m</sub>, that is, the greater the value of ''x''<sub>m</sub>, the greater the value of the likelihood function. Hence, since ''x'' ≥ ''x''<sub>m</sub>, we conclude that | It can be seen that <math>\ell(\alpha, x_\mathrm{m})</math> is monotonically increasing with ''x''<sub>m</sub>, that is, the greater the value of ''x''<sub>m</sub>, the greater the value of the likelihood function. Hence, since ''x'' ≥ ''x''<sub>m</sub>, we conclude that | ||
<math display="block">\widehat x_\mathrm{m} = \min_i {x_i}.</math> | |||
To find the [[estimator]] for ''α'', we compute the corresponding partial derivative and determine where it is zero: | To find the [[estimator]] for ''α'', we compute the corresponding partial derivative and determine where it is zero: | ||
<math display="block">\frac{\partial \ell}{\partial \alpha} = \frac{n}{\alpha} + n \ln x_\mathrm{m} - \sum _{i=1}^n \ln x_i = 0.</math> | |||
Thus the [[maximum likelihood]] estimator for ''α'' is: | Thus the [[maximum likelihood]] estimator for ''α'' is: | ||
<math display="block">\widehat \alpha = \frac{n}{\sum _i \ln (x_i/\widehat x_\mathrm{m}) }.</math> | |||
The expected statistical error is:<ref>{{cite journal |author=M. E. J. Newman |year=2005 |title=Power laws, Pareto distributions and Zipf's law |journal=[[Contemporary Physics]] |volume=46 |issue=5 |pages=323–51| arxiv=cond-mat/0412004 |doi=10.1080/00107510500052444 |bibcode=2005ConPh..46..323N|s2cid=202719165 }}</ref> | The expected statistical error is:<ref>{{cite journal |author=M. E. J. Newman |year=2005 |title=Power laws, Pareto distributions and Zipf's law |journal=[[Contemporary Physics]] |volume=46 |issue=5 |pages=323–51| arxiv=cond-mat/0412004 |doi=10.1080/00107510500052444 |bibcode=2005ConPh..46..323N|s2cid=202719165 }}</ref> | ||
<math display="block">\sigma = \frac {\widehat \alpha} {\sqrt n}. </math> | |||
Malik (1970)<ref>{{cite journal |author=H. J. Malik |year=1970 |title=Estimation of the Parameters of the Pareto Distribution |journal=Metrika |volume=15|pages=126–132 |doi=10.1007/BF02613565 |s2cid=124007966 }}</ref> gives the exact joint distribution of <math>(\hat{x}_\mathrm{m},\hat\alpha)</math>. In particular, <math>\hat{x}_\mathrm{m}</math> and <math>\hat\alpha</math> are [[Independence (probability theory)|independent]] and <math>\hat{x}_\mathrm{m}</math> is Pareto with scale parameter ''x''<sub>m</sub> and shape parameter ''nα'', whereas <math>\hat\alpha</math> has an [[inverse-gamma distribution]] with shape and scale parameters ''n'' − 1 and ''nα'', respectively. | Malik (1970)<ref>{{cite journal |author=H. J. Malik |year=1970 |title=Estimation of the Parameters of the Pareto Distribution |journal=Metrika |volume=15|pages=126–132 |doi=10.1007/BF02613565 |s2cid=124007966 }}</ref> gives the exact joint distribution of <math>(\hat{x}_\mathrm{m},\hat\alpha)</math>. In particular, <math>\hat{x}_\mathrm{m}</math> and <math>\hat\alpha</math> are [[Independence (probability theory)|independent]] and <math>\hat{x}_\mathrm{m}</math> is Pareto with scale parameter ''x''<sub>m</sub> and shape parameter ''nα'', whereas <math>\hat\alpha</math> has an [[inverse-gamma distribution]] with shape and scale parameters ''n'' − 1 and ''nα'', respectively. | ||
| Line 404: | Line 388: | ||
==Occurrence and applications== | ==Occurrence and applications== | ||
===General=== | ===General=== | ||
[[Vilfredo Pareto]] originally used this distribution to describe the [[Distribution of wealth|allocation of wealth]] among individuals since it seemed to show rather well the way that a larger portion of the wealth of any society is owned by a smaller percentage of the people in that society. He also used it to describe distribution of income.<ref name=":1">Pareto, Vilfredo, ''Cours d'Économie Politique: Nouvelle édition par G.-H. Bousquet et G. Busino'', Librairie Droz, Geneva, 1964, pp. 299–345. [https://web.archive.org/web/20130531151249/http://www.institutcoppet.org/wp-content/uploads/2012/05/Cours-d%C3%A9conomie-politique-Tome-II-Vilfredo-Pareto.pdf Original book archived]</ref> This idea is sometimes expressed more simply as the [[Pareto principle]] or the "80-20 rule" which says that 20% of the population controls 80% of the wealth.<ref>For a two-quantile population, where approximately 18% of the population owns 82% of the wealth, the [[Theil index]] takes the value 1.</ref> As Michael Hudson points out | [[Vilfredo Pareto]] originally used this distribution to describe the [[Distribution of wealth|allocation of wealth]] among individuals since it seemed to show rather well the way that a larger portion of the wealth of any society is owned by a smaller percentage of the people in that society. He also used it to describe distribution of income.<ref name=":1">Pareto, Vilfredo, ''Cours d'Économie Politique: Nouvelle édition par G.-H. Bousquet et G. Busino'', Librairie Droz, Geneva, 1964, pp. 299–345. [https://web.archive.org/web/20130531151249/http://www.institutcoppet.org/wp-content/uploads/2012/05/Cours-d%C3%A9conomie-politique-Tome-II-Vilfredo-Pareto.pdf Original book archived]</ref> This idea is sometimes expressed more simply as the [[Pareto principle]] or the "80-20 rule" which says that 20% of the population controls 80% of the wealth.<ref>For a two-quantile population, where approximately 18% of the population owns 82% of the wealth, the [[Theil index]] takes the value 1.</ref> As Michael Hudson points out in ''The Collapse of Antiquity'', "a mathematical corollary [is] that 10% would have 65% of the wealth, and 5% would have half the national wealth."<ref>{{Cite book |last=Hudson |first=Michael |title=The Collapse of Antiquity |year=2023 |page=85, n. 7}}</ref> However, the 80-20 rule corresponds to a particular value of ''α'', and in fact, Pareto's data on British income taxes in his ''Cours d'économie politique'' indicates that about 30% of the population had about 70% of the income.{{citation needed|date=May 2019}} The [[probability density function]] (PDF) graph at the beginning of this article shows that the "probability" or fraction of the population that owns a small amount of wealth per person is rather high, and then decreases steadily as wealth increases. (The Pareto distribution is not realistic for wealth for the lower end, however. In fact, [[net worth]] may even be negative.) This distribution is not limited to describing wealth or income, but to many situations in which an equilibrium is found in the distribution of size or magnitude. The following examples are sometimes seen as approximately Pareto-distributed: | ||
<!-- THESE TWO SEEM TO BELONG UNDER [[Zipf's law]] RATHER THAN THE PARETO DISTRIBUTION | <!-- THESE TWO SEEM TO BELONG UNDER [[Zipf's law]] RATHER THAN THE PARETO DISTRIBUTION | ||
* Frequencies of words in longer texts (a few words are used often, lots of words are used infrequently) | * Frequencies of words in longer texts (a few words are used often, lots of words are used infrequently) | ||
* Frequencies of [[Given name#Popularity distribution of given names|given names]] --> | * Frequencies of [[Given name#Popularity distribution of given names|given names]] --> | ||
* All four variables of | * All four variables of household budget constraints: consumption, labor income, capital income, and wealth.<ref>{{cite web |ssrn=4636704 |last1=Gaillard |first1=Alexandre |last2=Hellwig |first2=Christian |last3=Wangner | first3=Philipp |last4=Werquin |first4=Nicolas |title=Consumption, Wealth, and Income Inequality: A Tale of Tails |date=2023 |doi=10.2139/ssrn.4636704 | url=https://ssrn.com/abstract=4636704 }}</ref> | ||
* The sizes of human settlements (few cities, many hamlets/villages)<ref name="Reed">{{cite journal |citeseerx=10.1.1.70.4555 |first=William J. |last=Reed |title=The Double Pareto-Lognormal Distribution – A New Parametric Model for Size Distributions |journal=Communications in Statistics – Theory and Methods |volume=33 |issue=8 |pages=1733–53 |year=2004 |doi=10.1081/sta-120037438|s2cid=13906086 |display-authors=etal}}</ref><ref name="Reed2002">{{cite journal |first=William J. |last=Reed |title=On the rank-size distribution for human settlements |journal=Journal of Regional Science |volume=42 |issue=1 |pages=1–17 |year=2002 |doi=10.1111/1467-9787.00247|bibcode=2002JRegS..42....1R |s2cid=154285730 }}</ref> | * The sizes of human settlements (a few large cities, many hamlets/villages)<ref name="Reed">{{cite journal |citeseerx=10.1.1.70.4555 |first=William J. |last=Reed |title=The Double Pareto-Lognormal Distribution – A New Parametric Model for Size Distributions |journal=Communications in Statistics – Theory and Methods |volume=33 |issue=8 |pages=1733–53 |year=2004 |doi=10.1081/sta-120037438|s2cid=13906086 |display-authors=etal}}</ref><ref name="Reed2002">{{cite journal |first=William J. |last=Reed |title=On the rank-size distribution for human settlements |journal=Journal of Regional Science |volume=42 |issue=1 |pages=1–17 |year=2002 |doi=10.1111/1467-9787.00247|bibcode=2002JRegS..42....1R |s2cid=154285730 }}</ref> | ||
* File size distribution of Internet traffic which uses the TCP protocol (many smaller files, few larger ones)<ref name ="Reed" /> | * File size distribution of Internet traffic which uses the TCP protocol (many smaller files, few larger ones)<ref name ="Reed" /> | ||
* [[Hard disk drive]] error rates<ref>{{cite journal |title=Understanding latent sector error and how to protect against them |url=http://www.usenix.org/event/fast10/tech/full_papers/schroeder.pdf |first1=Bianca |last1=Schroeder |author1-link= Bianca Schroeder |first2=Sotirios |last2=Damouras |first3=Phillipa |last3=Gill |journal=8th Usenix Conference on File and Storage Technologies (FAST 2010)| date=2010-02-24 |access-date=2010-09-10 |quote=We experimented with 5 different distributions (Geometric, Weibull, Rayleigh, Pareto, and Lognormal), that are commonly used in the context of system reliability, and evaluated their fit through the total squared differences between the actual and hypothesized frequencies (χ<sup>2</sup> statistic). We found consistently across all models that the geometric distribution is a poor fit, while the Pareto distribution provides the best fit.}}</ref> | * [[Hard disk drive]] error rates<ref>{{cite journal |title=Understanding latent sector error and how to protect against them |url=http://www.usenix.org/event/fast10/tech/full_papers/schroeder.pdf |first1=Bianca |last1=Schroeder |author1-link= Bianca Schroeder |first2=Sotirios |last2=Damouras |first3=Phillipa |last3=Gill |journal=8th Usenix Conference on File and Storage Technologies (FAST 2010)| date=2010-02-24 |access-date=2010-09-10 |quote=We experimented with 5 different distributions (Geometric, Weibull, Rayleigh, Pareto, and Lognormal), that are commonly used in the context of system reliability, and evaluated their fit through the total squared differences between the actual and hypothesized frequencies (χ<sup>2</sup> statistic). We found consistently across all models that the geometric distribution is a poor fit, while the Pareto distribution provides the best fit.}}</ref> | ||
* Clusters of [[Bose–Einstein condensate]] near [[absolute zero]]<ref name="Simon">{{cite journal|first2=Herbert A.|last2=Simon|author=Yuji Ijiri |title=Some Distributions Associated with Bose–Einstein Statistics|journal=Proc. Natl. Acad. Sci. USA|date=May 1975|volume=72|issue=5|pages=1654–57|pmc=432601|pmid=16578724|doi=10.1073/pnas.72.5.1654|bibcode=1975PNAS...72.1654I|doi-access=free}}</ref> | * Clusters of [[Bose–Einstein condensate]] near [[absolute zero]]<ref name="Simon">{{cite journal|first2=Herbert A.|last2=Simon|author=Yuji Ijiri |title=Some Distributions Associated with Bose–Einstein Statistics|journal=Proc. Natl. Acad. Sci. USA|date=May 1975|volume=72|issue=5|pages=1654–57|pmc=432601|pmid=16578724|doi=10.1073/pnas.72.5.1654|bibcode=1975PNAS...72.1654I|doi-access=free}}</ref> | ||
[[File:FitParetoDistr.tif|thumb|250px|Fitted cumulative Pareto (Lomax) distribution to maximum one-day rainfalls using | [[File:FitParetoDistr.tif|thumb|250px|Fitted cumulative Pareto (Lomax) distribution to maximum one-day rainfalls using CumFreq, see also [[distribution fitting]] ]] | ||
* The values of [[oil reserves]] in oil fields (a few [[Giant oil and gas fields|large fields]], many [[Stripper well|small fields]])<ref name ="Reed" /> | * The values of [[oil reserves]] in oil fields (a few [[Giant oil and gas fields|large fields]], many [[Stripper well|small fields]])<ref name ="Reed" /> | ||
* The length distribution in jobs assigned to supercomputers (a few large ones, many small ones)<ref>{{Cite journal|last1=Harchol-Balter|first1=Mor|author1-link=Mor Harchol-Balter|last2=Downey|first2=Allen|date=August 1997|title=Exploiting Process Lifetime Distributions for Dynamic Load Balancing|url=https://users.soe.ucsc.edu/~scott/courses/Fall11/221/Papers/Sync/harcholbalter-tocs97.pdf|journal=ACM Transactions on Computer Systems|volume=15|issue=3|pages=253–258|doi=10.1145/263326.263344|s2cid=52861447}}</ref> | * The length distribution in [[Job (computing)|jobs]] assigned to [[supercomputers]] (a few large ones, many small ones)<ref>{{Cite journal|last1=Harchol-Balter|first1=Mor|author1-link=Mor Harchol-Balter|last2=Downey|first2=Allen|date=August 1997|title=Exploiting Process Lifetime Distributions for Dynamic Load Balancing|url=https://users.soe.ucsc.edu/~scott/courses/Fall11/221/Papers/Sync/harcholbalter-tocs97.pdf|journal=ACM Transactions on Computer Systems|volume=15|issue=3|pages=253–258|doi=10.1145/263326.263344|s2cid=52861447}}</ref> | ||
* The standardized price returns on individual stocks <ref name="Reed" /> | * The standardized [[Price return|price returns]] on individual stocks<ref name="Reed" /> | ||
* | * The sizes of sand particles<ref name ="Reed" /> | ||
* The | * The sizes of [[meteorites]] | ||
* | * The severity of large [[casualty insurance]] losses for certain lines of business such as general liability, commercial auto, and workers' compensation<ref>Kleiber and Kotz (2003): p. 94.</ref><ref>{{cite journal |last1=Seal |first1=H. |year=1980 |title=Survival probabilities based on Pareto claim distributions |journal=ASTIN Bulletin |volume=11 |pages=61–71|doi=10.1017/S0515036100006620 |doi-access=free }}</ref> | ||
* In [[hydrology]] the Pareto distribution is applied to extreme events such as annually maximum one-day rainfalls and river discharges.<ref>CumFreq, software for cumulative frequency analysis and probability distribution fitting [https://www.waterlog.info/cumfreq.htm]</ref> The blue picture illustrates an example of fitting the Pareto distribution to ranked annually maximum one-day rainfalls showing also the 90% [[confidence belt]] based on the [[binomial distribution]]. The rainfall data are represented by [[plotting position]]s as part of the [[cumulative frequency analysis]]. | * In [[hydrology]] the Pareto distribution is applied to extreme events such as annually maximum one-day rainfalls and river discharges.<ref>CumFreq, software for cumulative frequency analysis and probability distribution fitting [https://www.waterlog.info/cumfreq.htm]</ref> The blue picture illustrates an example of fitting the Pareto distribution to ranked annually maximum one-day rainfalls showing also the 90% [[confidence belt]] based on the [[binomial distribution]]. The rainfall data are represented by [[plotting position]]s as part of the [[cumulative frequency analysis]]. | ||
* | * Electric utility distribution reliability (80% of customer minutes interrupted occur on approximately 20% of the days in a given year) | ||
===Relation to Zipf's law=== | ===Relation to Zipf's law=== | ||
The Pareto distribution is a continuous probability distribution. [[Zipf's law]], also sometimes called the [[zeta distribution]], is a discrete distribution, separating the values into a simple ranking. Both are a simple power law with a negative exponent, scaled so that their cumulative distributions equal 1. Zipf's can be derived from the Pareto distribution if the <math>x</math> values (incomes) are binned into <math>N</math> ranks so that the number of people in each bin follows a 1/rank pattern. The distribution is normalized by defining <math>x_m</math> so that <math>\alpha x_\mathrm{m}^\alpha = \frac{1}{H(N,\alpha-1)}</math> where <math>H(N,\alpha-1)</math> is the [[Harmonic number#Generalized harmonic numbers|generalized harmonic number]]. This makes Zipf's probability density function derivable from Pareto's. | The Pareto distribution is a continuous probability distribution. [[Zipf's law]], also sometimes called the [[zeta distribution]], is a discrete distribution, separating the values into a simple ranking. Both are a simple power law with a negative exponent, scaled so that their cumulative distributions equal 1. Zipf's can be derived from the Pareto distribution if the <math>x</math> values (incomes) are binned into <math>N</math> ranks so that the number of people in each bin follows a 1/rank pattern. The distribution is normalized by defining <math>x_m</math> so that <math>\alpha x_\mathrm{m}^\alpha = \frac{1}{H(N,\alpha-1)}</math> where <math>H(N,\alpha-1)</math> is the [[Harmonic number#Generalized harmonic numbers|generalized harmonic number]]. This makes Zipf's probability density function derivable from Pareto's. | ||
<math display="block">f(x) = \frac{\alpha x_\mathrm{m}^\alpha}{x^{\alpha+1}} = \frac{1}{x^s H(N,s)}</math> | |||
where <math>s = \alpha-1</math> and <math>x</math> is an integer representing rank from 1 to N where N is the highest income bracket. So a randomly selected person (or word, website link, or city) from a population (or language, internet, or country) has <math>f(x)</math> probability of ranking <math>x</math>. | where <math>s = \alpha-1</math> and <math>x</math> is an integer representing rank from 1 to N where N is the highest income bracket. So a randomly selected person (or word, website link, or city) from a population (or language, internet, or country) has <math>f(x)</math> probability of ranking <math>x</math>. | ||
| Line 434: | Line 417: | ||
The "[[Pareto principle|80/20 law]]", according to which 20% of all people receive 80% of all income, and 20% of the most affluent 20% receive 80% of that 80%, and so on, holds precisely when the Pareto index is <math>\alpha = \log_4 5 = \cfrac{\log_{10} 5}{\log_{10} 4} \approx 1.161</math>. This result can be derived from the [[Lorenz curve]] formula given below. Moreover, the following have been shown<ref>{{cite journal |last1=Hardy |first1=Michael |year=2010 |title=Pareto's Law |journal=[[Mathematical Intelligencer]] |volume=32 |issue=3 |pages=38–43 |doi=10.1007/s00283-010-9159-2|s2cid=121797873 }}</ref> to be mathematically equivalent: | The "[[Pareto principle|80/20 law]]", according to which 20% of all people receive 80% of all income, and 20% of the most affluent 20% receive 80% of that 80%, and so on, holds precisely when the Pareto index is <math>\alpha = \log_4 5 = \cfrac{\log_{10} 5}{\log_{10} 4} \approx 1.161</math>. This result can be derived from the [[Lorenz curve]] formula given below. Moreover, the following have been shown<ref>{{cite journal |last1=Hardy |first1=Michael |year=2010 |title=Pareto's Law |journal=[[Mathematical Intelligencer]] |volume=32 |issue=3 |pages=38–43 |doi=10.1007/s00283-010-9159-2|s2cid=121797873 }}</ref> to be mathematically equivalent: | ||
* Income is distributed according to a Pareto distribution with index ''α'' > 1. | * Income is distributed according to a Pareto distribution with index ''α'' > 1. | ||
* There is some number 0 ≤ ''p'' ≤ 1/2 such that 100''p'' % of all people receive 100(1 − ''p'')% of all income, and similarly for every real (not necessarily integer) ''n'' > 0, 100''p<sup>n</sup>'' % of all people receive 100(1 − ''p'')<sup>''n''</sup> percentage of all income. ''α'' and ''p'' are related by | * There is some number 0 ≤ ''p'' ≤ 1/2 such that 100''p'' % of all people receive 100(1 − ''p'')% of all income, and similarly for every real (not necessarily integer) ''n'' > 0, 100''p<sup>n</sup>'' % of all people receive 100(1 − ''p'')<sup>''n''</sup> percentage of all income. ''α'' and ''p'' are related by <math display="block">1-\frac{1}{\alpha}=\frac{\ln(1-p)}{\ln(p)}=\frac{\ln((1-p)^n)}{\ln(p^n)}</math> | ||
This does not apply only to income, but also to wealth, or to anything else that can be modeled by this distribution. | This does not apply only to income, but also to wealth, or to anything else that can be modeled by this distribution. | ||
| Line 449: | Line 431: | ||
The [[Lorenz curve]] is often used to characterize income and wealth distributions. For any distribution, the Lorenz curve ''L''(''F'') is written in terms of the PDF ''f'' or the CDF ''F'' as | The [[Lorenz curve]] is often used to characterize income and wealth distributions. For any distribution, the Lorenz curve ''L''(''F'') is written in terms of the PDF ''f'' or the CDF ''F'' as | ||
<math display="block">L(F) = \frac{\int_{x_\mathrm{m}}^{x(F)}xf(x)\,dx}{\int_{x_\mathrm{m}}^\infty xf(x)\,dx} =\frac{\int_0^F x(F')\,dF'}{\int_0^1 x(F')\,dF'}</math> | |||
where ''x''(''F'') is the inverse of the CDF. For the Pareto distribution, | where ''x''(''F'') is the inverse of the CDF. For the Pareto distribution, | ||
<math display="block">x(F) = \frac{x_\mathrm{m}}{(1-F)^{\frac{1}{\alpha}}}</math> | |||
and the Lorenz curve is calculated to be | and the Lorenz curve is calculated to be | ||
<math display="block">L(F) = 1-(1-F)^{1-\frac{1}{\alpha}},</math> | |||
For <math>0<\alpha\le 1</math> the denominator is infinite, yielding ''L''=0. Examples of the Lorenz curve for a number of Pareto distributions are shown in the graph on the right. | For <math>0<\alpha\le 1</math> the denominator is infinite, yielding ''L''=0. Examples of the Lorenz curve for a number of Pareto distributions are shown in the graph on the right. | ||
According to [[Oxfam]] (2016) the richest 62 people have as much wealth as the poorest half of the world's population.<ref>{{cite web|title=62 people own the same as half the world, reveals Oxfam Davos report|url=https://www.oxfam.org/en/pressroom/pressreleases/2016-01-18/62-people-own-same-half-world-reveals-oxfam-davos-report|publisher=Oxfam|date=Jan 2016}}</ref> We can estimate the Pareto index that would apply to this situation. Letting ε equal <math>62/(7\times 10^9)</math> we have: | According to [[Oxfam]] (2016) the richest 62 people have as much wealth as the poorest half of the world's population.<ref>{{cite web|title=62 people own the same as half the world, reveals Oxfam Davos report|url=https://www.oxfam.org/en/pressroom/pressreleases/2016-01-18/62-people-own-same-half-world-reveals-oxfam-davos-report|publisher=Oxfam|date=Jan 2016}}</ref> We can estimate the Pareto index that would apply to this situation. Letting ε equal <math>62/(7\times 10^9)</math> we have: | ||
<math display="block">L(1/2)=1-L(1-\varepsilon)</math> | |||
or | or | ||
<math display="block">1-(1/2)^{1-\frac{1}{\alpha}}=\varepsilon^{1-\frac{1}{\alpha}}</math> | |||
<!-- | <!--<math display="block">\ln(1-(1/2)^{1-\frac{1}{\alpha}})=(1-\frac{1}{\alpha})\ln\varepsilon</math> | ||
<math display="block">\ln(1-(1/2)^{1-\frac{1}{\alpha}})=(\ln\varepsilon/\ln 2)(1-\frac{1}{\alpha})\ln 2</math> | |||
<math display="block">\ln(1-(1/2)^{1-\frac{1}{\alpha}})=-(\ln\varepsilon/\ln 2)\ln((1/2)^{1-\frac{1}{\alpha}})</math> | |||
<math display="block">\ln(1-(1/2)^{1-\frac{1}{\alpha}})\approx(\ln\varepsilon/\ln 2)(1-(1/2)^{1-\frac{1}{\alpha}})</math> | |||
<math display="block">-\ln(1-(1/2)^{1-\frac{1}{\alpha}})\exp(-\ln(1-(1/2)^{1-\frac{1}{\alpha}}))\approx -\ln\varepsilon/\ln 2</math> | |||
<math display="block">-\ln(1-(1/2)^{1-\frac{1}{\alpha}})\approx W(-\ln\varepsilon/\ln 2)</math> | |||
where ''W'' is the [[Lambert W function]]. So | where ''W'' is the [[Lambert W function]]. So | ||
<math display="block">(1/2)^{1-\frac{1}{\alpha}}\approx 1-\exp(-W(-\ln\varepsilon/\ln 2))</math> | |||
<math display="block">{1-\frac{1}{\alpha}}\approx -\ln(1-\exp(-W(-\ln\varepsilon/\ln 2)))/\ln 2</math> | |||
<math display="block">\alpha\approx 1/(1+\ln(1-\exp(-W(-\ln\varepsilon/\ln 2)))/\ln 2)</math> | |||
-->The solution is that ''α'' equals about 1.15, and about 9% of the wealth is owned by each of the two groups. But actually the poorest 69% of the world adult population owns only about 3% of the wealth.<ref>{{cite web|title=Global Wealth Report 2013|url=https://publications.credit-suisse.com/tasks/render/file/?fileID=BCDB1364-A105-0560-1332EC9100FF5C83|publisher=Credit Suisse|page=22|date=Oct 2013|access-date=2016-01-24|archive-url=https://web.archive.org/web/20150214155424/https://publications.credit-suisse.com/tasks/render/file/?fileID=BCDB1364-A105-0560-1332EC9100FF5C83|archive-date=2015-02-14|url-status=dead}}</ref> | -->The solution is that ''α'' equals about 1.15, and about 9% of the wealth is owned by each of the two groups. But actually the poorest 69% of the world adult population owns only about 3% of the wealth.<ref>{{cite web|title=Global Wealth Report 2013|url=https://publications.credit-suisse.com/tasks/render/file/?fileID=BCDB1364-A105-0560-1332EC9100FF5C83|publisher=Credit Suisse|page=22|date=Oct 2013|access-date=2016-01-24|archive-url=https://web.archive.org/web/20150214155424/https://publications.credit-suisse.com/tasks/render/file/?fileID=BCDB1364-A105-0560-1332EC9100FF5C83|archive-date=2015-02-14|url-status=dead}}</ref> | ||
The [[Gini coefficient]] is a measure of the deviation of the Lorenz curve from the equidistribution line which is a line connecting [0, 0] and [1, 1], which is shown in black (''α'' = ∞) in the Lorenz plot on the right. Specifically, the Gini coefficient is twice the area between the Lorenz curve and the equidistribution line. The Gini coefficient for the Pareto distribution is then calculated (for <math>\alpha\ge 1</math>) to be | The [[Gini coefficient]] is a measure of the deviation of the Lorenz curve from the equidistribution line which is a line connecting [0, 0] and [1, 1], which is shown in black (''α'' = ∞) in the Lorenz plot on the right. Specifically, the Gini coefficient is twice the area between the Lorenz curve and the equidistribution line. The Gini coefficient for the Pareto distribution is then calculated (for <math>\alpha\ge 1</math>) to be | ||
<math display="block">G = 1-2 \left (\int_0^1L(F) \, dF \right ) = \frac{1}{2\alpha-1}</math> | |||
(see Aaberge 2005). | (see Aaberge 2005). | ||
| Line 488: | Line 470: | ||
Random samples can be generated using [[inverse transform sampling]]. Given a random variate ''U'' drawn from the [[uniform distribution (continuous)|uniform distribution]] on the unit interval [0, 1], the variate ''T'' given by | Random samples can be generated using [[inverse transform sampling]]. Given a random variate ''U'' drawn from the [[uniform distribution (continuous)|uniform distribution]] on the unit interval [0, 1], the variate ''T'' given by | ||
<math display="block">T=\frac{x_\mathrm{m}}{U^{1/\alpha}}</math> | |||
is Pareto-distributed.<ref>{{cite book |last=Tanizaki |first=Hisashi |title=Computational Methods in Statistics and Econometrics |year=2004 |page=133 |publisher=CRC Press |url=https://books.google.com/books?id=pOGAUcn13fMC|isbn=9780824750886 }}</ref> | is Pareto-distributed.<ref>{{cite book |last=Tanizaki |first=Hisashi |title=Computational Methods in Statistics and Econometrics |year=2004 |page=133 |publisher=CRC Press |url=https://books.google.com/books?id=pOGAUcn13fMC|isbn=9780824750886 }}</ref> | ||
| Line 520: | Line 502: | ||
| series=Œuvres complètes : T. III | | series=Œuvres complètes : T. III | ||
| isbn=9782600040211}} | | isbn=9782600040211}} | ||
* {{cite journal | last = Pareto | first = Vilfredo | year = 1895 | title = La legge della domanda | journal = Giornale degli Economisti | volume = 10 | pages = 59–68 }} | * {{cite journal | last = Pareto | first = Vilfredo | year = 1895 | title = La legge della domanda | journal = Giornale degli Economisti | volume = 10 | pages = 59–68 }} | ||
* {{cite book | * {{cite book | ||
| Line 532: | Line 513: | ||
* {{springer|title=Pareto distribution|id=p/p071580}} | * {{springer|title=Pareto distribution|id=p/p071580}} | ||
* {{MathWorld |title=Pareto distribution |id=ParetoDistribution}} | * {{MathWorld |title=Pareto distribution |id=ParetoDistribution}} | ||
* {{citation|mode=cs1 | * {{citation | ||
| mode=cs1 | |||
| url=http://www3.unisi.it/eventi/GiniLorenz05/25%20may%20paper/PAPER_Aaberge.pdf | | url=http://www3.unisi.it/eventi/GiniLorenz05/25%20may%20paper/PAPER_Aaberge.pdf | ||
| contribution=Gini's Nuclear Family | | contribution=Gini's Nuclear Family | ||
| Line 538: | Line 520: | ||
| last=Aabergé | | last=Aabergé | ||
| title=International Conference to Honor Two Eminent Social Scientists | | title=International Conference to Honor Two Eminent Social Scientists | ||
| date=May 2005}} | | date=May 2005 | ||
| access-date=2019-02-25 | |||
| archive-date=2020-04-20 | |||
| archive-url=https://web.archive.org/web/20200420080507/http://www3.unisi.it/eventi/GiniLorenz05/25%20may%20paper/PAPER_Aaberge.pdf | |||
| url-status=dead | |||
}} | |||
* {{cite conference | * {{cite conference | ||
| url=https://www.cs.bu.edu/~crovella/paper-archive/self-sim/journal-version.pdf | | url=https://www.cs.bu.edu/~crovella/paper-archive/self-sim/journal-version.pdf | ||
| Line 558: | Line 544: | ||
| url-status=dead | | url-status=dead | ||
}} | }} | ||
* [http://www.csee.usf.edu/~kchriste/tools/syntraf1.c syntraf1.c] {{Webarchive|url=https://web.archive.org/web/20190210155653/http://www.csee.usf.edu/~kchriste/tools/syntraf1.c |date=2019-02-10 }} is a [[C program]] to generate synthetic packet traffic with bounded Pareto burst size and exponential interburst time. | |||
* [http://www.csee.usf.edu/~kchriste/tools/syntraf1.c syntraf1.c] is a [[C program]] to generate synthetic packet traffic with bounded Pareto burst size and exponential interburst time. | |||
{{ProbDistributions|continuous-semi-infinite}} | {{ProbDistributions|continuous-semi-infinite}} | ||
Latest revision as of 23:26, 6 November 2025
Template:Short description Template:CS1 config Script error: No such module "infobox3cols".Script error: No such module "Check for unknown parameters".
The Pareto distribution, named after the Italian civil engineer, economist, and sociologist Vilfredo Pareto,[1] is a power-law probability distribution that is used in description of social, quality control, scientific, geophysical, actuarial, and many other types of observable phenomena; the principle originally applied to describing the distribution of wealth in a society, fitting the trend that a large portion of wealth is held by a small fraction of the population.[2][3]
The Pareto principle or "80:20 rule" stating that 80% of outcomes are due to 20% of causes was named in honour of Pareto, but the concepts are distinct, and only Pareto distributions with shape value (Template:Math) Template:Nobr precisely reflect it. Empirical observation has shown that this 80:20 distribution fits a wide range of cases, including natural phenomena[4] and human activities.[5][6]
Definitions
If X is a random variable with a Pareto (Type I) distribution,[7] then the probability that X is greater than some number x, i.e., the survival function (also called tail function), is given by
where xm is the (necessarily positive) minimum possible value of X, and α is a positive parameter. The type I Pareto distribution is characterized by a scale parameter xm and a shape parameter α, which is known as the tail index. If this distribution is used to model the distribution of wealth, then the parameter α is called the Pareto index.
Cumulative distribution function
From the definition, the cumulative distribution function of a Pareto random variable with parameters α and xm is
Probability density function
It follows (by differentiation) that the probability density function is
When plotted on linear axes, the distribution assumes the familiar J-shaped curve which approaches each of the orthogonal axes asymptotically. All segments of the curve are self-similar (subject to appropriate scaling factors). When plotted in a log–log plot, the distribution is represented by a straight line.
Properties
Moments and characteristic function
- The expected value of a random variable following a Pareto distribution is
- The variance of a random variable following a Pareto distribution is (If α ≤ 1, the variance does not exist.)
- The raw moments are
- The moment generating function is only defined for non-positive values t ≤ 0 as Thus, since the expectation does not converge on an open interval containing we say that the moment generating function does not exist.
- The characteristic function is given by where Γ(a, x) is the incomplete gamma function.
The parameters may be solved for using the method of moments.[8]
Conditional distributions
The conditional probability distribution of a Pareto-distributed random variable, given the event that it is greater than or equal to a particular number exceeding , is a Pareto distribution with the same Pareto index but with minimum instead of :
This implies that the conditional expected value (if it is finite, i.e. ) is proportional to :
In case of random variables that describe the lifetime of an object, this means that life expectancy is proportional to age, and is called the Lindy effect or Lindy's Law.[9]
A characterization theorem
Suppose are independent identically distributed random variables whose probability distribution is supported on the interval for some . Suppose that for all , the two random variables and are independent. Then the common distribution is a Pareto distribution.Script error: No such module "Unsubst".
Geometric mean
The geometric mean (G) is[10]
Harmonic mean
The harmonic mean (H) is[10]
Graphical representation
The characteristic curved 'long tail' distribution, when plotted on a linear scale, masks the underlying simplicity of the function when plotted on a log-log graph, which then takes the form of a straight line with negative gradient: It follows from the formula for the probability density function that for x ≥ xm,
Since α is positive, the gradient −(α + 1) is negative.
Related distributions
Generalized Pareto distributions
Script error: No such module "Labelled list hatnote".
There is a hierarchy [7][11] of Pareto distributions known as Pareto Type I, II, III, IV, and Feller–Pareto distributions.[7][11][12] Pareto Type IV contains Pareto Type I–III as special cases. The Feller–Pareto[11][13] distribution generalizes Pareto Type IV.
Pareto types I–IV
The Pareto distribution hierarchy is summarized in the next table comparing the survival functions (complementary CDF).
When μ = 0, the Pareto distribution Type II is also known as the Lomax distribution.[14]
In this section, the symbol xm, used before to indicate the minimum value of x, is replaced by σ.
| Support | Parameters | ||
|---|---|---|---|
| Type I | |||
| Type II | |||
| Lomax | |||
| Type III | |||
| Type IV |
The shape parameter α is the tail index, μ is location, σ is scale, γ is an inequality parameter. Some special cases of Pareto Type (IV) are
The finiteness of the mean, and the existence and the finiteness of the variance depend on the tail index α (inequality index γ). In particular, fractional δ-moments are finite for some δ > 0, as shown in the table below, where δ is not necessarily an integer.
| Condition | Condition | |||
|---|---|---|---|---|
| Type I | ||||
| Type II | ||||
| Type III | ||||
| Type IV |
Feller–Pareto distribution
Feller[11][13] defines a Pareto variable by transformation U = Y−1 − 1 of a beta random variable ,Y, whose probability density function is
where B( ) is the beta function. If
then W has a Feller–Pareto distribution FP(μ, σ, γ, γ1, γ2).[7]
If and are independent Gamma variables, another construction of a Feller–Pareto (FP) variable is[15]
and we write W ~ FP(μ, σ, γ, δ1, δ2). Special cases of the Feller–Pareto distribution are
Inverse-Pareto Distribution / Power Distribution
When a random variable follows a pareto distribution, then its inverse follows a Power distribution. Inverse Pareto distribution is equivalent to a Power distribution[16]
Relation to the exponential distribution
The Pareto distribution is related to the exponential distribution as follows. If X is Pareto-distributed with minimum xm and index α, then
is exponentially distributed with rate parameter α. Equivalently, if Y is exponentially distributed with rate α, then
is Pareto-distributed with minimum xm and index α.
This can be shown using the standard change-of-variable techniques:
The last expression is the cumulative distribution function of an exponential distribution with rate α.
Pareto distribution can be constructed by hierarchical exponential distributions.[17] Let and . Then we have and, as a result, .
More in general, if (shape-rate parametrization) and , then .
Equivalently, if and , then .
Relation to the log-normal distribution
The Pareto distribution and log-normal distribution are alternative distributions for describing the same types of quantities. One of the connections between the two is that they are both the distributions of the exponential of random variables distributed according to other common distributions, respectively the exponential distribution and normal distribution. (See the previous section.)
Relation to the generalized Pareto distribution
The Pareto distribution is a special case of the generalized Pareto distribution, which is a family of distributions of similar form, but containing an extra parameter in such a way that the support of the distribution is either bounded below (at a variable point), or bounded both above and below (where both are variable), with the Lomax distribution as a special case. This family also contains both the unshifted and shifted exponential distributions.
The Pareto distribution with scale and shape is equivalent to the generalized Pareto distribution with location , scale and shape and, conversely, one can get the Pareto distribution from the GPD by taking and if .
Bounded Pareto distribution
Script error: No such module "Labelled list hatnote". Template:Probability distribution
The bounded (or truncated) Pareto distribution has three parameters: α, L and H. As in the standard Pareto distribution α determines the shape. L denotes the minimal value, and H denotes the maximal value.
The probability density function is
where L ≤ x ≤ H, and α > 0.
Generating bounded Pareto random variables
If U is uniformly distributed on (0, 1), then applying inverse-transform method [18]
is a bounded Pareto-distributed.
Symmetric Pareto distribution
The purpose of the Symmetric and Zero Symmetric Pareto distributions is to capture some special statistical distribution with a sharp probability peak and symmetric long probability tails. These two distributions are derived from the Pareto distribution. Long probability tails normally means that probability decays slowly, and can be used to fit a variety of datasets. But if the distribution has symmetric structure with two slow decaying tails, Pareto could not do it. Then Symmetric Pareto or Zero Symmetric Pareto distribution is applied instead.[19]
The Cumulative distribution function (CDF) of Symmetric Pareto distribution is defined as following:[19]
The corresponding probability density function (PDF) is:[19]
This distribution has two parameters: a and b. It is symmetric about b. Then the mathematic expectation is b. When, it has variance as following:
The CDF of Zero Symmetric Pareto (ZSP) distribution is defined as following:
The corresponding PDF is:
This distribution is symmetric about zero. Parameter a is related to the decay rate of probability and (a/2b) represents peak magnitude of probability.[19]
Multivariate Pareto distribution
The univariate Pareto distribution has been extended to a multivariate Pareto distribution.[20]
Statistical inference
Estimation of parameters
The likelihood function for the Pareto distribution parameters α and xm, given an independent sample x = (x1, x2, ..., xn), is
Therefore, the logarithmic likelihood function is
It can be seen that is monotonically increasing with xm, that is, the greater the value of xm, the greater the value of the likelihood function. Hence, since x ≥ xm, we conclude that
To find the estimator for α, we compute the corresponding partial derivative and determine where it is zero:
Thus the maximum likelihood estimator for α is:
The expected statistical error is:[21]
Malik (1970)[22] gives the exact joint distribution of . In particular, and are independent and is Pareto with scale parameter xm and shape parameter nα, whereas has an inverse-gamma distribution with shape and scale parameters n − 1 and nα, respectively.
Occurrence and applications
General
Vilfredo Pareto originally used this distribution to describe the allocation of wealth among individuals since it seemed to show rather well the way that a larger portion of the wealth of any society is owned by a smaller percentage of the people in that society. He also used it to describe distribution of income.[3] This idea is sometimes expressed more simply as the Pareto principle or the "80-20 rule" which says that 20% of the population controls 80% of the wealth.[23] As Michael Hudson points out in The Collapse of Antiquity, "a mathematical corollary [is] that 10% would have 65% of the wealth, and 5% would have half the national wealth."[24] However, the 80-20 rule corresponds to a particular value of α, and in fact, Pareto's data on British income taxes in his Cours d'économie politique indicates that about 30% of the population had about 70% of the income.Script error: No such module "Unsubst". The probability density function (PDF) graph at the beginning of this article shows that the "probability" or fraction of the population that owns a small amount of wealth per person is rather high, and then decreases steadily as wealth increases. (The Pareto distribution is not realistic for wealth for the lower end, however. In fact, net worth may even be negative.) This distribution is not limited to describing wealth or income, but to many situations in which an equilibrium is found in the distribution of size or magnitude. The following examples are sometimes seen as approximately Pareto-distributed:
- All four variables of household budget constraints: consumption, labor income, capital income, and wealth.[25]
- The sizes of human settlements (a few large cities, many hamlets/villages)[26][27]
- File size distribution of Internet traffic which uses the TCP protocol (many smaller files, few larger ones)[26]
- Hard disk drive error rates[28]
- Clusters of Bose–Einstein condensate near absolute zero[29]
- The values of oil reserves in oil fields (a few large fields, many small fields)[26]
- The length distribution in jobs assigned to supercomputers (a few large ones, many small ones)[30]
- The standardized price returns on individual stocks[26]
- The sizes of sand particles[26]
- The sizes of meteorites
- The severity of large casualty insurance losses for certain lines of business such as general liability, commercial auto, and workers' compensation[31][32]
- In hydrology the Pareto distribution is applied to extreme events such as annually maximum one-day rainfalls and river discharges.[33] The blue picture illustrates an example of fitting the Pareto distribution to ranked annually maximum one-day rainfalls showing also the 90% confidence belt based on the binomial distribution. The rainfall data are represented by plotting positions as part of the cumulative frequency analysis.
- Electric utility distribution reliability (80% of customer minutes interrupted occur on approximately 20% of the days in a given year)
Relation to Zipf's law
The Pareto distribution is a continuous probability distribution. Zipf's law, also sometimes called the zeta distribution, is a discrete distribution, separating the values into a simple ranking. Both are a simple power law with a negative exponent, scaled so that their cumulative distributions equal 1. Zipf's can be derived from the Pareto distribution if the values (incomes) are binned into ranks so that the number of people in each bin follows a 1/rank pattern. The distribution is normalized by defining so that where is the generalized harmonic number. This makes Zipf's probability density function derivable from Pareto's.
where and is an integer representing rank from 1 to N where N is the highest income bracket. So a randomly selected person (or word, website link, or city) from a population (or language, internet, or country) has probability of ranking .
Relation to the "Pareto principle"
The "80/20 law", according to which 20% of all people receive 80% of all income, and 20% of the most affluent 20% receive 80% of that 80%, and so on, holds precisely when the Pareto index is . This result can be derived from the Lorenz curve formula given below. Moreover, the following have been shown[34] to be mathematically equivalent:
- Income is distributed according to a Pareto distribution with index α > 1.
- There is some number 0 ≤ p ≤ 1/2 such that 100p % of all people receive 100(1 − p)% of all income, and similarly for every real (not necessarily integer) n > 0, 100pn % of all people receive 100(1 − p)n percentage of all income. α and p are related by
This does not apply only to income, but also to wealth, or to anything else that can be modeled by this distribution.
This excludes Pareto distributions in which 0 < α ≤ 1, which, as noted above, have an infinite expected value, and so cannot reasonably model income distribution.
Relation to Price's law
Price's law is sometimes offered as a property of or as similar to the Pareto distribution. However, the law only holds in the case that . Note that in this case, the total and expected amount of wealth are not defined, and the rule only applies asymptotically to random samples. The extended Pareto Principle mentioned above is a far more general rule.
Lorenz curve and Gini coefficient
The Lorenz curve is often used to characterize income and wealth distributions. For any distribution, the Lorenz curve L(F) is written in terms of the PDF f or the CDF F as
where x(F) is the inverse of the CDF. For the Pareto distribution,
and the Lorenz curve is calculated to be
For the denominator is infinite, yielding L=0. Examples of the Lorenz curve for a number of Pareto distributions are shown in the graph on the right.
According to Oxfam (2016) the richest 62 people have as much wealth as the poorest half of the world's population.[35] We can estimate the Pareto index that would apply to this situation. Letting ε equal we have: or The solution is that α equals about 1.15, and about 9% of the wealth is owned by each of the two groups. But actually the poorest 69% of the world adult population owns only about 3% of the wealth.[36]
The Gini coefficient is a measure of the deviation of the Lorenz curve from the equidistribution line which is a line connecting [0, 0] and [1, 1], which is shown in black (α = ∞) in the Lorenz plot on the right. Specifically, the Gini coefficient is twice the area between the Lorenz curve and the equidistribution line. The Gini coefficient for the Pareto distribution is then calculated (for ) to be
(see Aaberge 2005).
Random variate generation
Script error: No such module "labelled list hatnote".
Random samples can be generated using inverse transform sampling. Given a random variate U drawn from the uniform distribution on the unit interval [0, 1], the variate T given by
is Pareto-distributed.[37]
See also
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
- Template:Annotated link
References
Notes
- Script error: No such module "Citation/CS1".
- Script error: No such module "citation/CS1".
- Script error: No such module "Citation/CS1".
- Script error: No such module "citation/CS1".
External links
- Template:Springer
- Script error: No such module "Template wrapper".
- Script error: No such module "citation/CS1".
- Script error: No such module "citation/CS1".
- syntraf1.c Template:Webarchive is a C program to generate synthetic packet traffic with bounded Pareto burst size and exponential interburst time.
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ a b Pareto, Vilfredo, Cours d'Économie Politique: Nouvelle édition par G.-H. Bousquet et G. Busino, Librairie Droz, Geneva, 1964, pp. 299–345. Original book archived
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ a b c d Script error: No such module "citation/CS1".
- ↑ S. Hussain, S.H. Bhatti (2018). Parameter estimation of Pareto distribution: Some modified moment estimators. Maejo International Journal of Science and Technology 12(1):11-27.
- ↑ Script error: No such module "Citation/CS1".
- ↑ a b Johnson NL, Kotz S, Balakrishnan N (1994) Continuous univariate distributions Vol 1. Wiley Series in Probability and Statistics.
- ↑ a b c d Johnson, Kotz, and Balakrishnan (1994), (20.4).
- ↑ Script error: No such module "citation/CS1".
- ↑ a b Script error: No such module "citation/CS1". "The densities (4.3) are sometimes called after the economist Pareto. It was thought (rather naïvely from a modern statistical standpoint) that income distributions should have a tail with a density ~ Ax−α as x → ∞".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Template:Cite thesis section 5.3.1.
- ↑ Script error: No such module "citation/CS1".
- ↑ a b c d Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ For a two-quantile population, where approximately 18% of the population owns 82% of the wealth, the Theil index takes the value 1.
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ a b c d e Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Kleiber and Kotz (2003): p. 94.
- ↑ Script error: No such module "Citation/CS1".
- ↑ CumFreq, software for cumulative frequency analysis and probability distribution fitting [1]
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".