Hyperexponential distribution

Diagram showing queueing system equivalent of a hyperexponential distribution

In probability theory, a hyperexponential distribution is a continuous probability distribution whose probability density function of the random variable X is given by

f X ( x ) = i = 1 n f Y i ( x ) p i , {\displaystyle f_{X}(x)=\sum _{i=1}^{n}f_{Y_{i}}(x)\;p_{i},}

where each Yi is an exponentially distributed random variable with rate parameter λi, and pi is the probability that X will take on the form of the exponential distribution with rate λi.[1] It is named the hyperexponential distribution since its coefficient of variation is greater than that of the exponential distribution, whose coefficient of variation is 1, and the hypoexponential distribution, which has a coefficient of variation smaller than one. While the exponential distribution is the continuous analogue of the geometric distribution, the hyperexponential distribution is not analogous to the hypergeometric distribution. The hyperexponential distribution is an example of a mixture density.

An example of a hyperexponential random variable can be seen in the context of telephony, where, if someone has a modem and a phone, their phone line usage could be modeled as a hyperexponential distribution where there is probability p of them talking on the phone with rate λ1 and probability q of them using their internet connection with rate λ2.

Properties

Since the expected value of a sum is the sum of the expected values, the expected value of a hyperexponential random variable can be shown as

E [ X ] = x f ( x ) d x = i = 1 n p i 0 x λ i e λ i x d x = i = 1 n p i λ i {\displaystyle E[X]=\int _{-\infty }^{\infty }xf(x)\,dx=\sum _{i=1}^{n}p_{i}\int _{0}^{\infty }x\lambda _{i}e^{-\lambda _{i}x}\,dx=\sum _{i=1}^{n}{\frac {p_{i}}{\lambda _{i}}}}

and

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "http://localhost:6011/en.wikipedia.org/v1/":): {\displaystyle E\!\left[X^2\right] = \int_{-\infty}^\infty x^2 f(x) \, dx = \sum_{i=1}^n p_i\int_0^\infty x^2\lambda_i e^{-\lambda_ix} \, dx = \sum_{i=1}^n \frac{2}{\lambda_i^2}p_i,}

from which we can derive the variance:[2]

Var [ X ] = E [ X 2 ] E [ X ] 2 = i = 1 n 2 λ i 2 p i [ i = 1 n p i λ i ] 2 = [ i = 1 n p i λ i ] 2 + i = 1 n j = 1 n p i p j ( 1 λ i 1 λ j ) 2 . {\displaystyle \operatorname {Var} [X]=E\!\left[X^{2}\right]-E\!\left[X\right]^{2}=\sum _{i=1}^{n}{\frac {2}{\lambda _{i}^{2}}}p_{i}-\left[\sum _{i=1}^{n}{\frac {p_{i}}{\lambda _{i}}}\right]^{2}=\left[\sum _{i=1}^{n}{\frac {p_{i}}{\lambda _{i}}}\right]^{2}+\sum _{i=1}^{n}\sum _{j=1}^{n}p_{i}p_{j}\left({\frac {1}{\lambda _{i}}}-{\frac {1}{\lambda _{j}}}\right)^{2}.}

The standard deviation exceeds the mean in general (except for the degenerate case of all the λs being equal), so the coefficient of variation is greater than 1.

The moment-generating function is given by

E [ e t x ] = e t x f ( x ) d x = i = 1 n p i 0 e t x λ i e λ i x d x = i = 1 n λ i λ i t p i . {\displaystyle E\!\left[e^{tx}\right]=\int _{-\infty }^{\infty }e^{tx}f(x)\,dx=\sum _{i=1}^{n}p_{i}\int _{0}^{\infty }e^{tx}\lambda _{i}e^{-\lambda _{i}x}\,dx=\sum _{i=1}^{n}{\frac {\lambda _{i}}{\lambda _{i}-t}}p_{i}.}

Fitting

A given probability distribution, including a heavy-tailed distribution, can be approximated by a hyperexponential distribution by fitting recursively to different time scales using Prony's method.[3]

See also

  • Phase-type distribution
  • Hyper-Erlang distribution
  • Lomax distribution (continuous mixture of exponentials)

References

  1. ^ Singh, L. N.; Dattatreya, G. R. (2007). "Estimation of the Hyperexponential Density with Applications in Sensor Networks". International Journal of Distributed Sensor Networks. 3 (3): 311. CiteSeerX 10.1.1.78.4137. doi:10.1080/15501320701259925.
  2. ^ H.T. Papadopolous; C. Heavey; J. Browne (1993). Queueing Theory in Manufacturing Systems Analysis and Design. Springer. p. 35. ISBN 9780412387203.
  3. ^ Feldmann, A.; Whitt, W. (1998). "Fitting mixtures of exponentials to long-tail distributions to analyze network performance models" (PDF). Performance Evaluation. 31 (3–4): 245. doi:10.1016/S0166-5316(97)00003-5.
  • v
  • t
  • e
Discrete
univariate
with finite
support
with infinite
support
Continuous
univariate
supported on a
bounded interval
supported on a
semi-infinite
interval
supported
on the whole
real line
with support
whose type varies
Mixed
univariate
continuous-
discrete
Multivariate
(joint)DirectionalDegenerate
and singular
Degenerate
Dirac delta function
Singular
Cantor
Families
  • Category
  • Commons