Divisible, decomposable and stable distributions

Ways of slicing randomness into easy chunks

June 15, 2017 — October 9, 2024

dynamical systems
linear algebra
Lévy processes
probability
SDEs
stochastic processes
time series

There are various closely related notions of how to construct random variables as sums of other random variables. I write them out here so that I might finally remember which is which.

Figure 1: by ori2uru, CC BY 2.0, via flickr

1 Infinitely divisible

The Lévy process quality.

A probability distribution is infinitely divisible if it can be expressed as the probability distribution of the sum of any arbitrary natural number of independent and identically distributed random variables. i.e. The distribution \(F\) is infinitely divisible if, for every positive integer \(n\), there exist \(n\) i.i.d. RVs whose sum

\[X_1 + \dots + X_n = S_n \sim F.\]

In addition to the classics (Gaussian, Poisson, stable and Gamma processes), Kyprianou (2014) lists various other infinitely divisible ones:

There are many more known examples of infinitely divisible distributions (and hence Lévy processes). Of the many known proofs of infinite divisibility for specific distributions, most of them are non-trivial, often requiring intimate knowledge of special functions. A brief list of such distributions might include generalised inverse Gaussian (see Good (1953) and Jorgensen (1982)), truncated stable (see Tweedie (1984), Hougaard (1986), Koponen (1995), Boyarchenko and Levendorskii (2002a) and Carr et al. (2003)), generalised hyperbolic (see Halgreen (1979)), Meixner (see Schoutens and Teugels (1998)), Pareto (see Fred W. Steutel (1970), Thorin (1977b)), F-distributions (see Ismail (1979)), Gumbel (see Johnson and Kotz 1970; F. W. Steutel 1973), Weibull (see Johnson and Kotz 1970; Fred W. Steutel 1970), lognormal (see Thorin 1977b) and Student t-distribution (see Grosswald 1976; Ismail 1977).

I think the references to Fred W. Steutel (1970), which is an unavailable tech report, can be replaced with refs to Keilson and Steutel (1972) or Fred W. Steutel and van Harn (2003).

Vexingly, the proofs are often of existence type but construct no easy closed form representation for the component distributions.

Note that infinite divisibility for a given distribution does not necessarily imply that the distribution is divisible in the family we might have assumed — e.g. lognormal RVs are, it turns out, divisible in the family of generalized Γ-convolutions, according to Thorin (1977b), and these generalized Γ-convolutions are closed under addition, although they are not necessarily actual lognormals.

Natural exponential families with quadratic variance function have infinite divisibility in all cases except binomial (Morris 1982).

2 Decomposable

The distribution of \(X\) is decomposable if there are 2 or more non-constant RVs, not necessarily in the same family, whose sum is equal in distribution. Not a strong property, but the cases where an RV fails to possess even this are curious. 🏗

Figure 2

3 Self-decomposable

Carr et al. (2007) define it

The distribution of a random variable \(X\) is said to be self-decomposable (Sato 1999 Definition 15.1) if for any constant \(c, 0<c<1\) there exists an independent random variable say, \(X^{(c)}\) such that \[ X \stackrel{\text { law }}{=} c X+X^{(c)} \]

While this looks more general than divisible distributions, they note that self-decomposable distributions form sub-class of infinitely divisible distributions.

4 Stable

A distribution or a random variable is said to be stable if a linear combination of two independent copies of a random sample has the same distribution, up to location and scale parameters. (i.e. a stronger property than the infinitely divisible property, which allows other parameters than location and scale.)

This induces (at least?) 2 families of distributions, the discrete and continuous stable families, depending on whether they are supported on the reals or the integers. Presumably other fields get other families. See (van Harn and Steutel 1993).

For continuous-valued continuous/discrete indexed stochastic process, \(X(t)\), \(\alpha\)-stability implies that the marginal law of the value of the process at certain times satisfies a stability equation: \[X(a) \simeq W^{1/\alpha}X(b),\] for \(0 < a < b\), \(\alpha> 0\) and \(W\sim \operatorname{Unif}([0,1])\perp X\).

The marginal distributions of such processes are those of the \(\alpha\)-stable processes. For \(\alpha=2\) we have Gaussians and for \(\alpha=1\), the Cauchy law.

5 Induced processes

5.1 Lévy

All the divisible distributions induce an obvious process — the decomposition of the process into independent increment Markov variates; which is to say, each divisible family induces an associated Lévy process. Classic example: the Gaussian distribution induces a Gauss Markov (i.e. Wiener) process, and the Gamma distribution a Gamma-Lévy process etc.

5.2 Ornstein–Uhlenbeck

This needs a notebook.

5.3 Linear differential

See Lévy SDEs.

6 Non-additive

🏗 Everything so far has been about sums of RVs; but presumably we could construct similar analyses of other algebraic structures of distributions, e.g. maximum processes. TBD.

7 Generalized Gamma Convolutions

The Generalized Gamma Convolutions (GGC) is a construction Barndorff-Nielsen, Maejima, and Sato (2006) that represents some startling (to me) processes using generalized Gamma distributions, including Pareto (Thorin 1977b) and Lognormal (Thorin 1977b) ones.

They seem to be related to the idea of subordinator convolutions, which convolve a subordinator process with some kernel. The GGC convolves a Gamma distribution with some measure and makes a new divisible distribution.

James, Roynette, and Yor (2008):

we say that a positive r.v. \(\Gamma\) is a generalized gamma convolution \((\mathrm{GGC})\) — without translation term — if there exists a positive Radon measure \(\mu\) on \(( 0, \infty)\) such that: \[ \begin{aligned} E\left[e^{-\lambda \Gamma}\right]=& \exp \left\{-\int_{0}^{\infty}\left(1-e^{-\lambda x}\right) \frac{d x}{x} \int_{0}^{\infty} e^{-x z} \mu(d z)\right\} \\ =& \exp \left\{-\int_{0}^{\infty} \log \left(1+\frac{\lambda}{z}\right) \mu(d z)\right\} \\ \text { with: } & \int_{] 0,1]}|\log x| \mu(d x)<\infty \text { and } \int_{[1, \infty[} \frac{\mu(d x)}{x}<\infty \end{aligned} \]

Pérez-Abreu and Stelzer (2014) generalises the GGC to vector- and matrix-valued distributions.

8 References

Applebaum. 2009. Lévy Processes and Stochastic Calculus. Cambridge Studies in Advanced Mathematics 116.
Arras, and Houdré. 2019. On Stein’s Method for Infinitely Divisible Laws with Finite First Moment. Edited by Benjamin Arras and Christian Houdré. SpringerBriefs in Probability and Mathematical Statistics.
Barndorff-Nielsen, Maejima, and Sato. 2006. Some Classes of Multivariate Infinitely Divisible Distributions Admitting Stochastic Integral Representations.” Bernoulli.
Bertoin. 1996. Lévy Processes. Cambridge Tracts in Mathematics 121.
———. 2000. Subordinators, Lévy Processes with No Negative Jumps, and Branching Processes.
Bondesson. 2012. Generalized Gamma Convolutions and Related Classes of Distributions and Densities. Lecture Notes in Statistics 76.
Cahoy, Uchaikin, and Woyczynski. 2010. Parameter Estimation for Fractional Poisson Processes.” Journal of Statistical Planning and Inference.
Carr, Geman, Madan, et al. 2007. Self-Decomposability and Option Pricing.” Mathematical Finance.
Ernst, Kagan, and Rogers. 2021. The Least Favorable Noise.” arXiv:2103.09794 [Math, Stat].
Grigelionis. 2013. Student’s t-Distribution and Related Stochastic Processes. SpringerBriefs in Statistics.
Grosswald. 1976. The Student t-Distribution of Any Degree of Freedom Is Infinitely Divisible.” Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete.
Hasebe. 2014. Free Infinite Divisibility for Beta Distributions and Related Ones.” Electronic Journal of Probability.
Houdré. 2002. Remarks on Deviation Inequalities for Functions of Infinitely Divisible Random Vectors.” The Annals of Probability.
Ismail. 1977. Bessel Functions and the Infinite Divisibility of the Student \(t\)- Distribution.” The Annals of Probability.
James, Roynette, and Yor. 2008. Generalized Gamma Convolutions, Dirichlet Means, Thorin Measures, with Explicit Examples.” Probability Surveys.
Janson. 2011. Stable Distributions.” Eprint arXiv:1112.0220.
Johnson, and Kotz. 1970. Distributions in Statistics.
Keilson, and Steutel. 1972. Families of Infinitely Divisible Distributions Closed Under Mixing and Convolution.” The Annals of Mathematical Statistics.
Kyprianou. 2014. Fluctuations of Lévy Processes with Applications: Introductory Lectures. Universitext.
Morris. 1982. Natural Exponential Families with Quadratic Variance Functions.” The Annals of Statistics.
———. 1983. Natural Exponential Families with Quadratic Variance Functions: Statistical Theory.” The Annals of Statistics.
Morris, and Lock. 2009. Unifying the Named Natural Exponential Families and Their Relatives.” The American Statistician.
Nishiyama, and Fukumizu. 2016. Characteristic Kernels and Infinitely Divisible Distributions.” The Journal of Machine Learning Research.
Pérez-Abreu, and Stelzer. 2014. Infinitely Divisible Multivariate and Matrix Gamma Distributions.” Journal of Multivariate Analysis.
Sato. 1999. Lévy Processes and Infinitely Divisible Distributions.
Steutel, Fred W. 1970. “Preservation of Infinite Divisibility Under Mixing and Related Topics.” Math. Centre Tracts.
Steutel, F. W. 1973. Some Recent Results in Infinite Divisibility.” Stochastic Processes and Their Applications.
Steutel, F. W., Kent, Bondesson, et al. 1979. Infinite Divisibility in Theory and Practice [with Discussion and Reply].” Scandinavian Journal of Statistics.
Steutel, F. W., and van Harn. 1979. Discrete Analogues of Self-Decomposability and Stability.” The Annals of Probability.
Steutel, Fred W., and van Harn. 2003. Infinite Divisibility of Probability Distributions on the Real Line.
Thorin. 1977a. On the Infinite Divisbility of the Pareto Distribution.” Scandinavian Actuarial Journal.
———. 1977b. On the Infinite Divisibility of the Lognormal Distribution.” Scandinavian Actuarial Journal.
Unser, and Tafti. 2014. An Introduction to Sparse Stochastic Processes.
van Harn, and Steutel. 1993. Stability Equations for Processes with Stationary Independent Increments Using Branching Processes and Poisson Mixtures.” Stochastic Processes and Their Applications.
van Harn, Steutel, and Vervaat. 1982. Self-Decomposable Discrete Distributions and Branching Processes.” Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete.
Wolpert. 2021. Lecture Notes on Stationary Gamma Processes.” arXiv:2106.00087 [Math].