In this appendix, we present the definitions of cumulants.
Consider a scalar random variable of zero mean, say x, whose characteristic
function is denoted by
Cumulants should be compared with (centered) moments. The r-th moment of x is defined as [88,109]. (For simplicity, x was here assumed to have zero mean, in which case the centered moments, or moments about the mean, equal the non-centered moments, or moments about zero). The moments may also be obtained from a Taylor expansion that is otherwise identical to the one in (43), but no logarithm is taken on the left side. Note that the first 3 moments equal the first 3 cumulants. For r>3, however, this is no longer the case.
The mathematical simplicity of the cumulant-based approach in ICA is due to certain linearity properties of the cumulants . For kurtosis, these can be formulated as follows. If x1 and x2 are two independent random variables, it holds and , where is a scalar.
Cumulants of several random variables
x1,...,xm are defined similarly. The
for any set of indices ij is defined by the coefficient of the term ti1 ti2 ... tik in the Taylor expansion of the logarithm of the characteristic function of the vector .