Maths encyclopedia and lessons  
Search

Mathematics Encyclopedia and Lessons

 
     
 

Lessons

Popular
Subjects

algebra
arithmetic
calculus
equations
geometry
differential equations
trigonometry
number theory
probability theory
more
 

References

applied mathematics
mathematical games
mathematicians
more
 
 

Characteristic function

Some mathematicians use the phrase characteristic function synonymously with indicator function. The indicator function of a subset A of a set B is the function with domain B, whose value is 1 at each point in A and 0 at each point that is in B but not in A.


In probability theory, the characteristic function of any probability distribution on the real line is given by the following formula, where X is any random variable with the distribution in question:

\phi_X(t) = \operatorname{E}\left(e^{itX}\right)    = \int_\Omega e^{itx}\, dF_X(x)   = \int_{-\infty}^{\infty} f_X(x)\, e^{itx}\,dx.

Here t is a real number, E denotes the expected value and F is the cumulative distribution function. The last form is valid only when the probability density function f exists. The form preceding it is a Riemann-Stieltjes integral and is valid regardless of whether a density function exists.

If X is a vector-valued random variable, one takes the argument t to be a vector and tX to be a dot product.

A characteristic function exists for any random variable. More than that, there is a bijection between cumulative probability distribution functions and characteristic functions. In other words, two probability distributions never share the same characteristic function.

Given a characteristic function φ, it is possible to reconstruct the corresponding cumulative probability distribution function F:

F_X(y) - F_X(x) = \lim_{\tau \to +\infty} \frac{1} {2\pi}   \int_{-\tau}^{+\tau} \frac{e^{-itx} - e^{-ity}} {it}\, \phi_X(t)\, dt.

In general this is an improper integral; the function being integrated may be only conditionally integrable rather than Lebesgue-integrable, i.e. the integral of its absolute value may be infinite.

Characteristic functions are used in the most frequently seen proof of the central limit theorem.

Characteristic functions can also be used to find moments of random variable. Provided that n-th moment exists, characteristic function can be differentiated n times and

\operatorname{E}\left(X^n\right) = i^n\, \phi_X^{(n)}(0)   = i^n\, \left[\frac{d^n}{dt^n} \phi_X(t)\right]_{t=0}.

Related concepts include the moment-generating function and the probability-generating function.

The characteristic function is closely related to the Fourier transform: the characteristic function of a distribution with density function f is proportional to the inverse Fourier transform of f.

Characteristic functions are particularly useful for dealing with functions of independent random variables. For example, if X1, X2, ..., Xn is a sequence of independent (and not necessarily identically distributed) random variables, and

S_n = \sum_{i=1}^n a_i X_i,

where the a i are constants, then the characteristic function for S n is given by

\phi_{S_n}(t)=\phi_{X_1}(a_1t)\phi_{X_2}(a_2t)\cdots \phi_{X_n}(a_nt).
01-04-2007 01:18:14
The contents of this article are licensed from Wikipedia.org
under the GNU Free Documentation License. How to see transparent copy