Gamma function

The gamma function is a mathematical function that extends the domain of factorials to non-integers. The factorial of a positive integer n, written n!, is the product 1·2·3···n. The gamma function, denoted by $\Gamma$, is defined to satisfy $\Gamma (n)=(n-1)!$ for all positive integers n and to smoothly interpolate the factorial between the integers. The gamma function is one of the most commonly occurring examples of a nonelementary function; that is, a function that cannot be expressed in finite terms using algebraic operations, exponentials, and logarithms. Its study dates back to Leonhard Euler, who gave a formula for its calculation in 1729.

Motivation

"enjoy studying its properties"

Nobel Prize winner Gerard 't Hooft, recommending prospective students of theoretical physics to learn about the gamma function

It is easy to graphically interpolate the factorial to non-integer values, but is there a formula that describes the resulting curve?

A famous anecdote tells that Carl Friedrich Gauss as a child found that the sum $1+2+...+n$ can be calculated from the formula $n(n+1)/2$. He was thereby able to quickly sum all the integers between 1 and 100, to the astonishment of his teacher.

Such a formula, in which the number of operations does not depend on the size of $n$, is called a closed-form expression. Is there a closed-form expression for factorials? If we had one, we could not only calculate factorials less tediously, but also generalize the concept of a factorial to numbers that are not integers. The formula $n(n+1)/2$, for comparison, describes a parabola when plotted for a continuously changing variable $n$.

By plotting the factorial of a few small integers, it becomes apparent that the dots can be connected with a smooth curve. We could, very roughly, calculate fractional factorials by just inspecting the graph. The problem is that it is not so easy to find a formula that exactly describes the curve. In fact, we now know that no simple such formula exists — "simple" meaning that no finite combination of elementary functions such as the usual arithmetic operations and the exponential function will do. Considering the simple solution for sums, it may come as surprise that changing "+" to "·" makes such a difference. But it is possible to find a general formula for factorials, if we deploy tools from calculus.

Basic properties of the gamma function

Euler's integral definition

The gamma function is commonly defined by a definite integral due to Leonhard Euler,

$\Gamma (z)=\int _{0}^{\infty }e^{-t}t^{z-1}dt,$

where $t^{z-1}$ is interpreted as $e^{(z-1)\log t}$ if $z$ is not an integer. Using standard theorems from mathematical analysis, it can be shown that Euler's integral defines $\Gamma$ to be a continuous function if $z$ is positive, or indeed any complex number with positive real part. To see that it corresponds to the factorial at integers, we can insert $z+1$ instead of $z$ and perform an integration by parts to obtain

$\Gamma (z+1)=\left[-e^{-t}t^{z}\right]_{0}^{\infty }+z\int _{0}^{\infty }e^{-t}t^{z-1}dt=z\Gamma (z).$

This relation is called the recurrence formula or recurrence relation of the gamma function. The equation $f(z+1)=zf(z)$ is an example of a functional equation — an equation to be solved for the function $f$ for all values of $z$. It is analogous to the recurrence satisfied by factorials, $n!=n(n-1)!$, the only difference being that the function argument has been shifted by 1. A repeated application of the gamma function's recurrence formula gives

$\Gamma (z+n)=z(z+1)(z+2)\cdots (z+n-1)\Gamma (z),$

which together with the initial value $\textstyle \Gamma (1)=\int _{0}^{\infty }e^{-t}dt=1$ establishes that

$\Gamma (n)=1\cdot 2\cdot 3\ldots (n-1)=(n-1)!$

for positive integers $n$. We can of course equivalently write $\Gamma (n+1)=n!$. We may use these formulas to explicitly calculate $\Gamma (n)$ or, conversely, to define $z!$ for non-integers in terms of the gamma function.

Real and complex numbers

The behavior of $\Gamma (z)$ for an increasing positive variable is simple: it grows quickly — faster than an exponential function. Asymptotically as $z\to \infty$, the magnitude of the gamma function is given by Stirling's formula

$\Gamma (z+1)\approx {\sqrt {2\pi z}}\left({\frac {z}{e}}\right)^{z}.$

The behavior for nonpositive $z$ is more intricate. Euler's integral does not converge for $z\leq 0$, but the function it defines in the positive complex half-plane has a unique analytic continuation to the negative half-plane. One way to find that analytic continuation is to use Euler's integral for positive arguments and extend the domain to negative numbers by repeated application of the recurrence formula,

$\Gamma (z)={\frac {\Gamma (z+n)}{z(z+1)\cdots (z+n-1)}},$

choosing $n$ such that $z+n$ is positive. The product contains a factor that blows up due to division by zero as $z$ approaches any of the integers $0,-1,-2,\ldots$. Thus, the gamma function must be undefined at those points; it is a meromorphic function with poles at the nonpositive integers. The following image shows the graph of the gamma function along the real line:

The gamma function is nonzero everywhere along the real line, although it comes arbitrarily close as $z\to -\infty$. There is in fact no complex number z for which $\Gamma (z)=0$, and hence the reciprocal gamma function $1/\Gamma$ is an entire function, with zeros at $z=0,-1,-2,\ldots$. We see that the gamma function has a local minimum at $x_{\mathrm {min} }\approx 1.46163$ where it attains the value $\Gamma (x_{\mathrm {min} })\approx 0.885603$. The gamma function must alternate sign between the poles because the product in the forward recurrence contains an odd number of negative factors if the number of poles between $z$ and $z+n$ is odd, and an even number if the number of poles is even.

Plotting the gamma function in the complex plane yields beautiful graphs:

• 

  Absolute value

• 

  Real part

• 

  Imaginary part

The reflection formula

The recurrence relation is not the only functional equation satisfied by the gamma function. Another important property is the reflection formula

$\Gamma (z)\Gamma (1-z)={\frac {\pi }{\sin \pi z}}$

which gives a concise relation between the gamma function of positive and negative numbers. The division by a sine, which is periodically zero, again indicates the existence of the gamma function's periodically occurring poles. Further, inserting z = 1/2 reveals the surprising fact that

$\Gamma (1/2)={\sqrt {\pi }}.$

Hence, by the recurrence formula, the gamma function or factorial of any half-integer is a rational multiple of ${\sqrt {\pi }}$.

Numerical methods

It is easy to approximate the gamma function given a known approximation that holds on some interval of unit width, say for $1\leq z\leq 2$; the value anywhere else can then be computed via the recurrence and reflection formulas, using only a few multiplications or an evaluation of the sine in the reflection formula. Listings of polynomials and rational functions that approximate the gamma function in a unit interval are available in various reference works.

For large arguments, say $|z|>10$, it is best to use an asymptotic expansion; the most popular is Stirling's series

$\Gamma (z+1)\sim {\sqrt {2\pi z}}\left({\frac {z}{e}}\right)^{z}\left(1+{\frac {1}{12z}}+{\frac {1}{288z^{2}}}-\cdots \right).$

This is Stirling's formula multiplied by a series that corrects the error. The series coefficients can be calculated in terms of Bernoulli numbers. The "$\sim$" sign denotes an asymptotic equality: the series diverges for every z, but yields arbitrarily accurate approximations of the gamma function as $z\to \infty$ if the series is truncated at the smallest term. We can use Stirling's series to calculate the gamma function for small numbers as well, using the recurrence relation. Taking $n=10$ and calculating $\Gamma (z)$ from $\Gamma (z+n)$, using the three first terms in Stirling's series, we obtain $\Gamma (1)$ ≈ 1.000003 and $\Gamma (2)$ ≈ 1.000002; this particular approximation is good to five decimal places on the interval $1\leq z\leq 2$. With larger $n$ and more terms, Stirling's series permits calculating the gamma function with arbitrary precision.

Other practical methods for high-precision calculation include the Lanczos approximation and Spouge's approximation, which are both similar in form to Stirling's series but have different convergence characteristics.

It should be noted that it may be convenient to work with the logarithm of the gamma function instead of the gamma function itself, since the raw gamma function grows quickly and can cause overflow in computer arithmetic. It is common to encounter a quotient of two large gamma function values, which is most safely computed by subtracting two logarithms. Stirling's, Lanczos's and Spouge's approximations can all be calculated directly in logarithmic form.

Applications

Opening a random page in an advanced table of formulas, one may be as likely to spot the gamma function as a trigonometric function. One author describes the gamma function as "Arguably, the most common special function, or the least 'special' of them. The other transcendental functions listed below are called 'special' because you could conceivably avoid some of them by staying away from many specialized mathematical topics. On the other hand, the Gamma function $y=\Gamma (x)$ is most difficult to avoid."

Integration problems

The gamma function finds application in such diverse areas as quantum physics, astrophysics and fluid dynamics. The gamma distribution, which is formulated in terms of the gamma function, is used in statistics to model a wide range of processes; for example, the expected time between occurrences of earthquakes.

The primary reason for the gamma function's usefulness in such contexts is the prevalence of expressions of the type $f(t)\,e^{-g(t)}$ which describe processes that decay exponentially in time or space. Integrals of such expressions can occasionally be solved in terms of the gamma function when no elementary solution exists. For example, if $f$ is a power function and $g$ is a linear function, a simple change of variables gives the evaluation

$\int _{0}^{\infty }t^{b}e^{-at}\,dt={\frac {\Gamma (a+1)}{a^{b+1}}}.$

The fact that the integration is performed along the entire positive real line might signify that the gamma function describes the cumulation of a time-dependent process that continues indefinitely, or the value might be the total of a distribution in an infinite space.

It is of course frequently useful to take limits of integration other than 0 and $\infty$ to describe the cumulation of a finite process, in which case the ordinary gamma function is no longer a solution; the solution is then called an incomplete gamma function. (The ordinary gamma function, obtained by integrating across the entire positive real line, is sometimes called the complete gamma function for contrast).

An important category of exponentially decaying functions is that of Gaussian functions $ae^{-(x-b)^{2}/c^{2}}$ and integrals thereof, such as the error function. There are many interrelations between these functions and the gamma function; notably, the square root of $\pi$ we obtained by evaluating $\Gamma (1/2)$ is the "same" as that found in the normalizing factor of the error function and the normal distribution.

The integrals we have discussed so far involve transcendental functions, but the gamma function also arises from integrals of purely algebraic functions. In particular, the arc lengths of ellipses and of the lemniscate, which are curves defined by algebraic equations, are given by elliptic integrals that in special cases can be evaluated in terms of the gamma function.

Another important special case is that of the beta function

$\mathrm {\mathrm {B} } (x,y)=\int _{0}^{1}t^{x-1}(1-t)^{y-1}\,dt={\frac {\Gamma (x)\,\Gamma (y)}{\Gamma (x+y)}}.$

Expressing products

The gamma function's ability to and generalize factorial products immediately leads to applications in many areas of mathematics; in combinatorics, and by extension in areas such as probability theory and the calculation of power series. Many expressions involving products of successive integers can be written as some combination of factorials, the most important example perhaps being that of the binomial coefficient

${n \choose k}={\frac {n!}{k!(n-k)!}}.$

The example of binomial coefficients motivates why the properties of the gamma function when extended to negative numbers are natural. A binomial coefficient gives the number of ways to choose $k$ elements from a set of $n$ elements; if $k>n$, there are of course no ways. If $k>n$, $(n-k)!$ is the factorial of a negative integer and hence infinite if we use the gamma function definition of factorials — dividing by infinity gives the expected value of 0.

We can replace the factorial by a gamma function to extend any such formula to the complex numbers. Generally, any product where each factor is a rational function of the index variable is susceptible to the same treatment. If $P$ and $Q$ are monic polynomials of degree $m$ and $n$ with respective roots $p_{1}\ldots p_{m}$ and $q_{1}\ldots q_{n}$, we have

$\prod _{i=a}^{b}{\frac {P(i)}{Q(i)}}=\left(\prod _{j=1}^{m}{\frac {\Gamma (b-p_{j}+1)}{\Gamma (a-p_{j})}}\right)\left(\prod _{k=1}^{n}{\frac {\Gamma (a-q_{k})}{\Gamma (b-q_{k}+1)}}\right).$

If we have a way to calculate the gamma function numerically, it is a breeze to calculate numerical values of such products. The number of gamma functions in the right-hand side depends only on the degree of the polynomials, so it does not matter whether $b-a$ equals 5 or $10^{5}$. Moreover, due to the poles of the gamma function, the equation also holds (in the sense of taking limits) when the left-hand product contain zeros or poles.

By taking limits, rational products with infinitely many factors can be evaluated in terms of the gamma function as well. Due to the Weierstrass factorization theorem, many simple analytic functions can be written as infinite products of rational factors, and hence can be represented as finite products or quotients of the gamma function. We have already seen one striking example: the reflection formula essentially represents the sine function as the product of two gamma functions. Starting from this formula, the exponential function as well as all the trigonometric and hyperbolic functions can be expressed in terms of the gamma function.

More functions yet, including the hypergeometric function and special cases thereof, can be represented by means of complex contour integrals of products and quotients of the gamma function, called Mellin-Barnes integrals.

Analytic number theory

An elegant and deep application of the gamma function is in the study of the Riemann zeta function. A fundamental property of the Riemann zeta function is its functional equation:

$\Gamma \left({\frac {s}{2}}\right)\zeta (s)\pi ^{-s/2}=\Gamma \left({\frac {1-s}{2}}\right)\zeta (1-s)\pi ^{(1-s)/2}.$

Among other things, this provides an explicit form for the analytic continuation of the zeta function to a meromorphic function in the complex plane and leads to an immediate proof that the zeta function has infinitely many so-called "trivial" zeros on the real line. Borwein et al. call this formula "one of the most beautiful findings in mathematics". Another champion for that title might be

$\zeta (z)\;\Gamma (z)=\int _{0}^{\infty }{\frac {t^{z-1}}{e^{t}-1}}\;dt.$

Both formulas were derived by Bernhard Riemann in his seminal 1859 paper "Über die Anzahl der Primzahlen unter einer gegebenen Grösse" ("On the Number of Prime Numbers less than a Given Quantity"), one of the milestones in the development of analytic number theory — the branch of mathematics that studies prime numbers using the tools of mathematical analysis. Factorial numbers, considered as discrete objects, are an important concept in classical number theory due to containing many prime factors, but Riemann found a use for their continuous extension that arguably turned out to be even more important.

History

The gamma function has caught the interest of some of the most prominent mathematicians of all time. Its history, notably documented by Philip J. Davis in an article that won him the 1963 Chauvenet Prize, reflects many of the major developments within mathematics since the 18th century. In the words of Davis, "each generation has found something of interest to say about the gamma function. Perhaps the next generation will also."

18th century: Euler and Stirling

The first page of Euler's paper "De progressionibus transcendentibus seu quarum termini generales algebraice dari nequeunt".

The problem of extending the factorial to non-integer arguments was apparently first considered by Daniel Bernoulli and Christian Goldbach in the 1720s, and was solved at the end of the same decade by Leonhard Euler. Euler gave two different definitions: the first was not his integral but an infinite product,

$n!=\prod _{k=1}^{\infty }{\frac {\left(1+{\frac {1}{k}}\right)^{n}}{1+{\frac {n}{k}}}},$

of which he informed Goldbach in a letter dated October 13, 1729. He wrote to Goldbach again on January 8, 1730, to announce his discovery of the integral representation

$n!=\int _{0}^{1}(-\log s)^{n}\,ds,$

which is valid for $n>0$. By the change of varibles $t=-\log s$, this becomes the familiar Euler integral. Euler published his results in the paper "De progressionibus transcendentibus seu quarum termini generales algebraice dari nequeunt" ("On transcendental progressions, that is, those whose general terms cannot be given algebraically"), submitted to the St. Petersburg Academy on November 28, 1729. Euler further discovered some of the gamma function's important functional properties, including the reflection formula.

James Stirling, a contemporary of Euler, also attempted to find a continuous expression for the factorial and came up with what is now known as Stirling's formula. Although Stirling's formula gives a good estimate of $n!$, also for non-integers, it does not provide the exact value. Extensions of his formula that correct the error were given by Stirling himself and by Jacques Philippe Marie Binet.

19th century: Gauss, Weierstrass and Legendre

Carl Friedrich Gauss rewrote Euler's product as

$\Gamma (z)=\lim _{m\to \infty }{\frac {m^{z}m!}{z(z+1)(z+2)\cdots (z+m)}}$

and used this formula to discover new properties of the gamma function. Although Euler was a pioneer in the theory of complex variables, he does not appear to have considered the factorial of a complex numbers, as instead Gauss first did. Gauss also proved the multiplication theorem of the gamma function.

Karl Weierstrass further established the role of the gamma function in complex analysis, starting from yet another product representation,

$\Gamma (z)={\frac {e^{-\gamma z}}{z}}\prod _{k=1}^{\infty }\left(1+{\frac {z}{k}}\right)^{-1}e^{z/k},\,\!$

where $\gamma \approx 0.577216$ is Euler's constant. Weierstrass originally wrote his product as one for $1/\Gamma$, in which case it is taken over the function's zeros rather than its poles. Inspired by this result, he proved what is known as the Weierstrass factorization theorem — that any entire function can be written as a product over its zeros in the complex plane; a generalization of the fundamental theorem of algebra.

The name gamma function and the symbol $\Gamma$ were introduced by Adrien-Marie Legendre around 1811; Legendre also rewrote Euler's integral definition in its modern form. Although the symbol is an upper-case Greek Gamma, there is no accepted standard for whether the function name should be written "Gamma function" or "gamma function" (some authors simply write "$\Gamma$-function"). The alternative "Pi function" notation $\Pi (z)=z!$ due to Gauss is sometimes encountered in older literature, but Legendre's notation is dominant in modern works.

It is justified to ask why we distinguish between the "ordinary factorial" and the gamma function by using distinct symbols, and particularly why the gamma function should be normalized to $\Gamma (n+1)=n!$ instead of simply using "$\Gamma (n)=n!$". Legendre's motivation for the normalization does not appear to be known, and has been criticized as cumbersome by some (the 20th-century mathematician Cornelius Lanczos, for example, called it "void of any rationality" and would instead use $z!$). The normalization does simplify some formulas, but complicates others.

19th-20th centuries: characterizing the gamma function

It is somewhat problematic that a large number of definitions have been given for the gamma function. Although they describe the same function, it is not entirely straightforward to prove the equivalence. Stirling never proved that his extended formula corresponds exactly to Euler's gamma function; a proof was first given by Charles Hermite in 1900. Instead of finding a specialized proof for each formula, it would be desirable to have a general method of identifying the gamma function.

One way to prove would be to find a differential equation that characterizes the gamma function. Most special functions in applied mathematics arise as solutions to differential equations, whose solutions are unique. However, the gamma function does not appear to satisfy any simple differential equation. Otto Hölder proved in 1887 that the gamma function at least does not satisfy any algebraic differential equation by showing that a solution to such an equation could not satisfy the gamma function's recurrence formula. This result is known as Hölder's theorem.

A definite and generally applicable characterization of the gamma function was not given until 1922. Harald Bohr and Johannes Mollerup then proved what is known as the Bohr-Mollerup theorem: that the gamma function is the unique solution to the factorial recurrence relation that is also logarithmically convex for positive z. That is, if a function interpolates the factorial, and its logarithm is a convex function for positive $z$, it must be the gamma function.

The Bohr-Mollerup theorem is useful because it is relatively easy to prove logarithmic convexity for any of the different formulas used to define the gamma function. Taking things further, instead of defining the gamma function by any particular formula, we can choose the conditions of the Bohr-Mollerup theorem as the definition, and then pick any formula we like that satisfies the conditions as a starting point for studying the gamma function. This approach was used by the Bourbaki group.

Reference tables and software

Although the gamma function can be calculated virtually as easily as any mathematically simpler function with a modern computer — even with a programmable pocket calculator — this was of course not always the case. Until the mid-20th century, mathematicians relied on hand-made tables; in the case of the gamma function, notably a table computed by Gauss in 1813 and one computed by Legendre in 1825.

A hand-drawn graph of the absolute value of the complex gamma function, from Tables of Higher Functions by Jahnke and Emde.

Tables of complex values of the gamma function, as well as hand-drawn graphs, were given in Tables of Higher Functions by Jahnke and Emde, first published in Germany in 1909. According to Michael Berry, "the publication in J&E of a three-dimensional graph showing the poles of the gamma function in the complex plane acquired an almost iconic status."

There was in fact little practical need for anything but real values of the gamma function until the 1930s, when applications for the complex gamma function were discovered in theoretical physics. As electronic computers became available for the production of tables in the 1950s, several extensive tables for the complex gamma function were published to meet the demand, including a table accurate to 12 decimal places from the U.S. National Bureau of Standards.

Like for many other special functions, Abramowitz and Stegun became the standard reference after its publication in 1964.

Double-precision floating-point implementations of the gamma function and its logarithm are now available in most scientific computing software and special functions libraries, for example Matlab, GNU Octave, and the GNU Scientific Library. The gamma function was also added to the C mathematics library (math.h) as part of the C99 standard, but is not implemented by all C compilers. Arbitrary-precision implementations are available in most computer algebra systems, such as Mathematica and Maple. Pari/GP, MPFR and MPFUN contain free arbitrary-precision implementations.