Heaviside step function

The Heaviside step function, or the unit step function, usually denoted by Template:Mvar or Template:Mvar (but sometimes Template:Mvar, Template:Math or Template:Math), is a step function named after Oliver Heaviside, the value of which is zero for negative arguments and one for positive arguments. Different conventions concerning the value Template:Math are in use. It is an example of the general class of step functions, all of which can be represented as linear combinations of translations of this one.

The function was originally developed in operational calculus for the solution of differential equations, where it represents a signal that switches on at a specified time and stays switched on indefinitely. Heaviside developed the operational calculus as a tool in the analysis of telegraphic communications and represented the function as Template:Math.

Formulation

Taking the convention that Template:Math, the Heaviside function may be defined as:

• A piecewise function: $$H(x):=\{\begin{array}{ll}1,& x\ge 0\\ 0,& x<0\end{array}$$
• Using the Iverson bracket notation: $$H(x):=[x\ge 0]$$
• An indicator function: $$H(x):={\mathbf{𝟏}}_{x\ge 0}={\mathbf{𝟏}}_{{\mathbb{ℝ}}_{+}}(x)$$

For the alternative convention that Template:Math, it may be expressed as:

• A piecewise function: $$H(x):=\{\begin{array}{ll}1,& x>0\\ \frac{1}{2},& x=0\\ 0,& x<0\end{array}$$
• A linear transformation of the sign function: $$H(x):=\frac{1}{2}(\text{sgn}x+1)$$
• The arithmetic mean of two Iverson brackets: $$H(x):=\frac{[x\ge 0]+[x>0]}{2}$$
• A one-sided limit of the two-argument arctangent: $$H(x)=:\underset{ϵ\to 0^{+}}{\lim }\frac{\text{atan2}(ϵ,-x)}{\pi }$$
• A hyperfunction: $$H(x)=:(1-\frac{1}{2\pi i}\log z,-\frac{1}{2\pi i}\log z)$$ Or equivalently: $$H(x)=:(-\frac{\log -z}{2\pi i},-\frac{\log -z}{2\pi i}),$$ where Template:Math is the principal value of the complex logarithm of Template:Mvar.

Other definitions which are undefined at Template:Math include:

• A piecewise function: $$H(x):=\{\begin{array}{ll}1,& x>0\\ 0,& x<0\end{array}$$
• The derivative of the ramp function: $$H(x):=\frac{d}{dx}\max \{x,0\}\text{for }x\ne 0$$
• Expressed in terms of the absolute value function, such as:$$H(x)=\frac{x+|x|}{2x}$$

Relationship with Dirac delta

The Dirac delta function is the weak derivative of the Heaviside function:$$\delta (x)=\frac{d}{dx}H(x),$$Hence the Heaviside function can be considered to be the integral of the Dirac delta function. This is sometimes written as:$$H(x):=\underset{-\mathrm{\infty }}{\overset{x}{\int }}\delta (s)ds,$$although this expansion may not hold (or even make sense) for Template:Math, depending on which formalism one uses to give meaning to integrals involving Template:Mvar. In this context, the Heaviside function is the cumulative distribution function of a random variable which is almost surely 0. (See Constant random variable.)

Analytic approximations

Approximations to the Heaviside step function are of use in biochemistry and neuroscience, where logistic approximations of step functions (such as the Hill and the Michaelis–Menten equations) may be used to approximate binary cellular switches in response to chemical signals.

For a smooth approximation to the step function, one can use the logistic function:$$H(x)\approx \frac{1}{2}+\frac{1}{2}\tanh kx=\frac{1}{1+e^{-2kx}},$$where a larger Template:Mvar corresponds to a sharper transition at Template:Math.

If we take Template:Math, equality holds in the limit:$$H(x)=\underset{k\to \mathrm{\infty }}{\lim }\frac{1}{2}(1+\tanh kx)=\underset{k\to \mathrm{\infty }}{\lim }\frac{1}{1+e^{-2kx}}.$$

A set of functions that successively approach the step function

$\frac{1}{2}+\frac{1}{2}\tanh (kx)=\frac{1}{1+e^{-2kx}}$
approaches the step function as Template:Math.

There are many other smooth, analytic approximations to the step function. Among the possibilities are:

$$\begin{array}{rl}H(x)& =\underset{k\to \mathrm{\infty }}{\lim }(\frac{1}{2}+\frac{1}{\pi }\arctan kx)\\ H(x)& =\underset{k\to \mathrm{\infty }}{\lim }(\frac{1}{2}+\frac{1}{2}\mathrm{erf}kx)\end{array}$$

These limits hold pointwise and in the sense of distributions. In general, however, pointwise convergence need not imply distributional convergence, and vice versa distributional convergence need not imply pointwise convergence. (However, if all members of a pointwise convergent sequence of functions are uniformly bounded by some "nice" function, then convergence holds in the sense of distributions too.)

In general, any cumulative distribution function of a continuous probability distribution that is peaked around zero and has a parameter that controls for variance can serve as an approximation, in the limit as the variance approaches zero. For example, all three of the above approximations are cumulative distribution functions of common probability distributions: the logistic, Cauchy and normal distributions, respectively.

Non-Analytic approximations

Approximations to the Heaviside step function could be made through Smooth transition function like $1\le m\to \mathrm{\infty }$:$$\begin{array}{rl}f(x)& =\{\begin{array}{ll}\frac{1}{2}(1+\tanh \left(m\frac{2x}{1-x^2}\right)),& |x|<1\\ \\ 1,& x\ge 1\\ 0,& x\le -1\end{array}\end{array}$$

Integral representations

Often an integral representation of the Heaviside step function is useful:$$\begin{array}{rl}H(x)& =\underset{\epsilon \to 0^{+}}{\lim }-\frac{1}{2\pi i}\underset{-\mathrm{\infty }}{\overset{\mathrm{\infty }}{\int }}\frac{1}{\tau +i\epsilon }{e}^{-ix\tau }d\tau \\ & =\underset{\epsilon \to 0^{+}}{\lim }\frac{1}{2\pi i}\underset{-\mathrm{\infty }}{\overset{\mathrm{\infty }}{\int }}\frac{1}{\tau -i\epsilon }{e}^{ix\tau }d\tau ,\end{array}$$where the second representation is easy to deduce from the first, given that the step function is real and thus is its own complex conjugate.

Zero argument

Since Template:Mvar is usually used in integration, and the value of a function at a single point does not affect its integral, it rarely matters what particular value is chosen of Template:Math. Indeed when Template:Mvar is considered as a distribution or an element of Template:Math (see [[Lp space|Template:Math space]]) it does not even make sense to talk of a value at zero, since such objects are only defined almost everywhere. If using some analytic approximation (as in the examples above) then often whatever happens to be the relevant limit at zero is used.

There exist various reasons for choosing a particular value.

• Template:Math is often used since the graph then has rotational symmetry; put another way, Template:Math is then an odd function. In this case the following relation with the sign function holds for all Template:Mvar: $$H(x)=\frac{1}{2}(1+\mathrm{sgn}x).$$Also, $\mathrm{\forall }x,H(x)+H(-x)=1$.

• Template:Math is used when Template:Mvar needs to be right-continuous. For instance cumulative distribution functions are usually taken to be right continuous, as are functions integrated against in Lebesgue–Stieltjes integration. In this case Template:Mvar is the indicator function of a closed semi-infinite interval: $$H(x)={\mathbf{𝟏}}_{[0,\mathrm{\infty })}(x).$$ The corresponding probability distribution is the degenerate distribution.

• Template:Math is used when Template:Mvar needs to be left-continuous. In this case Template:Mvar is an indicator function of an open semi-infinite interval: $$H(x)={\mathbf{𝟏}}_{(0,\mathrm{\infty })}(x).$$
• In functional-analysis contexts from optimization and game theory, it is often useful to define the Heaviside function as a set-valued function to preserve the continuity of the limiting functions and ensure the existence of certain solutions. In these cases, the Heaviside function returns a whole interval of possible solutions, Template:Math.

Discrete form

An alternative form of the unit step, defined instead as a function $H:\mathbb{\mathbb{Z}}\to \mathbb{ℝ}$ (that is, taking in a discrete variable Template:Mvar), is:$$H[n]=\{\begin{array}{ll}0,& n<0,\\ 1,& n\ge 0,\end{array}$$Or using the half-maximum convention:$$H[n]=\{\begin{array}{ll}0,& n<0,\\ \frac{1}{2},& n=0,\\ 1,& n>0,\end{array}$$where Template:Mvar is an integer. If Template:Mvar is an integer, then Template:Math must imply that Template:Math, while Template:Math must imply that the function attains unity at Template:Math. Therefore the "step function" exhibits ramp-like behavior over the domain of Template:Closed-closed, and cannot authentically be a step function, using the half-maximum convention.

Unlike the continuous case, the definition of Template:Math is significant.

The discrete-time unit impulse is the first difference of the discrete-time step:$$\delta [n]=H[n]-H[n-1].$$This function is the cumulative summation of the Kronecker delta:$$H[n]=\sum _{k=-\mathrm{\infty }}^n\delta [k],$$where $\delta [k]={\delta }_{k,0}$ is the discrete unit impulse function.

Antiderivative and derivative

The ramp function is an antiderivative of the Heaviside step function:$$\underset{-\mathrm{\infty }}{\overset{x}{\int }}H(\xi )d\xi =xH(x)=\max \{0,x\}.$$The distributional derivative of the Heaviside step function is the Dirac delta function:$$\frac{dH(x)}{dx}=\delta (x).$$

Fourier transform

The Fourier transform of the Heaviside step function is a distribution. Using one choice of constants for the definition of the Fourier transform we have $$\hat{H}(s)=\underset{N\to \mathrm{\infty }}{\lim }\underset{-N}{\overset{N}{\int }}{e}^{-2\pi ixs}H(x)dx=\frac{1}{2}(\delta (s)-\frac{i}{\pi }\mathrm{p.v.}\frac{1}{s}).$$Here Template:Math is the distribution that takes a test function Template:Mvar to the Cauchy principal value of ${\int }_{-\mathrm{\infty }}^{\mathrm{\infty }}\frac{\phi (s)}{s}ds$. The limit appearing in the integral is also taken in the sense of (tempered) distributions.

Unilateral Laplace transform

The Laplace transform of the Heaviside step function is a meromorphic function. Using the unilateral Laplace transform we have:$$\begin{array}{rl}\hat{H}(s)& =\underset{N\to \mathrm{\infty }}{\lim }\underset{0}{\overset{N}{\int }}{e}^{-sx}H(x)dx\\ & =\underset{N\to \mathrm{\infty }}{\lim }\underset{0}{\overset{N}{\int }}{e}^{-sx}dx\\ & =\frac{1}{s}\end{array}$$When the bilateral transform is used, the integral can be split in two parts and the result will be the same.

See also

• Gamma function
• Dirac delta function
• Indicator function
• Iverson bracket
• Laplace transform
• Laplacian of the indicator
• List of mathematical functions
• Macaulay brackets
• Negative number
• Rectangular function
• Sign function
• Sine integral
• Step response

External links

• Digital Library of Mathematical Functions, NIST, [1].