Lambda calculus: Difference between revisions

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
imported>Epachamo
Added image illustrating the lambda abstraction
 
Line 1: Line 1:
{{Short description|Mathematical-logic system based on functions}}
{{Short description|Mathematical-logic system based on functions}}
 
[[File:LambdaAbstraction.svg|thumb|The lambda abstraction decomposed. The <math>\lambda</math> indicates the start of a function. <math>x</math> is the input parameter. <math>M</math> is the body, separated by a dot separator "<math>.</math>" from the input parameter.]]
In [[mathematical logic]], the '''lambda calculus''' (also written as '''''λ''-calculus''') is a [[formal system]] for expressing [[computability|computation]] based on function [[Abstraction (computer science)|abstraction]] and [[function application|application]] using variable [[Name binding|binding]] and [[Substitution (algebra)|substitution]]. Untyped lambda calculus, the topic of this article, is a [[universal machine]], a [[model of computation]] that can be used to simulate any [[Turing machine]] (and vice versa). It was introduced by the mathematician [[Alonzo Church]] in the 1930s as part of his research into the [[foundations of mathematics]]. In 1936, Church found a formulation which was [[#History|logically consistent]], and documented it in 1940.
In [[mathematical logic]], the '''lambda calculus''' (also written as '''''λ''-calculus''') is a [[formal system]] for expressing [[computability|computation]] based on function [[Abstraction (computer science)|abstraction]] and [[function application|application]] using variable [[Name binding|binding]] and [[Substitution (algebra)|substitution]]. Untyped lambda calculus, the topic of this article, is a [[universal machine]], a [[model of computation]] that can be used to simulate any [[Turing machine]] (and vice versa). It was introduced by the mathematician [[Alonzo Church]] in the 1930s as part of his research into the [[foundations of mathematics]]. In 1936, Church found a formulation which was [[#History|logically consistent]], and documented it in 1940.


Lambda calculus consists of constructing [[#Lambda terms|lambda term]]s and performing [[#Reduction|reduction]] operations on them. A term is defined as any valid lambda calculus expression. In the simplest form of lambda calculus, terms are built using only the following rules:{{efn|name=3rules|1= These rules produce expressions such as: <math>(\lambda x.\lambda y.(\lambda z.(\lambda x .z\ x)\ (\lambda y.z\ y))(x\ y))</math>. Parentheses can be dropped if the expression is unambiguous. For some applications, terms for logical and mathematical constants and operations may be included.}}
== Definition ==
 
{{Main|Lambda calculus definition}}
# <math display="inline">x</math>: A [[#validLambdaVar|variable]] is a character or string representing a parameter.
The lambda calculus consists of a language of '''lambda terms''', that are defined by a certain formal syntax, and a set of transformation rules for manipulating the lambda terms. In [[Backus–Naur form|BNF]], the syntax is <math>e ::= x \mid \lambda x.e \mid e \, e,</math> where variables {{math|''x'',''y'',''z''}} range over an infinite set of names. Terms {{math|''M'',''N'',''t'',''s'',''e'',''f''}} range over all lambda terms. This corresponds to the following [[inductive definition]]:
# <math display="inline">(\lambda x.M)</math>: A [[#lambdaAbstr|lambda abstraction]] is a function definition, taking as input the bound variable <math>x</math> (between the λ and the punctum/dot '''.''') and returning the body <math display="inline">M</math>.
*{{anchor|validLambdaVar}} A ''variable'' {{mvar|x}} is itself a valid lambda term.
# <math display="inline">(M\ N)</math>: An [[#anApplic|application]], applying a function <math display="inline">M</math> to an argument <math display="inline">N</math>. Both <math display="inline">M</math> and <math display="inline">N</math> are lambda terms.
*{{anchor|lambdaAbstr}} An ''abstraction'' is a lambda term <math>(\lambda x.t)</math> where {{mvar|t}} is a lambda term and {{mvar|x}} is a variable,
 
*{{anchor|anApplic}} An ''application'' is a lambda term <math>(t s)</math> where {{mvar|t}} and {{mvar|s}} are lambda terms.
The reduction operations include:
A lambda term is syntactically valid if and only if it can be obtained by repeated application of these three rules. For convenience, parentheses can often be omitted when writing a lambda term—see {{section link|Lambda calculus definition#Notation}} for details.


* <math display="inline">(\lambda x.M[x])\rightarrow(\lambda y.M[y])</math> : [[#α-conversion|α-conversion]], renaming the bound variables in the expression. Used to avoid [[name collision]]s.
In the term <math>\lambda x.M</math>, occurrences of {{mvar|x}} within {{mvar|M}} that are under the scope of this λ are termed ''bound''; any occurrence of a variable not bound by an enclosing λ is ''free''. {{math|FV(M)}} is the set of free variables of {{mvar|M}}. The notation <math>M[x := N]</math> denotes '''capture-avoiding substitution''': substituting {{mvar|N}} for every free occurrence of {{mvar|x}} in {{mvar|M}}, while avoiding variable capture.{{efn|1="where M[x := N] denotes the substitution of N for every occurrence of x in M".<ref name="BarendregtBarendsen">{{Citation|last1=Barendregt|first1=Henk|author1-link=Henk Barendregt|last2=Barendsen|first2=Erik|title=Introduction to Lambda Calculus|date=March 2000|url=https://ftp.science.ru.nl/CSI/CompMath.Found/lambda.pdf}}</ref>{{rp|7}} Also denoted M[N/x], "the substitution of N for x in M".<ref>{{nlab|id=explicit+substitution|title=explicit substitution}}</ref>}} This operation is defined inductively as follows:
* <math display="inline">((\lambda x.M)\ N)\rightarrow (M[x:=N])</math> : [[#β-reduction|β-reduction]],{{efn|name=beta|1= Barendregt, Barendsen (2000) call this form
* <math>x[x := N] = N</math>; <math>y[x := N] = y</math> if <math>y \ne x</math>.
*''axiom β'': (λx.M[x]) N = M[N] , rewritten as (λx.M) N = M[x := N], "where M[x := N] denotes the substitution of N for every occurrence of x in M".<ref name="BarendregtBarendsen"/>{{rp|7}} Also denoted M[N/x], "the substitution of N for x in M".<ref>{{nlab|id=explicit+substitution|title=explicit substitution}}</ref>}} replacing the bound variables with the argument expression in the body of the abstraction.
* <math>(M_1 M_2)[x := N] = (M_1[x := N]) (M_2[x := N])</math>.
* <math>(\lambda y.M)[x := N]</math> has three cases:
** If <math>y = x</math>, becomes <math>\lambda x.M</math> (<math>x</math> is bound; no change).
** If <math>y \notin FV(N)</math>, becomes <math>\lambda y.(M[x := N])</math>.
** If <math>y \in FV(N)</math>, first α-rename <math>\lambda y.M</math> to <math>\lambda y'.M[y := y']</math> with <math>y'</math> [[fresh variable|fresh]] to avoid [[name collision]]s, then continue as above.


If [[De Bruijn index]]ing is used, then α-conversion is no longer required as there will be no name collisions. If [[Reduction strategy (lambda calculus)|repeated application]] of the reduction steps eventually terminates, then by the [[Church–Rosser theorem]] it will produce a [[Beta normal form|β-normal form]].
There are several notions of "equivalence" and "reduction" that make it possible to reduce lambda terms to equivalent lambda terms.<ref>{{cite journal|last1=de Queiroz|first1=Ruy J. G. B.|author1-link=Ruy de Queiroz|year=1988|doi=10.1111/j.1746-8361.1988.tb00919.x|title=A Proof-Theoretic Account of Programming and the Role of Reduction Rules|journal=Dialectica|volume=42|issue=4|pages=265–282}}</ref>
* ''α-conversion'' captures the intuition that the particular choice of a bound variable, in an abstraction, does not (usually) matter. If <math>y \notin FV(M)</math>, then the terms <math>\lambda x.M</math> and <math>\lambda y.M[x := y]</math> are considered ''alpha-equivalent'', written <math>\lambda x.M \equiv_{\alpha} \lambda y.M[x := y]</math>. The equivalence relation is the smallest congruence relation on lambda terms generated by this rule. For instance, <math>\lambda x.x</math> and <math>\lambda y.y</math> are alpha-equivalent lambda terms.
* The ''β-reduction'' rule states that a β-redex, an application of the form <math>( \lambda x . t) s</math>, reduces to the term <math> t [ x := s]</math>.{{efn|name=beta|1= Barendregt, Barendsen (2000) call this rule ''axiom β''}} For example, for every <math>s</math>, <math>( \lambda x . x ) s \to x[ x := s ] = s </math>. This demonstrates that <math> \lambda x . x </math> really is the identity. Similarly, <math>( \lambda x . y ) s \to y [ x := s ] = y </math>, which demonstrates that <math> \lambda x . y </math> is a constant function.
* ''η-conversion'' expresses extensionality and converts between <math>\lambda x . f x</math> and <math>f</math> whenever <math>x</math> does not appear free in <math>f</math>. It is often omitted in many treatments of lambda calculus.


Variable names are not needed if using a universal lambda function, such as [[Iota and Jot]], which can create any function behavior by calling it on itself in various combinations.
{{anchor|redex}}The term ''redex'', short for ''reducible expression'', refers to subterms that can be reduced by one of the reduction rules. For example, (λ''x''.''M'') ''N'' is a β-redex in expressing the substitution of ''N'' for ''x'' in ''M''. The expression to which a redex reduces is called its ''reduct''; the reduct of (λ''x''.''M'') ''N'' is ''M''[''x'' := ''N''].


== Explanation and applications ==
== Explanation and applications ==
Line 50: Line 57:
According to Scott, Church's entire response consisted of returning the postcard with the following annotation: "[[eeny, meeny, miny, moe]]".
According to Scott, Church's entire response consisted of returning the postcard with the following annotation: "[[eeny, meeny, miny, moe]]".


== Informal description ==
== Motivation ==


=== Motivation ===
[[Computable function]]s are a fundamental concept within computer science and mathematics. The lambda calculus provides simple [[Semantics#Computer science|semantics]] for computation which are useful for formally studying properties of computation. The lambda calculus incorporates two simplifications that make its semantics simple.
[[Computable function]]s are a fundamental concept within computer science and mathematics. The lambda calculus provides simple [[Semantics#Computer science|semantics]] for computation which are useful for formally studying properties of computation. The lambda calculus incorporates two simplifications that make its semantics simple.
{{anchor|anonymousForm}}The first simplification is that the lambda calculus treats functions "anonymously"; it does not give them explicit names. For example, the function
{{anchor|anonymousForm}}The first simplification is that the lambda calculus treats functions "anonymously"; it does not give them explicit names. For example, the function
Line 81: Line 87:
to arrive at the same result.
to arrive at the same result.


=== The lambda calculus ===
In lambda calculus, functions are taken to be '[[First-class object|first class values]]', so functions may be used as the inputs, or be returned as outputs from other functions. For example, the lambda term <math>\lambda x.x</math> represents the [[identity function]], <math>x \mapsto x</math>. Further, <math>\lambda x.y</math> represents the ''constant function'' <math>x \mapsto y</math>, the function that always returns <math>y</math>, no matter the input. As an example of a function operating on functions, the [[function composition]] can be defined as <math>\lambda f. \lambda g. \lambda x. (f ( g x))</math>.
The lambda calculus consists of a language of ''lambda terms'', that are defined by a certain formal syntax, and a set of transformation rules for manipulating the lambda terms. These transformation rules can be viewed as an [[equational theory]] or as an [[operational definition]].
 
As described above, having no names, all functions in the lambda calculus are anonymous functions. They only accept one input variable, so [[currying]] is used to implement functions of several variables.
 
==== Lambda terms ====
The syntax of the lambda calculus defines some expressions as valid lambda calculus expressions and some as invalid, just as some strings of characters are valid computer programs and some are not. A valid lambda calculus expression is called a "'''lambda term'''".
 
The following three rules give an [[inductive definition]] that can be applied to build all syntactically valid lambda terms:{{efn|name=lamTerms|1= The expression e can be:  variables x, lambda abstractions, or applications —in BNF, <math>e ::= x \mid \lambda x.e \mid e \, e</math> .— ''from Wikipedia's [[Simply typed lambda calculus#Syntax]] for untyped lambda calculus}}
*{{anchor|validLambdaVar}} variable {{mvar|x}} is itself a valid lambda term.
*if {{mvar|t}} is a lambda term, and {{mvar|x}} is a variable, then <math>(\lambda x.t)</math>{{efn| <math>(\lambda x.t)</math> is sometimes written in [[ASCII]] as <math>L x.t</math>}} is a lambda term (called an ''abstraction'');
*if {{mvar|t}} and {{mvar|s}} are lambda terms, then <math>(t s)</math> is a lambda term (called an ''application'').
Nothing else is a lambda term. That is, a lambda term is valid if and only if it can be obtained by repeated application of these three rules. For convenience, some parentheses can be omitted when writing a lambda term. For example, the outermost parentheses are usually not written. See [[#Notation|§ Notation]], below, for an explicit description of which parentheses are optional. It is also common to extend the syntax presented here with additional operations, which allows making sense of terms such as <math>\lambda x.x^2.</math> The focus of this article is the pure lambda calculus without extensions, but lambda terms extended with arithmetic operations are used for explanatory purposes.
 
{{anchor|lambdaAbstr}} An ''abstraction'' <math>\lambda x.t</math> denotes an [[#anonymousForm|§ anonymous function]]{{efn|The lambda term <math>(\lambda x.t)</math> represents the function <math>x \mapsto t</math> written in anonymous form.}} that takes a single input {{mvar|x}} and returns {{mvar|t}}. For example, <math>\lambda x.(x^2+2)</math> is an abstraction representing the function <math>f</math> defined by <math>f(x) = x^2 + 2,</math> using the term <math>x^2+2</math> for {{mvar|t}}. The name <math>f</math> is superfluous when using abstraction. The syntax <math>(\lambda x.t)</math> [[Free variables and bound variables|binds]] the variable {{mvar|x}} in the term {{mvar|t}}. The definition of a function with an abstraction merely "sets up" the function but does not invoke it.
 
{{anchor|anApplic}} An ''application'' <math>t s</math> represents the application of a function {{mvar|t}} to an input {{mvar|s}}, that is, it represents the act of calling function {{mvar|t}} on input {{mvar|s}} to produce <math>t(s)</math>.
 
A lambda term may refer to a variable that has not been bound, such as the term <math>\lambda x.(x+y)</math> (which represents the function definition <math>f(x) = x + y</math>). In this term, the variable {{mvar|y}} has not been defined and is considered an unknown. The abstraction <math>\lambda x.(x+y)</math> is a syntactically valid term and represents a function that adds its input to the yet-unknown {{mvar|y}}.
 
Parentheses may be used and might be needed to disambiguate terms. For example,
#{{anchor|Example1parenRightIsAbstraction}}<math>\lambda x.((\lambda x.x)x)</math> is of form <math>\lambda x.B</math> and is therefore an abstraction, while
#<math>(\lambda x.(\lambda x.x)) x</math> is of form <math>M N</math> and is therefore an application.
 
The examples 1 and 2 denote different terms, differing only in where the parentheses are placed. They have different meanings: example 1 is a function definition, while example 2 is a function application. The lambda variable {{mvar|x}} is a placeholder in both examples.
 
Here, [[#Example1parenRightIsAbstraction|example 1]] ''defines'' a function <math>\lambda x.B</math>, where <math>B</math> is <math>(\lambda x.x)x</math>, an anonymous function <math>(\lambda x.x)</math>, with input <math>x</math>; while example 2, <math>M </math>&nbsp;<math>N</math>, is M applied to N, where <math>M</math> is the lambda term <math>(\lambda x.(\lambda x.x))</math> being applied to the input <math>N</math> which is <math>x</math>. Both examples 1 and 2 would evaluate to the [[identity function]] <math>\lambda x.x</math>.
 
==== Functions that operate on functions ====
In lambda calculus, functions are taken to be '[[First-class object|first class values]]', so functions may be used as the inputs, or be returned as outputs from other functions.
 
For example, the lambda term <math>\lambda x.x</math> represents the [[identity function]], <math>x \mapsto x</math>. Further, <math>\lambda x.y</math> represents the ''constant function'' <math>x \mapsto y</math>, the function that always returns <math>y</math>, no matter the input. As an example of a function operating on functions, the [[function composition]] can be defined as <math>\lambda f. \lambda g. \lambda x. (f ( g x))</math>.<!---Notational conventions should be explained elsewhere in this article; they differ by author, anyway:---In lambda calculus, function application is regarded as [[Operator associativity|left-associative]], so that <math>stx</math> means <math>(st)x</math>.--->
 
There are several notions of "equivalence" and "reduction" that make it possible to "reduce" lambda terms to "equivalent" lambda terms.
 
==== Alpha equivalence ====
A basic form of equivalence, definable on lambda terms, is ''alpha equivalence''. It captures the intuition that the particular choice of a bound variable, in an abstraction, does not (usually) matter.
For instance, <math>\lambda x.x</math> and <math>\lambda y.y</math> are alpha-equivalent lambda terms, and they both represent the same function (the identity function).
The terms <math>x</math> and <math>y</math> are not alpha-equivalent, because they are not bound in an abstraction.
In many presentations, it is usual to identify alpha-equivalent lambda terms.
 
The following definitions are necessary in order to be able to define β-reduction:
 
==== Free variables ====
The ''free variables''{{efn|free variables in lambda Notation and its Calculus are comparable to [[Free variables and bound variables|linear algebra and mathematical concepts of the same name]]}} of a term are those variables not bound by an abstraction. The set of free variables of an expression is defined inductively:
* The free variables of <math>x</math> are just <math>x</math>
* The [[Set theory|set]] of free variables of <math>\lambda x.t</math> is the set of free variables of <math>t</math>, but with <math>x</math> removed
* The [[Set theory|set]] of free variables of <math>t s</math> is the union of the set of free variables of <math>t</math> and the set of free variables of <math>s</math>.
 
For example, the lambda term representing the identity <math>\lambda x.x</math> has no free variables, but the function <math>\lambda x. y x</math> has a single free variable, <math>y</math>.
 
==== Capture-avoiding substitutions ====
Suppose <math>t</math>, <math>s</math> and <math>r</math> are lambda terms, and <math>x</math> and <math>y</math> are variables.
The notation <math>t[x := r]</math> indicates substitution of <math>r</math> for <math>x</math> in <math>t</math> in a ''capture-avoiding'' manner. This is defined so that:
* <math>x[x := r] = r</math> ; with <math>r</math> substituted for <math>x</math>, <math>x</math> becomes <math>r</math>
* <math>y[x := r] = y</math> if <math>x \neq y</math> ; with <math>r</math> substituted for <math>x</math>, <math>y</math> (which is not <math>x</math>) remains <math>y</math>
* <math>(t s)[x := r] = (t[x := r])(s[x := r])</math> ; substitution distributes to both sides of an application
* <math>(\lambda x.t)[x := r] = \lambda x.t</math> ; a variable bound by an abstraction is not subject to substitution; substituting such variable leaves the abstraction unchanged
* <math>(\lambda y.t)[x := r] = \lambda y.(t[x := r])</math> if <math>x \neq y</math> and <math>y</math> does not appear among the free variables of <math>r</math> (<math>y</math> is said to be "[[fresh variable|fresh]]" for <math>r</math>) ; substituting a variable which is not bound by an abstraction proceeds in the abstraction's body, provided that the abstracted variable <math>y</math> is "fresh" for the substitution term <math>r</math>.
 
For example, <math>(\lambda x.x)[y := y] = \lambda x.(x[y := y]) = \lambda x.x</math>, and <math>((\lambda x.y)x)[x := y] = ((\lambda x.y)[x := y])(x[x := y]) = (\lambda x.y)y</math>.
 
The freshness condition (requiring that <math>y</math> is not in the [[#Free and bound variables|free variables]] of <math>r</math>) is crucial in order to ensure that substitution does not change the meaning of functions.
 
For example, a substitution that ignores the freshness condition could lead to errors: <math>(\lambda x.y)[y := x] = \lambda x.(y[y := x]) = \lambda x.x</math>. This erroneous substitution would turn the constant function <math>\lambda x.y</math> into the identity <math>\lambda x.x</math>.
 
In general, failure to meet the freshness condition can be remedied by alpha-renaming first, with a suitable fresh variable.
For example, switching back to our correct notion of substitution, in <math>(\lambda x.y)[y := x]</math> the abstraction can be renamed with a fresh variable <math>z</math>, to obtain <math>(\lambda z.y)[y := x] = \lambda z.(y[y := x]) = \lambda z.x</math>, and the meaning of the function is preserved by substitution.
 
==== β-reduction ====
The β-reduction rule{{efn|name=beta}} states that an application of the form <math>( \lambda x . t) s</math> reduces to the term <math> t [ x := s]</math>. The notation <math>( \lambda x . t ) s \to t [ x := s ] </math> is used to indicate that <math>( \lambda x .t ) s </math> β-reduces to <math> t [ x := s ] </math>.
For example, for every <math>s</math>, <math>( \lambda x . x ) s \to x[ x := s ] = s </math>. This demonstrates that <math> \lambda x . x </math> really is the identity.
Similarly, <math>( \lambda x . y ) s \to y [ x := s ] = y </math>, which demonstrates that <math> \lambda x . y </math> is a constant function.
 
The lambda calculus may be seen as an idealized version of a functional programming language, like [[Haskell]] or [[Standard ML]]. Under this view,{{anchor|betaReducIsAcomput}} β-reduction corresponds to a computational step. This step can be repeated by additional β-reductions until there are no more applications left to reduce. In the untyped lambda calculus, as presented here, this reduction process may not terminate. For instance, consider the term <math>\Omega = (\lambda x . xx)( \lambda x . xx )</math>.
Here <math>( \lambda x . xx)( \lambda x . xx) \to ( xx )[ x := \lambda x . xx ] = ( x [ x := \lambda x . xx ] )( x [ x := \lambda x . xx ] ) = ( \lambda x . xx)( \lambda x . xx )</math>.
That is, the term reduces to itself in a single β-reduction, and therefore the reduction process will never terminate.
 
{{anchor|untypedData}}Another aspect of the untyped lambda calculus is that it does not distinguish between different kinds of data. For instance, it may be desirable to write a function that only operates on numbers. However, in the untyped lambda calculus, there is no way to prevent a function from being applied to [[truth value]]s, strings, or other non-number objects.
 
== Formal definition ==
{{Further|Lambda calculus definition}}
 
=== Definition ===
Lambda expressions are composed of:
* variables ''v''<sub>1</sub>, ''v''<sub>2</sub>, ...;
* the abstraction symbols λ (lambda) and . (dot);
* parentheses ().
 
The set of lambda expressions, {{math|Λ}}, can be [[Recursive definition|defined inductively]]:
 
# If ''x'' is a variable, then {{math|''x'' ∈ Λ.}}
# If ''x'' is a variable and {{math|''M'' ∈ Λ,}} then {{math|(λ''x''.''M'') ∈ Λ.}}
# If {{math|''M'', ''N'' ∈ Λ,}} then {{math|(''M N'') ∈ Λ.}}
 
Instances of rule 2 are known as ''abstractions'' and instances of rule 3 are known as ''applications''.<ref>{{Cite book|url= https://www.elsevier.com/books/the-lambda-calculus/barendregt/978-0-444-87508-2|last1=Barendregt|first1=Hendrik Pieter|author1-link=Henk Barendregt|title=The Lambda Calculus: Its Syntax and Semantics|publisher=North Holland|year=1984|volume=103|series=Studies in Logic and the Foundations of Mathematics|edition=Revised|isbn=0-444-87508-5}} ([https://ftp.science.ru.nl/CSI/CompMath.Found/ErrataLCalculus.pdf Corrections]).</ref> ''See [[#redex|§ reducible expression]]''
 
This set of rules may be written in [[Backus–Naur form]] as:
<syntaxhighlight lang="bnf">
<expression>  ::= <abstraction> | <application> | <variable>
<abstraction> ::= λ <variable> . <expression>
<application> ::= ( <expression> <expression> )
<variable>    ::= v1 | v2 | ...
</syntaxhighlight>
 
=== Notation ===
To keep the notation of lambda expressions uncluttered, the following conventions are usually applied:
* Outermost parentheses are dropped: ''M'' ''N'' instead of (''M'' ''N'').
* Applications are assumed to be left associative: ''M'' ''N'' ''P'' may be written instead of ((''M'' ''N'') ''P'').<ref name="lambda-bound">{{cite web|url=http://www.lambda-bound.com/book/lambdacalc/node27.html|title=Example for Rules of Associativity|publisher=Lambda-bound.com|access-date=2012-06-18}}</ref>
* When all variables are single-letter, the space in applications may be omitted: ''MNP'' instead of ''M'' ''N'' ''P''.<ref>{{cite web |title=The Basic Grammar of Lambda Expressions |url=https://softoption.us/node/33 |website=SoftOption |quote=Some other systems use juxtaposition to mean application, so 'ab' means 'a@b'. This is fine except that it requires that variables have length one so that we know that 'ab' is two variables juxtaposed not one variable of length 2. But we want to labels like 'firstVariable' to mean a single variable, so we cannot use this juxtaposition convention.}}</ref>
* The body of an abstraction extends [[Regular expression#Lazy matching|as far right as possible]]: λ''x''.''M N'' means λ''x''.(''M N'') and not (λ''x''.''M'') ''N''.
* A sequence of abstractions is contracted: λ''x''.λ''y''.λ''z''.''N'' is abbreviated as λ''xyz''.''N''.<ref name="Selinger">{{Citation|first1=Peter|last1=Selinger|title=Lecture Notes on the Lambda Calculus|year=2008|page=9|publisher=Department of Mathematics and Statistics, University of Ottawa|url=http://www.mathstat.dal.ca/~selinger/papers/lambdanotes.pdf|bibcode=2008arXiv0804.3434S|volume=0804|arxiv=0804.3434|issue=class: cs.LO}}</ref><ref name="lambda-bound" />
 
=== Free and bound variables ===
The abstraction operator, λ, is said to bind its variable wherever it occurs in the body of the abstraction. Variables that fall within the scope of an abstraction are said to be ''bound''. In an expression λ''x''.''M'', the part λ''x'' is often called ''binder'', as a hint that the variable ''x'' is getting bound by prepending λ''x'' to ''M''. All other variables are called ''free''. For example, in the expression λ''y''.''x x y'', ''y'' is a bound variable and ''x'' is a free variable. Also a variable is bound by its nearest abstraction. In the following example the single occurrence of ''x'' in the expression is bound by the second lambda: λ''x''.''y'' (λ''x''.''z x'').
 
The set of ''free variables'' of a lambda expression, ''M'', is denoted as FV(''M'') and is defined by recursion on the structure of the terms, as follows:
# {{math|1=FV(''x'') = {{mset|''x''}}}}, where ''x'' is a variable.
# {{anchor|FreeMsExXs}} {{math|1=FV(''λx''.''M'') = FV(''M'') \ {{mset|''x''}}}}.{{efn|The set of free variables of M, but with {''x''} removed}}
# {{anchor|FreeMsNs}} {{math|1=FV(''M N'') = FV(''M'') ∪ FV(''N'').}}{{efn|The union of the set of free variables of <math>M</math> and the set of free variables of <math>N</math><ref name="BarendregtBarendsen">{{Citation|last1=Barendregt|first1=Henk|author1-link=Henk Barendregt|last2=Barendsen|first2=Erik|title=Introduction to Lambda Calculus|date=March 2000|url=https://ftp.science.ru.nl/CSI/CompMath.Found/lambda.pdf}}</ref>}}
 
An expression that contains no free variables is said to be ''closed''. Closed lambda expressions are also known as ''combinators'' and are equivalent to terms in [[combinatory logic]].
 
== Reduction ==
The meaning of lambda expressions is defined by how expressions can be reduced.<ref>{{cite journal|last1=de Queiroz|first1=Ruy J. G. B.|author1-link=Ruy de Queiroz|year=1988|doi=10.1111/j.1746-8361.1988.tb00919.x|title=A Proof-Theoretic Account of Programming and the Role of Reduction Rules|journal=Dialectica|volume=42|issue=4|pages=265–282}}</ref>
 
There are three kinds of reduction:
* ''α-conversion'': changing bound variables;
* ''β-reduction'': applying functions to their arguments;
* ''η-conversion'': expressing extensionality.
 
We also speak of the resulting equivalences: two expressions are ''α-equivalent'', if they can be α-converted into the same expression. β-equivalence and η-equivalence are defined similarly.
 
{{anchor|redex}}The term ''redex'', short for ''reducible expression'', refers to subterms that can be reduced by one of the reduction rules. For example, (λ''x''.''M'') ''N'' is a β-redex in expressing the substitution of ''N'' for ''x'' in ''M''. The expression to which a redex reduces is called its ''reduct''; the reduct of (λ''x''.''M'') ''N'' is ''M''[''x'' := ''N''].{{efn|name=beta}}
 
If ''x'' is not free in ''M'', λ''x''.''M x'' is also an η-redex, with a reduct of ''M''.
 
=== α-conversion ===
'''α-conversion''' ([[alpha]]-conversion), sometimes known as α-renaming,<ref>{{Citation|title=Design concepts in programming languages|last1=Turbak|first1=Franklyn|last2=Gifford|first2=David|year=2008|publisher=MIT press|page=251|isbn=978-0-262-20175-9}}</ref> allows bound variable names to be changed. For example, α-conversion of λ''x''.''x'' might yield λ''y''.''y''. Terms that differ only by α-conversion are called ''α-equivalent''. Frequently, in uses of lambda calculus, α-equivalent terms are considered to be equivalent.
 
The precise rules for α-conversion are not completely trivial. First, when α-converting an abstraction, the only variable occurrences that are renamed are those that are bound to the same abstraction. For example, an α-conversion of λ''x''.λ''x''.''x'' could result in λ''y''.λ''x''.''x'', but it could ''not'' result in λ''y''.λ''x''.''y''. The latter has a different meaning from the original. This is analogous to the programming notion of [[variable shadowing]].
 
Second, α-conversion is not possible if it would result in a variable getting captured by a different abstraction. For example, if we replace ''x'' with ''y'' in λ''x''.λ''y''.''x'', we get λ''y''.λ''y''.''y'', which is not at all the same.
 
In programming languages with static scope, α-conversion can be used to make [[Name resolution (programming languages)|name resolution]] simpler by ensuring that no variable name [[Variable shadowing|masks]] a name in a containing [[scope (programming)|scope]] (see [[Name resolution (programming languages)#Alpha renaming to make name resolution trivial|α-renaming to make name resolution trivial]]).
 
In the [[De Bruijn index]] notation, any two α-equivalent terms are syntactically identical.
 
==== Substitution ====
Substitution, written ''M''[''x'' := ''N''], is the process of replacing all ''free'' occurrences of the variable ''x'' in the expression ''M'' with expression ''N''. Substitution on terms of the lambda calculus is defined by recursion on the structure of terms, as follows (note: x and y are only variables while M and N are any lambda expression):
 
: ''x''[''x'' := ''N''] = ''N''
: ''y''[''x'' := ''N''] = ''y'', if ''x'' ≠ ''y''
: (''M''<sub>1</sub> ''M''<sub>2</sub>)[''x'' := ''N''] = ''M''<sub>1</sub>[''x'' := ''N''] ''M''<sub>2</sub>[''x'' := ''N'']
: (λ''x''.''M'')[''x'' := ''N''] = λ''x''.''M''
: (λ''y''.''M'')[''x'' := ''N''] = λ''y''.(''M''[''x'' := ''N'']), if ''x'' ≠ ''y'' and ''y'' ∉ FV(''N'')  ''See [[#Free and bound variables|above for the FV]]''
 
To substitute into an abstraction, it is sometimes necessary to α-convert the expression. For example, it is not correct for (λ''x''.''y'')[''y'' := ''x''] to result in λ''x''.''x'', because the substituted ''x'' was supposed to be free but ended up being bound. The correct substitution in this case is λ''z''.''x'', [[up to]] α-equivalence. Substitution is defined uniquely up to α-equivalence. ''See Capture-avoiding substitutions [[#Capture-avoiding substitutions|above]]''.
 
=== β-reduction ===
'''β-reduction''' ([[beta]] reduction) captures the idea of function application. β-reduction is defined in terms of substitution: the β-reduction of (λ''x''.''M'') ''N'' is ''M''[''x'' := ''N''].{{efn|name= beta}}
 
For example, assuming some encoding of 2, 7, ×, we have the following β-reduction: (λ''n''.''n'' × 2) 7 → 7 × 2.
 
β-reduction can be seen to be the same as the concept of ''local reducibility'' in [[natural deduction]], via the [[Curry–Howard isomorphism]].
 
=== η-conversion ===
'''η-conversion''' ([[eta]] conversion) expresses the idea of [[extensionality]],<ref name= etaReduct >Luke Palmer [https://mail.haskell.org/pipermail/haskell-cafe/2010-December/087783.html (29 Dec 2010) Haskell-cafe: What's the motivation for η rules?]</ref> which in this context is that two functions are the same [[if and only if]] they give the same result for all arguments. η-conversion converts between λ''x''.''f'' ''x'' and ''f'' whenever ''x'' does not appear free in ''f''.
 
η-reduction changes λ''x''.''f'' ''x'' to ''f'', and η-expansion changes ''f'' to λ''x''.''f'' ''x'', under the same requirement that ''x'' does not appear free in ''f''.
 
η-conversion can be seen to be the same as the concept of ''local completeness'' in [[natural deduction]], via the [[Curry–Howard isomorphism]].


== Normal forms and confluence ==
== Normal forms and confluence ==
{{Further|Normalization property (abstract rewriting)}}
{{Further|Normalization property (abstract rewriting)}}
For the untyped lambda calculus, β-reduction as a [[rewrite system|rewriting rule]] is neither [[strongly normalising]] nor [[weakly normalising]].
It can be shown that β-reduction is [[confluence (abstract rewriting)|confluent]] when working up to α-conversion (i.e. we consider two normal forms to be equal if it is possible to α-convert one into the other). If [[Reduction strategy (lambda calculus)|repeated application]] of the reduction steps eventually terminates, then by the [[Church–Rosser theorem]] it will produce a unique [[Beta normal form|β-normal form]]. However, the untyped lambda calculus as a [[rewrite system|rewriting rule]] under β-reduction is neither [[strongly normalising]] nor [[weakly normalising]]; there are terms with no normal form such as {{Mono|'''Ω'''}}.
 
However, it can be shown that β-reduction is [[confluence (abstract rewriting)|confluent]] when working up to α-conversion (i.e. we consider two normal forms to be equal if it is possible to α-convert one into the other).


Therefore, both strongly normalising terms and weakly normalising terms have a unique normal form. For strongly normalising terms, any reduction strategy is guaranteed to yield the normal form, whereas for weakly normalising terms, some reduction strategies may fail to find it.
Considering individual terms, both strongly normalising terms and weakly normalising terms have a unique normal form. For strongly normalising terms, any reduction strategy is guaranteed to yield the normal form, whereas for weakly normalising terms, some reduction strategies may fail to find it.


== Encoding datatypes ==
== Encoding datatypes ==
{{Further|Church encoding|Mogensen–Scott encoding}}
{{Further|Church encoding|Mogensen–Scott encoding}}
The basic lambda calculus may be used to model [[arithmetic]], Booleans, data structures, and recursion, as illustrated in the following sub-sections ''[[#Arithmetic in lambda calculus|i]]'', ''[[#Logic and predicates|ii]]'', ''[[#Pairs|iii]]'', and ''[[Mogensen–Scott encoding|§ iv]]''.
The basic lambda calculus may be used to model [[arithmetic]], Booleans, data structures, and recursion, as illustrated in the following sub-sections ''[[#Arithmetic in lambda calculus|i]]'', ''[[#Logic and predicates|ii]]'', ''[[#Pairs|iii]]'', and ''[[#Recursion and fixed points|§ iv]]''.


=== Arithmetic in lambda calculus ===
=== Arithmetic in lambda calculus ===
Line 272: Line 105:
: {{Mono|1=2 := λ''f''.λ''x''.''f'' (''f'' ''x'')}}
: {{Mono|1=2 := λ''f''.λ''x''.''f'' (''f'' ''x'')}}
: {{Mono|1=3 := λ''f''.λ''x''.''f'' (''f'' (''f'' ''x''))}}
: {{Mono|1=3 := λ''f''.λ''x''.''f'' (''f'' (''f'' ''x''))}}
and so on. Or using the alternative syntax presented above in ''[[#Notation|Notation]]'':
and so on. Or using an alternative syntax allowing multiple uncurried arguments to a function:


: {{Mono|1=0 := λ''fx''.''x''}}
: {{Mono|1=0 := λ''fx''.''x''}}
Line 298: Line 131:
: {{Mono|1=PLUS′ := λ''m''.λ''n''.''m'' SUCC ''n ''}}<ref>{{Citation|last1=Felleisen|first1=Matthias|last2=Flatt|first2=Matthew|title=Programming Languages and Lambda Calculi|year=2006|page=26|url=http://www.cs.utah.edu/plt/publications/pllc.pdf|archive-url=https://web.archive.org/web/20090205113235/http://www.cs.utah.edu/plt/publications/pllc.pdf|archive-date=2009-02-05}}; A note (accessed 2017) at the original location suggests that the authors consider the work originally referenced to have been superseded by a book.</ref>
: {{Mono|1=PLUS′ := λ''m''.λ''n''.''m'' SUCC ''n ''}}<ref>{{Citation|last1=Felleisen|first1=Matthias|last2=Flatt|first2=Matthew|title=Programming Languages and Lambda Calculi|year=2006|page=26|url=http://www.cs.utah.edu/plt/publications/pllc.pdf|archive-url=https://web.archive.org/web/20090205113235/http://www.cs.utah.edu/plt/publications/pllc.pdf|archive-date=2009-02-05}}; A note (accessed 2017) at the original location suggests that the authors consider the work originally referenced to have been superseded by a book.</ref>
Similarly, following {{Mono|(''f''<sup>(''n'')</sup>)<sup>(''m'')</sup> {{=}} ''f''<sup>(''m*n'')</sup>}}, multiplication can be defined as
Similarly, following {{Mono|(''f''<sup>(''n'')</sup>)<sup>(''m'')</sup> {{=}} ''f''<sup>(''m*n'')</sup>}}, multiplication can be defined as
: {{Mono|1=MULT := λ''m''.λ''n''.λ''f''.''m'' (''n'' ''f'')}}<ref name="Selinger" />
: {{Mono|1=MULT := λ''m''.λ''n''.λ''f''.''m'' (''n'' ''f'')}}<ref name="Selinger">
{{Citation
  | first = Peter
  | last = Selinger
  | title = Lecture Notes on the Lambda Calculus
  | year =2008
  | page = 9
  | publisher = Department of Mathematics and Statistics, University of Ottawa
  | url = http://www.mathstat.dal.ca/~selinger/papers/lambdanotes.pdf
  | bibcode = 2008arXiv0804.3434S
  | volume = 0804
  | arxiv = 0804.3434
  | issue=class: cs.LO }}</ref>
Thus multiplication of Church numerals is simply their composition as functions. Alternatively
Thus multiplication of Church numerals is simply their composition as functions. Alternatively
: {{Mono|1=MULT′ := λ''m''.λ''n''.''m'' (PLUS ''n'') 0}}
: {{Mono|1=MULT′ := λ''m''.λ''n''.''m'' (PLUS ''n'') 0}}
Line 441: Line 286:
Every recursively defined function can be seen as a fixed point of some suitably defined higher order function (also known as functional) closing over the recursive call with an extra argument. Therefore, using {{Mono|'''Y'''}}, every recursive function can be expressed as a lambda expression. In particular, we can now cleanly define the subtraction, multiplication, and comparison predicates of natural numbers, using recursion.
Every recursively defined function can be seen as a fixed point of some suitably defined higher order function (also known as functional) closing over the recursive call with an extra argument. Therefore, using {{Mono|'''Y'''}}, every recursive function can be expressed as a lambda expression. In particular, we can now cleanly define the subtraction, multiplication, and comparison predicates of natural numbers, using recursion.


When [[Fixed-point combinator|Y combinator]] is coded directly in a [[strict programming language]], the applicative order of evaluation used in such languages will cause an attempt to fully expand the internal self-application <math>(x x)</math> prematurely, causing [[stack overflow]] or, in case of [[tail call optimization]], indefinite looping.<ref>{{cite web |last1=Bene |first1=Adam |title=Fixed-Point Combinators in JavaScript |url=https://blog.benestudio.co/fixed-point-combinators-in-javascript-c214c15ff2f6 |website=Bene Studio |publisher=Medium |access-date=2 August 2020 |language=en |date=17 August 2017}}</ref> A delayed variant of Y, the [[Z combinator]], can be used in such languages. It has the internal self-application hidden behind an extra abstraction through [[#η-conversion|eta-expansion]], as <math>(\lambda v.x x v)</math>, thus preventing its premature expansion:<ref>{{cite web |title=CS 6110 S17 Lecture 5. Recursion and Fixed-Point Combinators |url=https://www.cs.cornell.edu/courses/cs6110/2017sp/lectures/lec05.pdf |website=Cornell University |at=4.1 A CBV Fixed-Point Combinator}}</ref>
When [[Fixed-point combinator|Y combinator]] is coded directly in a [[strict programming language]], the applicative order of evaluation used in such languages will cause an attempt to fully expand the internal self-application <math>(x x)</math> prematurely, causing [[stack overflow]] or, in case of [[tail call optimization]], indefinite looping.<ref>{{cite web |last1=Bene |first1=Adam |title=Fixed-Point Combinators in JavaScript |url=https://benestudio.co/fixed-point-combinators-in-javascript/ |website=Bene Studio |publisher=Medium |access-date=2 August 2020 |language=en |date=17 August 2017 }}</ref> A delayed variant of Y, the [[Z combinator]], can be used in such languages. It has the internal self-application hidden behind an extra abstraction through [[#η-conversion|eta-expansion]], as <math>(\lambda v.x x v)</math>, thus preventing its premature expansion:<ref>{{cite web |title=CS 6110 S17 Lecture 5. Recursion and Fixed-Point Combinators |url=https://www.cs.cornell.edu/courses/cs6110/2017sp/lectures/lec05.pdf |website=Cornell University |at=4.1 A CBV Fixed-Point Combinator}}</ref>
: <math>Z = \lambda f.(\lambda x.f (\lambda v.x x v)) \ (\lambda x.f (\lambda v.x x v))\ .</math>
: <math>Z = \lambda f.(\lambda x.f (\lambda v.x x v)) \ (\lambda x.f (\lambda v.x x v))\ .</math>


Line 480: Line 325:
== Reduction strategies ==
== Reduction strategies ==
{{Further|Reduction strategy#Lambda calculus}}
{{Further|Reduction strategy#Lambda calculus}}
Whether a term is normalising or not, and how much work needs to be done in normalising it if it is, depends to a large extent on the reduction strategy used. Common lambda calculus reduction strategies include:<ref>{{cite book |last1=Pierce |first1=Benjamin C. |author1-link=Benjamin C. Pierce |title=Types and Programming Languages |year=2002 |publisher=[[MIT Press]] |isbn=0-262-16209-1 |page=56|url=https://books.google.com/books?id=ti6zoAC9Ph8C&pg=PA56}}</ref><ref>{{cite book |last1=Sestoft |first1=Peter |title=The Essence of Computation |chapter=Demonstrating Lambda Calculus Reduction |series=Lecture Notes in Computer Science |date=2002 |volume=2566 |pages=420–435 |doi=10.1007/3-540-36377-7_19 |isbn=978-3-540-00326-7 |chapter-url=http://itu.dk/people/sestoft/papers/sestoft-lamreduce.pdf |access-date=22 August 2022}}</ref><ref>{{cite journal |last1=Biernacka |first1=Małgorzata |last2=Charatonik |first2=Witold |last3=Drab |first3=Tomasz |editor1-last=Andronick |editor1-first=June |editor2-last=de Moura |editor2-first=Leonardo |title=The Zoo of Lambda-Calculus Reduction Strategies, and Coq |journal=13th International Conference on Interactive Theorem Proving (ITP 2022) |date=2022 |volume=237 |pages=7:1–7:19 |publisher=Schloss Dagstuhl – Leibniz-Zentrum für Informatik |doi=10.4230/LIPIcs.ITP.2022.7 |doi-access=free |url=https://drops.dagstuhl.de/opus/volltexte/2022/16716/pdf/LIPIcs-ITP-2022-7.pdf |access-date=22 August 2022}}</ref>
Whether a term is normalising or not, and how much work needs to be done in normalising it if it is, depends to a large extent on the reduction strategy used. Common lambda calculus reduction strategies include:<ref>{{cite book |last1=Pierce |first1=Benjamin C. |author1-link=Benjamin C. Pierce |title=Types and Programming Languages |year=2002 |publisher=[[MIT Press]] |isbn=0-262-16209-1 |page=56|url=https://books.google.com/books?id=ti6zoAC9Ph8C&pg=PA56}}</ref><ref>{{cite book |last1=Sestoft |first1=Peter |title=The Essence of Computation |chapter=Demonstrating Lambda Calculus Reduction |series=Lecture Notes in Computer Science |date=2002 |volume=2566 |pages=420–435 |doi=10.1007/3-540-36377-7_19 |isbn=978-3-540-00326-7 |chapter-url=http://itu.dk/people/sestoft/papers/sestoft-lamreduce.pdf |access-date=22 August 2022}}</ref><ref>{{cite book |last1=Biernacka |first1=Małgorzata |last2=Charatonik |first2=Witold |last3=Drab |first3=Tomasz |title=The Zoo of Lambda-Calculus Reduction Strategies, and Coq |series=Leibniz International Proceedings in Informatics (LIPIcs) |editor1-last=Andronick |editor1-first=June |editor2-last=de Moura |editor2-first=Leonardo |date=2022 |volume=237 |pages=7:1–7:19 |publisher=Schloss Dagstuhl – Leibniz-Zentrum für Informatik |doi=10.4230/LIPIcs.ITP.2022.7 |isbn=978-3-95977-252-5 |doi-access=free |url=https://drops.dagstuhl.de/opus/volltexte/2022/16716/pdf/LIPIcs-ITP-2022-7.pdf |access-date=22 August 2022}}</ref>
; Normal order: The leftmost outermost redex is reduced first. That is, whenever possible, arguments are substituted into the body of an abstraction before the arguments are reduced. If a term has a beta-normal form, normal order reduction will always reach that normal form.
; Normal order: The leftmost outermost redex is reduced first. That is, whenever possible, arguments are substituted into the body of an abstraction before the arguments are reduced. If a term has a beta-normal form, normal order reduction will always reach that normal form.
; Applicative order: The leftmost innermost redex is reduced first. As a consequence, a function's arguments are always reduced before they are substituted into the function. Unlike normal order reduction, applicative order reduction may fail to find the beta-normal form of an expression, even if such a normal form exists. For example, the term <math>( \; \lambda x.y \;\; (\lambda z. (z z) \; \lambda z. (z z)) \; )</math> is reduced to itself by applicative order, while normal order reduces it to its beta-normal form <math>y</math>.
; Applicative order: The leftmost innermost redex is reduced first. As a consequence, a function's arguments are always reduced before they are substituted into the function. Unlike normal order reduction, applicative order reduction may fail to find the beta-normal form of an expression, even if such a normal form exists. For example, the term <math>( \; \lambda x.y \;\; (\lambda z. (z z) \; \lambda z. (z z)) \; )</math> is reduced to itself by applicative order, while normal order reduces it to its beta-normal form <math>y</math>.
Line 512: Line 357:
{{Further|Anonymous function}}
{{Further|Anonymous function}}
For example, in [[Python (programming language)|Python]] the "square" function can be expressed as a lambda expression as follows:
For example, in [[Python (programming language)|Python]] the "square" function can be expressed as a lambda expression as follows:
<!-- Please do not add the same example in different languages to this article, see Anonymous function for that. Thank you! -->
<!-- Please do not add the same example in different languages to this article; see instead 'Anonymous function' for that. Thank you! -->
<syntaxhighlight lang="Python">
<syntaxhighlight lang="python">
(lambda x: x**2)
(lambda x: x**2)
</syntaxhighlight>
</syntaxhighlight>


The above example is an expression that evaluates to a first-class function. The symbol <code>lambda</code> creates an anonymous function, given a list of parameter names, <code>x</code> – just a single argument in this case, and an expression that is evaluated as the body of the function, <code>x**2</code>. Anonymous functions are sometimes called lambda expressions.
The above example is an expression that evaluates to a first-class function. The symbol <code>lambda</code> creates an anonymous function, given a list of parameter names—just the single argument <code>x</code>, in this case—and an expression that is evaluated as the body of the function, <code>x**2</code>. Anonymous functions are sometimes called ''lambda expressions.''


For example, [[Pascal (programming language)|Pascal]] and many other imperative languages have long supported passing [[Function (computer programming)|subprograms]] as [[Parameter (computer programming)|arguments]] to other subprograms through the mechanism of [[function pointer]]s. However, function pointers are an insufficient condition for functions to be [[First-class function|first class]] datatypes, because a function is a first class datatype if and only if new instances of the function can be created at [[Execution (computing)#runtime|runtime]]. Such runtime creation of functions is supported in [[Smalltalk]], [[JavaScript]], [[Wolfram Language]], and more recently in [[Scala (programming language)|Scala]], [[Eiffel (programming language)|Eiffel]] (as agents), [[C Sharp (programming language)|C#]] (as delegates) and [[C++11]], among others.
[[Pascal (programming language)|Pascal]] and many other imperative languages have long supported passing [[Function (computer programming)|subprograms]] as [[Parameter (computer programming)|arguments]] to other subprograms through the mechanism of [[function pointer]]s. However, function pointers are an insufficient condition for functions to be [[First-class function|first class]] datatypes, because a function is a first class datatype if and only if new instances of the function can be created at [[Execution (computing)#runtime|runtime]]. Such runtime creation of functions is supported in [[Smalltalk]], [[JavaScript]], [[Wolfram Language]], and more recently in [[Scala (programming language)|Scala]], [[Eiffel (programming language)|Eiffel]] (as agents), [[C Sharp (programming language)|C#]] (as delegates) and [[C++11]], among others.


=== Parallelism and concurrency ===
=== Parallelism and concurrency ===

Latest revision as of 22:12, 17 November 2025

Template:Short description

File:LambdaAbstraction.svg
The lambda abstraction decomposed. The λ indicates the start of a function. x is the input parameter. M is the body, separated by a dot separator "." from the input parameter.

In mathematical logic, the lambda calculus (also written as λ-calculus) is a formal system for expressing computation based on function abstraction and application using variable binding and substitution. Untyped lambda calculus, the topic of this article, is a universal machine, a model of computation that can be used to simulate any Turing machine (and vice versa). It was introduced by the mathematician Alonzo Church in the 1930s as part of his research into the foundations of mathematics. In 1936, Church found a formulation which was logically consistent, and documented it in 1940.

Definition

Script error: No such module "Labelled list hatnote". The lambda calculus consists of a language of lambda terms, that are defined by a certain formal syntax, and a set of transformation rules for manipulating the lambda terms. In BNF, the syntax is e::=xλx.eee, where variables Template:Math range over an infinite set of names. Terms Template:Math range over all lambda terms. This corresponds to the following inductive definition:

  • Script error: No such module "anchor". A variable Template:Mvar is itself a valid lambda term.
  • Script error: No such module "anchor". An abstraction is a lambda term (λx.t) where Template:Mvar is a lambda term and Template:Mvar is a variable,
  • Script error: No such module "anchor". An application is a lambda term (ts) where Template:Mvar and Template:Mvar are lambda terms.

A lambda term is syntactically valid if and only if it can be obtained by repeated application of these three rules. For convenience, parentheses can often be omitted when writing a lambda term—see Template:Section link for details.

In the term λx.M, occurrences of Template:Mvar within Template:Mvar that are under the scope of this λ are termed bound; any occurrence of a variable not bound by an enclosing λ is free. Template:Math is the set of free variables of Template:Mvar. The notation M[x:=N] denotes capture-avoiding substitution: substituting Template:Mvar for every free occurrence of Template:Mvar in Template:Mvar, while avoiding variable capture.Template:Efn This operation is defined inductively as follows:

  • x[x:=N]=N; y[x:=N]=y if yx.
  • (M1M2)[x:=N]=(M1[x:=N])(M2[x:=N]).
  • (λy.M)[x:=N] has three cases:
    • If y=x, becomes λx.M (x is bound; no change).
    • If yFV(N), becomes λy.(M[x:=N]).
    • If yFV(N), first α-rename λy.M to λy.M[y:=y] with y fresh to avoid name collisions, then continue as above.

There are several notions of "equivalence" and "reduction" that make it possible to reduce lambda terms to equivalent lambda terms.[1]

  • α-conversion captures the intuition that the particular choice of a bound variable, in an abstraction, does not (usually) matter. If yFV(M), then the terms λx.M and λy.M[x:=y] are considered alpha-equivalent, written λx.Mαλy.M[x:=y]. The equivalence relation is the smallest congruence relation on lambda terms generated by this rule. For instance, λx.x and λy.y are alpha-equivalent lambda terms.
  • The β-reduction rule states that a β-redex, an application of the form (λx.t)s, reduces to the term t[x:=s].Template:Efn For example, for every s, (λx.x)sx[x:=s]=s. This demonstrates that λx.x really is the identity. Similarly, (λx.y)sy[x:=s]=y, which demonstrates that λx.y is a constant function.
  • η-conversion expresses extensionality and converts between λx.fx and f whenever x does not appear free in f. It is often omitted in many treatments of lambda calculus.

Script error: No such module "anchor".The term redex, short for reducible expression, refers to subterms that can be reduced by one of the reduction rules. For example, (λx.M) N is a β-redex in expressing the substitution of N for x in M. The expression to which a redex reduces is called its reduct; the reduct of (λx.M) N is M[x := N].

Explanation and applications

Lambda calculus is Turing complete, that is, it is a universal model of computation that can be used to simulate any Turing machine.[2] Its namesake, the Greek letter lambda (λ), is used in lambda expressions and lambda terms to denote binding a variable in a function.

Script error: No such module "anchor".Script error: No such module "anchor".Lambda calculus may be untyped or typed. In typed lambda calculus, functions can be applied only if they are capable of accepting the given input's "type" of data. Typed lambda calculi are strictly weaker than the untyped lambda calculus, which is the primary subject of this article, in the sense that typed lambda calculi can express less than the untyped calculus can. On the other hand, more things can be proven with typed lambda calculi. For example, in simply typed lambda calculus, it is a theorem that every evaluation strategy terminates for every simply typed lambda-term, whereas evaluation of untyped lambda-terms need not terminate (see below). One reason there are many different typed lambda calculi has been the desire to do more (of what the untyped calculus can do) without giving up on being able to prove strong theorems about the calculus.

Lambda calculus has applications in many different areas in mathematics, philosophy,[3] linguistics,[4][5] and computer science.[6][7] Lambda calculus has played an important role in the development of the theory of programming languages. Functional programming languages implement lambda calculus. Lambda calculus is also a current research topic in category theory.[8]

History

Lambda calculus was introduced by mathematician Alonzo Church in the 1930s as part of an investigation into the foundations of mathematics.[9]Template:Efn The original system was shown to be logically inconsistent in 1935 when Stephen Kleene and J. B. Rosser developed the Kleene–Rosser paradox.[10][11]

Subsequently, in 1936 Church isolated and published just the portion relevant to computation, what is now called the untyped lambda calculus.[12] In 1940, he also introduced a computationally weaker, but logically consistent system, known as the simply typed lambda calculus.[13]

Until the 1960s when its relation to programming languages was clarified, the lambda calculus was only a formalism. Thanks to Richard Montague and other linguists' applications in the semantics of natural language, the lambda calculus has begun to enjoy a respectable place in both linguistics[14] and computer science.[15]

Origin of the λ symbol

Script error: No such module "anchor". There is some uncertainty over the reason for Church's use of the Greek letter lambda (λ) as the notation for function-abstraction in the lambda calculus, perhaps in part due to conflicting explanations by Church himself. According to Cardone and Hindley (2006):

By the way, why did Church choose the notation "λ"? In [an unpublished 1964 letter to Harald Dickson] he stated clearly that it came from the notation "x^" used for class-abstraction by Whitehead and Russell, by first modifying "x^" to "x" to distinguish function-abstraction from class-abstraction, and then changing "" to "λ" for ease of printing.

This origin was also reported in [Rosser, 1984, p.338]. On the other hand, in his later years Church told two enquirers that the choice was more accidental: a symbol was needed and λ just happened to be chosen.

Dana Scott has also addressed this question in various public lectures.[16] Scott recounts that he once posed a question about the origin of the lambda symbol to Church's former student and son-in-law John W. Addison Jr., who then wrote his father-in-law a postcard:

Dear Professor Church,

Russell had the iota operator, Hilbert had the epsilon operator. Why did you choose lambda for your operator?

According to Scott, Church's entire response consisted of returning the postcard with the following annotation: "eeny, meeny, miny, moe".

Motivation

Computable functions are a fundamental concept within computer science and mathematics. The lambda calculus provides simple semantics for computation which are useful for formally studying properties of computation. The lambda calculus incorporates two simplifications that make its semantics simple. Script error: No such module "anchor".The first simplification is that the lambda calculus treats functions "anonymously"; it does not give them explicit names. For example, the function

square_sum(x,y)=x2+y2

can be rewritten in anonymous form as

(x,y)x2+y2

(which is read as "a tuple of Template:Mvar and Template:Mvar is mapped to x2+y2").Template:Efn Similarly, the function

id(x)=x

can be rewritten in anonymous form as

xx

where the input is simply mapped to itself.Template:Efn

The second simplification is that the lambda calculus only uses functions of a single input. An ordinary function that requires two inputs, for instance the square_sum function, can be reworked into an equivalent function that accepts a single input, and as output returns another function, that in turn accepts a single input. For example,

(x,y)x2+y2

can be reworked into

x(yx2+y2)

This method, known as currying, transforms a function that takes multiple arguments into a chain of functions each with a single argument.

Function application of the square_sum function to the arguments (5, 2), yields at once

((x,y)x2+y2)(5,2)
=52+22
=29,

whereas evaluation of the curried version requires one more step

((x(yx2+y2))(5))(2)
=(y52+y2)(2) // the definition of x has been used with 5 in the inner expression. This is like β-reduction.
=52+22 // the definition of y has been used with 2. Again, similar to β-reduction.
=29

to arrive at the same result.

In lambda calculus, functions are taken to be 'first class values', so functions may be used as the inputs, or be returned as outputs from other functions. For example, the lambda term λx.x represents the identity function, xx. Further, λx.y represents the constant function xy, the function that always returns y, no matter the input. As an example of a function operating on functions, the function composition can be defined as λf.λg.λx.(f(gx)).

Normal forms and confluence

Script error: No such module "labelled list hatnote". It can be shown that β-reduction is confluent when working up to α-conversion (i.e. we consider two normal forms to be equal if it is possible to α-convert one into the other). If repeated application of the reduction steps eventually terminates, then by the Church–Rosser theorem it will produce a unique β-normal form. However, the untyped lambda calculus as a rewriting rule under β-reduction is neither strongly normalising nor weakly normalising; there are terms with no normal form such as Template:Mono.

Considering individual terms, both strongly normalising terms and weakly normalising terms have a unique normal form. For strongly normalising terms, any reduction strategy is guaranteed to yield the normal form, whereas for weakly normalising terms, some reduction strategies may fail to find it.

Encoding datatypes

Script error: No such module "labelled list hatnote". The basic lambda calculus may be used to model arithmetic, Booleans, data structures, and recursion, as illustrated in the following sub-sections i, ii, iii, and § iv.

Arithmetic in lambda calculus

There are several possible ways to define the natural numbers in lambda calculus, but by far the most common are the Church numerals, which can be defined as follows:

Template:Mono
Template:Mono
Template:Mono
Template:Mono

and so on. Or using an alternative syntax allowing multiple uncurried arguments to a function:

Template:Mono
Template:Mono
Template:Mono
Template:Mono

A Church numeral is a higher-order function—it takes a single-argument function Template:Mono, and returns another single-argument function. The Church numeral Template:Mono is a function that takes a function Template:Mono as argument and returns the Template:Mono-th composition of Template:Mono, i.e. the function Template:Mono composed with itself Template:Mono times. This is denoted Template:Mono and is in fact the Template:Mono-th power of Template:Mono (considered as an operator); Template:Mono is defined to be the identity function. Functional composition is associative, and so, such repeated compositions of a single function Template:Mono obey two laws of exponents, Template:Mono and Template:Mono, which is why these numerals can be used for arithmetic. (In Church's original lambda calculus, the formal parameter of a lambda expression was required to occur at least once in the function body, which made the above definition of Template:Mono impossible.)

One way of thinking about the Church numeral Template:Mono, which is often useful when analyzing programs, is as an instruction 'repeat n times'. For example, using the Template:Mono and Template:Mono functions defined below, one can define a function that constructs a (linked) list of n elements all equal to x by repeating 'prepend another x element' n times, starting from an empty list. The lambda term

Template:Mono

creates, given a Church numeral Template:Mono and some Template:Mono, a sequence of n applications

Template:Mono

By varying what is being repeated, and what argument(s) that function being repeated is applied to, a great many different effects can be achieved.

We can define a successor function, which takes a Church numeral Template:Mono and returns its successor Template:Mono by performing one additional application of the function Template:Mono it is supplied with, where Template:Mono means "n applications of f starting from x":

Template:Mono

Because the Template:Mono-th composition of Template:Mono composed with the Template:Mono-th composition of Template:Mono gives the Template:Mono-th composition of Template:Mono, Template:Mono, addition can be defined as

Template:Mono

Template:Mono can be thought of as a function taking two natural numbers as arguments and returning a natural number; it can be verified that

Template:Mono

and

Template:Mono

are beta-equivalent lambda expressions. Since adding Template:Mono to a number can be accomplished by repeating the successor operation Template:Mono times, an alternative definition is:

Template:Mono[17]

Similarly, following Template:Mono, multiplication can be defined as

Template:Mono[18]

Thus multiplication of Church numerals is simply their composition as functions. Alternatively

Template:Mono

since multiplying Template:Mono and Template:Mono is the same as adding Template:Mono repeatedly, Template:Mono times, starting from zero.

Exponentiation, being the repeated multiplication of a number with itself, translates as a repeated composition of a Church numeral with itself, as a function. And repeated composition is what Church numerals are:

Template:Mono[19]

Alternatively here as well,

Template:Mono

Simplifying, it becomes

Template:Mono

but that is just an eta-expanded version of Template:Mono we already have, above.

The predecessor function, specified by two equations Template:Mono and Template:Mono, is considerably more involved. The formula

Template:Mono

can be validated by showing inductively that if T denotes Template:Mono, then Template:Mono for Template:Mono. Two other definitions of Template:Mono are given below, one using conditionals and the other using pairs. With the predecessor function, subtraction is straightforward. Defining

Template:Mono,

Template:Mono yields Template:Mono when Template:Mono and Template:Mono otherwise.

Logic and predicates

By convention, the following two definitions (known as Church Booleans) are used for the Boolean values Template:Mono and Template:Mono:

Template:Mono
Template:Mono

Then, with these two lambda terms, we can define some logic operators (these are just possible formulations; other expressions could be equally correct):

Template:Mono
Template:Mono
Template:Mono
Template:Mono

We are now able to compute some logic functions, for example:

Template:Mono
Template:Mono
Template:Mono

and we see that Template:Mono is equivalent to Template:Mono.

A predicate is a function that returns a Boolean value. The most fundamental predicate is Template:Mono, which returns Template:Mono if its argument is the Church numeral Template:Mono, but Template:Mono if its argument were any other Church numeral:

Template:Mono

The following predicate tests whether the first argument is less-than-or-equal-to the second:

Template:Mono,

and since Template:Mono, if Template:Mono and Template:Mono, it is straightforward to build a predicate for numerical equality.

The availability of predicates and the above definition of Template:Mono and Template:Mono make it convenient to write "if-then-else" expressions in lambda calculus. For example, the predecessor function can be defined as:

Template:Mono

which can be verified by showing inductively that Template:Mono is the add Template:Mono − 1 function for Template:Mono > 0.

Pairs

A pair (2-tuple) can be defined in terms of Template:Mono and Template:Mono, by using the Church encoding for pairs. For example, Template:Mono encapsulates the pair (Template:Mono,Template:Mono), Template:Mono returns the first element of the pair, and Template:Mono returns the second.

Template:Mono
Template:Mono
Template:Mono
Template:Mono
Template:Mono

A linked list can be defined as either NIL for the empty list, or the Template:Mono of an element and a smaller list. The predicate Template:Mono tests for the value Template:Mono. (Alternatively, with Template:Mono, the construct Template:Mono obviates the need for an explicit NULL test).

As an example of the use of pairs, the shift-and-increment function that maps Template:Mono to Template:Mono can be defined as

Template:Mono

which allows us to give perhaps the most transparent version of the predecessor function:

Template:Mono

Additional programming techniques

There is a considerable body of programming idioms for lambda calculus. Many of these were originally developed in the context of using lambda calculus as a foundation for programming language semantics, effectively using lambda calculus as a low-level programming language. Because several programming languages include the lambda calculus (or something very similar) as a fragment, these techniques also see use in practical programming, but may then be perceived as obscure or foreign.

Named constants

In lambda calculus, a library would take the form of a collection of previously defined functions, which as lambda-terms are merely particular constants. The pure lambda calculus does not have a concept of named constants since all atomic lambda-terms are variables, but one can emulate having named constants by setting aside a variable as the name of the constant, using abstraction to bind that variable in the main body, and apply that abstraction to the intended definition. Thus to use Template:Mono to mean N (some explicit lambda-term) in M (another lambda-term, the "main program"), one can say

Template:MonoMTemplate:Mono N

Authors often introduce syntactic sugar, such as Template:Mono,Template:Efn to permit writing the above in the more intuitive order

Template:Mono N Template:Mono M

By chaining such definitions, one can write a lambda calculus "program" as zero or more function definitions, followed by one lambda-term using those functions that constitutes the main body of the program.

A notable restriction of this Template:Mono is that the name Template:Mono may not be referenced in N, for N is outside the scope of the abstraction binding Template:Mono, which is M; this means a recursive function definition cannot be written with Template:Mono. The Template:MonoTemplate:Efn construction would allow writing recursive function definitions, where the scope of the abstraction binding Template:Mono includes N as well as M. Or self-application a-la that which leads to Template:Mono combinator could be used.

Recursion and fixed points

Script error: No such module "labelled list hatnote". Script error: No such module "Labelled list hatnote". Recursion is when a function invokes itself. What would a value be which were to represent such a function? It has to refer to itself somehow inside itself, just as the definition refers to itself inside itself. If this value were to contain itself by value, it would have to be of infinite size, which is impossible. Other notations, which support recursion natively, overcome this by referring to the function by name inside its definition. Lambda calculus cannot express this, since in it there simply are no names for terms to begin with, only arguments' names, i.e. parameters in abstractions. Thus, a lambda expression can receive itself as its argument and refer to (a copy of) itself via the corresponding parameter's name. This will work fine in case it was indeed called with itself as an argument. For example, Template:Mono will express recursion when E is an abstraction which is applying its parameter to itself inside its body to express a recursive call. Since this parameter receives E as its value, its self-application will be the same Template:Mono again.

As a concrete example, consider the factorial function Template:Mono, recursively defined by

Template:Mono.

In the lambda expression which is to represent this function, a parameter (typically the first one) will be assumed to receive the lambda expression itself as its value, so that calling it with itself as its first argument will amount to the recursive call. Thus to achieve recursion, the intended-as-self-referencing argument (called Template:Mono here, reminiscent of "self", or "self-applying") must always be passed to itself within the function body at a recursive call point:

Template:Mono
with Template:Mono to hold, so Template:Mono and
Template:Mono

and we have

Template:Mono

Here Template:Mono becomes the same Template:Mono inside the result of the application Template:Mono, and using the same function for a call is the definition of what recursion is. The self-application achieves replication here, passing the function's lambda expression on to the next invocation as an argument value, making it available to be referenced there by the parameter name Template:Mono to be called via the self-application Template:Mono, again and again as needed, each time re-creating the lambda-term Template:Mono.

The application is an additional step just as the name lookup would be. It has the same delaying effect. Instead of having Template:Mono inside itself as a whole up-front, delaying its re-creation until the next call makes its existence possible by having two finite lambda-terms Template:Mono inside it re-create it on the fly later as needed.

This self-applicational approach solves it, but requires re-writing each recursive call as a self-application. We would like to have a generic solution, without the need for any re-writes:

Template:Mono
with Template:Mono to hold, so Template:Mono and
Template:Mono where Template:Mono
so that Template:Mono

Given a lambda term with first argument representing recursive call (e.g. Template:Mono here), the fixed-point combinator Template:Mono will return a self-replicating lambda expression representing the recursive function (here, Template:Mono). The function does not need to be explicitly passed to itself at any point, for the self-replication is arranged in advance, when it is created, to be done each time it is called. Thus the original lambda expression Template:Mono is re-created inside itself, at call-point, achieving self-reference.

In fact, there are many possible definitions for this Template:Mono operator, the simplest of them being:

Script error: No such module "anchor". Template:Mono

In the lambda calculus, Template:Mono is a fixed-point of Template:Mono, as it expands to:

Template:Mono
Template:Mono
Template:Mono
Template:Mono
Template:Mono

Now, to perform the recursive call to the factorial function for an argument n, we would simply call Template:Mono. Given n = 4, for example, this gives: Template:Smalldiv Every recursively defined function can be seen as a fixed point of some suitably defined higher order function (also known as functional) closing over the recursive call with an extra argument. Therefore, using Template:Mono, every recursive function can be expressed as a lambda expression. In particular, we can now cleanly define the subtraction, multiplication, and comparison predicates of natural numbers, using recursion.

When Y combinator is coded directly in a strict programming language, the applicative order of evaluation used in such languages will cause an attempt to fully expand the internal self-application (xx) prematurely, causing stack overflow or, in case of tail call optimization, indefinite looping.[20] A delayed variant of Y, the Z combinator, can be used in such languages. It has the internal self-application hidden behind an extra abstraction through eta-expansion, as (λv.xxv), thus preventing its premature expansion:[21]

Z=λf.(λx.f(λv.xxv)) (λx.f(λv.xxv)) .

Standard terms

Certain terms have commonly accepted names:[22][23][24]

Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono
Script error: No such module "anchor". Template:Mono

Template:Mono is the identity function. Template:Mono and Template:Mono form complete combinator calculus systems that can express any lambda term - see the next section. Template:Mono is Template:Mono, the smallest term that has no normal form. Template:Mono is another such term. Template:Mono is standard and defined above, and can also be defined as Template:Mono, so that Template:Mono. Template:Mono and Template:Mono defined above are commonly abbreviated as Template:Mono and Template:Mono.

Abstraction elimination

Script error: No such module "labelled list hatnote". If N is a lambda-term without abstraction, but possibly containing named constants (combinators), then there exists a lambda-term T(Template:Mono,N) which is equivalent to Template:MonoN but lacks abstraction (except as part of the named constants, if these are considered non-atomic). This can also be viewed as anonymising variables, as T(Template:Mono,N) removes all occurrences of Template:Mono from N, while still allowing argument values to be substituted into the positions where N contains an Template:Mono. The conversion function T can be defined by:

T(Template:Mono, Template:Mono) := I
T(Template:Mono, N) := K N if Template:Mono is not free in N.
T(Template:Mono, M N) := S T(Template:Mono, M) T(Template:Mono, N)

In either case, a term of the form T(Template:Mono,N) P can reduce by having the initial combinator I, K, or S grab the argument P, just like β-reduction of Template:MonoNTemplate:Mono P would do. I returns that argument. K throws the argument away, just like Template:MonoNTemplate:Mono would do if Template:Mono has no free occurrence in N. S passes the argument on to both subterms of the application, and then applies the result of the first to the result of the second.

The combinators B and C are similar to S, but pass the argument on to only one subterm of an application (B to the "argument" subterm and C to the "function" subterm), thus saving a subsequent K if there is no occurrence of Template:Mono in one subterm. In comparison to B and C, the S combinator actually conflates two functionalities: rearranging arguments, and duplicating an argument so that it may be used in two places. The W combinator does only the latter, yielding the B, C, K, W system as an alternative to SKI combinator calculus.

Typed lambda calculus

Script error: No such module "labelled list hatnote". A typed lambda calculus is a typed formalism that uses the lambda-symbol (λ) to denote anonymous function abstraction. In this context, types are usually objects of a syntactic nature that are assigned to lambda terms; the exact nature of a type depends on the calculus considered (see Kinds of typed lambda calculi). From a certain point of view, typed lambda calculi can be seen as refinements of the untyped lambda calculus but from another point of view, they can also be considered the more fundamental theory and untyped lambda calculus a special case with only one type.[25]

Typed lambda calculi are foundational programming languages and are the base of typed functional programming languages such as ML and Haskell and, more indirectly, typed imperative programming languages. Typed lambda calculi play an important role in the design of type systems for programming languages; here typability usually captures desirable properties of the program, e.g., the program will not cause a memory access violation.

Typed lambda calculi are closely related to mathematical logic and proof theory via the Curry–Howard isomorphism and they can be considered as the internal language of classes of categories, e.g., the simply typed lambda calculus is the language of a Cartesian closed category (CCC).

Reduction strategies

Script error: No such module "labelled list hatnote". Whether a term is normalising or not, and how much work needs to be done in normalising it if it is, depends to a large extent on the reduction strategy used. Common lambda calculus reduction strategies include:[26][27][28]

Normal order
The leftmost outermost redex is reduced first. That is, whenever possible, arguments are substituted into the body of an abstraction before the arguments are reduced. If a term has a beta-normal form, normal order reduction will always reach that normal form.
Applicative order
The leftmost innermost redex is reduced first. As a consequence, a function's arguments are always reduced before they are substituted into the function. Unlike normal order reduction, applicative order reduction may fail to find the beta-normal form of an expression, even if such a normal form exists. For example, the term (λx.y(λz.(zz)λz.(zz))) is reduced to itself by applicative order, while normal order reduces it to its beta-normal form y.
Full β-reductions
Any redex can be reduced at any time. This means essentially the lack of any particular reduction strategy—with regard to reducibility, "all bets are off".

Weak reduction strategies do not reduce under lambda abstractions:

Call by valueScript error: No such module "anchor".
Like applicative order, but no reductions are performed inside abstractions. This is similar to the evaluation order of strict languages like C: the arguments to a function are evaluated before calling the function, and function bodies are not even partially evaluated until the arguments are substituted in.
Call by name
Like normal order, but no reductions are performed inside abstractions. For example, Template:Mono is in normal form according to this strategy, although it contains the redex Template:Mono.

Strategies with sharing reduce computations that are "the same" in parallel:

Optimal reduction
As normal order, but computations that have the same label are reduced simultaneously.
Call by need
As call by name (hence weak), but function applications that would duplicate terms instead name the argument. The argument may be evaluated "when needed", at which point the name binding is updated with the reduced value. This can save time compared to normal order evaluation.

Computability

There is no algorithm that takes as input any two lambda expressions and outputs Template:Mono or Template:Mono depending on whether one expression reduces to the other.[12] More precisely, no computable function can decide the question. This was historically the first problem for which undecidability could be proven. As usual for such a proof, computable means computable by any model of computation that is Turing complete. In fact computability can itself be defined via the lambda calculus: a function F: NN of natural numbers is a computable function if and only if there exists a lambda expression f such that for every pair of x, y in N, F(x)=y if and only if f Template:Mono =β Template:Mono, where Template:Mono and Template:Mono are the Church numerals corresponding to x and y, respectively and =β meaning equivalence with β-reduction. See the Church–Turing thesis for other approaches to defining computability and their equivalence.

Church's proof of uncomputability first reduces the problem to determining whether a given lambda expression has a normal form. Then he assumes that this predicate is computable, and can hence be expressed in lambda calculus. Building on earlier work by Kleene and constructing a Gödel numbering for lambda expressions, he constructs a lambda expression Template:Mono that closely follows the proof of Gödel's first incompleteness theorem. If Template:Mono is applied to its own Gödel number, a contradiction results.

Complexity

The notion of computational complexity for the lambda calculus is a bit tricky, because the cost of a β-reduction may vary depending on how it is implemented.[29] To be precise, one must somehow find the location of all of the occurrences of the bound variable Template:Mono in the expression Template:Mono, implying a time cost, or one must keep track of the locations of free variables in some way, implying a space cost. A naïve search for the locations of Template:Mono in Template:Mono is O(n) in the length n of Template:Mono. Director strings were an early approach that traded this time cost for a quadratic space usage.[30] More generally this has led to the study of systems that use explicit substitution.

In 2014, it was shown that the number of β-reduction steps taken by normal order reduction to reduce a term is a reasonable time cost model, that is, the reduction can be simulated on a Turing machine in time polynomially proportional to the number of steps.[31] This was a long-standing open problem, due to size explosion, the existence of lambda terms which grow exponentially in size for each β-reduction. The result gets around this by working with a compact shared representation. The result makes clear that the amount of space needed to evaluate a lambda term is not proportional to the size of the term during reduction. It is not currently known what a good measure of space complexity would be.[32]

An unreasonable model does not necessarily mean inefficient. Optimal reduction reduces all computations with the same label in one step, avoiding duplicated work, but the number of parallel β-reduction steps to reduce a given term to normal form is approximately linear in the size of the term. This is far too small to be a reasonable cost measure, as any Turing machine may be encoded in the lambda calculus in size linearly proportional to the size of the Turing machine. The true cost of reducing lambda terms is not due to β-reduction per se but rather the handling of the duplication of redexes during β-reduction.[33] It is not known if optimal reduction implementations are reasonable when measured with respect to a reasonable cost model such as the number of leftmost-outermost steps to normal form, but it has been shown for fragments of the lambda calculus that the optimal reduction algorithm is efficient and has at most a quadratic overhead compared to leftmost-outermost.[32] In addition the BOHM prototype implementation of optimal reduction outperformed both Caml Light and Haskell on pure lambda terms.[33]

Lambda calculus and programming languages

As pointed out by Peter Landin's 1965 paper "A Correspondence between ALGOL 60 and Church's Lambda-notation",[34] sequential procedural programming languages can be understood in terms of the lambda calculus, which provides the basic mechanisms for procedural abstraction and procedure (subprogram) application.

Anonymous functions

Script error: No such module "labelled list hatnote". For example, in Python the "square" function can be expressed as a lambda expression as follows:

(lambda x: x**2)

The above example is an expression that evaluates to a first-class function. The symbol lambda creates an anonymous function, given a list of parameter names—just the single argument x, in this case—and an expression that is evaluated as the body of the function, x**2. Anonymous functions are sometimes called lambda expressions.

Pascal and many other imperative languages have long supported passing subprograms as arguments to other subprograms through the mechanism of function pointers. However, function pointers are an insufficient condition for functions to be first class datatypes, because a function is a first class datatype if and only if new instances of the function can be created at runtime. Such runtime creation of functions is supported in Smalltalk, JavaScript, Wolfram Language, and more recently in Scala, Eiffel (as agents), C# (as delegates) and C++11, among others.

Parallelism and concurrency

The Church–Rosser property of the lambda calculus means that evaluation (β-reduction) can be carried out in any order, even in parallel. This means that various nondeterministic evaluation strategies are relevant. However, the lambda calculus does not offer any explicit constructs for parallelism. One can add constructs such as futures to the lambda calculus. Other process calculi have been developed for describing communication and concurrency.

Semantics

The fact that lambda calculus terms act as functions on other lambda calculus terms, and even on themselves, led to questions about the semantics of the lambda calculus. Could a sensible meaning be assigned to lambda calculus terms? The natural semantics was to find a set D isomorphic to the function space DD, of functions on itself. However, no nontrivial such D can exist, by cardinality constraints because the set of all functions from D to D has greater cardinality than D, unless D is a singleton set.

In the 1970s, Dana Scott showed that if only continuous functions were considered, a set or domain D with the required property could be found, thus providing a model for the lambda calculus.[35]

This work also formed the basis for the denotational semantics of programming languages.

Variations and extensions

These extensions are in the lambda cube:

These formal systems are extensions of lambda calculus that are not in the lambda cube:

These formal systems are variations of lambda calculus:

These formal systems are related to lambda calculus:

  • Combinatory logic – A notation for mathematical logic without variables
  • SKI combinator calculus – A computational system based on the S, K and I combinators, equivalent to lambda calculus, but reducible without variable substitutions

See also

Script error: No such module "Portal". Template:Colbegin

Template:Colend

Further reading

Monographs/textbooks for graduate students
  • Sørensen, Morten Heine and Urzyczyn, Paweł (2006), Lectures on the Curry–Howard isomorphism, Elsevier, Template:Isbn is a recent monograph that covers the main topics of lambda calculus from the type-free variety, to most typed lambda calculi, including more recent developments like pure type systems and the lambda cube. It does not cover subtyping extensions.
  • Script error: No such module "citation/CS1". covers lambda calculi from a practical type system perspective; some topics like dependent types are only mentioned, but subtyping is an important topic.
Documents

Notes

Template:Notelist

References

Some parts of this article are based on material from FOLDOC, used with permission. Template:Reflist

External links

Template:Sister project

Template:Alonzo Church Template:Mathematical logic Template:Authority control Template:Formal semantics Template:Functions navbox

  1. Script error: No such module "Citation/CS1".
  2. Script error: No such module "Citation/CS1".
  3. Script error: No such module "citation/CS1".
  4. Script error: No such module "citation/CS1".
  5. Script error: No such module "citation/CS1".
  6. Script error: No such module "citation/CS1"..
  7. Script error: No such module "citation/CS1".
  8. Script error: No such module "citation/CS1".
  9. Script error: No such module "Citation/CS1".
  10. Script error: No such module "Citation/CS1".
  11. Script error: No such module "Citation/CS1".
  12. a b Script error: No such module "Citation/CS1".
  13. Script error: No such module "Citation/CS1".
  14. Script error: No such module "citation/CS1".
  15. Script error: No such module "citation/CS1".
  16. Dana Scott, "Looking Backward; Looking Forward", Invited Talk at the Workshop in honour of Dana Scott's 85th birthday and 50 years of domain theory, 7–8 July, FLoC 2018 (talk 7 July 2018). The relevant passage begins at 32:50. (See also this extract of a May 2016 talk at the University of Birmingham, UK.)
  17. Script error: No such module "citation/CS1".; A note (accessed 2017) at the original location suggests that the authors consider the work originally referenced to have been superseded by a book.
  18. Script error: No such module "citation/CS1".
  19. Cite error: Invalid <ref> tag; no text was provided for refs named BarendregtBarendsen
  20. Script error: No such module "citation/CS1".
  21. Script error: No such module "citation/CS1".
  22. Script error: No such module "citation/CS1".
  23. Script error: No such module "citation/CS1".
  24. Script error: No such module "Citation/CS1".
  25. Types and Programming Languages, p. 273, Benjamin C. Pierce
  26. Script error: No such module "citation/CS1".
  27. Script error: No such module "citation/CS1".
  28. Script error: No such module "citation/CS1".
  29. Script error: No such module "citation/CS1".
  30. Script error: No such module "Citation/CS1".
  31. Script error: No such module "citation/CS1".
  32. a b Script error: No such module "Citation/CS1".
  33. a b Script error: No such module "citation/CS1".
  34. Script error: No such module "Citation/CS1".
  35. Script error: No such module "Citation/CS1". Written 1969, widely circulated as an unpublished manuscript.
  36. Script error: No such module "citation/CS1".