Functional derivative: Difference between revisions
imported>BobH4 |
imported>Jajaperson m →Functional differential: cf. homotopy |
||
| Line 6: | Line 6: | ||
For example, consider the functional | For example, consider the functional | ||
<math display="block"> J[f] = \int_a^b L( \, x, f(x), f'{(x)} \, ) \, dx \, , </math> | <math display="block"> J[f] = \int_a^b L( \, x, f(x), f'{(x)} \, ) \, dx \, , </math> | ||
where {{math|''f'' ′(''x'') ≡ ''df''/''dx''}}. If {{math|''f''}} is varied by adding to it a function {{math|''δf''}}, and the resulting integrand {{math|''L''(''x'', ''f'' +''δf'', ''f'' ′+''δf'' ′)}} is expanded in powers of {{math|''δf''}}, then the change in the value of {{math|''J''}} to first order in {{math|''δf''}} can be expressed as follows:<ref name="GiaquintaHildebrandtP18" /><ref | where {{math|''f'' ′(''x'') ≡ ''df''/''dx''}}. If {{math|''f''}} is varied by adding to it a function {{math|''δf''}}, and the resulting integrand {{math|''L''(''x'', ''f'' +''δf'', ''f'' ′+''δf'' ′)}} is expanded in powers of {{math|''δf''}}, then the change in the value of {{math|''J''}} to first order in {{math|''δf''}} can be expressed as follows:<ref name="GiaquintaHildebrandtP18" /><ref group="Note">According to {{Harvp|Giaquinta|Hildebrandt|1996|p=18}}, this notation is customary in [[Physics|physical]] literature.</ref> | ||
<math display="block">\begin{align} | <math display="block">\begin{align} | ||
\delta J &= \int_a^b \left( \frac{\partial L}{\partial f} \delta f(x) + \frac{\partial L}{\partial f'} \frac{d}{dx} \delta f(x) \right) \, dx \, \\[1ex] | \delta J &= \int_a^b \left( \frac{\partial L}{\partial f} \delta f(x) + \frac{\partial L}{\partial f'} \frac{d}{dx} \delta f(x) \right) \, dx \, \\[1ex] | ||
| Line 15: | Line 15: | ||
==Definition== | ==Definition== | ||
In this section, the functional differential (or variation or first variation)< | In this section, the functional differential (or variation or first variation)<ref group="Note">Called ''first variation'' in {{harv|Giaquinta|Hildebrandt|1996|p=3}}, ''variation'' or ''first variation'' in {{harv|Courant|Hilbert|1953|p=186}}, ''variation'' or ''differential'' in {{harv|Gelfand|Fomin|2000|loc= p. 11, § 3.2}} and ''differential'' in {{harv|Parr|Yang|1989|p=246}}.</ref> is defined. Then the functional derivative is defined in terms of the functional differential. | ||
===Functional differential=== | ===Functional differential=== | ||
| Line 37: | Line 37: | ||
</math> | </math> | ||
Note that this notion of the functional differential can even be defined without a norm. | Note that this notion of the functional differential can even be defined without a norm. | ||
In a more general case the [[function space]] <math> | |||
B | |||
</math> appearing as the domain of <math>F</math> is not a vector space, | |||
and therefore variations of the form <math>\rho + \varepsilon \phi</math> do not make sense. | |||
In this case we consider a variation <math>\alpha_{?} : (-\varepsilon_0, \varepsilon_0) \to B</math> of <math>\rho</math> to be a <math>C^1</math>-family of functions such that <math>\alpha_0 = \rho</math>.<ref group="Note">cf. [[homotopy]].</ref> | |||
Denoting the space of all such variations as <math>\mathcal V_\rho</math>, the functional differential <math>\delta F[\rho] : \mathcal V_\rho \to \mathbb R</math> is the functional | |||
<math display="block"> | |||
\begin{align} | |||
\delta F[\rho;\alpha] = \delta F[\rho][\alpha] = \lim_{ \epsilon \to 0 } \frac{F[\alpha_{\epsilon}] - F[\rho]}{\epsilon} = F[\alpha_{?}]'(0) | |||
\end{align} | |||
</math> | |||
where <math> | |||
F[\alpha_?](\epsilon) = F[\alpha_\epsilon] | |||
</math>. The above then becomes the special case <math> | |||
\alpha_\epsilon = \rho + \epsilon \eta | |||
</math>.<ref>{{Cite web |last=Terek |first=Ivo |date=2019-06-12 |title=Introductory Variational Calculus on Manifolds |url=https://web.williams.edu/Mathematics/it3/texts/var_noether.pdf |url-status=live |access-date=2025-11-01 |format=PDF}}</ref> | |||
===Functional derivative=== | ===Functional derivative=== | ||
| Line 49: | Line 69: | ||
If this is the case and, moreover, <math>\delta F[\rho,\phi]</math> can be written as the integral of <math>\phi</math> times another function (denoted {{math|''δF''/''δρ''}}) | If this is the case and, moreover, <math>\delta F[\rho,\phi]</math> can be written as the integral of <math>\phi</math> times another function (denoted {{math|''δF''/''δρ''}}) | ||
<math display="block">\delta F [\rho, \phi] = \int_\Omega \frac {\delta F} {\delta \rho}(x) \ \phi(x) \ dx</math> | <math display="block">\delta F [\rho, \phi] = \int_\Omega \frac {\delta F} {\delta \rho}(x) \ \phi(x) \ dx</math> | ||
then this function {{math|''δF''/''δρ''}} is called the '''functional derivative''' of {{math|''F''}} at {{math|''ρ''}}.<ref name=ParrYangP246A.2>{{harvp|Parr|Yang|1989|loc= p. 246, Eq. A.2}}.</ref><ref name=GreinerReinhardtP36.2>{{harvp|Greiner|Reinhardt|1996|p=36,37}}.</ref> If <math>F</math> is restricted to only certain functions <math>\rho</math> (for example, if there are some boundary conditions imposed) then <math>\phi</math> is restricted to | then this function {{math|''δF''/''δρ''}} is called the '''functional derivative''' of {{math|''F''}} at {{math|''ρ''}}.<ref name="ParrYangP246A.2">{{harvp|Parr|Yang|1989|loc= p. 246, Eq. A.2}}.</ref><ref name="GreinerReinhardtP36.2">{{harvp|Greiner|Reinhardt|1996|p=36,37}}.</ref> If <math>F</math> is restricted to only certain functions <math>\rho</math> (for example, if there are some boundary conditions imposed) then <math>\phi</math> is restricted to functions such that <math>\rho+\varepsilon\phi</math> continues to satisfy these conditions. | ||
Heuristically, <math>\phi</math> is the change in <math>\rho</math>, so we 'formally' have <math>\phi = \delta\rho</math>, and then this is similar in form to the [[total differential]] of a function <math>F(\rho_1,\rho_2,\dots,\rho_n)</math>, | Heuristically, <math>\phi</math> is the change in <math>\rho</math>, so we 'formally' have <math>\phi = \delta\rho</math>, and then this is similar in form to the [[total differential]] of a function <math>F(\rho_1,\rho_2,\dots,\rho_n)</math>, | ||
<math display="block"> dF = \sum_{i=1} ^n \frac {\partial F} {\partial \rho_i} \ d\rho_i ,</math> | <math display="block"> dF = \sum_{i=1} ^n \frac {\partial F} {\partial \rho_i} \ d\rho_i ,</math> | ||
where <math>\rho_1,\rho_2,\dots,\rho_n</math> are independent variables. | where <math>\rho_1,\rho_2,\dots,\rho_n</math> are independent variables. | ||
Comparing the last two equations, the functional derivative <math>\delta F/\delta\rho(x)</math> has a role similar to that of the partial derivative <math>\partial F/\partial\rho_i</math>, where the variable of integration <math>x</math> is like a continuous version of the summation index <math>i</math>.<ref name=ParrYangP246>{{harvp|Parr|Yang|1989|p=246}}.</ref> One thinks of {{math|''δF''/''δρ''}} as the gradient of {{math|''F''}} at the point {{math|''ρ''}}, so the value {{math|''δF''/''δρ(x)''}} measures how much the functional {{math|''F''}} will change if the function {{math|''ρ''}} is changed at the point {{math|''x''}}. Hence the formula | Comparing the last two equations, the functional derivative <math>\delta F/\delta\rho(x)</math> has a role similar to that of the partial derivative <math>\partial F/\partial\rho_i</math>, where the variable of integration <math>x</math> is like a continuous version of the summation index <math>i</math>.<ref name="ParrYangP246">{{harvp|Parr|Yang|1989|p=246}}.</ref> One thinks of {{math|''δF''/''δρ''}} as the gradient of {{math|''F''}} at the point {{math|''ρ''}}, so the value {{math|''δF''/''δρ(x)''}} measures how much the functional {{math|''F''}} will change if the function {{math|''ρ''}} is changed at the point {{math|''x''}}. Hence the formula | ||
<math display="block">\int \frac{\delta F}{\delta\rho}(x) \phi(x) \; dx</math> | <math display="block">\int \frac{\delta F}{\delta\rho}(x) \phi(x) \; dx</math> | ||
is regarded as the directional derivative at point <math>\rho</math> in the direction of <math>\phi</math>. This is analogous to vector calculus, where the inner product of a vector <math>v</math> with the gradient gives the directional derivative in the direction of <math>v</math>. | is regarded as the directional derivative at point <math>\rho</math> in the direction of <math>\phi</math>. This is analogous to vector calculus, where the inner product of a vector <math>v</math> with the gradient gives the directional derivative in the direction of <math>v</math>. | ||
| Line 64: | Line 84: | ||
is introduced. | is introduced. | ||
</ref> | </ref> | ||
* Linearity:<ref name=ParrYangP247A.3>{{harvp|Parr|Yang|1989|loc= p. 247, Eq. A.3}}.</ref> <math display="block">\frac{\delta(\lambda F + \mu G)[\rho ]}{\delta \rho(x)} = \lambda \frac{\delta F[\rho]}{\delta \rho(x)} + \mu \frac{\delta G[\rho]}{\delta \rho(x)},</math> where {{math|''λ'', ''μ''}} are constants. | * Linearity:<ref name="ParrYangP247A.3">{{harvp|Parr|Yang|1989|loc= p. 247, Eq. A.3}}.</ref> <math display="block">\frac{\delta(\lambda F + \mu G)[\rho ]}{\delta \rho(x)} = \lambda \frac{\delta F[\rho]}{\delta \rho(x)} + \mu \frac{\delta G[\rho]}{\delta \rho(x)},</math> where {{math|''λ'', ''μ''}} are constants. | ||
* Product rule:<ref name=ParrYangP247A.4>{{harvp|Parr|Yang|1989|loc= p. 247, Eq. A.4}}.</ref> <math display="block">\frac{\delta(FG)[\rho]}{\delta \rho(x)} = \frac{\delta F[\rho]}{\delta \rho(x)} G[\rho] + F[\rho] \frac{\delta G[\rho]}{\delta \rho(x)} \, , </math> | * Product rule:<ref name="ParrYangP247A.4">{{harvp|Parr|Yang|1989|loc= p. 247, Eq. A.4}}.</ref> <math display="block">\frac{\delta(FG)[\rho]}{\delta \rho(x)} = \frac{\delta F[\rho]}{\delta \rho(x)} G[\rho] + F[\rho] \frac{\delta G[\rho]}{\delta \rho(x)} \, , </math> | ||
* Chain rules: | * Chain rules: | ||
**If {{math|''F''}} is a functional and {{math|''G''}} another functional, then<ref>{{harvp|Greiner|Reinhardt|1996|loc=p. 38, Eq. 6}}.</ref> <math display="block">\frac{\delta F[G[\rho]] }{\delta\rho(y)} = \int dx \frac{\delta F[G]}{\delta G(x)}_{G = G[\rho]}\cdot\frac {\delta G[\rho](x)} {\delta\rho(y)} \ . </math> | **If {{math|''F''}} is a functional and {{math|''G''}} another functional, then<ref>{{harvp|Greiner|Reinhardt|1996|loc=p. 38, Eq. 6}}.</ref> <math display="block">\frac{\delta F[G[\rho]] }{\delta\rho(y)} = \int dx \frac{\delta F[G]}{\delta G(x)}_{G = G[\rho]}\cdot\frac {\delta G[\rho](x)} {\delta\rho(y)} \ . </math> | ||
| Line 109: | Line 129: | ||
In the last two equations, the {{math|''n<sup>i</sup>''}} components of the tensor <math> \frac{\partial f}{\partial\left(\nabla^{(i)}\rho\right)} </math> are partial derivatives of {{math|''f''}} with respect to partial derivatives of ''ρ'', | In the last two equations, the {{math|''n<sup>i</sup>''}} components of the tensor <math> \frac{\partial f}{\partial\left(\nabla^{(i)}\rho\right)} </math> are partial derivatives of {{math|''f''}} with respect to partial derivatives of ''ρ'', | ||
<math display="block"> \left [ \frac {\partial f} {\partial \left (\nabla^{(i)}\rho \right ) } \right ]_{\alpha_1 \alpha_2 \cdots \alpha_i} = \frac {\partial f} {\partial \rho_{\alpha_1 \alpha_2 \cdots \alpha_i} } | <math display="block"> \left [ \frac {\partial f} {\partial \left (\nabla^{(i)}\rho \right ) } \right ]_{\alpha_1 \alpha_2 \cdots \alpha_i} = \frac {\partial f} {\partial \rho_{\alpha_1 \alpha_2 \cdots \alpha_i} } </math> | ||
where <math> | where <math> \rho_{\alpha_1 \alpha_2 \cdots \alpha_i} \equiv \frac {\partial^{\,i}\rho} {\partial r_{\alpha_1} \, \partial r_{\alpha_2} \cdots \partial r_{\alpha_i} } </math>, and the tensor scalar product is, | ||
<math display="block"> \nabla^{(i)} \cdot \frac{\partial f}{\partial\left(\nabla^{(i)}\rho\right)} = \sum_{\alpha_1, \alpha_2, \cdots, \alpha_i = 1}^n \ \frac {\partial^{\, i} } {\partial r_{\alpha_1} \, \partial r_{\alpha_2} \cdots \partial r_{\alpha_i} } \ \frac {\partial f} {\partial \rho_{\alpha_1 \alpha_2 \cdots \alpha_i} } \ . </math> <ref group="Note">For example, for the case {{math|1=''n'' = 3}} and {{math|1=''i'' = 2}}, the tensor scalar product is, | <math display="block"> \nabla^{(i)} \cdot \frac{\partial f}{\partial\left(\nabla^{(i)}\rho\right)} = \sum_{\alpha_1, \alpha_2, \cdots, \alpha_i = 1}^n \ \frac {\partial^{\, i} } {\partial r_{\alpha_1} \, \partial r_{\alpha_2} \cdots \partial r_{\alpha_i} } \ \frac {\partial f} {\partial \rho_{\alpha_1 \alpha_2 \cdots \alpha_i} } \ . </math> <ref group="Note">For example, for the case {{math|1=''n'' = 3}} and {{math|1=''i'' = 2}}, the tensor scalar product is, | ||
<math display="block"> \nabla^{(2)} \cdot \frac{\partial f}{\partial\left(\nabla^{(2)}\rho\right)} = \sum_{\alpha, \beta = 1}^3 \ \frac {\partial^{\, 2} } {\partial r_{\alpha} \, \partial r_{\beta} } \, \frac {\partial f} {\partial \rho_{\alpha \beta} } , </math>where <math>\rho_{\alpha \beta} \equiv \frac {\partial^{\, 2}\rho} {\partial r_{\alpha} \, \partial r_{\beta} }</math>.</ref> | <math display="block"> \nabla^{(2)} \cdot \frac{\partial f}{\partial\left(\nabla^{(2)}\rho\right)} = \sum_{\alpha, \beta = 1}^3 \ \frac {\partial^{\, 2} } {\partial r_{\alpha} \, \partial r_{\beta} } \, \frac {\partial f} {\partial \rho_{\alpha \beta} } , </math>where <math>\rho_{\alpha \beta} \equiv \frac {\partial^{\, 2}\rho} {\partial r_{\alpha} \, \partial r_{\beta} }</math>.</ref> | ||
| Line 119: | Line 139: | ||
The [[Thomas–Fermi model]] of 1927 used a kinetic energy functional for a noninteracting uniform [[free electron model|electron gas]] in a first attempt of [[density-functional theory]] of electronic structure: | The [[Thomas–Fermi model]] of 1927 used a kinetic energy functional for a noninteracting uniform [[free electron model|electron gas]] in a first attempt of [[density-functional theory]] of electronic structure: | ||
<math display="block">T_\mathrm{TF}[\rho] = C_\mathrm{F} \int \rho^{5/3}(\mathbf{r}) \, d\mathbf{r} \, .</math> | <math display="block">T_\mathrm{TF}[\rho] = C_\mathrm{F} \int \rho^{5/3}(\mathbf{r}) \, d\mathbf{r} \, .</math> | ||
Since the integrand of {{math|''T''<sub>TF</sub>[''ρ'']}} does not involve derivatives of {{math|''ρ''('''''r''''')}}, the functional derivative of {{math|''T''<sub>TF</sub>[''ρ'']}} is,<ref name=ParrYangP247A.6>{{harvp|Parr|Yang|1989|loc=p. 247, Eq. A.6}}.</ref> | Since the integrand of {{math|''T''<sub>TF</sub>[''ρ'']}} does not involve derivatives of {{math|''ρ''('''''r''''')}}, the functional derivative of {{math|''T''<sub>TF</sub>[''ρ'']}} is,<ref name="ParrYangP247A.6">{{harvp|Parr|Yang|1989|loc=p. 247, Eq. A.6}}.</ref> | ||
<math display="block">\frac{\delta T_{\mathrm{TF}}}{\delta \rho (\boldsymbol{r}) } | <math display="block">\frac{\delta T_{\mathrm{TF}}}{\delta \rho (\boldsymbol{r}) } | ||
= C_\mathrm{F} \frac{\partial \rho^{5/3}(\mathbf{r})}{\partial \rho(\mathbf{r})} | = C_\mathrm{F} \frac{\partial \rho^{5/3}(\mathbf{r})}{\partial \rho(\mathbf{r})} | ||
| Line 148: | Line 168: | ||
The first and second terms on the right hand side of the last equation are equal, since {{math|'''''r'''''}} and {{math|'''''r′'''''}} in the second term can be interchanged without changing the value of the integral. Therefore, | The first and second terms on the right hand side of the last equation are equal, since {{math|'''''r'''''}} and {{math|'''''r′'''''}} in the second term can be interchanged without changing the value of the integral. Therefore, | ||
<math display="block"> \int \frac{\delta J}{\delta\rho(\boldsymbol{r})} \phi(\boldsymbol{r})d\boldsymbol{r} = \int \left ( \int \frac {\rho(\boldsymbol{r}') }{| \boldsymbol{r}-\boldsymbol{r}' |} d\boldsymbol{r}' \right ) \phi(\boldsymbol{r}) d\boldsymbol{r} </math> | <math display="block"> \int \frac{\delta J}{\delta\rho(\boldsymbol{r})} \phi(\boldsymbol{r})d\boldsymbol{r} = \int \left ( \int \frac {\rho(\boldsymbol{r}') }{| \boldsymbol{r}-\boldsymbol{r}' |} d\boldsymbol{r}' \right ) \phi(\boldsymbol{r}) d\boldsymbol{r} </math> | ||
and the functional derivative of the electron-electron Coulomb potential energy functional {{math|''J''}}[''ρ''] is,<ref name=ParrYangP248A.11>{{harvp|Parr|Yang|1989|loc=p. 248, Eq. A.11}}.</ref> | and the functional derivative of the electron-electron Coulomb potential energy functional {{math|''J''}}[''ρ''] is,<ref name="ParrYangP248A.11">{{harvp|Parr|Yang|1989|loc=p. 248, Eq. A.11}}.</ref> | ||
<math display="block"> \frac{\delta J}{\delta\rho(\boldsymbol{r})} = \int \frac {\rho(\boldsymbol{r}') }{| \boldsymbol{r}-\boldsymbol{r}' |} d\boldsymbol{r}' \, . </math> | <math display="block"> \frac{\delta J}{\delta\rho(\boldsymbol{r})} = \int \frac {\rho(\boldsymbol{r}') }{| \boldsymbol{r}-\boldsymbol{r}' |} d\boldsymbol{r}' \, . </math> | ||
| Line 165: | Line 185: | ||
& = -\frac{1}{8}\frac{\nabla\rho \cdot \nabla\rho}{\rho^2} - \left ( \frac {1}{4} \frac {\nabla^2\rho} {\rho} - \frac {1}{4} \frac {\nabla\rho \cdot \nabla\rho} {\rho^2} \right ) \qquad \text{where} \ \ \nabla^2 = \nabla \cdot \nabla \ , | & = -\frac{1}{8}\frac{\nabla\rho \cdot \nabla\rho}{\rho^2} - \left ( \frac {1}{4} \frac {\nabla^2\rho} {\rho} - \frac {1}{4} \frac {\nabla\rho \cdot \nabla\rho} {\rho^2} \right ) \qquad \text{where} \ \ \nabla^2 = \nabla \cdot \nabla \ , | ||
\end{align}</math> | \end{align}</math> | ||
and the result is,<ref name=ParrYangP247A.9>{{harvp|Parr|Yang|1989|loc= p. 247, Eq. A.9}}.</ref> | and the result is,<ref name="ParrYangP247A.9">{{harvp|Parr|Yang|1989|loc= p. 247, Eq. A.9}}.</ref> | ||
<math display="block"> \frac{\delta T_\mathrm{W}}{\delta \rho} = \ \ \, \frac{1}{8}\frac{\nabla\rho \cdot \nabla\rho}{\rho^2} - \frac{1}{4}\frac{\nabla^2\rho}{\rho} \ . </math> | <math display="block"> \frac{\delta T_\mathrm{W}}{\delta \rho} = \ \ \, \frac{1}{8}\frac{\nabla\rho \cdot \nabla\rho}{\rho^2} - \frac{1}{4}\frac{\nabla^2\rho}{\rho} \ . </math> | ||
Latest revision as of 03:49, 1 November 2025
Template:Short description In the calculus of variations, a field of mathematical analysis, the functional derivative (or variational derivative)[1] relates a change in a functional (a functional in this sense is a function that acts on functions) to a change in a function on which the functional depends.
In the calculus of variations, functionals are usually expressed in terms of an integral of functions, their arguments, and their derivatives. In an integrand LScript error: No such module "Check for unknown parameters". of a functional, if a function fScript error: No such module "Check for unknown parameters". is varied by adding to it another function δfScript error: No such module "Check for unknown parameters". that is arbitrarily small, and the resulting integrand is expanded in powers of δfScript error: No such module "Check for unknown parameters"., the coefficient of δfScript error: No such module "Check for unknown parameters". in the first order term is called the functional derivative.
For example, consider the functional where f ′(x) ≡ df/dxScript error: No such module "Check for unknown parameters".. If fScript error: No such module "Check for unknown parameters". is varied by adding to it a function δfScript error: No such module "Check for unknown parameters"., and the resulting integrand L(x, f +δf, f ′+δf ′)Script error: No such module "Check for unknown parameters". is expanded in powers of δfScript error: No such module "Check for unknown parameters"., then the change in the value of JScript error: No such module "Check for unknown parameters". to first order in δfScript error: No such module "Check for unknown parameters". can be expressed as follows:[1][Note 1] where the variation in the derivative, δf ′Script error: No such module "Check for unknown parameters". was rewritten as the derivative of the variation (δf) ′Script error: No such module "Check for unknown parameters"., and integration by parts was used in these derivatives.
Definition
In this section, the functional differential (or variation or first variation)[Note 2] is defined. Then the functional derivative is defined in terms of the functional differential.
Functional differential
Suppose is a Banach space and is a functional defined on . The differential of at a point is the linear functional on defined[2] by the condition that, for all , where is a real number that depends on in such a way that as . This means that is the Fréchet derivative of at .
However, this notion of functional differential is so strong it may not exist,[3] and in those cases a weaker notion, like the Gateaux derivative is preferred. In many practical cases, the functional differential is defined[4] as the directional derivative Note that this notion of the functional differential can even be defined without a norm.
In a more general case the function space appearing as the domain of is not a vector space, and therefore variations of the form do not make sense. In this case we consider a variation of to be a -family of functions such that .[Note 3] Denoting the space of all such variations as , the functional differential is the functional
where . The above then becomes the special case .[5]
Functional derivative
In many applications, the domain of the functional is a space of differentiable functions defined on some space and is of the form for some function that may depend on , the value and the derivative . If this is the case and, moreover, can be written as the integral of times another function (denoted δF/δρScript error: No such module "Check for unknown parameters".) then this function δF/δρScript error: No such module "Check for unknown parameters". is called the functional derivative of FScript error: No such module "Check for unknown parameters". at ρScript error: No such module "Check for unknown parameters"..[6][7] If is restricted to only certain functions (for example, if there are some boundary conditions imposed) then is restricted to functions such that continues to satisfy these conditions.
Heuristically, is the change in , so we 'formally' have , and then this is similar in form to the total differential of a function , where are independent variables. Comparing the last two equations, the functional derivative has a role similar to that of the partial derivative , where the variable of integration is like a continuous version of the summation index .[8] One thinks of δF/δρScript error: No such module "Check for unknown parameters". as the gradient of FScript error: No such module "Check for unknown parameters". at the point ρScript error: No such module "Check for unknown parameters"., so the value δF/δρ(x)Script error: No such module "Check for unknown parameters". measures how much the functional FScript error: No such module "Check for unknown parameters". will change if the function ρScript error: No such module "Check for unknown parameters". is changed at the point xScript error: No such module "Check for unknown parameters".. Hence the formula is regarded as the directional derivative at point in the direction of . This is analogous to vector calculus, where the inner product of a vector with the gradient gives the directional derivative in the direction of .
Properties
Like the derivative of a function, the functional derivative satisfies the following properties, where F[ρ]Script error: No such module "Check for unknown parameters". and G[ρ]Script error: No such module "Check for unknown parameters". are functionals:[Note 4]
- Linearity:[9] where λ, μScript error: No such module "Check for unknown parameters". are constants.
- Product rule:[10]
- Chain rules:
- If FScript error: No such module "Check for unknown parameters". is a functional and GScript error: No such module "Check for unknown parameters". another functional, then[11]
- If GScript error: No such module "Check for unknown parameters". is an ordinary differentiable function (local functional) gScript error: No such module "Check for unknown parameters"., then this reduces to[12]
Determining functional derivatives
A formula to determine functional derivatives for a common class of functionals can be written as the integral of a function and its derivatives. This is a generalization of the Euler–Lagrange equation: indeed, the functional derivative was introduced in physics within the derivation of the Lagrange equation of the second kind from the principle of least action in Lagrangian mechanics (18th century). The first three examples below are taken from density functional theory (20th century), the fourth from statistical mechanics (19th century).
Formula
Given a functional and a function that vanishes on the boundary of the region of integration, from a previous section Definition,
The second line is obtained using the total derivative, where ∂f /∂∇ρScript error: No such module "Check for unknown parameters". is a derivative of a scalar with respect to a vector.[Note 5]
The third line was obtained by use of a product rule for divergence. The fourth line was obtained using the divergence theorem and the condition that on the boundary of the region of integration. Since is also an arbitrary function, applying the fundamental lemma of calculus of variations to the last line, the functional derivative is
where ρ = ρ(r)Script error: No such module "Check for unknown parameters". and f = f (r, ρ, ∇ρ)Script error: No such module "Check for unknown parameters".. This formula is for the case of the functional form given by F[ρ]Script error: No such module "Check for unknown parameters". at the beginning of this section. For other functional forms, the definition of the functional derivative can be used as the starting point for its determination. (See the example Coulomb potential energy functional.)
The above equation for the functional derivative can be generalized to the case that includes higher dimensions and higher order derivatives. The functional would be,
where the vector r ∈ RnScript error: No such module "Check for unknown parameters"., and ∇(i)Script error: No such module "Check for unknown parameters". is a tensor whose niScript error: No such module "Check for unknown parameters". components are partial derivative operators of order iScript error: No such module "Check for unknown parameters"., [Note 6]
An analogous application of the definition of the functional derivative yields
In the last two equations, the niScript error: No such module "Check for unknown parameters". components of the tensor are partial derivatives of fScript error: No such module "Check for unknown parameters". with respect to partial derivatives of ρ, where , and the tensor scalar product is, [Note 7]
Examples
Thomas–Fermi kinetic energy functional
The Thomas–Fermi model of 1927 used a kinetic energy functional for a noninteracting uniform electron gas in a first attempt of density-functional theory of electronic structure: Since the integrand of TTF[ρ]Script error: No such module "Check for unknown parameters". does not involve derivatives of ρ(r)Script error: No such module "Check for unknown parameters"., the functional derivative of TTF[ρ]Script error: No such module "Check for unknown parameters". is,[13]
Coulomb potential energy functional
The electron-nucleus potential energy is
Applying the definition of functional derivative, So,
The functional derivative of the classical part of the electron-electron interaction (often called Hartree energy) is From the definition of the functional derivative, The first and second terms on the right hand side of the last equation are equal, since rScript error: No such module "Check for unknown parameters". and r′Script error: No such module "Check for unknown parameters". in the second term can be interchanged without changing the value of the integral. Therefore, and the functional derivative of the electron-electron Coulomb potential energy functional JScript error: No such module "Check for unknown parameters".[ρ] is,[14]
The second functional derivative is
von Weizsäcker kinetic energy functional
In 1935 von Weizsäcker proposed to add a gradient correction to the Thomas-Fermi kinetic energy functional to make it better suit a molecular electron cloud: where Using a previously derived formula for the functional derivative, and the result is,[15]
Entropy
The entropy of a discrete random variable is a functional of the probability mass function.
Thus, Thus,
Exponential
Let
Using the delta function as a test function,
Thus,
This is particularly useful in calculating the correlation functions from the partition function in quantum field theory.
Functional derivative of a function
A function can be written in the form of an integral like a functional. For example, Since the integrand does not depend on derivatives of ρ, the functional derivative of ρ(r)Script error: No such module "Check for unknown parameters". is,
Functional derivative of iterated function
The functional derivative of the iterated function is given by: and
In general:
Putting in N = 0Script error: No such module "Check for unknown parameters". gives:
Using the delta function as a test function
In physics, it is common to use the Dirac delta function in place of a generic test function , for yielding the functional derivative at the point (this is a point of the whole functional derivative as a partial derivative is a component of the gradient):[16]
This works in cases when formally can be expanded as a series (or at least up to first order) in . The formula is however not mathematically rigorous, since is usually not even defined.
The definition given in a previous section is based on a relationship that holds for all test functions , so one might think that it should hold also when is chosen to be a specific function such as the delta function. However, the latter is not a valid test function (it is not even a proper function).
In the definition, the functional derivative describes how the functional changes as a result of a small change in the entire function . The particular form of the change in is not specified, but it should stretch over the whole interval on which is defined. Employing the particular form of the perturbation given by the delta function has the meaning that is varied only in the point . Except for this point, there is no variation in .
Notes
<templatestyles src="Reflist/styles.css" />
- ↑ According to Template:Harvp, this notation is customary in physical literature.
- ↑ Called first variation in Script error: No such module "Footnotes"., variation or first variation in Script error: No such module "Footnotes"., variation or differential in Script error: No such module "Footnotes". and differential in Script error: No such module "Footnotes"..
- ↑ cf. homotopy.
- ↑ Here the notation is introduced.
- ↑ For a three-dimensional Cartesian coordinate system, where and , , are unit vectors along the x, y, z axes.
- ↑ For example, for the case of three dimensions (n = 3Script error: No such module "Check for unknown parameters".) and second order derivatives (i = 2Script error: No such module "Check for unknown parameters".), the tensor ∇(2)Script error: No such module "Check for unknown parameters". has components, where and can be .
- ↑ For example, for the case n = 3Script error: No such module "Check for unknown parameters". and i = 2Script error: No such module "Check for unknown parameters"., the tensor scalar product is, where .
Script error: No such module "Check for unknown parameters".
Footnotes
<templatestyles src="Reflist/styles.css" />
- ↑ a b Template:Harvp
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Script error: No such module "citation/CS1".
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp.
- ↑ Template:Harvp
Script error: No such module "Check for unknown parameters".
References
- Script error: No such module "citation/CS1"..
- Script error: No such module "citation/CS1"..
- Script error: No such module "citation/CS1"..
- Script error: No such module "citation/CS1"..
- Script error: No such module "citation/CS1"..
- Script error: No such module "citation/CS1".
External links
Template:Functional analysis Template:Analysis in topological vector spaces