imported>L Dimitrova: /* growthexperiments-addlink-summary-summary:2|0|0 */

2025-02-08T18:40:47Z

growthexperiments-addlink-summary-summary:2|0|0

New page

{{Short description|Error-correcting code}}
{{infobox code
| name = Binary Justesen Codes
| image =
| image_caption =
| namesake = Jørn Justesen
| type = [[Linear block code]]
| block_length = <math>n</math>
| message_length = <math>k</math>
| rate = =<math>\frac{R}{2}=\frac{k}{2n}</math>
| distance = <math>\delta n</math> where <math>\delta\geq \Big(1-R-\epsilon\Big) H^{-1}_2\big(\frac{1}{2}-\epsilon\big) \sim 0.11(1-R-\epsilon)</math> for small <math>\epsilon>0</math>.
| alphabet_size = 2
| notation = <math>\left[ n, k/2, \delta n \right]_2</math>-code
| properties = constant rate, constant relative distance, constant alphabet size
}}
In [[coding theory]], '''Justesen codes''' form a class of [[Error detection and correction|error-correcting codes]] that have a constant rate, constant relative distance, and a constant alphabet size.

Before the Justesen error correction code was discovered, no error correction code was known that had all of these three parameters as a constant.

Subsequently, other ECC codes with this property have been discovered, for example [[expander code]]s.
These codes have important applications in [[computer science]] such as in the construction of [[small-bias sample space]]s.

Justesen codes are derived as the [[Concatenated error correction code|code concatenation]] of a [[Reed–Solomon error correction|Reed–Solomon code]] and the [[Wozencraft ensemble]].

The Reed–Solomon codes used achieve constant rate and constant relative distance at the expense of an alphabet size that is ''linear'' in the message length.

The [[Wozencraft ensemble]] is a family of codes that achieve constant rate and constant alphabet size, but the relative distance is only constant for most of the codes in the family.

The concatenation of the two codes first encodes the message using the Reed–Solomon code, and then encodes each symbol of the codeword further using a code from the [[Wozencraft ensemble]] – using a different code of the ensemble at each position of the codeword.

This is different from usual code concatenation where the inner codes are the same for each position. The Justesen code can be constructed very efficiently using only [[logarithmic space]].

==Definition==

The Justesen code is the concatenation of an <math>(N,K,D)_{q^k}</math> outer code <math>C_{out}</math> and different <math>(n,k,d)_q</math> inner codes <math>C_{in}^i</math>, for<math>1 \le i \le N</math>.

More precisely, the concatenation of these codes, denoted by <math>C_{out} \circ (C_{in}^1 ,...,C_{in}^N )</math>, is defined as follows. Given a message <math>m \in [q^k]^K</math>, we compute the codeword produced by an outer code <math>C_{out}</math>: <math>C_{out}(m) = (c_1,c_2,..,c_N)</math>.

Then we apply each code of N linear inner codes to each coordinate of that codeword to produce the final codeword; that is, <math>C_{out} \circ (C_{in}^1,..,C_{in}^N)(m) = (C_{in}^1(c_1),C_{in}^2(c_2),..,C_{in}^N(c_N))</math>.

Look back to the definition of the outer code and linear inner codes, this definition of the Justesen code makes sense because the codeword of the outer code is a vector with <math>N</math> elements, and we have <math>N</math> linear inner codes to apply for those <math>N</math> elements.

Here for the Justesen code, the outer code <math>C_{out}</math> is chosen to be [[Reed–Solomon error correction|Reed Solomon code]] over a [[Field (mathematics)|field]] <math>\mathbb{F}_{q^k}</math> evaluated over <math>\mathbb{F}_{q^k}-\{ 0 \}</math> of [[Code rate|rate]] <math>R</math>, <math>0</math> < <math>R</math> < <math>1</math>.

The outer code <math>C_{out}</math> have the relative distance <math>\delta_{out} = 1 - R</math> and block length of <math>N = q^k-1</math>. The set of inner codes is the [[Wozencraft ensemble]] <math>\{ C_{in}^\alpha \} _{\alpha \in \mathbb{F}_{q^k }^* }</math>.

==Property of Justesen code==

As the linear codes in the Wonzencraft ensemble have the rate <math>\frac{1}{2}</math>, Justesen code is the concatenated code <math>C^* = C_{out} \circ (C_{in}^1,C_{in}^2,..,C_{in}^N)</math> with the rate <math>\frac{R}{2}</math>. We have the following theorem that estimates the distance of the concatenated code <math>C^*</math>.

==Theorem==

Let <math>\varepsilon > 0.</math> Then <math>C^*</math> has relative distance of at least <math>(1-R-\varepsilon)H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right).</math>

===Proof===

In order to prove a lower bound for the distance of a code <math>C^*</math> we prove that the [[Hamming distance]] of an arbitrary but distinct pair of codewords has a lower bound. So let <math>\Delta(c^1,c^2)</math> be the Hamming distance of two codewords <math>c^1</math> and <math>c^2</math>. For any given

:<math>m_1 \neq m_2 \in \left (\mathbb{F}_{q^k} \right )^K, </math>

we want a lower bound for <math>\Delta(C^*(m_1),C^*(m_2)).</math>

Notice that if <math>C_{out}(m) = (c_1,\cdots,c_N)</math>, then <math>C^*(m) = (C_{in}^1(c_1),\cdots,C_{in}^N(c_N))</math>. So for the lower bound <math>\Delta(C^*(m_1),C^*(m_2))</math>, we need to take into account the distance of <math>C_{in}^1, \cdots, C_{in}^N.</math>

Suppose

:<math>\begin{align}
C_{out}(m_1) &= \left (c_1^1,\cdots,c_N^1 \right ) \\
C_{out}(m_2) &= \left (c_1^2,\cdots,c_N^2 \right )
\end{align}</math>

Recall that <math>\left \{ C_{in}^1, \cdots, C_{in}^N \right \}</math> is a [[Wozencraft ensemble]]. Due to "Wonzencraft ensemble theorem", there are at least <math>(1-\varepsilon) N</math> linear codes <math>C_{in}^i</math> that have distance <math>H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right ) \cdot 2k.</math> So if for some <math>1 \leqslant i \leqslant N, c_i^1 \ne c_i^2</math> and the code <math>C_{in}^i</math> has distance <math>\geqslant H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right) \cdot 2k,</math> then

:<math>\Delta \left (C_{in}^i \left (c_i^1 \right), C_{in}^i \left (c_i^2 \right ) \right ) \geqslant H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right ) \cdot 2k.</math>

Further, if we have <math>T</math> numbers <math>1 \leqslant i \leqslant N</math> such that <math>c_i^1 \ne c_i^2</math> and the code <math>C_{in}^i</math> has distance <math>\geqslant H_q^{-1}(\tfrac{1}{2}-\varepsilon) \cdot 2k,</math> then

:<math>\Delta \left (C^*(m_1),C^*(m_2) \right ) \geqslant H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right ) \cdot 2k \cdot T.</math>

So now the final task is to find a lower bound for <math>T</math>. Define:

:<math> S = \left \{ i \ : \ 1 \leqslant i \leqslant N, c_i^1 \ne c_i^2 \right \}.</math>

Then <math>T</math> is the number of linear codes <math>C_{in}^i, i \in S</math> having the distance <math>H_q^{-1}\left (\tfrac{1}{2}-\varepsilon \right) \cdot 2k.</math>

Now we want to estimate <math>|S|.</math> Obviously <math>|S|= \Delta(C_{out}(m_1),C_{out}(m_2)) \geqslant (1-R)N</math>.

Due to the [[Wozencraft ensemble|Wozencraft Ensemble Theorem]], there are at most <math>\varepsilon N</math> linear codes having distance less than <math>H_q^{-1}(\tfrac{1}{2}-\varepsilon) \cdot 2k,</math> so

:<math>T \geqslant |S| - \varepsilon N \geqslant (1-R)N - \varepsilon N = (1-R-\varepsilon)N.</math>

Finally, we have

:<math>\Delta(C^*(m_1),C^*(m_2)) \geqslant H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right ) \cdot 2k \cdot T \geqslant H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right ) \cdot 2k \cdot (1-R-\varepsilon) \cdot N.</math>

This is true for any arbitrary <math>m_1 \ne m_2</math>. So <math>C^*</math> has the relative distance at least <math>(1-R-\varepsilon)H_q^{-1} \left (\tfrac{1}{2}-\varepsilon \right ),</math> which completes the proof.

==Comments==
We want to consider the "strongly explicit code". So the question is what the "strongly explicit code" is. Loosely speaking, for linear code, the "explicit" property is related to the complexity of constructing its generator matrix G.

That in effect means that we can compute the matrix in logarithmic space without using the brute force algorithm to verify that a code has a given satisfied distance.

For the other codes that are not linear, we can consider the complexity of the encoding algorithm.

So by far, we can see that the Wonzencraft ensemble and Reed-Solomon codes are strongly explicit. Therefore, we have the following result:

'''''Corollary:''''' The concatenated code <math>C^*</math> is an asymptotically good code(that is, rate <math>R</math> > 0 and relative distance <math>\delta</math> > 0 for small q) and has a strongly explicit construction.

==An example of a Justesen code==

The following slightly different code is referred to as the Justesen code in MacWilliams/MacWilliams. It is the particular case of the above-considered
Justesen code for a very particular Wonzencraft ensemble:

Let ''R'' be a Reed-Solomon code of length ''N'' = 2''m'' − 1, [[dimension (vector space)|rank]] ''K'' and minimum weight ''N'' − ''K'' + 1.

The symbols of ''R'' are elements of ''F'' = GF(2''m'') and the codewords are obtained by taking every polynomial &fnof; over ''F'' of degree less than ''K'' and listing the values of &fnof; on the non-zero elements of ''F'' in some predetermined order.

Let α be a [[primitive element (finite field)|primitive element]] of ''F''. For a codeword '''a''' = (''a''1, ..., ''a''''N'') from ''R'', let '''b''' be the vector of length 2''N'' over ''F'' given by

:<math> \mathbf{b} = \left( a_1, a_1, a_2, \alpha^1 a_2, \ldots, a_N, \alpha^{N-1} a_N \right) </math>

and let '''c''' be the vector of length 2''N'' ''m'' obtained from ''b'' by expressing each element of ''F'' as a binary vector of length ''m''. The ''Justesen code'' is the linear code containing all such '''c'''.

The parameters of this code are length 2''m'' ''N'', dimension ''m'' ''K'' and [[Block code|minimum distance]] at least

:<math> \sum_{i=1}^\ell i \binom{2m}{i} , </math>

where <math>\ell</math> is the greatest [[integer]] satisfying <math>\sum_{i=1}^\ell \binom{2m}{i}\leq N-K+1</math>. (See MacWilliams/MacWilliams for a proof.)

==See also==
* [[Concatenated error correction code]]
* [[Linear code]]
* [[Reed–Solomon error correction|Reed-Solomon error correction]]
* [[Wozencraft ensemble]]

==References==
* [https://web.archive.org/web/20100702120650/http://www.cse.buffalo.edu/~atri/courses/coding-theory/ Lecture 28: Justesen Code. Coding theory's course. Prof. Atri Rudra].
* [http://people.csail.mit.edu/madhu/FT02/ Lecture 6: Concatenated codes. Forney codes. Justesen codes. Essential Coding Theory].
* {{cite journal | author=J. Justesen | title=A class of constructive asymptotically good algebraic codes | journal=IEEE Trans. Inf. Theory | volume=18 | year=1972 | pages=652–656 | doi=10.1109/TIT.1972.1054893 | issue=5 }}
* {{cite book | author=F.J. MacWilliams | author-link=Jessie MacWilliams |author2=N.J.A. Sloane | title=The Theory of Error-Correcting Codes | url=https://archive.org/details/theoryoferrorcor0000macw | url-access=registration | publisher=North-Holland | year=1977 | isbn=0-444-85193-3 | pages=[https://archive.org/details/theoryoferrorcor0000macw/page/306 306–316] }}

[[Category:Error detection and correction]]
[[Category:Finite fields]]
[[Category:Coding theory]]

Justesen code - Revision history

imported>L Dimitrova: /* growthexperiments-addlink-summary-summary:2|0|0 */