A discrete cosine transform (DCT) expresses a finite sequence of data points in terms of a sum of cosine functions oscillating at different frequencies. DCTs are important to numerous applications in science and engineering, from lossy compression of audio (e.g. MP3) and images (e.g. JPEG) (where small highfrequency components can be discarded), to spectral methods for the numerical solution of partial differential equations. The use of cosine rather than sine functions is critical for compression, since it turns out (as described below) that fewer cosine functions are needed to approximate a typical signal, whereas for differential equations the cosines express a particular choice of boundary conditions.
In particular, a DCT is a Fourierrelated transform similar to the discrete Fourier transform (DFT), but using only real numbers. DCTs are equivalent to DFTs of roughly twice the length, operating on real data with even symmetry (since the Fourier transform of a real and even function is real and even), where in some variants the input and/or output data are shifted by half a sample. There are eight standard DCT variants, of which four are common.
The most common variant of discrete cosine transform is the typeII DCT, which is often called simply "the DCT",^{[1]}^{[2]} its inverse, the typeIII DCT, is correspondingly often called simply "the inverse DCT" or "the IDCT". Two related transforms are the discrete sine transform (DST), which is equivalent to a DFT of real and odd functions, and the modified discrete cosine transform (MDCT), which is based on a DCT of overlapping data.
Applications
The DCT, and in particular the DCTII, is often used in signal and image processing, especially for lossy data compression, because it has a strong "energy compaction" property:^{[1]}^{[2]} most of the signal information tends to be concentrated in a few lowfrequency components of the DCT, approaching the KarhunenLoève transform (which is optimal in the decorrelation sense) for signals based on certain limits of Markov processes. As explained below, this stems from the boundary conditions implicit in the cosine functions.
DCTII (bottom) compared to the
DFT (middle) of an input signal (top).
A related transform, the modified discrete cosine transform, or MDCT (based on the DCTIV), is used in AAC, Vorbis, WMA, and MP3 audio compression.
DCTs are also widely employed in solving partial differential equations by spectral methods, where the different variants of the DCT correspond to slightly different even/odd boundary conditions at the two ends of the array.
DCTs are also closely related to Chebyshev polynomials, and fast DCT algorithms (below) are used in Chebyshev approximation of arbitrary functions by series of Chebyshev polynomials, for example in Clenshaw–Curtis quadrature.
JPEG
The DCT is used in JPEG image compression, MJPEG, MPEG, DV, Daala, and Theora video compression. There, the twodimensional DCTII of N \times N blocks are computed and the results are quantized and entropy coded. In this case, N is typically 8 and the DCTII formula is applied to each row and column of the block. The result is an 8 × 8 transform coefficient array in which the (0,0) element (topleft) is the DC (zerofrequency) component and entries with increasing vertical and horizontal index values represent higher vertical and horizontal spatial frequencies.
Informal overview
Like any Fourierrelated transform, discrete cosine transforms (DCTs) express a function or a signal in terms of a sum of sinusoids with different frequencies and amplitudes. Like the discrete Fourier transform (DFT), a DCT operates on a function at a finite number of discrete data points. The obvious distinction between a DCT and a DFT is that the former uses only cosine functions, while the latter uses both cosines and sines (in the form of complex exponentials). However, this visible difference is merely a consequence of a deeper distinction: a DCT implies different boundary conditions than the DFT or other related transforms.
The Fourierrelated transforms that operate on a function over a finite domain, such as the DFT or DCT or a Fourier series, can be thought of as implicitly defining an extension of that function outside the domain. That is, once you write a function f(x) as a sum of sinusoids, you can evaluate that sum at any x, even for x where the original f(x) was not specified. The DFT, like the Fourier series, implies a periodic extension of the original function. A DCT, like a cosine transform, implies an even extension of the original function.
Illustration of the implicit even/odd extensions of DCT input data, for N=11 data points (red dots), for the four most common types of DCT (types IIV).
However, because DCTs operate on finite, discrete sequences, two issues arise that do not apply for the continuous cosine transform. First, one has to specify whether the function is even or odd at both the left and right boundaries of the domain (i.e. the minn and maxn boundaries in the definitions below, respectively). Second, one has to specify around what point the function is even or odd. In particular, consider a sequence abcd of four equally spaced data points, and say that we specify an even left boundary. There are two sensible possibilities: either the data are even about the sample a, in which case the even extension is dcbabcd, or the data are even about the point halfway between a and the previous point, in which case the even extension is dcbaabcd (a is repeated).
These choices lead to all the standard variations of DCTs and also discrete sine transforms (DSTs). Each boundary can be either even or odd (2 choices per boundary) and can be symmetric about a data point or the point halfway between two data points (2 choices per boundary), for a total of 2 × 2 × 2 × 2 = 16 possibilities. Half of these possibilities, those where the left boundary is even, correspond to the 8 types of DCT; the other half are the 8 types of DST.
These different boundary conditions strongly affect the applications of the transform and lead to uniquely useful properties for the various DCT types. Most directly, when using Fourierrelated transforms to solve partial differential equations by spectral methods, the boundary conditions are directly specified as a part of the problem being solved. Or, for the MDCT (based on the typeIV DCT), the boundary conditions are intimately involved in the MDCT's critical property of timedomain aliasing cancellation. In a more subtle fashion, the boundary conditions are responsible for the "energy compactification" properties that make DCTs useful for image and audio compression, because the boundaries affect the rate of convergence of any Fourierlike series.
In particular, it is well known that any discontinuities in a function reduce the rate of convergence of the Fourier series, so that more sinusoids are needed to represent the function with a given accuracy. The same principle governs the usefulness of the DFT and other transforms for signal compression: the smoother a function is, the fewer terms in its DFT or DCT are required to represent it accurately, and the more it can be compressed. (Here, we think of the DFT or DCT as approximations for the Fourier series or cosine series of a function, respectively, in order to talk about its "smoothness".) However, the implicit periodicity of the DFT means that discontinuities usually occur at the boundaries: any random segment of a signal is unlikely to have the same value at both the left and right boundaries. (A similar problem arises for the DST, in which the odd left boundary condition implies a discontinuity for any function that does not happen to be zero at that boundary.) In contrast, a DCT where both boundaries are even always yields a continuous extension at the boundaries (although the slope is generally discontinuous). This is why DCTs, and in particular DCTs of types I, II, V, and VI (the types that have two even boundaries) generally perform better for signal compression than DFTs and DSTs. In practice, a typeII DCT is usually preferred for such applications, in part for reasons of computational convenience.
Formal definition
Formally, the discrete cosine transform is a linear, invertible function f:\mathbb{R}^{N}\to\mathbb{R}^{N} (where \mathbb{R} denotes the set of real numbers), or equivalently an invertible N × N square matrix. There are several variants of the DCT with slightly modified definitions. The N real numbers x_{0}, ..., x_{N1} are transformed into the N real numbers X_{0}, ..., X_{N1} according to one of the formulas:
DCTI

X_k = \frac{1}{2} (x_0 + (1)^k x_{N1}) + \sum_{n=1}^{N2} x_n \cos \left[\frac{\pi}{N1} n k \right] \quad \quad k = 0, \dots, N1.
Some authors further multiply the x_{0} and x_{N1} terms by √2, and correspondingly multiply the X_{0} and X_{N1} terms by 1/√2. This makes the DCTI matrix orthogonal, if one further multiplies by an overall scale factor of \sqrt{2/(N1)}, but breaks the direct correspondence with a realeven DFT.
The DCTI is exactly equivalent (up to an overall scale factor of 2), to a DFT of 2N2 real numbers with even symmetry. For example, a DCTI of N=5 real numbers abcde is exactly equivalent to a DFT of eight real numbers abcdedcb (even symmetry), divided by two. (In contrast, DCT types IIIV involve a halfsample shift in the equivalent DFT.)
Note, however, that the DCTI is not defined for N less than 2. (All other DCT types are defined for any positive N.)
Thus, the DCTI corresponds to the boundary conditions: x_{n} is even around n=0 and even around n=N1; similarly for X_{k}.
DCTII

X_k = \sum_{n=0}^{N1} x_n \cos \left[\frac{\pi}{N} \left(n+\frac{1}{2}\right) k \right] \quad \quad k = 0, \dots, N1.
The DCTII is probably the most commonly used form, and is often simply referred to as "the DCT".^{[1]}^{[2]}
This transform is exactly equivalent (up to an overall scale factor of 2) to a DFT of 4N real inputs of even symmetry where the evenindexed elements are zero. That is, it is half of the DFT of the 4N inputs y_n, where y_{2n}=0, y_{2n+1} = x_n for 0 \leq n < N, y_{2N}=0, and y_{4Nn}=y_n for 0 < n < 2N.
Some authors further multiply the X_{0} term by 1/√2 and multiply the resulting matrix by an overall scale factor of \sqrt{2/N} (see below for the corresponding change in DCTIII). This makes the DCTII matrix orthogonal, but breaks the direct correspondence with a realeven DFT of halfshifted input. This is the form used by the JPEG standard and by Matlab.
The DCTII implies the boundary conditions: x_{n} is even around n=1/2 and even around n=N1/2; X_{k} is even around k=0 and odd around k=N.
DCTIII

X_k = \frac{1}{2} x_0 + \sum_{n=1}^{N1} x_n \cos \left[\frac{\pi}{N} n \left(k+\frac{1}{2}\right) \right] \quad \quad k = 0, \dots, N1.
Because it is the inverse of DCTII (up to a scale factor, see below), this form is sometimes simply referred to as "the inverse DCT" ("IDCT").^{[2]}
Some authors further divide the x_{0} term by √2 (resulting in an overall x_{0}/√2 term) and multiply the resulting matrix by an overall scale factor of \sqrt{2/N} (see above for the corresponding change in DCTII), so that the DCTII and DCTIII are transposes of one another. This makes the DCTIII matrix orthogonal, but breaks the direct correspondence with a realeven DFT of halfshifted output.
The DCTIII implies the boundary conditions: x_{n} is even around n=0 and odd around n=N; X_{k} is even around k=1/2 and even around k=N1/2.
DCTIV

X_k = \sum_{n=0}^{N1} x_n \cos \left[\frac{\pi}{N} \left(n+\frac{1}{2}\right) \left(k+\frac{1}{2}\right) \right] \quad \quad k = 0, \dots, N1.
The DCTIV matrix becomes orthogonal (and thus, being clearly symmetric, its own inverse) if one further multiplies by an overall scale factor of \sqrt{2/N}.
A variant of the DCTIV, where data from different transforms are overlapped, is called the modified discrete cosine transform (MDCT) (Malvar, 1992).
The DCTIV implies the boundary conditions: x_{n} is even around n=1/2 and odd around n=N1/2; similarly for X_{k}.
DCT VVIII
DCTs of types IIV treat both boundaries consistently regarding the point of symmetry: they are even/odd around either a data point for both boundaries or halfway between two data points for both boundaries. By contrast, DCTs of types VVIII imply boundaries that are even/odd around a data point for one boundary and halfway between two data points for the other boundary.
In other words, DCT types IIV are equivalent to realeven DFTs of even order (regardless of whether N is even or odd), since the corresponding DFT is of length 2(N−1) (for DCTI) or 4N (for DCTII/III) or 8N (for DCTIV). The four additional types of discrete cosine transform (Martucci, 1994) correspond essentially to realeven DFTs of logically odd order, which have factors of N±½ in the denominators of the cosine arguments.
However, these variants seem to be rarely used in practice. One reason, perhaps, is that FFT algorithms for oddlength DFTs are generally more complicated than FFT algorithms for evenlength DFTs (e.g. the simplest radix2 algorithms are only for even lengths), and this increased intricacy carries over to the DCTs as described below.
(The trivial realeven array, a lengthone DFT (odd length) of a single number a, corresponds to a DCTV of length N=1.)
Inverse transforms
Using the normalization conventions above, the inverse of DCTI is DCTI multiplied by 2/(N1). The inverse of DCTIV is DCTIV multiplied by 2/N. The inverse of DCTII is DCTIII multiplied by 2/N and vice versa.^{[2]}
Like for the DFT, the normalization factor in front of these transform definitions is merely a convention and differs between treatments. For example, some authors multiply the transforms by \sqrt{2/N} so that the inverse does not require any additional multiplicative factor. Combined with appropriate factors of √2 (see above), this can be used to make the transform matrix orthogonal.
Multidimensional DCTs
Multidimensional variants of the various DCT types follow straightforwardly from the onedimensional definitions: they are simply a separable product (equivalently, a composition) of DCTs along each dimension.
For example, a twodimensional DCTII of an image or a matrix is simply the onedimensional DCTII, from above, performed along the rows and then along the columns (or vice versa). That is, the 2D DCTII is given by the formula (omitting normalization and other scale factors, as above):

\begin{align} X_{k_1,k_2} &=& \sum_{n_1=0}^{N_11} \left( \sum_{n_2=0}^{N_21} x_{n_1,n_2} \cos \left[\frac{\pi}{N_2} \left(n_2+\frac{1}{2}\right) k_2 \right]\right) \cos \left[\frac{\pi}{N_1} \left(n_1+\frac{1}{2}\right) k_1 \right]\\ &=& \sum_{n_1=0}^{N_11} \sum_{n_2=0}^{N_21} x_{n_1,n_2} \cos \left[\frac{\pi}{N_1} \left(n_1+\frac{1}{2}\right) k_1 \right] \cos \left[\frac{\pi}{N_2} \left(n_2+\frac{1}{2}\right) k_2 \right] . \end{align}
Twodimensional DCT frequencies from the
JPEG DCT
Technically, computing a two (or multi) dimensional DCT by sequences of onedimensional DCTs along each dimension is known as a rowcolumn algorithm (after the twodimensional case). As with multidimensional FFT algorithms, however, there exist other methods to compute the same thing while performing the computations in a different order (i.e. interleaving/combining the algorithms for the different dimensions).
The inverse of a multidimensional DCT is just a separable product of the inverse(s) of the corresponding onedimensional DCT(s) (see above), e.g. the onedimensional inverses applied along one dimension at a time in a rowcolumn algorithm.
The image to the right shows combination of horizontal and vertical frequencies for an 8 x 8 (N_1 = N_2 = 8) twodimensional DCT. Each step from left to right and top to bottom is an increase in frequency by 1/2 cycle. For example, moving right one from the topleft square yields a halfcycle increase in the horizontal frequency. Another move to the right yields two halfcycles. A move down yields two halfcycles horizontally and a halfcycle vertically. The source data (8x8) is transformed to a linear combination of these 64 frequency squares.
Computation
Although the direct application of these formulas would require O(N^{2}) operations, it is possible to compute the same thing with only O(N log N) complexity by factorizing the computation similarly to the fast Fourier transform (FFT). One can also compute DCTs via FFTs combined with O(N) pre and postprocessing steps. In general, O(N log N) methods to compute DCTs are known as fast cosine transform (FCT) algorithms.
The most efficient algorithms, in principle, are usually those that are specialized directly for the DCT, as opposed to using an ordinary FFT plus O(N) extra operations (see below for an exception). However, even "specialized" DCT algorithms (including all of those that achieve the lowest known arithmetic counts, at least for poweroftwo sizes) are typically closely related to FFT algorithms—since DCTs are essentially DFTs of realeven data, one can design a fast DCT algorithm by taking an FFT and eliminating the redundant operations due to this symmetry. This can even be done automatically (Frigo & Johnson, 2005). Algorithms based on the Cooley–Tukey FFT algorithm are most common, but any other FFT algorithm is also applicable. For example, the Winograd FFT algorithm leads to minimalmultiplication algorithms for the DFT, albeit generally at the cost of more additions, and a similar algorithm was proposed by Feig & Winograd (1992) for the DCT. Because the algorithms for DFTs, DCTs, and similar transforms are all so closely related, any improvement in algorithms for one transform will theoretically lead to immediate gains for the other transforms as well (Duhamel & Vetterli, 1990).
While DCT algorithms that employ an unmodified FFT often have some theoretical overhead compared to the best specialized DCT algorithms, the former also have a distinct advantage: highly optimized FFT programs are widely available. Thus, in practice, it is often easier to obtain high performance for general lengths N with FFTbased algorithms. (Performance on modern hardware is typically not dominated simply by arithmetic counts, and optimization requires substantial engineering effort.) Specialized DCT algorithms, on the other hand, see widespread use for transforms of small, fixed sizes such as the 8 \times 8 DCTII used in JPEG compression, or the small DCTs (or MDCTs) typically used in audio compression. (Reduced code size may also be a reason to use a specialized DCT for embeddeddevice applications.)
In fact, even the DCT algorithms using an ordinary FFT are sometimes equivalent to pruning the redundant operations from a larger FFT of realsymmetric data, and they can even be optimal from the perspective of arithmetic counts. For example, a typeII DCT is equivalent to a DFT of size 4N with realeven symmetry whose evenindexed elements are zero. One of the most common methods for computing this via an FFT (e.g. the method used in FFTPACK and FFTW) was described by Narasimha & Peterson (1978) and Makhoul (1980), and this method in hindsight can be seen as one step of a radix4 decimationintime Cooley–Tukey algorithm applied to the "logical" realeven DFT corresponding to the DCT II. (The radix4 step reduces the size 4N DFT to four sizeN DFTs of real data, two of which are zero and two of which are equal to one another by the even symmetry, hence giving a single sizeN FFT of real data plus O(N) butterflies.) Because the evenindexed elements are zero, this radix4 step is exactly the same as a splitradix step; if the subsequent sizeN realdata FFT is also performed by a realdata splitradix algorithm (as in Sorensen et al., 1987), then the resulting algorithm actually matches what was long the lowest published arithmetic count for the poweroftwo DCTII (2 N \log_2 N  N + 2 realarithmetic operations^{[1]}). So, there is nothing intrinsically bad about computing the DCT via an FFT from an arithmetic perspective—it is sometimes merely a question of whether the corresponding FFT algorithm is optimal. (As a practical matter, the functioncall overhead in invoking a separate FFT routine might be significant for small N, but this is an implementation rather than an algorithmic question since it can be solved by unrolling/inlining.)
Example of IDCT
Consider this 8x8 grayscale image of capital letter A.
Original size, scaled 10x (nearest neighbor), scaled 10x (bilinear).
DCT of the image.


\begin{bmatrix} 6.1917 & 0.3411 & 1.2418 & 0.1492 & 0.1583 & 0.2742 & 0.0724 & 0.0561 \\ 0.2205 & 0.0214 & 0.4503 & 0.3947 & 0.7846 & 0.4391 & 0.1001 & 0.2554 \\ 1.0423 & 0.2214 & 1.0017 & 0.2720 & 0.0789 & 0.1952 & 0.2801 & 0.4713 \\ 0.2340 & 0.0392 & 0.2617 & 0.2866 & 0.6351 & 0.3501 & 0.1433 & 0.3550 \\ 0.2750 & 0.0226 & 0.1229 & 0.2183 & 0.2583 & 0.0742 & 0.2042 & 0.5906 \\ 0.0653 & 0.0428 & 0.4721 & 0.2905 & 0.4745 & 0.2875 & 0.0284 & 0.1311 \\ 0.3169 & 0.0541 & 0.1033 & 0.0225 & 0.0056 & 0.1017 & 0.1650 & 0.1500 \\ 0.2970 & 0.0627 & 0.1960 & 0.0644 & 0.1136 & 0.1031 & 0.1887 & 0.1444 \\ \end{bmatrix}
Basis functions of the discrete cosine transformation with corresponding coefficients (specific for our image).
Each basis function is multiplied by its coefficient and then this product is added to the final image.
On the left is final image. In the middle is weighted function (multiplied by coefficient) which is added to the final image. On the right is the current function and corresponding coefficient. Images are scaled (using bilinear interpolation) by factor 10x.
Notes

^ The precise count of real arithmetic operations, and in particular the count of real multiplications, depends somewhat on the scaling of the transform definition. The 2 N \log_2 N  N + 2 count is for the DCTII definition shown here; two multiplications can be saved if the transform is scaled by an overall \sqrt2 factor. Additional multiplications can be saved if one permits the outputs of the transform to be rescaled individually, as was shown by Arai et al. (1988) for the size8 case used in JPEG.
Citations

^ ^{a} ^{b} ^{c}

^ ^{}a ^{b} ^{c} ^{d} ^{e}
See also
References


WenHsiung Chen; Smith, C.; Fralick, S. (September 1977). "A Fast Computational Algorithm for the Discrete Cosine Transform". IEEE Transactions on Communications 25 (9): 1004–1009.

Narasimha, M.; Peterson, A. (June 1978). "On the Computation of the Discrete Cosine Transform". IEEE Transactions on Communications 26 (6): 934–936.

Makhoul, J. (February 1980). "A fast cosine transform in one and two dimensions". IEEE Transactions on Acoustics, Speech, and Signal Processing 28 (1): 27–34.

Sorensen, H.; Jones, D.; Heideman, M.; Burrus, C. (June 1987). "Realvalued fast Fourier transform algorithms". IEEE Transactions on Acoustics, Speech, and Signal Processing 35 (6): 849–863.

Arai, Y.; Agui, T.; Nakajima, M. (November 1988). "A fast DCTSQ scheme for images". IEICE Transactions 71 (11): 1095–1097.

Duhamel, P.; Vetterli, M. (April 1990). "Fast fourier transforms: A tutorial review and a state of the art". Signal Processing 19 (4): 259–299.


Feig, E.; Winograd, S. (September 1992). "Fast algorithms for the discrete cosine transform". IEEE Transactions on Signal Processing 40 (9): 2174–2193.

Malvar, Henrique (1992), Signal Processing with Lapped Transforms, Boston: Artech House,

Martucci, S. A. (May 1994). "Symmetric convolution and the discrete sine and cosine transforms". IEEE Transactions on Signal Processing 42 (5): 1038–1051.

Oppenheim, Alan; Schafer, Ronald; Buck, John (1999), DiscreteTime Signal Processing (2nd ed.), Upper Saddle River, N.J: Prentice Hall,

Frigo, M.; Johnson, S. G. (February 2005). "The Design and Implementation of FFTW3". Proceedings of the IEEE 93 (2): 216–231.

Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007), "Section 12.4.2. Cosine Transform", Numerical Recipes: The Art of Scientific Computing (3rd ed.), New York: Cambridge University Press,
External links

discrete cosine transform at PlanetMath.org.

Syed Ali Khayam: The Discrete Cosine Transform (DCT): Theory and Application

Implementation of MPEG integer approximation of 8x8 IDCT (ISO/IEC 230022)

Matteo Frigo and Steven G. Johnson: FFTW, http://www.fftw.org/ A free (GPL) C library that can compute fast DCTs (types IIV) in one or more dimensions, of arbitrary size.

Tim Kientzle: Fast algorithms for computing the 8point DCT and IDCT, http://drdobbs.com/parallel/184410889.

LTFAT is a free Matlab/Octave toolbox with interfaces to the FFTW implementation of the DCTs and DSTs of type IIV.
This article was sourced from Creative Commons AttributionShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, EGovernment Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a nonprofit organization.