0001]This technique relates to an image processing apparatus and method, an image processing apparatus and method for performing quantization processing or inverse quantization process.
BACKGROUND
[0002]Recently, handling image information as digital, time, transmission of a high efficiency information, accumulated for the purpose of, by using the image information inherent redundancy, MPEG to compress by orthogonal transform and motion compensation such as a discrete cosine transform ( Moving Picture Experts Group) system that conforms to methods such as are widespread in both information distribution, and information reception in general homes, such as a broadcast station.
[0003]
　Recently, four times the high-definition image, want to compress an image of about 4096 × 2048 pixels, or such as the Internet, in a limited transmission capacity of the environment, but would like to deliver high-definition images, even higher compression rate coding there is a growing need for. Therefore, in VCEG affiliated ITU-T, Study on improvement of the coding efficiency has been performed is continued.
[0004]
　Is this to the image encoding method, MPEG1, MPEG2, and ITU-T H.264, the division unit of the image when the image coding in MPEG4-AVC (encoding unit), a partial area of ​​the image pixel size of a macroblock, were all 16 × 16 pixels. On the other hand, according to Non-Patent Document 1 Document, as an element technology for next-generation image coding standard, proposed to expand the number of pixels in the horizontal and vertical directions of the macro block is made. According to this proposal MPEG1, MPEG2, and ITU-T H.264, in addition to the pixel size of the macro block of 16 × 16 pixels as defined in MPEG4-AVC or the like, 32 × 32 pixels, consisting of 64 × 64 pixels it has also been proposed to use a macro block. This, for example, UHD; as in (Ultra High Definition 4000 pixels × 2000 pixels), but the horizontal and vertical pixel size of the future picture to be encoded is expected to increase, in this case, in a similar motion area, aims at improving coding efficiency by performing motion compensation and orthogonal transformation to a larger area as a unit.
[0005]
　In Non-Patent Document 1, by adopting a hierarchical structure, with respect to the following 16 × 16 pixel blocks, while maintaining macro-block compatible in the current AVC, as a superset, and larger block is defined .
[0006]
　Non-Patent Document 1 is proposed to apply an extended macroblock relative to the inter-slice, in Non-Patent Document 2, the extended macro-block, applying has been proposed an intra-slice.
CITATION
Non-patent literature
[0007]
Non-Patent Document 1: Peisong Chenn, Yan Ye, Marta Karczewicz, "Video Coding Using Extended Block Sizes", COM16-C123-E, Qualcomm Inc
Non-Patent Document 2: Sung-Chang Lim, Hahyun Lee, Jinho Lee, Jongho Kim, Haechul Choi, Seyoon Jeong, Jin Soo Choi, "Intra coding using extended block size", VCEG-AL28, 2009 July
Summary of the Invention
Problems that the Invention is to Solve
[0008]
　Incidentally, as proposed in Non-Patent Document 1 or Non-Patent Document 2, a region including the macro blocks of the expanded size is applied, a single macro block, a flat area, the texture There is likely to be mixed.
[0009]
　However, in Non-Patent Document 1 or Non-Patent Document 2, with respect to one macroblock, since the only possible to specify a single quantization parameter, according to the characteristics of each region in the plane, the adaptive it is difficult to perform quantization.
[0010]
　This technology has been made in view of such circumstances, it makes more appropriate quantization process, and an object thereof is to suppress a reduction in the subjective image quality of the decoded image.
Means for Solving the Problems
[0011]
　According to an embodiment of the present technology, a decoding unit for generating quantized data by decoding the encoded stream, than a reference coding unit in the reference layer of the coding unit is a coding unit for encoding the image data targeting the coding unit in the lower layer, and a setting unit for setting a quantization parameter to be used for inverse quantizing the quantized data generated by the decoding unit, a quantization parameter set by the setting unit with Te is an image processing apparatus and an inverse quantization unit for inverse quantizing the quantized data generated by the decoding unit.
[0012]
　The setting unit, differential quantization indicating a difference value between a quantization parameter set to the coding units in the same layer quantization parameter set to the current coding unit to be inverse quantization process and the current coding unit using parameter, it is possible to set a quantization parameter of the current coding unit.
[0013]
　As the difference quantization parameter, wherein a difference between the quantization parameter set to the coding unit which is previously decoded in decoding order than the current coding unit and the quantization parameter set in the current coding unit it can be.
[0014]
　The difference quantization parameter is a difference value between the current coding unit set quantization parameter and the current coding unit quantization parameter set to the coding unit which is decoded in the previous decoding processing order than it can be in a certain way.
[0015]
　The reference coding unit can be designed such that the maximum coding unit is a coding unit of the uppermost layer.
[0016]
　The encoding further comprising a receiving unit which stream to receive the minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter, wherein the setting unit is the smallest coding unit size received by the receiving unit according to the data, it is possible to set a quantization parameter of the current coding unit.
[0017]
　The receiving unit, from the slice header of the coded stream, it is possible to obtain the minimum coding unit size data.
[0018]
　If the size the indicated minimum coding unit size data is 16 pixels, the difference quantization parameter coding unit size is less than 16 pixels may be as has been set to 0.
[0019]
　The setting unit uses a differential quantization parameter indicating a difference value between a quantization parameter subject to current coding unit and the quantization parameter set in the current coding unit is set to belong slice decoding process, it is possible to set a quantization parameter of the current coding unit.
[0020]
　The setting unit, the current coding unit is the first case in which the decoding processing order in the hierarchy of the reference coding unit, the current coding unit set quantization parameter and the current coding unit is set to belong slices using the difference quantization parameter indicating a difference value between a quantization parameter, it is possible to set a quantization parameter of the current coding unit.
[0021]
　The reference coding unit can be designed such that the maximum coding unit is a coding unit of the uppermost layer.
[0022]
　The encoding further comprising a receiving unit which stream to receive the minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter, wherein the setting unit is the smallest coding unit size received by the receiving unit according to the data, it is possible to set a quantization parameter of the current coding unit.
[0023]
　The receiving unit, from the slice header of the coded stream, it is possible to obtain the minimum coding unit size data.
[0024]
　If the size of the indicated minimum coding unit size data is is 16 pixels, the difference quantization parameter coding unit size is less than 16 pixels may be as has been set to 0.
[0025]
　The setting unit, as a target the coding unit in the lower layer than the reference coding unit, if the value of the differential quantization parameter is 0, the quantization parameter set to the reference coding unit, the reference code it can be set as the quantization parameter set to the coding unit in the lower layer than unit.
[0026]
　Targeting the coding unit in the lower layer than the reference coding unit, the value of the differential quantization parameter further comprises a receiving unit for receiving the differential identification data for identifying whether the 0, the setting unit, by the receiving unit using the difference identification data received, the quantization parameter set to the reference coding unit can be set as the quantization parameter set to the coding unit in the lower layer than the reference coding unit.
[0027]
　According to an embodiment of the present technology, also decodes the encoded stream to generate quantized data, than the reference coding unit in the reference layer of the coding unit is a coding unit for encoding the image data backward targeting the coding unit in the layer, the generated quantized data to set the quantization parameters to be used for inverse quantization, using the set quantization parameter, inverse quantizes the generated quantized data the image processing method of.
[0028]
　Another aspect of the present technology, as a target the coding unit in the image data to a lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit of the coding, quantizing image image data a setting unit for setting a quantization parameter used for, using a quantization parameter set by the setting unit, a quantization unit for generating quantized data image data by quantizing, by the quantization unit the generated quantized data by encoding an image processing apparatus and a coding section for generating an encoded stream.
[0029]
　The setting unit, differential quantization indicating a difference value between a quantization parameter set to the coding unit in the same level is set to the current coding unit to be coded processing the quantization parameter and the current coding unit set parameters, a transmission unit for transmitting a setting coded stream generated by the differential quantization parameter and the coding unit by the setting unit may further comprise.
[0030]
　The setting unit, the difference value between the quantization parameter set in the encoded coding unit before the encoding processing order than is set as the current coding unit is a quantization parameter the current coding unit, wherein it can be set as a differential quantization parameter.
[0031]
　The setting unit is a difference value between the current coding unit set quantization parameter and a quantization parameter set to the coding unit which is encoded to the previous in coding order than the current coding unit , it may be set as the differential quantization parameter.
[0032]
　The reference coding unit can be designed such that the maximum coding unit is a coding unit of the uppermost layer.
[0033]
　The setting unit sets a minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter, the transmission unit may transmit the minimum coding unit size data set by the setting unit can.
[0034]
　The transmission unit is a minimum coding unit size data set by the setting unit, the syntax of the generated coded stream by the encoding unit, it can be added as a slice header.
[0035]
　The setting unit to set the size of the indicated minimum coding unit size data and 16 pixels, the differential quantization parameter of the coding unit size is less than 16 pixels can be set to 0.
[0036]
　The setting unit sets the differential quantization parameter indicating a difference value of the quantization parameter set in the current coding unit to be coded processing current coding unit is set to belong slice quantization parameter It may further include a transmission unit for transmitting the coded stream generated by the set and differential quantization parameter the encoding unit by the setting unit.
[0037]
　The setting unit, wherein when the current coding unit is the first in the encoding processing order in the hierarchy of the reference coding unit, the current coding unit set quantization parameter and the current coding unit is set to belong slices and the difference value between the quantization parameter may be set as the differential quantization parameter.
[0038]
The reference coding unit can be designed such that the maximum coding unit is a coding unit of the uppermost layer.
[0039]
　The setting unit sets a minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter, the transmission unit may transmit the minimum coding unit size data set by the setting unit can.
[0040]
　The transmission unit is a minimum coding unit size data set by the setting unit, the syntax of the generated coded stream by the encoding unit, it can be added as a slice header.
[0041]
　The setting unit to set the size of the indicated minimum coding unit size data and 16 pixels, the differential quantization parameter of the coding unit size is less than 16 pixels can be set to 0.
[0042]
　The setting unit, as a target the coding unit in the lower layer than the reference coded unit, to set the value of the differential quantization parameter to 0, the quantization parameter set to the reference coding unit, the reference it can be set as the quantization parameter is also set in the coding unit in the lower layer than the coding unit.
[0043]
　The setting unit, as a target the coding unit in the lower layer than the reference coding unit, the value of the differential quantization parameter sets the differential identification data for identifying whether the 0, set by the setting unit difference a transmission unit for transmitting the coded stream generated by the identification data and the pre-coding unit can further comprise.
[0044]
　Another aspect of the present technology, also, as a target the coding unit in the lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit for encoding the image data, the image picture data set the quantization parameter used for quantizing, by using a quantization parameter set, the image data is quantized to generate quantization data, the coded stream generated quantized data by encoding a product image processing method for.
[0045]
　In one aspect of the present technology, the decrypted encoded stream quantized data is generated, the lower than standard coding unit in the reference layer of the coding unit is a coding unit when the image data is encoded targeting the coding unit in the layer, it is generated quantized data set quantization parameter used when the inverse quantization, set by the quantization parameter is used, the generated quantized data inverse It is quantized.
[0046]
　In another aspect of the present technology, as a target the coding unit in the lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit for encoding the image data, the image picture data quantized set quantization parameter to be used for reduction is, used is set quantization parameter, the image data is quantized data is generated quantized, generated quantized data is encoded coding stream is generated.
Effect of the invention
[0047]
　According to this technique, it is possible to more appropriately quantization or inverse quantization process.
BRIEF DESCRIPTION OF THE DRAWINGS
[0048]
FIG. 1 is a block diagram showing a main configuration example of an image encoding apparatus according to the present technology.
It is a diagram illustrating an example of a correspondence relationship between the quantization parameter in FIG. 2 luminance signal quantization parameter and the color difference signals.
It is a diagram illustrating an example of FIG. 3 macroblocks.
It is a diagram showing another example of FIG. 4 macroblocks.
5 is a block diagram illustrating a detailed configuration example of a quantization unit.
Is a diagram illustrating an example of an image of FIG. 6 macroblock.
7 is a flowchart illustrating an example of an encoding processing flow.
8 is a flowchart illustrating an example of a flow of a quantization parameter calculation process.
9 is a block diagram showing a main configuration example of an image decoding apparatus according to the present technology.
It is a block diagram illustrating a detailed configuration example of FIG. 10 inverse quantization unit.
11 is a flowchart illustrating an example of a flow of a decoding process.
Is a flowchart illustrating an example of the flow of FIG. 12 inverse quantization process.
13 is a flowchart illustrating another example of the flow of the quantization parameter calculation process.
14 is a flowchart illustrating another example of the inverse quantization process flow.
It is a diagram illustrating a configuration example of FIG. 15 coding unit.
16 is a diagram showing an example of allocated quantization parameter for each coding unit.
17 is a diagram showing an example of a syntax.
18 is a block diagram illustrating another configuration example of the applied image coding apparatus to which the present technology.
19 is a block diagram illustrating a detailed configuration example of a coding unit quantization unit and a rate control unit.
[Figure 20] Flow of a quantization parameter calculation process is a flowchart describing yet another example.
21 is a block diagram illustrating another configuration example of the applied image decoding apparatus to which the present technology.
It is a block diagram illustrating a detailed configuration example of FIG. 22 coding units inverse quantization unit.
[Figure 23] of the inverse quantization processing flow is a flow chart showing still another example.
FIG. 24 is a diagram comparing the characteristics of each calculation method of the quantization parameter DQP.
Is a diagram illustrating an example of FIG. 25 coding unit quantization parameter assigned to each.
It is a diagram illustrating an example of the syntax of FIG. 26 slice header.
FIG. 27 is a diagram illustrating an example of a method for calculating the activity.
[FIG. 28] is a diagram for explaining the relationship between the quantization parameter and the quantization scale.
[Figure 29] of the image coding apparatus according to the present technology, is a block diagram showing still another configuration example.
[Figure 30] coding unit quantization unit is a block diagram illustrating a quantization unit, and a detailed configuration example of the rate control unit.
FIG. 31 is a flowchart for explaining another example of the encoding process flow.
FIG 32 is a flowchart illustrating an example of a flow of a quantization process.
[33] is a diagram showing a multi-view image encoding method.
FIG. 34 is a diagram showing a main configuration example of the multi-view image encoding apparatus to which the present technology is applied.
It is a diagram illustrating a main configuration example of FIG. 35 multi-view image decoding apparatus according to the present technology.
[FIG. 36] is a diagram showing an example of the hierarchical image coding method.
Is a diagram illustrating a main configuration example of FIG. 37 hierarchical image coding apparatus according to the present technology.
[FIG. 38] is a diagram showing a main configuration example of a hierarchical image decoding apparatus according to the present technology.
It is a block diagram showing a main configuration example of a computer according to the FIG. 39 the present technology.
It is a block diagram showing a main configuration example of FIG. 40 television apparatus to which the present technology is applied.
[FIG. 41] is a block diagram showing a main configuration example of a mobile terminal device according to the present technology.
[FIG. 42] is a block diagram showing a main configuration example of a recording and reproducing apparatus according to the present technology.
[43] is a block diagram showing a main configuration example of the applied imaging apparatus to which the present technology.
DESCRIPTION OF THE INVENTION
[0049]
　The following describes embodiments of the present disclosure (hereinafter referred to as embodiments). The description will be made in the following order.
1. First Embodiment (image coding apparatus)
2. Second Embodiment (image decoding apparatus)
3. Third Embodiment (image encoding device and the image decoding apparatus)
4. Fourth Embodiment (image encoding device and the image decoding apparatus)
5. Fifth Embodiment (image coding apparatus)
6. Sixth Embodiment (the multi-view image encoding and multi-view image decoding apparatus)
7. Seventh Embodiment (hierarchical image coding and hierarchical image decoding apparatus)
8. Eighth Embodiment (Application Example)
[0050]
<1. First Embodiment>
[Image encoding apparatus] FIG. 1 shows a configuration of an embodiment of an image coding apparatus as an image processing apparatus to which the present technology is applied.
[0051]
　The image coding apparatus 100 shown in FIG. 1, for example, H. 264 and MPEG (Moving Picture Experts Group) 4 Part10 (AVC (Advanced Video Coding)) (hereinafter referred to as H.264 / AVC) encoding apparatus for encoding an image similar to the method. However, the image coding apparatus 100 specifies the quantization parameter for each sub-macroblock.
[0052]
　The macro-block, a partial area of ​​the image serving as a processing unit for encoding the image. A sub-macroblock is a small area that divides the macro block into a plurality.
[0053]
　In the example of FIG. 1, the image encoding apparatus 100, A / D (Analog / Digital) conversion unit 101, a screen rearrangement buffer 102, an arithmetic unit 103, orthogonal transform unit 104, a quantization unit 105, a lossless coding unit 106 , and a storage buffer 107. Also, the image encoding apparatus 100, inverse quantization unit 108, inverse orthogonal transform unit 109, calculation unit 110, a deblocking filter 111, a frame memory 112, selection unit 113, an intra prediction unit 114, motion prediction and compensation unit 115, having a selection unit 116 and rate control unit 117.
[0054]
　The image coding apparatus 100 further includes a sub-macro-block quantization unit 121 and the sub-macro-block inverse quantization unit 122.
[0055]
　A / D conversion unit 101, the input image data converted A / D, and output to the screen rearrangement buffer 102 for storage.
[0056]
　Screen rearrangement buffer 102, an image of the stored display order of the frame, depending on the GOP (Group of Picture) structure to the order of frames for encoding. Screen rearrangement buffer 102, an image rearranged the order of the frame, and supplies the calculation unit 103. Also, the screen rearrangement buffer 102, an image rearranged the order of the frame, and supplies to the intra prediction unit 114 and the motion prediction and compensation unit 115.
[0057]
　Calculation section 103, from the image read from the screen rearrangement buffer 102, subtracts a prediction image supplied from the intra prediction unit 114 or the motion prediction and compensation unit 115 via the selection unit 116, orthogonal to the difference information and outputs to the converter 104.
[0058]
　For example, in the case of an image on which intra encoding is performed, the arithmetic unit 103 from the image read from the screen rearrangement buffer 102, subtracts a prediction image supplied from the intra prediction unit 114. For example, when an image inter-coding is performed, the arithmetic unit 103 from the image read from the screen rearrangement buffer 102, subtracts a prediction image supplied from the motion prediction and compensation unit 115.
[0059]
　Orthogonal transform unit 104, to the difference information supplied from the calculation unit 103, a discrete cosine transform, applies orthogonal transform such as Karhunen-Loeve transform, and supplies the transform coefficient to the quantization unit 105.
[0060]
　Quantization unit 105 quantizes the transform coefficients orthogonal transform unit 104 outputs. Quantization unit 105, based on the information supplied from the rate control unit 117, in cooperation with the sub-macroblock quantization unit 121, than the macro block to set the quantization parameters for each sub-macroblock is a small area , it performs quantization. Quantization unit 105 supplies the transform coefficient quantized in the lossless coding unit 106.
[0061]
　Lossless encoding unit 106, with respect to the quantized transform coefficients, variable length coding, a lossless encoding, such as arithmetic encoding performed.
[0062]
　Lossless coding unit 106 acquire the information indicating the intra prediction from the intra prediction unit 114 acquires such information and motion vector information indicating the inter prediction mode from the motion prediction and compensation unit 115. The information indicating the intra prediction (intraframe prediction) is hereinafter also referred to as intra prediction mode information. Further, information indicating the information mode indicating inter prediction (inter prediction) is hereinafter also referred to as inter prediction mode information.
[0063]
　Lossless coding unit 106 is configured to encode the quantized transform coefficients, the filter coefficients, intra prediction mode information, the inter prediction mode information, and various information such as the quantization parameter, the header information of the encoded data one and part (multiplexing). Lossless encoding unit 106, to accumulate and supplies the encoded data obtained by encoding in the storage buffer 107.
[0064]
　For example, in the lossless encoding unit 106, a lossless encoding process such as variable length encoding or arithmetic encoding is performed. The variable-length coding, H. Such as 264 / AVC CAVLC which is defined in the system (Context-Adaptive Variable Length Coding) and the like. The arithmetic coding, etc. CABAC (Context-Adaptive Binary Arithmetic Coding) and the like.
[0065]
　The accumulation buffer 107, the coded data supplied from the lossless encoding unit 106, and temporarily held at a predetermined timing, H. As encoded encoding image 264 / AVC method, for example, is output to the subsequent stage (not shown) recording device or transmission path.
[0066]
　The conversion coefficient quantized in the quantization unit 105 is also supplied to the inverse quantization unit 108. Inverse quantization unit 108, the quantized transform coefficients to inverse quantization in a manner corresponding to the quantization by the quantization unit 105. Inverse quantization unit 108, in cooperation with the sub-macro-block inverse quantization unit 122 performs inverse quantization using the quantization parameter of the sub-macro each block set in the quantization unit 105. Inverse quantization unit 108, the resulting transform coefficients, and supplies the inverse orthogonal transform unit 109.
[0067]
　Inverse orthogonal transform unit 109, the supplied transform coefficient, inverse orthogonal transform by a method corresponding to the orthogonal transform processing by the orthogonal transform unit 104. Inverse orthogonal transformed output (restored difference information) is supplied to the arithmetic unit 110.
[0068]
　Calculation unit 110, the inverse orthogonal transform result supplied from the inverse orthogonal transform unit 109, i.e., prediction the restored difference information supplied from the intra prediction unit 114 or the motion prediction and compensation unit 115 via the selector 116 adding the image to obtain a locally decoded image (decoded image).
[0069]
　For example, the difference information, if corresponding to the image on which intra encoding is performed, the arithmetic unit 110 adds the predicted image supplied from the intra prediction unit 114 to the difference information. Further, for example, difference information, when corresponding to the image inter-encoding is performed, the arithmetic unit 110 adds the predicted image supplied from the motion prediction and compensation unit 115 to the difference information.
[0070]
　The addition result is supplied to the deblocking filter 111 or the frame memory 112.
[0071]
　Deblocking filter 111, to remove the block distortion of the decoded image by performing the appropriate deblocking filtering, performs image quality improvement by, for example to perform an appropriate loop filtering using a Wiener filter (Wiener Filter). Deblocking filter 111, each pixel is classification, applying a suitable filter process for each class. Deblocking filter 111 supplies the filtering result to the frame memory 112.
[0072]
　The frame memory 112 at a predetermined timing, the reference image stored, and outputs via the selector 113 to the intra prediction unit 114 or the motion prediction and compensation unit 115.
[0073]
　For example, in the case of an image on which intra encoding is performed, the frame memory 112, the reference image is supplied to the intra prediction unit 114 via the selector 113. For example, when the inter-coding is performed, the frame memory 112, the reference image to the motion prediction and compensation unit 115 via the selector 113.
[0074]
　Selecting unit 113, if the reference image supplied from the frame memory 112 is an image for performing intra-coding, and supplies the reference image to the intra prediction unit 114. The selection unit 113, if the reference image supplied from the frame memory 112 is an image for performing inter-coding, and supplies the reference image to the motion prediction and compensation unit 115.
[0075]
　The intra prediction unit 114 performs intra-prediction to generate a prediction image using the pixel values ​​in the screen (intra prediction). The intra prediction unit 114 performs intra prediction by a plurality of modes (intra prediction mode).
[0076]
　The intra prediction unit 114 generates prediction images in all the intra prediction modes, evaluates each prediction image, and selects an optimal mode. The intra prediction unit 114 has selected the best intra prediction mode, a prediction image generated in the optimum mode, and supplies the arithmetic unit 103 and the execution unit 110 via the selector 116.
[0077]
　In addition, as described above, the intra prediction unit 114 supplies information such as the intra prediction mode information, as appropriate lossless coding unit 106 indicating the intra prediction mode adopted.
[0078]
　The motion prediction and compensation unit 115, the image inter-encoding is performed by using an input image supplied from the screen rearrangement buffer 102, and the reference image supplied from the frame memory 112 via the selector 113, It performs motion prediction performs motion compensation processing in accordance with the detected motion vector, and generates a predicted image (inter prediction image information).
[0079]
　The motion prediction and compensation unit 115 performs inter prediction processing for all candidate inter prediction modes to generate a prediction image. The motion prediction and compensation unit 115, the generated prediction image, and supplies the arithmetic unit 103 and the execution unit 110 via the selector 116.
[0080]
　The motion prediction and compensation unit 115 supplies and inter prediction mode information indicating the inter prediction mode is employed, the calculated motion vector information indicating the motion vector to the lossless encoding unit 106.
[0081]
　Selecting unit 116, if the image to be intra-coded, and supplies the output of the intra prediction unit 114 to the arithmetic unit 103 and the execution unit 110, if the image to be inter-coded, the output of the motion prediction and compensation portion 115 and it supplies the calculation unit 103 and the execution unit 110.
[0082]
　The rate control unit 117, based on the stored compressed image in the storage buffer 107, as an overflow or underflow does not occur, controlling the rate of the quantization operation of the quantization unit 105. The rate control unit 117 supplies for each sub-macroblock is a small area where a macroblock is divided into a plurality of information indicating the complexity of the image to the quantizing unit 105.
[0083]
　For example, the rate control unit 117, as information indicating the complexity of the image, to provide an activity which is information indicating a variance of pixel values ​​to the quantization unit 105. Of course, the information indicating the complexity of the image may be any information.
[0084]
　Sub-macroblock quantization unit 121, the quantization unit 105 obtains information indicating the complexity of the image for each sub-macroblock, a quantization value for each sub-macro-block based on the information (quantization step) set, and returns the value to the quantization unit 105.
[0085]
　Sub-macroblock the inverse quantization unit 122 obtains the quantization parameter from the inverse quantization unit 108 obtains a quantized value for each sub-macroblock with reference to these values, and returns it to the inverse quantization unit 108.
[0086]
[AVC quantization]
　Here, as a conventional quantization process, explaining the quantization which is defined in the AVC (Advanced Video Coding) as an example.
[0087]
　Integer transform matrix is ​​defined in the AVC [H] is not satisfied orthogonal transform matrix condition represented by the following formula (1), after integer transform performs different quantization processing for each component, an integer conversion and, by combining the quantization, so that the orthogonal transform processing is performed.
[0088]
　[H][H] Ｔ＝[I］
　・・・（１）
[0089]
　In AVC, for performing the quantization, to obtain a value of "0" to "51", it is possible to a quantization parameter QP (Quantization Parameter), it is defined for each macroblock.
[0090]
　For example, A (QP) and B (QP) is regardless of the value of QP, and is a value that satisfies the following equation (2).
[0091]
　A(QP)*B(QP)＝2m+n　・・・（２）
[0092]
　Orthogonal transform and inverse orthogonal transform in AVC can be realized by calculating the following equation (3) and (4).
[0093]
　d ＝c * A(QP) / 2 m　・・・（３）
　c'＝d * B(QP) / 2 n　・・・（４）
[0094]
　Incidentally, c is orthogonal transform coefficients before quantization, d is an orthogonal transformation coefficient of the orthogonal transform coefficients, c 'after inverse quantization of quantized.
[0095]
　By performing such processing, in the AVC, only by shift operations rather than division, it is possible to realize the quantization and inverse quantization.
[0096]
　The values ​​of A and B will have a different value for each component.
[0097]
　Quantization parameter QP, as said, for example, from 6 to 12, when the value is increased 6, twice coarse quantization process is designed to take place.
[0098]
　In particular, a lower bit rate, i.e., at higher QP, deterioration of the color difference signals conspicuous. Therefore, the quantization parameter QP for the luminance signal Y with respect to the default quantization parameter QP for the color difference signal C has been defined as the table shown in FIG.
[0099]
　User can configure information about ChromaQPOffset included in the image compression information, it is possible to control this relationship.　
[0100]
　Further, in the above High Profile, using ChromaQPOffset and 2NdChromaQPOffset, it is possible to set the quantization parameters for the Cb / Cr component independently.
[0101]
[Quantization parameter calculating]
　AVC encoding method, and, in the coding method described in Non-Patent Document 1 and Non-Patent Document 2, the quantization parameter MB_QP for each macroblock is calculated as follows.
[0102]
　That is, first, from bit_depth_luma_minus8 present in the sequence parameter set, QpBdOffset Y is calculated from the following formula (5).
[0103]
　QpBdOffset Y = 6 * bit_depth_luma_minus8　・・・（５）
[0104]
　Next, the pic_init_qp_minus26 in the picture parameter set, the initial value of the quantization parameter in each picture is designated.
[0105]
　Next, the slice_qp_delta defined in the slice layer, quantization parameter SliceQP in the slice Y is calculated by the following equation (6).
[0106]
　SliceQPY = 26 + pic_init_qp_minus26 + slice_qp_delta　・・・（６）
[0107]
　Finally, using mb_qp_delta in macroblock layer, quantization parameter MB_QP for each macroblock is calculated from the following formula (7).
[0108]
　MB_QP = ((MB_QP Prev + mb_qp_delta + 52 + 2 * QpBdOffset Y )% (52 + QpBdOffset Y ))
　　　　　- QpBdOffset Y　··· (7)
[0109]
　Here, MB_QP Prev is a quantization parameter in the immediately preceding macroblock.
[0110]
　In this technology, in addition to this, further, in the image compression, the sub-macroblock layer, which contains information about Submb_qp_delta.
[0111]
　Using this information, quantization parameter SubMB_QP for each sub-macroblock is calculated by the following equation (8).
[0112]
　SubMB_QP = Clip(0,51,MB_QP + submb_qp_delta)　・・・（８）
[0113]
　Here, Clip (min, max, value) is a function having a return value, such as the following equation (9).
[0114]
[Number

　1] ... (9)
[0115]
That is, the quantization parameter SubMB_QP for each sub-macroblock is calculated from the following formula (10). However, the minimum quantization parameter that is predefined as MinQP, and maxQP the maximum quantization parameter that is predefined.
[0116]
[Number

　2] · (10)
[0117]
　In the image compression in the information, if submb_qp_delta is not present, as its value is "0", the quantization parameter in the macroblock, to be applied to the sub-macroblock.
[0118]
Quantization unit]
　FIG. 5 is a block diagram illustrating a detailed configuration example of the quantization unit 105 of FIG. As shown in FIG. 5, the quantization unit 105, sub-macro-block activity buffer 151, the quantization parameter calculation unit 152, and a quantization processing section 153.
[0119]
　Sub-macroblock activity buffer 151 holds an activity supplied from the rate control unit 117. In the AVC encoding system, as defined in the MPEG-2 Test Model, although adaptive quantization based on activity is performed, the rate control unit 117, also referred to as the activity (sub-macroblock activity for each sub-macroblock performing the calculation of). The method of calculating the sub-macro-block activity is similar to the conventional case of calculating an activity for each macro block.
[0120]
　Sub-macroblock activity buffer 151 holds the sub-macro block activity supplied from the rate control unit 117, a predetermined amount (e.g., one frame) for each sub-macroblock quantizing the sub macro block activity that its retention supplied to the part 121.
[0121]
　Sub-macroblock quantization unit 121, by using a sub macro block activity supplied from the sub-macro-block activity buffer 151, for each sub-macroblock, calculates the quantized value. Quantized values ​​of the sub-macro each block can be calculated by the same method as in the case of calculating the quantization value for each macroblock from the activity of each macroblock.
[0122]
　When obtaining the quantization values ​​for each sub-macroblock, sub-macroblock quantization unit 121, the quantization value of the sub-macro-block by block, and supplies the quantization parameter calculation unit 152.
[0123]
　Quantization parameter calculation unit 152 uses the quantized values ​​for each sub-macroblock supplied from the sub-macroblock quantization unit 121, calculates various quantization parameter.
[0124]
　For example, the quantization parameter calculation unit 152, Pic_init_qp_minus26, calculated Slice_qp_delta, and a quantization parameter such mb_qp_delta. Quantization parameter calculation unit 152, the quantization value for each sub-macroblock, since it is possible to obtain the quantized value of each macro block, as in the case of such conventional AVC encoding scheme, these various quantization to calculate the parameters set.
[0125]
　Quantization parameter calculation unit 152 further obtains the quantization parameter MB_QP of each macroblock, the quantization parameter submb_qp_delta indicating a difference between the quantization parameter SubMB_QP for each sub-macroblock. Quantization parameter of the sub-macro each block must be transmitted to the decoding side. Accordingly, by this way the difference value, it is possible to reduce the code amount of quantization parameter of the sub-macro block by block. So to speak, the quantization parameter submb_qp_delta is a transmission format of the quantization parameter SubMB_QP. Quantization parameter SubMB_QP for each sub-macroblock is obtained by converting the quantization values ​​for each sub-macroblock. Similarly, the quantization parameter MB_QP of each macro block is obtained by converting the quantized value of each macro block. Quantization parameter calculation unit 152, for example, using Equation (35) described above, it calculates the submb_qp_delta for each sub-macroblock.
[0126]
　Quantization parameter calculation unit 152 supplies the quantized values ​​for each sub-macroblock quantization unit 153. The quantization parameter calculation unit 152 (specifically, pic_init_qp_minus26, slice_qp_delta, and mb_qp_delta etc.) calculated various quantization parameters supplied to the lossless encoding unit 106, an image with encoded encoded stream transmission make. As described above, if the value of submb_qp_delta is "0", transmission of submb_qp_delta is omitted. In other words, in which case, quantization parameters other than submb_qp_delta is supplied to the lossless encoding unit 106.
[0127]
　Furthermore, the quantization parameter calculation unit 152 also supplies the quantized values ​​for each sub-macroblock to the inverse quantization unit 108.
[0128]
　Quantization unit 153, an orthogonal transformation coefficient supplied from the orthogonal transform unit 104, and quantized using the quantization value for each sub-macroblock.
[0129]
　Quantization unit 153, an orthogonal transform coefficient quantized, and supplies the inverse quantization unit 108 and the lossless coding unit 106.
[0130]
　Incidentally, the inverse quantization unit 108, by using the sub-macro-block inverse quantization unit 122, inverse-quantizes the orthogonal transformation coefficients quantized by the above-described quantization unit 105. In the image decoding apparatus corresponding to the image encoding apparatus 100, since the inverse quantization process and the same processing is performed, a description of the details of the inverse quantization is carried out in the description of the image decoding apparatus.
[0131]
　For conventional such AVC encoding system, it could not be only set one of the quantization parameter with respect to 1 macroblock. Thus, one macro block, a flat area, if the region containing the texture are mixed, it is difficult to set an appropriate quantization parameter in the region of both.
[0132]
　In particular, as in the extended macroblock proposed in Non-Patent Document 2 or the like (extension area), the size of the macro block is larger, a possibility that an image having different characteristics in the region are mixed is higher becomes, according to the characteristics of the respective regions, it becomes more difficult to carry out adaptive quantization.
[0133]
　In contrast, the image coding apparatus 100 calculates an index indicating the complexity of the image for each sub-macroblock in the rate control unit 117, a quantized value for each sub-macroblock at the sub-macroblock quantization unit 121 it can be calculated. That is, the quantization unit 153 can perform the quantization process using the appropriate quantization values ​​for each sub-macroblock.
[0134]
　Thus, the image coding apparatus 100 can perform the quantization process more suitable for the content of the image. In particular, the macro block size is extended, in a single macro block, even if it contains both the area including the flat area and texture, the image encoding apparatus 100, adaptive quantization suitable for the respective areas performs processing, the deterioration of the subjective quality of the decoded image can be suppressed.
[0135]
　For example, in an image 160 shown in FIG. 6, the macro block 161 contains only the flat region. Therefore, if the image encoding apparatus 100, even when the quantization processing using a single quantization parameters for such macroblock 161, never of particular quality problems.
[0136]
　In contrast, the macro block 162 includes a flat region, both the texture region. In the quantization processing using a single quantization parameter can not perform appropriate adaptive quantization with respect to both the flat region and the texture region. Therefore, if the image encoding apparatus 100, when performing the quantization processing using a single quantization parameters for such a macro block 161, there is a possibility that the subjective image quality of the decoded image is reduced.
[0137]
　Even in this case, the image encoding apparatus 100, it is possible to calculate the quantization value in the sub-macroblock, as described above, it performs a more appropriate quantization process, a reduction in the subjective quality of the decoded image it can be suppressed.
[0138]
　Further, in the accumulation buffer 107, when a respective likely total code amount overflows for picture also, the control by the quantization parameter is performed. Therefore, as described above in this case, the quantization unit 105 calculates the quantized value at the sub-macroblock, by to perform quantization, the image coding apparatus 100, the overflow protection finer granularity it is possible to perform the control of.
[0139]
　Further, if the value of Submb_qp_delta is "0". Thus omit the transmission of the Submb_qp_delta, it is possible to suppress the reduction of unwanted coding efficiency. If the value of submb_qp_delta is "0", since the quantization parameter MB_QP sub macro quantization for each block parameter SubMB_QP and each macroblock is equal, at the decoding side, the quantization parameter MB_QP sub macro blocks per macroblock can be the quantization parameter SubMB_QP per value of Submb_qp_delta ( "0") is not required. Therefore, it is possible to omit the transmission of submb_qp_delta as described above. Of course, it is also possible value so as to transmit the Submb_qp_delta of "0", by omitting the transmission of Submb_qp_delta, can be improved correspondingly coding efficiency.
[0140]
Encoding Process Flow
　Next, the flow of each process executed by the image encoding apparatus 100 will be described. First, with reference to the flowchart of FIG. 7, an example of the flow of the encoding process.
[0141]
　In step S101, A / D conversion unit 101 the input image converting A / D. In step S102, the screen rearrangement buffer 102 stores the A / D-converted image, rearranges to order of coding the display order of each picture.
[0142]
　In step S103, the calculation section 103, an image rearranged by the processing in step S102, calculates a difference between the predicted image. Prediction image from the motion prediction and compensation unit 115 when the inter-prediction, if the intra prediction from the intra prediction unit 114, is supplied to the arithmetic unit 103 via the selector 116.
[0143]
　Difference data amount of data is reduced compared to the original image data. Therefore, as compared with the case of directly coding the image, it is possible to compress the data amount.
[0144]
　In step S104, the orthogonal transform unit 104 performs orthogonal transform on the difference information generated by the processing in step S103. Specifically, the discrete cosine transform, orthogonal transform such as Karhunen-Loeve transform is performed, transform coefficients are outputted.
[0145]
　In step S105, the quantization unit 105 and the sub-macroblock quantization unit 121 obtains the quantization parameter. It will be described later in detail a flow of the quantization parameter calculation process.
[0146]
　In step S106, the quantization unit 153 of the quantization unit 105 uses the quantized values ​​of the sub-macro each block calculated by the processing in step S105, quantizing the orthogonal transform coefficient obtained by the processing in step S104 to.
[0147]
　Difference information quantized by the processing in step S106 is locally decoded as follows. That is, in step S107, the inverse quantization unit 108 inversely quantizes the characteristic corresponding orthogonal transform coefficient quantized generated by the processing in step S106 (also referred to as quantized coefficients) to the characteristics of the quantization unit 105 . In step S108, the inverse orthogonal transform unit 109, an orthogonal transform coefficient obtained by the processing in step S107, the inverse orthogonal transform characteristics corresponding to the characteristics of the orthogonal transform unit 104.
[0148]
　In step S109, the arithmetic unit 110 adds the locally decoded difference information prediction image to generate a locally decoded image (an image corresponding to the input to the arithmetic unit 103). Deblocking filter 111 in step S110, filters the image generated by the processing in step S109. Thus, block distortion is removed.
[0149]
　In step S111, the frame memory 112 stores the image block distortion has been removed by the processing in step S110. Incidentally, the frame memory 112 is also an image that has not been filtered by the deblocking filter 111 is supplied from the operation unit 110, is stored.
[0150]
　In step S112, the intra prediction unit 114 performs intra prediction processing of the intra prediction modes. In step S113, the motion prediction and compensation unit 115 performs inter motion prediction process for performing motion prediction and motion compensation in inter prediction mode.
[0151]
　In step S114, the selection unit 116, based on the cost function values ​​output from the intra prediction unit 114 and the motion prediction and compensation unit 115 determines the optimal prediction mode. In other words, the selection unit 116 selects the predicted image generated by the intra prediction unit 114, one of the predicted image generated by the motion prediction and compensation unit 115.　
[0152]
　The selection information indicating the one of the predicted image is selected from among the intra prediction unit 114 and the motion prediction and compensation unit 115, are supplied towards the predicted image is selected. If the predicted image of the optimum intra prediction mode is selected, the intra prediction unit 114, information indicating the optimal intra prediction mode (i.e., intra prediction mode information), and supplies the lossless encoding unit 106.
[0153]
　If the predicted image of the optimal inter prediction mode is selected, the motion prediction and compensation unit 115, information indicating the optimal inter prediction mode, if necessary, the information corresponding to the optimal inter prediction mode to the lossless coding unit 106 Output. The information corresponding to the optimal inter prediction mode, motion vector information, flag information, reference frame information and the like.
[0154]
　In step S115, the lossless encoding unit 106 encodes the transform coefficient quantized by the processing in step S106. That is, (the case of inter secondary differential image) the difference image with respect to, the variable length coding or arithmetic coding lossless encoding or the like is performed.
[0155]
　Note that the lossless coding unit 106, the quantization parameters calculated in step S105 is encoded, adding it to the encoded data.
[0156]
　Also, the lossless encoding unit 106, the information about the prediction mode of the prediction image selected by the processing in step S114 is encoded and added to the encoded data obtained by the difference image is coded. That is, the lossless coding unit 106, the intra prediction mode information supplied from the intra prediction unit 114, or the like information corresponding to the optimal inter prediction mode supplied from the motion prediction and compensation unit 115 also encodes the encoded data It is added to.
[0157]
　Accumulation buffer 107 in step S116 stores the coded data output from the lossless encoding section 106. Encoded data accumulated in the storage buffer 107 is appropriately read out, and transmitted to the decoding side via a transmission path.
[0158]
　Rate control unit 117 in step S117, on the basis of the compressed image stored in the storage buffer 107 by the processing in step S116, as an overflow or underflow does not occur, controlling the rate of the quantization operation of the quantization unit 105 .
[0159]
　When the process of step S117 is finished, the encoding process ends.
[0160]
[Flow of the quantization parameter calculation process]
　Next, with reference to the flowchart of FIG. 8, an example of the flow of the quantization parameter calculation process executed in step S105 in FIG. 7.
[0161]
　When the quantization parameter calculation process is started, in step S131, the sub-macro-block activity buffer 151 acquires the sub-macro block activity supplied from the rate control unit 117. Sub-macroblock activity buffer 151, the acquired sub-macro-block activity, for example, to hold one screen.
[0162]
　In step S132, the sub-macroblock quantization unit 121, the sub-macro-block activity buffer 151, a sub-macro-block activity, to obtain for example one frame. The sub-macroblock quantization unit 121 uses the obtained sub-macro-block activity, to calculate a quantization value for each sub-macroblock.
[0163]
　In step S133, the quantization parameter calculation unit 152 uses the quantized values ​​of the sub-macro each block calculated in step S132, obtains the quantization parameter Pic_init_qp_minus26.
[0164]
　In step S134, the quantization parameter calculation unit 152 uses the quantized values ​​of the sub-macro each block calculated in step S132, obtains the quantization parameter Slice_qp_delta.
[0165]
　In step S135, the quantization parameter calculation unit 152 uses the quantized values ​​of the sub-macro each block calculated in step S132, obtains the quantization parameter mb_qp_delta.
[0166]
　In step S136, the quantization parameter calculation unit 152 uses the quantized values ​​of the sub-macro each block calculated in step S132, obtains the quantization parameter Submb_qp_delta.
[0167]
　When obtaining the various quantization parameters as described above, the quantization unit 105 terminates the quantization parameter calculation process, the process returns to step S105 of FIG. 7, step S106 to execute the subsequent processing.
[0168]
　Since performing encoding and quantization parameter calculation process as described above, the image coding apparatus 100 can submacro each block can be set quantization value, perform more appropriate quantization process .
[0169]
　Further, since the transmission thus calculated the quantization parameter to the image decoding apparatus, image encoding apparatus 100 obtains a quantized value the image decoding apparatus in each sub-macroblock, the inverse quantization using the same it is possible to perform the.
[0170]
<2. Second Embodiment>
[Image decoding apparatus]
　Fig. 9 is a block diagram showing a main configuration example of an image decoding apparatus according to the present technology. The image decoding apparatus 200 shown in FIG. 9 is a decoding apparatus corresponding to the image coding apparatus 100.
[0171]
　Coded data coded by the image coding apparatus 100, via a predetermined transmission path, is transmitted to the image decoding apparatus 200 corresponding to the image encoding apparatus 100, and shall be decoded.
[0172]
　As shown in FIG. 9, the image decoding device 200, a storage buffer 201, a lossless decoding unit 202, an inverse quantization unit 203, inverse orthogonal transform unit 204, calculation unit 205, a deblocking filter 206, a screen rearrangement buffer 207, and a D / a converter unit 208. Further, the image decoding apparatus 200 includes a frame memory 209, selection unit 210, an intra prediction unit 211, motion prediction and compensation unit 212 and selection unit 213,.
[0173]
　Furthermore, the image decoding apparatus 200 includes a sub-macro-block inverse quantization unit 221.
[0174]
　Accumulation buffer 201 accumulates the encoded data transmitted. The coded data is a coded by the image coding apparatus 100. Lossless decoding unit 202, the encoded data read out from the storage buffer 201 at a predetermined timing, decoding in a manner corresponding to the encoding method of the lossless coding unit 106 of FIG.
[0175]
　Inverse quantization unit 203 operates in conjunction with sub-macro-block inverse quantization unit 221, the coefficient data obtained by decoding by the lossless decoding unit 202 (quantized coefficients) of FIG. 1 of the quantization unit 105 dequantizing a manner corresponding to the quantization scheme. In other words, the inverse quantization unit 203, supplied from the image coding apparatus 100, using the quantization parameters calculated for each sub-macroblock, a quantization coefficient in the same manner as the inverse quantization unit 108 of FIG. 1 It performs the inverse quantization of.
[0176]
　Inverse quantization unit 203, inverse quantized coefficient data, that is, the orthogonal transform coefficients, and supplies to the inverse orthogonal transform unit 204. Inverse orthogonal transform unit 204, in a manner corresponding to the orthogonal transform scheme of the orthogonal transform unit 104 of FIG. 1, and the inverse orthogonal transform the orthogonal transform coefficients, before the residual data is orthogonally transformed in the image encoding apparatus 100 to give the corresponding decoded residual data.
[0177]
　It decoded residual data obtained by the inverse orthogonal transform is supplied to the arithmetic unit 205. Further, the arithmetic unit 205 via the selector 213, predicted image supplied from the intra prediction unit 211 or the motion prediction and compensation unit 212.
[0178]
　Calculation unit 205 obtains the decoded image data by adding the predictive image and the decoded residual data, corresponding to the image data before the calculating section 103 of the image encoding apparatus 100 predicted image is subtracted. Calculation unit 205 supplies the decoded image data to the deblocking filter 206.
[0179]
　Deblocking filter 206, after removing the block distortion of the supplied decoded image, and supplies to the screen rearrangement buffer 207.
[0180]
　The screen rearrangement buffer 207 performs the sort of image. That is, the screen rearrangement buffer 102 of FIG. 1 order of frames rearranged for the order of coding, it is rearranged to the original display order. D / A conversion unit 208, an image supplied from the screen rearrangement buffer 207 converts D / A, and outputs to the display not illustrated in the drawing, is displayed.
[0181]
　The output of the deblocking filter 206 is further supplied to the frame memory 209.
[0182]
　A frame memory 209, selection unit 210, an intra prediction unit 211, motion prediction and compensation unit 212 and selection unit 213, the frame memory 112 of the image encoding apparatus 100, selection unit 113, an intra prediction unit 114, motion prediction and compensation unit 115, and corresponding respectively to the selection unit 116.
[0183]
　Selection unit 210 reads an image to be referred to as an image to be inter-processed from the frame memory 209, to the motion prediction and compensation unit 212. The selection unit 210 reads the image used for intra prediction from the frame memory 209, and supplies the intra prediction unit 211.
[0184]
　The intra prediction unit 211, information indicating the intra prediction mode obtained by decoding the header information is appropriately supplied from the lossless decoding unit 202. The intra prediction unit 211, based on this information, generates a predicted image from the reference image acquired from the frame memory 209, and supplies the generated predicted image to the selection unit 213.
[0185]
　Motion prediction and compensation unit 212 obtains The information obtained by decoding the header information (prediction mode information, motion vector information, reference frame information, flags and various parameters, etc.) from the lossless decoding unit 202.
[0186]
　Motion prediction and compensation unit 212, based on the information supplied from the lossless decoding unit 202, generates a predicted image from the reference image acquired from the frame memory 209, and supplies the generated predicted image to the selection unit 213.
[0187]
　Selecting unit 213 selects the predicted image generated by the motion prediction and compensation unit 212 or the intra prediction unit 211, and supplies the arithmetic unit 205.
[0188]
　Sub-macroblock inverse quantization unit 221, the inverse quantization unit 203 obtains the quantization parameter, using Equation (10), obtains a quantized value for each sub-macroblock, it dequantizer 203 return to.
[0189]
[Inverse quantization unit]
　FIG. 10 is a block diagram illustrating a detailed configuration example of the inverse quantization unit 203.
[0190]
　As shown in FIG. 10, the inverse quantization unit 203 includes a quantization parameter buffer 251, the orthogonal transform coefficient buffer 252, and the inverse quantization unit 253.
[0191]
　And picture parameter set of the encoded data supplied from the image coding apparatus 100, such as slice header in each layer, the parameters relating to quantization is decoded in the lossless decoding unit 202, it is supplied to the quantization parameter buffer 251 . Quantization parameter buffer 251 suitably holds the quantization parameter is supplied to the sub-macro-block inverse quantization unit 221 at a predetermined timing.
[0192]
　Sub-macroblock inverse quantization unit 221, by using the quantization parameters supplied from the quantization parameter buffer 251, for example, as Equation (5) through (10), the quantization parameter for each sub-macroblock calculating a SubMB_QP, converts it to the quantization value for each sub-macroblock, and supplies it to the inverse quantization unit 253.
[0193]
As described above in the first embodiment, when the value of Submb_qp_delta is "0", Submb_qp_delta is not transmitted. Sub-macroblock inverse quantization unit 221, if there is no submb_qp_delta the quantization parameters supplied from the quantization parameter buffer 251, the value of the quantization parameter MB_QP of each macroblock, a quantization parameter for each sub-macroblock SubMB_QP to apply to.
[0194]
　Also, the lossless decoding unit 202, encoded data supplied from the image coding apparatus 100 is obtained by decoding, orthogonal transformation coefficients quantized is supplied to an orthogonal transform coefficient buffer 252. Orthogonal transformation coefficient buffer 252 suitably holds the quantized orthogonal transform coefficient, and supplies the inverse quantization unit 253 at a predetermined timing.
[0195]
　Inverse quantization unit 253, using the quantization value for each sub-macroblock supplied from the sub-macro-block inverse quantization unit 221, supplied from the orthogonal transform coefficient buffer 252, an orthogonal transform coefficient quantized inverse quantization. Inverse quantization unit 253 supplies the orthogonal transform coefficient obtained by the inverse quantization to the inverse orthogonal transform unit 204.
[0196]
　As described above, the inverse quantization unit 203 can perform inverse quantization processing using the calculated quantized values ​​for each sub-macroblock. Thus, the image decoding device 200 can perform inverse quantization processing suitable by the contents of the image. In particular, the macro block size is extended, in a single macro block, even if it contains both the area including the flat area and texture, the image decoding device 200, the adaptive inverse quantization suitable for the respective areas performs processing, the deterioration of the subjective quality of the decoded image can be suppressed.
[0197]
　Incidentally, the inverse quantization unit 108 of the image encoding apparatus 100 illustrated in FIG. 1 has the same configuration as the inverse quantization unit 203 performs the same process. However, the inverse quantization unit 108 obtains the quantization parameter supplied from the quantization unit 105, an orthogonal transform coefficient quantized performs inverse quantization.
[0198]
　The inverse quantization unit 108, the sub-macroblock inverse quantization unit 122 performs the same processing as sub-macroblock inverse quantization unit 221 provides a quantization parameter, generating a quantized value for each sub-macroblock make.
[0199]
Decoding Process Flow
　Next, the flow of each process executed by the image decoding apparatus 200 will be described. First, with reference to the flowchart of FIG. 11, an example flow of a decoding process.
[0200]
　When the decoding process starts, in step S201, the accumulation buffer 201 accumulates the encoded data transmitted. In step S202, the lossless decoding unit 202 decodes the encoded data supplied from the accumulation buffer 201. That is, the encoded I-picture by the lossless coding unit 106 of FIG. 1, P-picture, and B-pictures are decoded.
[0201]
　At this time, the motion vector information, reference frame information, prediction mode information (intra prediction mode or the inter-prediction mode), as well as information such as flags and quantization parameters are also decoded.
[0202]
　If the prediction mode information is intra prediction mode information, prediction mode information is supplied to the intra prediction unit 211. If the prediction mode information is inter prediction mode information, motion vector information corresponding to the prediction mode information is supplied to the motion prediction and compensation unit 212.
[0203]
　In step S203, the inverse quantization unit 203, obtained by decoding by the lossless decoding unit 202, inverse-quantizes the orthogonal transform coefficient quantized. The inverse orthogonal transform unit 204 in step S204 the orthogonal transform coefficient obtained are inverse quantization by the inverse quantization unit 203, inverse orthogonal transformation in a method corresponding to the orthogonal transform unit 104 of FIG. Thus will the difference information is decoded corresponding to the input of the orthogonal transform unit 104 of FIG. 1 (output of the computation unit 103).
[0204]
　In step S205, the arithmetic unit 205, the difference information obtained by the processing in step S204, adds the predicted image. Thus the original image data is decoded.
[0205]
　In step S206, the deblocking filter 206 appropriately filters the decoded image obtained by the processing in step S205. This block distortion is removed from the appropriately decoded image by.
[0206]
　In step S207, the frame memory 209 stores the filtered decoded image.
[0207]
　In step S208, the intra prediction unit 211 or the motion prediction and compensation unit 212, may correspond to the prediction mode information supplied from the lossless decoding unit 202 performs a prediction process of the image, respectively.
[0208]
　That is, when the intra prediction mode information from the lossless decoding unit 202 is supplied, the intra prediction unit 211 performs intra prediction processing of the intra prediction modes. Also, if the inter prediction mode information from the lossless decoding unit 202 is supplied, the motion prediction and compensation unit 212 performs motion prediction processing of the inter prediction modes.
[0209]
　In step S209, the selection unit 213 selects the predicted image. That is, the selection unit 213, the predicted image generated by the intra prediction unit 211, or the prediction image generated by the motion prediction and compensation unit 212 is supplied. Selecting unit 213 selects the side where the predicted image is supplied, and supplies the predicted image to the arithmetic unit 205. The prediction image is added to the difference information by the processing of step S205.
[0210]
　In step S210, the screen rearrangement buffer 207 performs sorting of frames of the decoded image data. That is, the decoded image data, the order of frames rearranged for encoding by the screen of the image encoding apparatus 100 rearrangement buffer 102 (FIG. 1) are rearranged in the original display order.
[0211]
　In step S211, D / A conversion unit 208, the decoded image data frame is sorted in the screen rearrangement buffer 207 to convert D / A. The decoded image data is output to a display (not shown), the image is displayed.
[0212]
[Inverse quantization processing]
　Next, with reference to the flowchart of FIG. 12, an example of the inverse quantization process flow.
[0213]
　When inverse quantization process is started, the quantization parameter buffer 251, in step S231, and acquires the quantization parameter pic_init_qp_minus26 supplied from the lossless decoding unit 202.
[0214]
　In step S232, the quantization parameter buffer 251 acquires the quantization parameter slice_qp_delta supplied from the lossless decoding unit 202.
[0215]
　In step S233, the quantization parameter buffer 251 acquires the quantization parameter mb_qp_delta supplied from the lossless decoding unit 202.
[0216]
　In step S234, the quantization parameter buffer 251 acquires the quantization parameter submb_qp_delta supplied from the lossless decoding unit 202. However, if the submb_qp_delta is not present, the process of step S234 is omitted.
[0217]
　In step S235, the sub-macro-block inverse quantization unit 221, by using various quantization parameter acquired in step S231 to step S234, and calculates the quantizing values ​​for each sub-macroblock. However, not supplied submb_qp_delta from the image coding apparatus 100, when the process at step S234 is omitted, the sub-macro-block inverse quantization unit 221, a quantized value of each macro block, quantization of each sub-macroblock It is applied to the value.
[0218]
　In step S236, the inverse quantization unit 253 is held to the orthogonal transform coefficient buffer 252, an orthogonal transform coefficient quantized by using the quantization values ​​of the sub-macro each block calculated by the processing in step S235 inverse quantization.
[0219]
　When the process of step S236 is completed, an inverse quantization unit 203, the process returns to step S203, step S204 to execute the subsequent processing.
[0220]
　As described above, by performing the decoding process and the inverse quantization processing, the image decoding apparatus 200 may perform the inverse quantization process using the calculated quantized values ​​for each sub-macroblock, the content of the image inverse quantization processing appropriate by can be performed.
[0221]
<3. Third Embodiment>
[Submb_qp_present_flag]
　In the above, has been described as appropriate transmit submb_qp_delta as a quantization parameter, further so as to transmit a flag for notifying the presence or absence of submb_qp_delta each macroblock it may be.
[0222]
　In that case, the configuration of the image coding apparatus 100 is similar to the configuration example shown in FIG. It is also similar to the configuration example also configurations of the quantization unit 105 shown in FIG. However, the quantization parameter calculation unit 152, further, for each macro block, the value is calculated submb_qp_present_flag is flag information indicating whether there is submb_qp_delta not "0". If submb_qp_delta sub macro blocks belonging to the macroblock has a value not even one "0" is set to submb_qp_present_flag for example, "1". Also, if submb_qp_delta of all sub macro blocks belonging to the macroblock is "0", is set to submb_qp_present_flag for example, "0".
[0223]
　Of course, the value of submb_qp_present_flag is arbitrary, if it is possible and if it has a submb_qp_delta is not even one "0" value, which is submb_qp_delta of all sub-macroblock to identify the case of "0", any value it may be.
[0224]
　Quantization parameter calculation unit 152 in this manner to set the value, the submb_qp_present_flag as one of the quantization parameters, supplied to the lossless encoding unit 106. Lossless encoding unit 106, the Submb_qp_present_flag, added to, for example, macro block header, encodes. That, Submb_qp_present_flag, like other quantization parameter is transmitted together with the encoded data.
[0225]
　Thus, coding processing in this case it is performed in the same manner as described above with reference to the flowchart of FIG. Further, in this case will be described with reference to the flowchart of FIG. 13 is an example of the flow of the quantization parameter calculation process. Quantization parameter calculation processing, even in this case, basically is similarly performed to that described with reference to the flowchart of FIG.
[0226]
　That is, the processes of steps S331 to step S336 are performed in the same manner as the processes of steps S131 to S136 in FIG. 8. However, in this case, the quantization parameter calculation unit 152, in step S337, and calculates the quantization parameter Submb_qp_present_flag.
[0227]
　As described above, the quantization parameter submb_qp_present_flag is calculated and transmitted.
[0228]
　This means that each macro-block header data, there is Submb_qp_present_flag. Then, the sub-macroblock header of the macroblock of the value of the submb_qp_present_flag is "1", there is Submb_qp_delta, the sub-macroblock header of the macroblock values ​​submb_qp_present_flag is "0", there is no Submb_qp_delta.
[0229]
　Such encoded data is transmitted from the image encoding apparatus 100 to the image decoding apparatus 200.
[0230]
　Configuration of the image decoding apparatus 200 in this case is similar to the configuration example shown in FIG. It is also similar to the configuration example in which configuration of the inverse quantization unit 203 is also shown in Figure 10. However, sub-macro-block inverse quantization unit 221, for the macroblock submb_qp_present_flag is set to "0", without waiting for the supply of Submb_qp_delta, calculates a quantization value of each macro block, the sub-macroblock it It applied to the quantization value for each.
[0231]
　In other words, sub-macro-block inverse quantization unit 221, when submb_qp_present_flag is "1" only acquires Submb_qp_delta, to calculate the quantization value for each sub-macroblock.
[0232]
　The decoding process in this case is performed in the same manner as described above with reference to the flowchart of FIG. 11. Further, in this case, an example of the inverse quantization process flow with reference to the flowchart of FIG. 14. Inverse quantization processing, even in this case, basically is similarly performed in the case described with reference to the flowchart of FIG. 12.
[0233]
　That is, the processes of steps S431 to step S433 are performed in the same manner as the processes of step S231 to step S233 in FIG. 12. However, in this case, the quantization parameter buffer 251, in step S434, and acquires the quantization parameter submb_qp_present_flag stored in the macroblock header.
[0234]
　In step S435, the sub-macro-block inverse quantization unit 221 determines whether the value of the quantization parameter submb_qp_present_flag is "1". If the value of the quantization parameter submb_qp_present_flag is "1", the quantization parameter buffer 251, in step S436, and acquires the quantization parameter Submb_qp_delta. In step S437, the sub-macro-block inverse quantization unit 221 calculates the quantized value of each sub macro block. That is, similarly to step S234 and step S235 of FIG. 12 is performed.
[0235]
　Further, in step S435, if the value of the quantization parameter submb_qp_present_flag is determined to be "0", the sub-macro-block inverse quantization unit 221, at step S438, calculates a quantization value of each macro block, it to apply as a quantization value for each sub-macroblock.
[0236]
　When the quantization value is calculated as described above, the inverse quantization unit 253, in step S439, it performs inverse quantization using the quantization value.
[0237]
　As described above, transmit submb_qp_present_flag indicating the presence or absence of a quantization parameter submb_qp_delta for each macroblock, by such use during inverse quantization, the image decoding device 200, the presence or absence of the quantization parameter submb_qp_delta more easily be grasped, without requiring unnecessary processing such as searching for a non-existent Submb_qp_delta, more easily can be calculated quantized values.
[0238]
　Above, in the first embodiment to the third embodiment, the image coding apparatus which performs coding by scheme pursuant to AVC, and, have been described as an example an image decoding apparatus which performs decoding by methods equivalent to AVC was, but the scope of application of the present technology is not limited to this, as shown in FIG. 4, it can be applied to any image coding apparatus and image decoding apparatus for performing encoding based on the block according to a hierarchical structure .
[0239]
　Further, various quantization parameters described above may, for example, may be added to an arbitrary position of the coded data may be transmitted separately to the decoding side of the encoded data. For example, the lossless coding unit 106, the information may be described as the syntax in the bitstream. Also, the lossless encoding unit 106, the information may be stored and transmitted in a predetermined area as auxiliary information. For example, these pieces of information, may be stored in the SEI (Suplemental Enhancement Information) parameter set, such as (e.g. sequence or picture header etc.).
[0240]
　Also, the lossless encoding unit 106, the information (as a separate file) separate from the encoded data, may be allowed to transmit from the image coding apparatus to the image decoding apparatus. In that case, these (to be able to grasp the decoding side) of information and to clarify the correspondence between the encoded data is necessary, the method is arbitrary. For example, separately, may be created table information indicating a correspondence relationship, the link information indicating a corresponding destination of the data may be such as embedded in each other's data.
[0241]
　Incidentally, the quantization using the quantization value for each sub-macroblock described above (calculation of the quantization parameter for each sub-macroblock) can be performed only for the 32 × 32 or more expansion macroblock.
[0242]
　For example, the rate control unit 117, if the current macroblock is extended macroblock only calculates the activity for each sub-macroblock, a conventional process target macroblock is defined to existing coding standards such as AVC 16 for × 16 following macroblock, calculates the activity for each macro block.
[0243]
　Sub-macroblock quantization unit 121, for example, only the extended macroblock, calculates the quantized value of each sub-macroblock, with respect to the conventional 16 × 16 following macroblock quantization for each macro block to calculate the value of.
[0244]
　Quantization parameter calculation unit 152, for example, only the extended macroblock, calculates the quantization parameter Submb_qp_delta, for a conventional 16 × 16 following macroblocks, not calculated quantization parameter Submb_qp_delta.
[0245]
　Quantization unit 153, for example, only the extended macroblock, performs quantization using the quantization value for each sub-macroblock, with respect to the conventional 16 × 16 following macroblocks, each macroblock perform quantization using the quantization value.
[0246]
　By doing as described above, the image coding apparatus 100, it is possible to sufficiently expect the effect of suppressing deterioration of the subjective quality of the decoded image, the quantum for each sub-macroblock only for extended macroblocks big area performs quantization using the reduction value, the expected effect is relatively small, with respect to the macro blocks of the conventional size, it is possible to perform quantization using the quantization value for each macroblock. Accordingly, the image encoding apparatus 100, it is possible to suppress the increase in the load by performing the quantization using the quantization value for each sub-macroblock.
[0247]
　Of course, in this case, the image decoding apparatus 200, like the image coding apparatus 100, only the extended macroblock, may perform inverse quantization using the quantization value for each sub-macroblock.
[0248]
　For example, sub-macro-block inverse quantization unit 221, only the extended macroblock, calculates the quantized value for each sub-macroblock, with respect to the conventional 16 × 16 following macroblock, for each macroblock calculating a quantized value.
[0249]
　Therefore, the inverse quantization unit 253, for example, only the extended macroblock, performs inverse quantization using the quantization value for each sub-macroblock, with respect to the conventional 16 × 16 following macroblock performs inverse quantization using the quantization value for each macroblock.
[0250]
By doing so, the image decoding device 200 can be sufficiently expected effect of suppressing deterioration of the subjective quality of the decoded image, the quantization value for each sub-macroblock only for extended macroblocks big area It performs inverse quantization using the expected effects are relatively small, with respect to the macro blocks of the conventional size, it is possible to perform inverse quantization using the quantization value for each macroblock. Thus, the image decoding device 200 can suppress the increase in the load by performing the inverse quantization using the quantization value for each sub-macroblock.
[0251]
　As in the third embodiment, when to transmit the Submb_qp_present_flag, the extended macro-block only, the quantization parameter Submb_qp_present_flag may be caused to be transmitted. In other words, for the macroblock of the conventional size, it is possible to omit the transmission of the quantization parameter Submb_qp_present_flag. Of course, for a macroblock of a conventional size, it may be caused to transmit the quantization parameter submb_qp_present_flag value indicating that the value does not exist quantization parameter submb_qp_delta other than "0".

claims

A decoding unit for generating quantized data by decoding the encoded stream,
　the coding unit in the image data to a lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit of the coding as a target, a setting unit for setting a quantization parameter to be used for inverse quantizing the quantized data generated by the decoding unit,
　by using the quantization parameter set by the setting unit, generated by the decoding unit and inverse quantization unit for inverse quantizing the quantized data
　image processing apparatus comprising a.
[Requested item 2]
　The setting unit, differential quantization indicating a difference value between a quantization parameter set to the coding units in the same layer quantization parameter set to the current coding unit to be inverse quantization process and the current coding unit using parameter sets a quantization parameter of the current coding unit
　image processing apparatus according to claim 1.
[Requested item 3]
　The difference quantization parameter, wherein a difference between the quantization parameter set to the coding unit which is previously decoded in decoding order than the current coding unit and the quantization parameter set in the current coding unit
　according the image processing apparatus according to claim 2.
[Requested item 4]
　The difference quantization parameter is a difference value between the current coding unit set quantization parameter and the current coding unit quantization parameter set to the coding unit which is decoded in the previous decoding processing order than there
　the image processing apparatus according to claim 3.
[Requested item 5]
　The reference coding unit is a maximum coding unit is a coding unit of the uppermost layer
　image processing apparatus according to claim 4.
[Requested item 6]
　The encoding further comprising a receiving unit which stream to receive the minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter,
　wherein the setting unit is the smallest coding unit size received by the receiving unit according to the data, and sets the quantization parameter of the current coding unit
　image processing apparatus according to claim 5.
[Requested item 7]
　The receiving unit, from the slice header of the encoded stream to obtain the minimum coding unit size data
　image processing apparatus according to claim 6.
[Requested item 8]
　Said minimum when the coding unit size indicated by the size data is 16 pixels, the differential quantization parameter of the coding unit size is less than 16 pixels is set to 0
　the image processing apparatus according to claim 7.
[Requested item 9]
　The setting unit uses a differential quantization parameter indicating a difference value between a quantization parameter subject to current coding unit and the quantization parameter set in the current coding unit is set to belong slice decoding process, setting a quantization parameter of the current coding unit
　image processing apparatus according to claim 1.
[Requested item 10]
　The setting unit, the current coding unit is the first case in which the decoding processing order in the hierarchy of the reference coding unit, the current coding unit set quantization parameter and the current coding unit is set to belong slices using the difference quantization parameter indicating a difference value between a quantization parameter, it sets the quantization parameter of the current coding unit
　image processing apparatus according to claim 9.
[Requested item 11]
　The reference coding unit is a maximum coding unit is a coding unit of the uppermost layer
　image processing apparatus according to claim 10.
[Requested item 12]
　The encoding further comprising a receiving unit which stream to receive the minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter,
　wherein the setting unit is the smallest coding unit size received by the receiving unit according to the data, and sets the quantization parameter of the current coding unit
　image processing apparatus according to claim 9.
[Requested item 13]
　The receiving unit, from the slice header of the encoded stream to obtain the minimum coding unit size data
　image processing apparatus according to claim 12.
[Requested item 14]
　It said minimum when the coding unit size indicated by the size data is is 16 pixels, the differential quantization parameter of the coding unit size is less than 16 pixels is set to 0
　the image processing apparatus according to claim 13.
[Requested item 15]
　The setting unit, as a target the coding unit in the lower layer than the reference coding unit, if the value of the differential quantization parameter is 0, the quantization parameter set to the reference coding unit, the reference code set as the quantization parameter set to the coding unit in the lower layer than the unit
　image processing apparatus according to claim 1.
[Requested item 16]
　Targeting the coding unit in the lower layer than the reference coding unit, the value of the differential quantization parameter further comprises a receiving unit for receiving the differential identification data for identifying whether the 0,
　the setting unit, by the receiving unit using the difference identification data received, sets a quantization parameter set to the reference coding unit, as the quantization parameter set to the coding unit in the lower layer than the reference coding unit
　according to claim 15 the image processing apparatus.
[Requested item 17]
　By decoding the encoded stream to generate quantized data,
　a coding unit in the image data to a lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit of the coding as a target, the generated quantized data to set the quantization parameters to be used for inverse quantization,
　using the quantization parameter set, inverse-quantizes the generated quantized data
　image processing method.
[Requested item 18]
　Targeting the coding unit in the lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit for encoding the image data, a quantization parameter used for quantizing the image picture data a setting unit that sets,
　by using the quantization parameter set by the setting unit, a quantization unit for generating quantized data image data are quantized,
　the quantized data generated by the quantization unit code It turned into by an encoding unit for generating an encoded stream
　image processing apparatus comprising a.
[Requested item 19]
　The setting unit, differential quantization indicating a difference value between a quantization parameter set to the coding unit in the same level is set to the current coding unit to be coded processing the quantization parameter and the current coding unit set parameters,
　further comprising a transmission unit for transmitting set and an encoding stream generated by the differential quantization parameter and the coding unit by the setting unit
　image processing apparatus according to claim 18.
[Requested item 20]
　The setting unit, the difference value between the quantization parameter set in the encoded coding unit before the encoding processing order than is set as the current coding unit is a quantization parameter the current coding unit, wherein It is set as a difference quantization parameter
　image processing apparatus according to claim 19.
[Requested item 21]
　The setting unit is a difference value between the current coding unit set quantization parameter and a quantization parameter set to the coding unit which is encoded to the previous in coding order than the current coding unit It is set as the difference quantization parameter
　image processing apparatus according to claim 20.
[Requested item 22]
　The reference coding unit is a maximum coding unit is a coding unit of the uppermost layer
　image processing apparatus according to claim 20.
[Requested item 23]
　The setting unit sets a minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter,
　wherein the transmission unit transmits the minimum coding unit size data set by the setting unit
　according the image processing apparatus according to claim 22.
[Requested item 24]
　The transmission unit is a minimum coding unit size data set by the setting unit, the syntax of the generated coded stream by the encoding unit is added as slice header
　image processing apparatus according to claim 23.
[Requested item 25]
　The setting unit to set the size of the indicated minimum coding unit size data and 16 pixels, sets the differential quantization parameter of the coding unit size is less than 16 pixels to 0.
　The image processing according to claim 24 apparatus.
[Requested item 26]
　The setting unit sets the differential quantization parameter indicating a difference value of the quantization parameter set in the current coding unit to be coded processing current coding unit is set to belong slice quantization parameter ,
　further comprising a transmission unit for transmitting the coded stream generated by the set and differential quantization parameter the encoding unit by the setting unit
　image processing apparatus according to claim 18
[Requested item 27]
　The setting unit, wherein when the current coding unit is the first in the encoding processing order in the hierarchy of the reference coding unit, the current coding unit set quantization parameter and the current coding unit is set to belong slices and the difference value between the quantization parameter is set as the difference quantization parameter
　image processing apparatus according to claim 26.
[Requested item 28]
　The reference coding unit is a maximum coding unit is a coding unit of the uppermost layer
　image processing apparatus according to claim 27.
[Requested item 29]
　The setting unit sets a minimum coding unit size data indicating the minimum size of the coding unit for setting the differential quantization parameter,
　wherein the transmission unit transmits the minimum coding unit size data set by the setting unit
　according the image processing apparatus according to claim 28.
[Requested item 30]
　The transmission unit is a minimum coding unit size data set by the setting unit, the syntax of the generated coded stream by the encoding unit is added as slice header
　image processing apparatus according to claim 29.
[Requested item 31]
　The setting unit to set the size of the indicated minimum coding unit size data and 16 pixels, sets the differential quantization parameter of the coding unit size is less than 16 pixels to 0.
　The image processing according to claim 30 apparatus.
[Requested item 32]
　The setting unit, as a target the coding unit in the lower layer than the reference coded unit, to set the value of the differential quantization parameter to 0, the quantization parameter set to the reference coding unit, the reference set as the quantization parameter set to the coding unit in the lower layer than the coding unit
　image processing apparatus according to claim 18.
[Requested item 33]
　The setting unit, as a target the coding unit in the lower layer than the reference coding unit, the value of the differential quantization parameter sets the differential identification data for identifying whether the 0,
　set by the setting unit difference further comprising a transmission unit for transmitting the coded stream generated by the identification data and the pre-encoding unit
　image processing apparatus according to claim 32.
[Requested item 34]
　Targeting the coding unit in the lower layer than the reference coding unit in the reference layer of the coding unit is a coding unit for encoding the image data, a quantization parameter used for quantizing the image picture data set,
　by using the quantization parameter set, the image data is quantized to generate quantization data,
　generated to generate an encoded stream by encoding the quantized data
　image processing method.