Abstract: The present invention relates to a method for inducing a merge candidate block and a device using same. An image decoding method involves decoding motion estimation region (MER) related information; determining whether or not a predicted target block and a spatial merge candidate block are included in the same MER; and determining the spatial merge candidate block to be an unavailable merge candidate block when the predicted target block and the spatial merge candidate block are included in the same MER. Accordingly, by parallely performing the method for inducing a merge candidate, parallel processing is enabled and the computation amount and implementation complexity are reduced.
BACKGROUND
[0002]
Recently, the demand for high-resolution, high-quality video, such as HD (High Definition) video and UHD (Ultra High Definition) video is increasing in various application areas. Since the image data has been increasing the amount of high resolution, high quality is the more relatively data compared to traditional image data if the stored transmit image data using a medium such as an existing wired or wireless broadband, or with a conventional storage medium, transmission cost and It increases storage costs. In order to address these issues as the picture data of high resolution, high quality image can be compressed with high efficiency techniques are utilized.
[0003]
A video compression techniques inter picture predicting the pixel values of the current picture from a previous or subsequent picture in the current picture prediction techniques, by using the pixel information in the current picture screen for predicting the pixel values of current picture prediction techniques, It may assign a short code to a value of high appearance frequency, and transmitted or stored until there is a variety of techniques, such as an entropy encoding technique for assigning a long code to the low frequency of appearance values, and effectively compressing the image data by using such a video compression technology.
Summary of the Invention
SUMMARY
[0004]
A first object of the invention to provide a method of inducing the remaining candidates in parallel.
[0005]
A second object of the invention to provide an apparatus to perform the method of inducing the remaining candidates in parallel.
Problem solving means
[0006]
The image decoding method according to an aspect of the present invention for achieving the first object of the present invention described above is the steps, a prediction target block and the spatially remaining candidate blocks for decoding the information (Motion Estimation Region) MER included in the same MER If whether or not the determining contained in the same MER the prediction target block and the remaining spatial candidate block may include a step of determining the spatial merge candidate block with the remaining candidate blocks are not available. The video decoding method further comprises the step of determining the prediction block and the spatially merge candidate block adaptively depending on the size of the size and the prediction target block of the MER when the spatial remaining candidate blocks included in the same MER can do. It may be the case where the said MER 8x8, and the size of the prediction block to 8x4 or 4x8, at least one of spatial merge candidate block in the prediction target block is changed, the block including a point located outside the MER. The image decoding method may further comprise the step of determining whether or not included in the MER is the spatial remaining candidate blocks that have not yet been decoded. The image decoding method may further comprise the step of changing the spatial merge candidate block when it is contained in the same MER the prediction target block and the remaining spatial candidate block as a block in any of the other MER. Said modified spatially merge candidate block may be changed spatially merge candidate block to be included in the prediction target block and the other MER adaptively according to the spatial position of the remaining candidate blocks included in the same MER. The MER-related information may be information that is sent to picture units as information related to a size of the MER. Determining whether the prediction target block and the spatially remaining candidate blocks included in the same MER is the determined expression on the basis the position information, position information, the MER size information of the spatial merge candidate block for the prediction target block on the basis it may be a step of determining whether the prediction target block and the remaining spatial candidate blocks included in the same MER.
[0007]
The image decoding apparatus according to an aspect of the present invention for achieving the second object of the present invention described above is the entropy decoding unit and a prediction target block and the spatially remaining candidate blocks for decoding the information (Motion Estimation Region) MER the same MER when deciding whether or not there is included, and included in the prediction target block and the remaining spatial candidate block same MER it may further include a prediction for determining the spatial merge candidate block with the remaining candidate blocks are not available. The prediction unit may predict Buil of determining the prediction block and the remaining spatial candidate block size adaptively according to the size and the prediction target block in the case where the MER spatial remaining candidate blocks included in the same MER. The prediction unit to the case where the said MER 8x8, and the size of the prediction block to 8x4 or 4x8, at least one of spatial merge candidate block in the prediction target block is changed, the block including a point located outside the MER can. The prediction unit may judge whether or not included in the MER is the spatial remaining candidate blocks that have not yet been decoded. The prediction unit may predict Buil changing the spatial merge candidate block if it is included in the prediction target block and the remaining spatial candidate block MER same as the block with the other MER. Said modified spatially merge candidate block may be changed spatially merge candidate block to be included in the prediction target block and the other MER adaptively according to the spatial position of the remaining candidate blocks included in the same MER. The MER-related information may be information that is sent to picture units as information related to a size of the MER. The prediction unit that, based on the based on the position information, position information, the MER size information of the spatial merge candidate block for the prediction target block is determined expression the prediction target block and the spatially remaining candidate blocks included in the same MER It can predict Buil to determine whether.
Effects of the Invention
[0008]
Enabling parallel processing by performing a merge candidate block induction method according to the apparatus using the remaining candidate blocks derived method and such a method according to an embodiment of the present invention in parallel, as described above, and can reduce the amount of computation and implementation complexity is.
Brief Description of the Drawings
[0009]
Figure 1 is a block diagram showing an image encoding apparatus according to an embodiment of the invention.
[0010]
2 is a block diagram showing an image decoding according to an embodiment of the present invention.
[0011]
3 is a conceptual diagram showing a candidate block for use in the near future, and a skip mode in the embodiment;
[0012]
4 is a conceptual diagram showing the method of determining the remaining candidate blocks in the embodiment;
[0013]
5 is a conceptual diagram illustrating a method of determining the remaining candidate blocks based on the size of the MER in the embodiment;
[0014]
6 is a conceptual view showing spatial merge candidate block of the current block showing the method for determining whether or not available.
[0015]
7 is a flow chart illustrating a method of calculating the spatial merge candidate block from the merge mode in the embodiment;
[0016]
8 is a flowchart of a predicting method using the inter-picture merge mode in the embodiment;
[0017]
Mode for the Invention
[0018]
The invention will be described in bars, illustrated in the drawings certain embodiments that may have a variety of embodiments can be applied to various changes and detail in the Detailed Description. This, however, is by no means to restrict the invention to the specific embodiments, it is to be understood as embracing all included in the spirit and scope of the present invention changes, equivalents and substitutes. In describing the drawings was used for a similar reference numerals to like elements.
[0019]
First, the term of the second, etc., can be used in describing various elements, but the above elements shall not be restricted to the above terms. These terms are only used to distinguish one element from the other. For example, without departing from the scope of the present invention, the first component may be referred to as a second configuration can be named as an element, similar to the first component is also a second component. And / or the term includes any item of the items described concerning the combination or plurality of the plurality of related items disclosed.
[0020]
It understood that when one element is described as being "connected" or "coupled" to another element, but may be directly connected or coupled to the other components, may be other element in between It should be. In contrast, when an element is referred to there being "directly connected" to another element or "directly connected", it should be understood that other components in the middle that does not exist.
[0021]
The terms used in the present specification are merely used to describe particular embodiments, and are not intended to limit the present invention. Expression in the singular number include a plural forms unless the context clearly indicates otherwise. In this application, the terms "inclusive" or "gajida" terms, such as is that which you want to specify that the features, numbers, steps, actions, components, parts, or one that exists combinations thereof described in the specification, the one or more other features , numbers, steps, actions, components, parts, or the presence or possibility of combinations thereof and are not intended to preclude.
[0022]
With reference to the accompanying drawings, it will be described in detail preferred embodiments of the invention. The same reference numerals for the same components on the accompanying drawings and the description redundant with respect to the same elements will be omitted.
[0023]
[0024]
Figure 1 is a block diagram showing an image encoding apparatus according to an embodiment of the invention.
[0025]
1, the image encoding device 100 includes a picture dividing unit 110, an inter prediction unit 120, intra prediction unit 125, conversion unit 130, a quantization unit 135, a rearrangement unit (160 ), and it may include an entropy coding unit 165, an inverse quantization unit 140, an inverse transformation unit 145, filter unit 150 and memory 155. the
[0026]
FIG constituent parts shown in Fig. 1 does not mean that each independently shown to represent another characteristic feature, made of an constituent parts are separate hardware or a software unit in the image encoding apparatus. That is, the respective constituent parts combined addition of convenience, each of the configuration of at least one constituent part that includes the list part two configurations described or made part a configuration, it is possible to perform a divided parts of one configuration addition plurality of configuration functions for each of these one is included in the scope of the present invention that do not are out of the configuration in the nature of the present invention examples of an integrated and separate exemplary embodiment portion.
[0027]
In addition, some of the components are not the essential components that perform essential functions in the present invention can only be an optional component to improve the performance. Structure of the present invention can only be implemented to include only the essential component parts to implement the essence of the present invention except for the components that are used to improve performance, including only optional configuration required components except the elements that are only used for better performance It is also included in the scope of the present invention.
[0028]
A picture dividing unit 110 can be divided for the input picture to at least one processing unit. At this time, in units of prediction unit may be: (CU Coding Unit) (Prediction Unit:: PU) may be a, a translation unit (TU Transform Unit) and may be a coding unit. Picture division 105 in divided into a plurality of coding unit, a prediction unit, and the combination of the transform unit for the one picture and a predetermined reference (for example, a cost function), as a coding unit, a prediction unit and a translation unit, a combination to select it can be encoded in the picture.
[0029]
For example, one picture can be divided into a plurality of coding units. In order to divide the unit of encoding in a picture quadtree structure (Quad Tree Structure) and can use a recursive tree structure there to one image or full-size unit of encoding to the root divided coded danwieun is divided into different encoding unit encoding unit has a child node can be divided by the number of. The encoding unit is no longer split in accordance with a predetermined restriction is a leaf node. That is, if we assume that the square divided only possible for one of the coding unit, a coding unit may be divided into up to four different coding units.
[0030]
Or less, and in the embodiment of the present invention not only it means a unit of encoding the meaning of the coded unit to be used in the sense of the decoding unit.
[0031]
Prediction unit may be divided to have the form of at least one of the square or rectangle of the same size within a coded unit.
[0032]
If not the minimum coding unit when generating a prediction unit that performs intra picture prediction based on the encoding unit may perform intra picture prediction without being divided into a plurality of prediction units of NxN basis.
[0033]
It may include an intra-prediction unit that performs inter-prediction unit 120 and the intra prediction for performing inter picture prediction predictor 125. The For the prediction unit whether to use the inter picture prediction or decision whether to perform intra picture prediction, and it is possible to determine the specific information (e.g., the intra-prediction mode, motion vectors, reference picture, and so on) for each prediction method. At this time, the prediction process unit is performed and the prediction method and the specific process unit to be the content determined may be different. For example, the prediction method and the prediction mode and the like is determined as a prediction unit, for performing prediction may be performed in a conversion unit. Residual values between the generated prediction block and the original block (residuals block) can be input to the converter 130. Further, the prediction mode information used for prediction, the motion vector information which are coded by the entropy coding unit 135, together with the residual value may be delivered decoding groups. When using a specific encoding mode, instead of generating a prediction block by the prediction unit (120, 125), by directly coding the source block it is also possible to transfer the decryption unit
[0034]
The inter picture predicting unit may predict a prediction unit based on the information of at least one picture of the previous picture or a subsequent picture of the current picture. The inter picture predicting unit reference picture interpolation, motion predictor may include a motion compensation portion.
[0035]
The reference picture interpolation may receive service information from the reference picture memory 155, it generates the pixel information of more than integer pixels in a reference picture. Can be used for luminance pixel, quarter-8-tap interpolation filter (DCT-based Interpolation Filter) in the DCT-based otherwise the filter coefficient to generate the pixel information of the integer pixels in units of pixels or less. For the color difference signals is 1/8 4-tap interpolation filter (DCT-based Interpolation Filter) in the DCT-based having different filter coefficients on a pixel-by-pixel basis to generate the pixel information of integer pixels or less can be used.
[0036]
Motion estimation unit may perform motion estimation based on the reference picture in a reference picture interpolation by the interpolation. As a way to calculate the motion vector FBMA (Full search-based Block Matching Algorithm), TSS (Three Step Search), NTS (New Three-Step Search Algorithm) or the like can be used a variety of methods. A motion vector may have a motion vector value of 1/2 or 1/4 pixel units on the basis of the interpolation pixel. The motion predictor different from the motion prediction methods to predict the current prediction unit. A motion prediction method Skip (Skip) method, merge (Merge) method, can be used in a variety of ways, including (Advanced Motion Vector Prediction) AMVP way.
[0037]
According to an embodiment of the present invention can perform prediction in parallel by defining (Motion Estimation Region) MER when performing the inter picture prediction. For example, the near future or the inter-picture prediction using a skip is performed when predicting the current block and spatially merge candidate block to determine whether or not included in the same MER and the same MER the prediction target block and the spatially merge candidate block If that is not included in it it is determined whether the remaining spatially determined by the remaining candidate blocks are not available for the candidate blocks included in the MER or not yet decoded spatial merge candidate block may determine the remaining candidate blocks. Hereinafter, embodiments of the present invention will be described in detail with respect to the prediction operation unit when performing the inter picture prediction.
[0038]
An intra prediction unit may generate a prediction unit based on the pixel information of the reference pixel information around the current block in the current picture. Performing a current when a neighboring block of a prediction unit of a pixel by performing the block is then the reference pixel using inter picture prediction performs the inter picture prediction with reference prediction pixels around the screen which is included in the block performing the inter picture prediction It can be used by replacing the pixel information of the reference block. In other words, if reference pixels are not available, it may be replaced by at least one reference pixel in the reference pixels available for reference information that is not available pixels.
[0039]
In the intra picture prediction mode prediction may have a non-directional mode that does not use the directional jeongboeul for the performance of the directional prediction mode, the prediction using the reference pixels in accordance with information on a prediction direction. And a mode for predicting the mode and color difference information to predict the luminance information may be different, it is possible to take advantage of the intensity information the predicted intra-prediction mode information or the prediction luminance signal information to estimate the color difference information.
[0040]
Screen if the same size of the size of the translation unit of the prediction unit in performing the prediction, that exists on the left side of the prediction unit of pixels, a pixel existing in the upper left, the screen for the prediction unit based on the pixels existing in the top within the perform a prediction, but when the size of the intra prediction of the unit for the performance of the predicted size conversion unit be different, it is possible to perform the intra picture prediction using a reference on the basis conversion unit pixel. It is also possible to use a prediction within the screen using the NxN split only for the minimum coding unit.
[0041]
Prediction method screen may generate a prediction block after applying the MDIS (Intra Mode Dependent Smoothing) filter to a reference pixel according to the prediction mode. MDIS type of filter applied to the reference pixel may be different. To carry out the prediction method selection screen intra prediction mode of the current prediction unit it may be predicted from the intra-prediction mode of the prediction unit existing in the vicinity of the current prediction unit. When using the mode information predicted from the surrounding prediction unit for predicting a prediction mode of the current prediction unit, when the same is the intra prediction mode of the current prediction unit and the surrounding prediction unit, and the current prediction unit using the predetermined flag information. can transmit the information that the prediction modes of the surrounding prediction unit of the same, if, it is possible if the prediction mode of the current prediction unit and the peripheral units of different prediction, by performing the entropy coding to encode the prediction mode information of the current block.
[0042]
In addition, a residual block that contains the prediction section 120, 125 predicted by performing a prediction based on a prediction unit of the unit to the original block of the prediction unit and the difference value of the residual values (Residual) information generated by the can be generated. The generated residual block may be input to the converter 130. In the converter 130, such as a residual block, including residual value (residual) information of the prediction unit generated from the source block and the prediction unit (120, 125) and the DCT (Discrete Cosine Transform) or DST (Discrete Sine Transform) conversion using the method can be converted. Is to apply the DCT to determine the intra-prediction mode information of the prediction unit used to generate the residual block might seem applying a DST to the base in order to convert the residual block.
[0043]
The quantization unit 135 may quantize the values converted into the frequency domain in a transform unit 130. The Based on the importance of the image or depending on the block quantization coefficient it may be varied. A value calculated by the quantization unit 135 may be provided to the inverse quantization unit 140 and the reordering unit 160.
[0044]
Reordering unit 160 may perform the reordering of the coefficient value for the quantized residual values.
[0045]
Rearrangement unit 160 may change the form factor of the two-dimensional block by a coefficient scanning method (Coefficient Scanning) in the form of a vector of 1 dimension. For example, the rearrangement unit 160 may change the diamond goneol scan (Diagonal Scan) to scan from a DC coefficient by way of the high frequency coefficients to the areas to form a one-dimensional vector. Depending on the transform size and the intra-prediction mode of the unit diamond polygonal scan vertical scan method of scanning a block form factor of the two-dimensional non-method (Diagonal Scan) in the column direction, the horizontal scanning of a block shape factor of two dimensions in the row direction. this scanning method can be used. That is, according to the size conversion unit and the intra prediction mode diamond polygonal scan, how to scan any of the vertical scanning and the horizontal scanning is to determine whether to use.
[0046]
The entropy encoding unit 165 may perform entropy-encoding on the basis of the value calculated by the reordering unit 160. The Entropy encoding, for example, may be used for various coding methods such as exponential Golomb (Exponential Golomb), CABAC (Context-Adaptive Binary Arithmetic Coding).
[0047]
The entropy encoding section 165 rearrangement unit 160 and the prediction unit (120, 125) encoding the residual value coefficient information and the block unit from the type information, the prediction mode information, division unit information, a prediction unit of information and transmission unit information, motion vector information, and reference frame information, interpolation information, filtering information, MER information of the block can be encoded in a variety of information.
[0048]
The entropy coding unit 165, the coefficient may be a value of an encoded input unit in the rearrangement unit 160, using the CABAC entropy encoding method such as entropy encoding to perform.
[0049]
The inverse quantization unit 140 and inverse transform unit 145 inverse quantizes the values quantized by the quantization unit 135 and inverse transform the values converted by the conversion unit 130. Residual value (Residual) generated by the inverse quantization unit 140 and inverse transformation unit 145 is the prediction unit restoring combined with the motion estimator, a motion compensator, and intraprediction predicted through parts prediction unit comprises a (120, 125) it is possible to produce a block (block Reconstructed).
[0050]
Filter unit 150 may include at least one of a deblocking filter, offset correction, ALF (Adaptive Loop Filter).
[0051]
De-blocking filter may be removed and the resulting block distortion due to the interface between the block in the reconstructed picture. To perform a de-blocking can be determined whether or not to apply the deblocking filter to the current block based on pixels included in several rows or columns included in the block in order to determine. For the application of the deblocking filter to the block can be applied in a strong filter (Strong Filter) or a weak filter (Weak Filter) in accordance with the necessary de-blocking filter strength. In addition, there horizontal filtering and vertical filtering for the performance of vertical filtering and horizontal filtering applying the deblocking filter may allow parallel processing.
[0052]
Offset compensation unit for performing a de-blocking the image it is possible to correct the offset of the original image in pixels. Offset and then divided into the area of the number of certain of the pixels included in the image to perform the offset correction for the specified picture determines the area to perform the offset considering a method of applying an offset to the area or edge information of each pixel you can use the method of applying.
[0053]
(Adaptive Loop Filter) ALF may perform filtering on the basis of a comparison of the original picture and the filtered reconstructed image value. Divide the pixels included in the image in a predetermined group can be performed by determining the differential filter as a single filter to be applied to the group for each group. Information relating to whether to apply the ALF is a luminance signal may be transmitted for each coding unit (Coding Unit, CU), the size and the coefficient of ALF applied according to each of the blocks may vary. ALF may also vary the number of coefficients included accordingly can have a variety of configurations, filter. Filtering related information in these ALF (filter coefficient information, ALF On / Off information and filter type information) is included in the predetermined set of parameters in the bitstream may be transmitted.
[0054]
Memory 155 may be provided in a can store the restored block, or picture, or the picture is stored recovery block in performing the predictive inter-picture prediction unit (120, 125) output by the filter section 150.
[0055]
[0056]
2 is a block diagram showing an image decoding according to an embodiment of the present invention.
[0057]
2, the video decoder entropy decoding unit 210, a reordering unit 215, an inverse quantization unit 220, an inversion unit 225, a prediction unit (230, 235), a filter unit 240, a memory It may be included (245).
[0058]
If the video bit streams from the video encoder input, the input bit stream can be decoded in the process of a video encoder and opposite.
[0059]
The entropy decoding unit 210 may perform entropy decoding in the reverse procedure to that performing the entropy coding in the entropy coding unit of the video encoder. Entropy decoding unit information for generating the predicted block of the decoding information in 210 is available in a prediction unit (230, 235) and a residual value, perform the entropy decoding on the entropy decoding unit may be inputted to the reordering unit 215 is.
[0060]
The entropy decoding unit 210 can decode the information associated with the prediction of the intra prediction performed in the encoder and the screen. If the predetermined restrictive in performing intra picture prediction and inter picture prediction in the video encoder as described above, perform the entropy decoding on the basis of this constraint section provides information on the intra picture prediction and inter picture prediction for the current block It can be.
[0061]
Reordering unit 215 may perform reordering based on the way rearrange the entropy decoded bitstream in the entropy decoding unit 210 in the encoding unit. The coefficients represented as one-dimensional vector form may be further rearranged to restore it to the coefficients of the blocks in the form of two-dimensional.
[0062]
The inverse quantization unit 220 may perform inverse quantization based on the count value of the reordered block and the quantization parameter provided by the encoder.
[0063]
Inverse transformer 225 may perform inverse DCT and inverse DCT and DST for the DST performed in the conversion unit for the result of the quantization performed in the video encoder. The inverse transform may be performed on the basis of the transmission unit is determined from the video encoder. In the conversion unit of the video encoder DCT and DST prediction method it may be selectively performed according to the current block a plurality of information such as the size and the prediction direction, the inversion unit 225 of the video decoder performs the conversion unit of the video encoder the inverse transform may be performed on the basis of the conversion information.
[0064]
Predictor (230, 235) may generate a prediction block based on a previously decoded block, or picture information provided by the entropy decoding unit 210, a prediction block generated additional information and the memory 245 provided in the.
[0065]
Predictor (230, 235) may include prediction portion predicting unit determining unit, the inter prediction unit and the screen. Prediction unit judging section receives a variety of information such as the motion prediction information of the prediction mode information, prediction method between the screen of the prediction method information prediction unit which is input from the entropy decoding unit, the screen separates the prediction unit of the current coding unit, and the prediction unit Or is that performing inter-picture prediction may be performed to determine whether the prediction screen. Inter-picture prediction section provided in the video encoder using the information necessary for inter picture prediction of a current prediction unit of the current prediction unit based on the information contained in the at least one picture of the previous picture or a subsequent picture of a current picture containing the current prediction unit for it to perform inter picture prediction.
[0066]
Whether any method of, based on the coding units for performing inter-picture prediction motion estimation method of the prediction unit included in the encoding unit a skip mode (Skip Mode), merge mode (Merge mode), AMVP mode (AMVP Mode) the can be determined.
[0067]
According to an embodiment of the present invention can perform prediction in parallel by defining (Motion Estimation Region) MER when performing the inter picture prediction. For example, the near future or the inter-picture prediction using a skip is performed when predicting the current block and spatially merge candidate block to determine whether or not included in the same MER and the same MER the prediction target block and the spatially merge candidate block If that is not included in it it is determined whether the remaining spatially determined by the remaining candidate blocks are not available for the candidate blocks included in the MER or not yet decoded spatial merge candidate block may determine the remaining candidate blocks. Hereinafter, the embodiment of the present invention will be described in detail with respect to the operation prediction unit.
[0068]
Intra picture prediction unit may generate a prediction block based on a pixel information in the current picture. When the prediction unit of the prediction unit performing the intra picture prediction, it is possible to perform the intra picture prediction based on the intra prediction mode information of the prediction unit provided in the video encoder. Prediction sub-screen may include a MDIS filter, the reference pixel interpolating units, DC filter. MDIS filter may be applied to determine whether a filter is applied in accordance with the prediction mode of the current prediction unit as a part that filters the current block of the reference pixel. Using the prediction mode of the prediction unit and the MDIS filter information provided from the video encoder may perform the filtering for the current block of the reference pixel. If the current mode is a prediction mode of the block does not perform filtering, MDIS filter can not be applied.
[0069]
Reference pixel interpolation unit may if the prediction mode of the prediction unit of one prediction unit that performs intra picture prediction based on the pixel value of the interpolation reference pixels, by interpolating the reference pixel to generate a reference pixel of a pixel unit or less constant value . If the prediction mode of generating a predictive block without the prediction mode of the current prediction unit interpolates the reference pixels a reference pixel can not be interpolated. DC filter has a prediction mode of the current block to generate a prediction block through the filter when the DC mode.
[0070]
The reconstructed block or picture may be provided to filter unit 240. Filter unit 240 may include the deblocking filter, offset correction, ALF.
[0071]
From the video encoder can be provided with information and di was applied when the blocking filter, information on whether the applied strong filter or apply a weak filter to whether on whether or not applying the deblocking filter to the block or picture. The deblocking filter of a video decoder being provided for the de-blocking filter-related information provided from the video encoder may perform deblocking filtering on the block in the video decoder. But, as in the video encoder performs the first vertical deblocking filtering and horizontal deblocking filtering, it is possible to perform at least one of a vertical de-blocking and de-blocking in the horizontal overlap. Vertical de-blocking a vertical or horizontal deblocking filtering deblocking filter could not be carried out prior to be performed in the overlap filter and horizontal deblocking filtering. Parallel processing of the deblocking filtering through this de-blocking filter process is possible (Parallel Processing).
[0072]
Offset correcting unit may perform the offset correction on the restored image based on the information such as the type and the offset value of the offset compensation applied to the video encoding operation.
[0073]
ALF may perform filtering on the basis of a comparison of the reconstructed image and the original image values after performing the filtering. On the basis of whether the ALF application provided from the encoder information, ALF coefficient information and the like can be applied to the encoding unit ALF. The ALF information may be provided to include a particular parameter set.
[0074]
Memory 245 stores the reconstructed picture blocks or can to be used as a reference picture or a reference block may also provide the reconstructed picture as an output module.
[0075]
In the following embodiments, the present invention as described above, used as a term for convenience coding unit (Coding Unit) coding units of description, but the encoding may be not only a unit for performing the decoding. Hereinafter, an image prediction method described in Figs. 3 to 11 in accordance with an embodiment of the present invention may be carried out in a forming section, such as the prediction unit comprising in Figs.
[0076]
[0077]
3 is a conceptual diagram showing a candidate block for use in the near future, and a skip mode in the embodiment;
[0078]
Hereinafter, the embodiment of the present invention described with limited to the merge mode for convenience of explanation, however, it is applied in the same way in the skip mode, and such embodiments are also included in the scope of the present invention.
[0079]
Referring to Figure 3, in order to perform inter picture prediction mode can be used with the remaining spatial remaining candidate blocks (300, 305, 310, 315, 320) and the time remaining candidate blocks (350, 355).
[0080]
Spatial remaining candidate blocks (300, 305, 310, 315, 320) is a point at the top left of the prediction based on the location of the prediction block to the current block (xP, yP), nPSW the width dimension of the prediction target block, prediction when the width dimension of the block that nPSH (xP-1, yP + nPSH) of points a fourth block 315, the first block including the point (xP-1, yP + nPSH-MinPuSize) containing ( 300), (xP + nPSW, yP-1) of that third block (310), (xP + nPSW-MinPuSize, a second block (305, including the point yP-1)), (xP- containing the fifth block (320) including a MinPuSize, the point yP-1) may be.
[0081]
Time remaining candidates can be used a plurality of candidate blocks and the first call block 350 may be a block including the point (xP + nPSW, yP + nPSH) located in the call-picture. If the case 1 is not available for a call block 350 does not exist (e.g., when the first call block is not performing the inter picture prediction), a point located in a call-picture (xP + (nPSW >> 1), a second call block (355 containing yP + (nPSH >> 1))) may be used instead.
[0082]
According to an embodiment of the invention, based on the predetermined area in order to perform inter picture prediction using a merge mode, in parallel, when the motion estimation is carried out it can be determined whether to use the remaining candidate blocks. For example, determining whether the remaining candidate blocks are in the same area based on the area of a predetermined size to determine the remaining candidate blocks for performing the merge mode to determine or not to use or whether to use the remaining candidate blocks or using, for example, how to replace the other remaining candidate blocks can be performed in parallel, the motion prediction on the basis of a given area. Hereinafter, embodiments of the present invention will be described with respect to parallel movement prediction method using such a merge mode.
[0083]
[0084]
4 is a conceptual diagram showing the method of determining the remaining candidate blocks in the embodiment;
[0085]
4, will be described on the assumption that if the LCU (Largest Coding Unit), divided into four MER (Motion Estimation Region).
[0086]
Claim is five spatial merge candidate block when performing the inter picture prediction using a merge mode for 1 MER (MER0) a first prediction block (PU0) is the same manner as in 1 Figure 4 for the prediction block (PU0) that includes a the spatial remaining candidate blocks (400, 405, 410, 415, 420) may be present. Five remaining candidate blocks (400, 405, 410, 415, 420) may be a MER claim 1 present in a location that is not included in (MER0), and encoding and decoding the block has already been performed.
[0087]
Claim 4 of the second prediction block (PU1) is the second MER (MER1) is merged mode with spatial remaining candidate blocks for performing the inter picture prediction (430, 435, 440, 445, 450) as a predicted block, which contains the the remaining candidate blocks (430, 435, 445, 450) comprises a block belonging to the same MER and MER to perform the current predicted as a block that exists in the interior of 2 MER (MER1), and one of the remaining candidate blocks (440) is a block included in the current LCU MER or have not been encoded, and decoding is performed as a block existing in the right side of the MER.
[0088]
According to an embodiment of the invention, if present the remaining candidate blocks in the block belonging to the same MER as the current block, the remaining candidate blocks of the current block, and excludes, the block of a different location, at least one according to the current block size and MER size the motion information can be added to the remaining candidates.
[0089]
The block including a point at which a vertical or horizontal direction are in different MER can be added to the remaining candidate blocks. Or it may be added to the blocks belonging to different MER of the nearest position and the candidate block to the remaining candidate blocks. Or it may be added to the remaining candidate blocks in a predetermined position depending on the shape and size of the current block.
[0090]
As an example, in the case of a merge candidate block 435 and the remaining candidate blocks 450 in the upper left corner at the top, is changed to other blocks (455, 460) including a second point MER located outside in the vertical direction merges It can be used as a candidate block. Remaining candidate block 445 is located in the remaining candidate block 430 and the lower left corner on the left side can be changed to other blocks (465, 470) including a point located on the MER outside in the horizontal direction as the remaining candidate blocks. If included in the same MER can not be used with the remaining candidate block, the other block containing a single point included in another MER based on the location of the remaining candidate blocks may change the remaining candidate blocks.
[0091]
The it can be used to replace the remaining candidate blocks 475 also contained in the same MER Similarly, if the third prediction block (PU2) to block 480 to present on the vertical direction. How to change the position of the remaining candidate blocks as above is used for changing an embodiment as above, as the position of the spatial remaining candidate blocks in a block included in an MER in the other direction than the vertical or horizontal direction in accordance with the present invention carried out it is also possible to change the position of the remaining candidate blocks and these examples also are included in the scope of the present invention.
[0092]
In order to carry out the method for determining the merge candidate blocks you can follow the steps below.
[0093]
1) Motion Estimation Region (MER) step for decoding information
[0094]
MER-related information, it can be determined whether or not include information relating to the size and this MER MER size information or a block size prediction target block on the basis of the basis of the information of this is included in the MER.
[0095]
2) determining whether the prediction target block and the remaining spatial candidate blocks included in the same MER
[0096]
You may perform the procedure above to determine the spatial merge candidate block adaptively depending on the size of the size and the prediction target block of the MER case in which the prediction target block and the spatially remaining candidate blocks included in the same MER .
[0097]
3) determining the remaining candidate blocks are not available for spatial merge candidate block if the block contains the prediction and the spatial remaining candidate blocks in the same MER
[0098]
If the prediction target block and the spatially remaining candidate blocks included in a same MER it can be used to determine the non-availability of spatial merge candidate block merge candidate block and change the spatial remaining candidate blocks included in the same MER the other remaining candidate blocks. The remaining candidate blocks also determined as not usable, as the above-mentioned below, it is also possible that are not used by inter picture prediction using a near future.
[0099]
According to another embodiment of the method of the present invention does not use the remaining candidate blocks that belong to the same MER may also be used.
[0100]
For example, the remaining candidate block of the already encoded and decoded were conducted blocks belonging to the current predicted to proceed MER and other MER are they merge mode as a block that can be utilized to carry out the inter picture prediction using a merge mode in parallel the may be used as a prediction candidate block using inter-picture. However, the current part of the block in the prediction in the same MER and MER is in progress are inter picture prediction candidate can not be used as a block addition encoded and block decoding is not carried out too prediction candidate inter picture for performing inter picture prediction using a merge mode, embodiment may not be used as a block and such examples are also included in the scope of the present invention.
[0101]
[0102]
5 is a conceptual diagram illustrating a method of determining the remaining candidate blocks based on the size of the MER in the embodiment;
[0103]
Referring to Figure 5, it is possible according to the size of MER unit of the prediction and the current size to determine the remaining candidate adaptively. For example, the location of the remaining candidates (A, B, C, D, E) when falling within the remaining candidate is equal MER corresponding to the processing that is not available for the remaining candidates and the current block size and MER size in some may be added to at least one block, the motion information of the different positions of the candidate in the near future.
[0104]
In Figure 5 will be described by assuming the case where the MER of 8x8 and a 4x8 prediction block. If the MER size of the 8x8 block A included in the prediction target block is included in the same MER, blocks B, C, D and E are included in the non-identical MER.
[0105]
In the case of block A may be changed to a position that is not included in the non-identical MER block and can be changed to the block A 'position. Therefore, according to an embodiment of the present invention if the remaining candidate blocks of a current block belongs to the same MER as the current block, the remaining candidate blocks of the current block is excluded by a block of a different location, at least one according to the current block size and MER size the motion information can be added to the remaining candidates.
[0106]
[0107]
According to an embodiment of the invention the size information of the MER can be transmitted it is included in the high-level syntax information.
[0108]
Table 1 below illustrates a method for transmitting information MER size at a high level syntax.
[0109]
[0110]
[0111]
[0112]
Referring to Table 1, it is based on the syntax elements log2_parallel_merge_level_minus2 values contained in the parent structure, such as a picture parameter set syntax can calculate the size information of the MER. Be a syntax element log2_parallel_merge_level_minus2 the other parent syntax structure than the picture parameter set to be included, and such embodiments are also included in the scope of the present invention.
[0113]
[0114]
Table 2 below is a table showing the relationship between the size of the MER based on the log2_parallel_merge_level_minus2 value.
[0115]
[0116]
[0117]
[0118]
Referring to Table 2, log2_parallel_merge_level_minus2 value may be differently defined according to the value of the MER size may have a value of 0 to 4, and syntax elements. If the MER 0 is the same as in the case of performing the inter picture prediction using merge mode without using the MER.
[0119]
Syntax elements including a size of the MER is below, can be used to define the term MER size syntax element in an embodiment of the present invention and to define the MER size syntax element, as shown in Table 2, among other things as an illustration possible to determine the MER size by using the method and also such a syntax element representation is included in the scope of the present invention.
[0120]
[0121]
6 is a conceptual view showing spatial merge candidate block of the current block showing the method for determining whether or not available.
[0122]
6, the prediction target block 600 and the prediction based on the location and MER size syntax element of the spatial merge candidate block 650 is located in the vicinity of the target block 600 determines the availability of spatial merge candidate block can do.
[0123]
That the point existing in the upper left position (xP, yP) the prediction target block and (xN, yN) for the remaining candidate blocks in the Equations (1) and (2) below, assuming that existing in the upper left position through it can be determined whether the available spatial merge candidate blocks.
[0124]
<수학 식 1>
[0125]
[0126]
<수학 식 2>
[0127]
[0128]
The above Equation 1 and Equation 2 is an example of an equation for determining whether there is a remaining candidate block and the prediction block are included in the same MER other than the determination method above unless you are out of from the spirit of the invention using this determines how soon the candidate block and the prediction block may determine whether it contains the same MER.
[0129]
[0130]
7 is a flow chart illustrating a method of calculating the spatial merge candidate block from the merge mode in the embodiment;
[0131]
7, it decodes the MER-related information (step S700).
[0132]
MER-related information may be included in the high-level syntax structure as the syntax element information, as described above. That on the basis of the decryption information included in the same MER MER spatial merge candidate block and the prediction block, or it can be determined whether any of the other MER.
[0133]
It is determined whether the remaining spatial candidate prediction block and the current block included in the same MER (step S710).
[0134]
According to an embodiment of the invention, if present the remaining candidate blocks in the block belonging to the same MER as the current block, a block of a different location, at least one according to the current block size and MER size by the remaining candidate blocks of the current block is excluded It can be added to the movement information to the remaining candidate (step S720). According to a further embodiment of the present invention as contained in this same MER spatial merge candidate block and the prediction block, other MER present in different positions, instead of using the spatial remaining candidate blocks included in the same MER as the remaining candidate blocks by replacing the block with the spatially merge candidate block may perform inter picture prediction.
[0135]
In the case in other embodiments included in the spatial remaining the same MER candidate prediction block and the current block, may not use included in the same spatial MER remaining candidate blocks as described above, the remaining candidate blocks.
[0136]
If the remaining spatial candidate prediction block and the current block is not included in the same MER it is performed in the spatial prediction merged screen on the basis of the candidate blocks (step S730).
[0137]
[0138]
8 is a flowchart of a predicting method using the inter-picture merge mode in the embodiment;
[0139]
8, leads to motion prediction related information from the spatial remaining candidate (step S800).
[0140]
From the peripheral unit of the prediction of the prediction target block may derive a spatial remaining candidate (spatial merge candidate). Spatial soon have width and height information of the prediction unit, (Motion Estimation Region) MER be provided with information, singleMCLFlag information, partition information, and location to induce a candidate. Availability information (availableFlagN) according to the position of the spatial merge candidates on the basis of input information such as above, the reference picture information to drive (refIdxL0, refIdxL1), the list using information (predFlagL0N, predFlagL1N), motion vector information (mvL0N, mvL1N) can. Spatially merge candidate may be a plurality of blocks existing in the vicinity of the prediction target block.
[0141]
According to an embodiment of the invention remaining spatial candidate block may be classified into three types as below. 1) can be classified as the same does not belong to the MER already coded or decoded spatially merge candidate block, 2) spatial remaining candidate blocks belonging to the same MER, 3) spatial remaining candidate blocks are not already in progress the encoding and decoding.
[0142]
According to an embodiment of the invention in the same MER and parallel in order to perform inter picture prediction it does not belong to the same MER of spatial remaining candidate blocks for performing the inter picture prediction already coded or decoded spatial remaining candidate blocks in MER unit a spatial part of the remaining candidate blocks, change the spatial position of the remaining candidate blocks that can be used to spatially merge candidate block. That is, the according to the embodiment of the invention if the remaining candidate blocks of a current block belongs to the same MER as the current block, the current block of the remaining candidate blocks are excluded by the other position the at least one according to the current block size and MER size It can be added to block the motion information of said remaining candidate. Method for determining the remaining candidate blocks, as described above, determining whether there is a step, the prediction target block and the spatially remaining candidate blocks for decoding the information (Motion Estimation Region) MER included in the same MER and predicting the current block and has a spatial remaining candidate blocks can be performed by determining the remaining candidate blocks are not available if it is included in the same spatial MER remaining candidate blocks.
[0143]
According to another embodiment of the invention with spatially merge candidate block same it does not belong to the MER already coded or only spatial merge candidate block the decoded spatial merge candidate block of for performing inter picture prediction to perform inter picture prediction can.
[0144]
It induces a reference picture index value of the time remaining candidate (step S810).
[0145]
A reference picture index value of the time remaining candidates as an index value of a picture including the call time remaining candidate (call block) may be derived from the specific conditions shown below. The following conditions may be varied as optional. For example, the point at the top left of the prediction block (xP, yP), the width dimension of the prediction target block nPSW, if that the width dimension of the prediction target block nPSH, 1) (xP-1, yP + nPSH -1) will be referred to as a peripheral unit of the predicted prediction block corresponding to the present position (hereinafter, a reference picture index calculated around the prediction unit.) 2) the reference picture index value of the partition around the prediction unit calculates the index 0, and 3) when the reference picture index calculated around the prediction unit screen is not a block performing a prediction using a prediction mode 4) that is not part of the prediction target block Motion Estimation Region (the same MER and the reference picture index calculated around the predicted block), time remaining It may determine a reference picture index value of the candidate to the same value as a reference picture index value of a reference picture index calculated around the prediction unit. If the above conditions are not satisfied, the reference picture index value of the time remaining candidates can be set to zero.
[0146]
Determines a time remaining candidates induce motion prediction related information from the time remaining candidate (step S820).
[0147]
The time remaining determines a candidate block (call block) and the determined time remaining candidate block if, for example, to derive the motion prediction related information from the (call block), the call block whether soluble in the prediction target block, the prediction block to position exists in any position relative to the LCU if used to calculate a temporal predictive motion vector on the basis of conditions such as (the position of the prediction block to whether you are located at the boundary lower end relative to the LCU located on the right boundary, and so on) It may determine the location of the call block. Through a method of inducing a motion prediction information based on the reference picture information and the motion vector prediction information of the determined call blocks may derive a motion prediction related information from the time remaining candidate blocks (call block).
[0148]
Constitute a merge candidate list (step S830).
[0149]
Remaining candidate list may be configured to include at least one of the remaining candidate spatial and temporal merge candidates. Spatial and temporal merge candidates remaining candidates included in the merge candidate list may be arranged with a certain priority.
[0150]
Remaining candidate list can comprise the remaining candidates for a fixed number, in the case to generate a merge candidate for a fixed number of lack of remaining candidate, by combining the motion prediction related information with the remaining candidate generating a merge candidate or by creating a zero vector value in merging candidate can create a merge candidate list.
[0151]
[0152]
Remaining candidate induction method as above, as described above, as well as a prediction method using the inter-picture prediction method used for the remaining mode is inter picture using the SKIP mode, and such embodiments are also within the scope of the present invention.
[0153]
[0154]
Above embodiment has been with reference to describe, understand that without departing from the spirit and scope of the invention defined in the claims below are those skilled in the art can make various modifications and variations to the present invention It will be.
[0155]
Claims
[Claim 1]
(Motion Estimation Region) MER step for decoding the relevant information;
Determining whether the prediction target block and the remaining spatial candidate blocks included in the same MER; And
the prediction target block and the case is spatially remaining candidate blocks are included in the same the spatial MER remaining remaining candidate induction method comprises the step of determining the remaining candidate blocks are not available for a candidate block.
[Claim 2]
The method of claim 1, wherein
if the prediction target block and the spatially remaining candidate blocks included in the same MER further determining the spatial merge candidate block adaptively depending on the size of the size and the prediction target block of the MER merging candidate derived comprises.
[Claim 3]
The method of claim 2, wherein the
blocks when the size of the MER 8x8, and the size of the prediction block to 8x4 or 4x8, at least one of spatial merge candidate block in the prediction target block comprises a point located outside the MER merging candidate derived method being changed.
[Claim 4]
The method of claim 1, wherein
the remaining the remaining spatial candidate induction method further comprises determining whether the candidate block is included in the MER has not yet been decoded.
[Claim 5]
The method of claim 1, wherein
the prediction block and the remaining spatial candidate block when it is contained in the same MER remaining candidates induce further comprising the step of changing the spatial merge candidate block as a block in any of the other MER.
[Claim 6]
The method of claim 5, wherein the modified spatial remaining candidate blocks,
wherein said spatial remaining candidate, the prediction is adaptively based on the location of the block target block and the modified spatial merge candidate block to be included in other MER remaining candidates included in the same MER how induction.
[Claim 7]
The method of claim 1, wherein the MER-related information,
information of the remaining candidate induction method is sent to picture units as information related to a size of the MER.
[Claim 8]
The method of claim 1, wherein the prediction block and the spatially merge candidates step of the block is determined whether or not included in the same MER is,
location information, the MER size information of the location information of the prediction target block, the spatial merge candidate block the step of the remaining candidate induction method that is based on based on a determination formula to determine whether or not the prediction target block and the remaining spatial candidate blocks included in the same MER.
[Claim 9]
MER entropy decoding unit for decoding the information (Motion Estimation Region); And
determining whether the prediction target block and the spatially remaining candidate blocks included in the same MER and the remaining candidate blocks are not available for the spatial merge candidate block, if included in the prediction target block and the spatially merge candidate block same MER the image decoding apparatus further comprises: prediction unit for determining.
[Claim 10]
10. The method of claim 9, wherein the prediction unit
determines the prediction block and the spatially merge candidate block adaptively depending on the size of the size and the prediction target block of the MER when the spatial remaining candidate blocks included in the same MER prediction denied video decoding device.
[Claim 11]
11. The method of claim 10, wherein the prediction unit,
that if the size of the MER 8x8, and the size of the prediction block to 8x4 or 4x8, at least one of spatial merge candidate block in the prediction target block is located on the outside of the MER the image decoding device, comprising a step of changing the block containing.
[Claim 12]
10. The method of claim 9, wherein the prediction unit,
prediction deny the image decoding apparatus determines whether or not included in the MER is the spatial remaining candidate blocks that have not yet been decoded.
[Claim 13]
10. The method of claim 9, wherein the prediction unit,
when the prediction target block and the remaining spatial candidate blocks included in the same MER prediction denied image decoding device for changing the spatial merge candidate block as a block in any of the other MER.
[Claim 14]
The method of claim 13, wherein the modified spatial remaining candidate blocks,
said spatially merge the image decoding the prediction target block and the modified spatial merge candidate block to be included in other MER adaptively based on the location of the candidate blocks included in the same MER Device.
[Claim 15]
10. The method of claim 9, wherein the MER-related information,
information of the image decoding apparatus to be transmitted as information relating to the size of the MER in picture units.
[Claim 16]
10. The method of claim 9, wherein the prediction unit,
the prediction target block location information, the spatial merge candidate block position information, the MER size information on the basis of based on the judgment formula A to the prediction target block of the spatial merge candidate block of prediction denied video decoding device to determine whether it contains the same MER.
| # | Name | Date |
|---|---|---|
| 1 | Form 5 [16-05-2017(online)].pdf | 2017-05-16 |
| 2 | Form 3 [16-05-2017(online)].pdf | 2017-05-16 |
| 3 | Form 18 [16-05-2017(online)].pdf_541.pdf | 2017-05-16 |
| 4 | Form 18 [16-05-2017(online)].pdf | 2017-05-16 |
| 5 | Drawing [16-05-2017(online)].pdf | 2017-05-16 |
| 6 | Description(Complete) [16-05-2017(online)].pdf_540.pdf | 2017-05-16 |
| 7 | Description(Complete) [16-05-2017(online)].pdf | 2017-05-16 |
| 8 | Form 3 [09-06-2017(online)].pdf | 2017-06-09 |
| 9 | abstract.jpg | 2017-07-05 |
| 10 | 201718017198-Proof of Right (MANDATORY) [31-07-2017(online)].pdf | 2017-07-31 |
| 11 | 201718017198-FORM-26 [31-07-2017(online)].pdf | 2017-07-31 |
| 12 | 201718017198-certified copy of translation (MANDATORY) [31-07-2017(online)].pdf | 2017-07-31 |
| 13 | 201718017198-FER.pdf | 2021-10-18 |
| 14 | 201718017198-Information under section 8(2) [04-03-2022(online)].pdf | 2022-03-04 |
| 15 | 201718017198-FORM 3 [04-03-2022(online)].pdf | 2022-03-04 |
| 16 | 201718017198-OTHERS [07-04-2022(online)].pdf | 2022-04-07 |
| 17 | 201718017198-FER_SER_REPLY [07-04-2022(online)].pdf | 2022-04-07 |
| 18 | 201718017198-CLAIMS [07-04-2022(online)].pdf | 2022-04-07 |
| 19 | 201718017198-PatentCertificate03-08-2022.pdf | 2022-08-03 |
| 20 | 201718017198-IntimationOfGrant03-08-2022.pdf | 2022-08-03 |
| 1 | searchdivisional7198E_16-09-2021.pdf |
| 2 | search7198amendedAE_18-07-2022.pdf |