Sign In to Follow Application
View All Documents & Correspondence

Adaptive Entropy Coding For Images And Videos Using Set Partitioning In Generalized Hierarchical Trees

Abstract: Adaptive entropy encoding and decoding utilizing set partitioning within generalized hierarchical trees which is applicable to both embedded and non- embedded encoding. After decorrelation and quantization during encoding  a tree structure is selected from multiple candidates  based on geometric relationships within the image block  for coding the coefficients toward improving coefficient zero clustering. The tree structure has leaf and non-leaf nodes in a specified arrangement  with leaf nodes containing coefficients associated with each non-leaf node. By proper tree selection  the number of zero clustered coefficients which may be eliminated from the encoded output stream is increased. During decoding  a tree structure compatible with the encoding for the current block is used for decoding the existing coefficients from the symbol stream and restoring missing zero coefficients.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
10 October 2011
Publication Number
46/2012
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
Parent Application
Patent Number
Legal Status
Grant Date
2019-12-24
Renewal Date

Applicants

SONY CORPORATION
1-7-1 Konan  Minato-ku  Tokyo 108-0075  Japan

Inventors

1. LIU  Wei
1376 Tanaka Drive  San Jose  CA 95131  United States of America
2. GHARAVI-ALKHANSARI  Mohammad
3602 Flora Vista Avenue  #306  Santa Clara  CA 95051  United States of America

Claims

1. An apparatus for adaptive entropy encoding within an image or video encoder, comprising: a computer or an encoder (136) having a processing element and memory, said computer or encoder (136) configured for image/video encoding; said computer or encoder is configured to perform steps comprising, dividing an image or a video frame into blocks, decorrelating each block using a transform, quantizing the transform coefficients, selecting a desired tree structure from multiple candidates in response to determination of geometric relationships within the block of pixels for the image, and encoding the block using clustering of zero coefficients in response to the selected tree structure; wherein a portion of the zero coefficients are eliminated from the encoded output in response to having non-leaf nodes of said selected tree structure represent that respective leaf nodes contain only zero coefficients and not coding these descendent leaf nodes into an encoded output bit stream.

2. The apparatus as claimed in claim 1, wherein said tree structure has leaf and non-leaf nodes in a specified arrangement; and wherein one or more leaf nodes containing coefficients are associated with each non-leaf node.

3. The apparatus as claimed in claim 1, wherein said encoding of the block is performed in response to the selected tree structure according to a predetermined traversal of the tree structure; or wherein the state of each non-leaf node is represented by a bit indicating whether its descendent leaf nodes contain all zero coefficients, or do not contain all zero coefficients; or wherein a set of tree structures are retained in the encoder and configured for allowing one of the tree structures to be selected in response to said selection of tree structure; or wherein said geometric relationships which can be recognized within the blocks are selected from the group of geometric block relationships consisting of flat, noisy, horizontal, vertical, diagonal +45°, diagonal - 45°.

4. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to provide information to a decoder (142) about which transform was used when decorrelating blocks of the image.

5. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to provide information to a decoder about which tree structure was selected for use in coding each block of the image.

6. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to perform steps comprising:29 providing information to a decoder about which tree structure was selected for use in coding each block of the image; and wherein said information comprises communicating at least one index for said selected tree structure to a decoder (142) configured for receiving the encoded image.

7. The apparatus as claimed in claim 1, wherein said geometric relationship comprises a two-dimensional relationship between the coefficients in the current block being coded.

8. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured for interblock prediction or pre-filtering of the block prior to transform.

9. The apparatus as claimed in claim 1, wherein said block can be of any desired shape and size, including block sizes selected from the group of block sizes consisting of 4x4, 8x8 and 16x16, 32x32 coefficient blocks.

10. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to perform the adaptive entropy encoding within an image encoder which is configured for non-embedded encoding.

11. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to perform the adaptive entropy encoding within an image encoder which is configured for embedded encoding, in which encoding is performed across any desired number of bit planes and can be stopped at any desired coding rate.

12. The apparatus as claimed in claim 1, wherein said coding is performed to a desired coding rate in response to fitting within a bit-budget for an encoded image stream.

13. The apparatus as claimed in claim 1, wherein said transform comprises a spectral transform; or wherein said transform comprises either a discrete wavelet transform (DWT) or a discrete cosine transform (DCT), or any overlapped transforms.

14. The apparatus as claimed in claim 1, further comprising: a computer or a decoder (142) having a processing element and memory (154), said computer or decoder (142) is configured for image decoding of the encoded output bit stream; said computer or decoder is configured for outputting an image signal in response to performing steps comprising, determining the tree structure selected by said computer or encoder in encoding the block, decoding leaves of the tree structure into coefficients of an output, outputting zero coefficients within the output in response to decoding non-leaf nodes without non-zero branches, performing dequantizing of the output,30 performing an inverse transform of the output, reconstructing the image signal in response to receipt of the output.

15. A method for adaptive entropy encoding within an image encoder, comprising: dividing an image or a video frame into blocks; decorrelating each block using a spectral transform; quantizing the transform coefficients; selecting a tree structure from multiple candidates in response to determination of two-dimensional geometric relationships within the block for the image; and encoding the block while clustering zero coefficients in response to the selected tree structure; wherein a portion of the zero coefficients are eliminated from the encoded output in response to having non-leaf nodes of said selected tree structure represent that their respective leaf nodes contain only zero coefficients.

Specification

28
We claim:-
1. An apparatus for adaptive entropy encoding within an image or video encoder, comprising:
a computer or an encoder (136) having a processing element and memory, said computer or encoder (136)
configured for image/video encoding;
said computer or encoder is configured to perform steps comprising,
dividing an image or a video frame into blocks,
decorrelating each block using a transform,
quantizing the transform coefficients,
selecting a desired tree structure from multiple candidates in response to determination of geometric
relationships within the block of pixels for the image, and
encoding the block using clustering of zero coefficients in response to the selected tree structure;
wherein a portion of the zero coefficients are eliminated from the encoded output in response to having
non-leaf nodes of said selected tree structure represent that respective leaf nodes contain only zero
coefficients and not coding these descendent leaf nodes into an encoded output bit stream.
2. The apparatus as claimed in claim 1,
wherein said tree structure has leaf and non-leaf nodes in a specified arrangement;
and
wherein one or more leaf nodes containing coefficients are associated with each non-leaf node.
3. The apparatus as claimed in claim 1,
wherein said encoding of the block is performed in response to the selected tree structure according to a
predetermined traversal of the tree structure; or
wherein the state of each non-leaf node is represented by a bit indicating whether its descendent leaf
nodes contain all zero coefficients, or do not contain all zero coefficients; or
wherein a set of tree structures are retained in the encoder and configured for allowing one of the tree
structures to be selected in response to said selection of tree structure; or
wherein said geometric relationships which can be recognized within the blocks are selected from the
group of geometric block relationships consisting of flat, noisy, horizontal, vertical, diagonal +45°, diagonal -
45°.
4. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to provide
information to a decoder (142) about which transform was used when decorrelating blocks of the image.
5. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to provide
information to a decoder about which tree structure was selected for use in coding each block of the image.
6. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to perform
steps comprising:29
providing information to a decoder about which tree structure was selected for use in coding each block of
the image; and
wherein said information comprises communicating at least one index for said selected tree structure to a
decoder (142) configured for receiving the encoded image.
7. The apparatus as claimed in claim 1, wherein said geometric relationship comprises a two-dimensional
relationship between the coefficients in the current block being coded.
8. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured for interblock prediction or pre-filtering of the block prior to transform.
9. The apparatus as claimed in claim 1, wherein said block can be of any desired shape and size, including
block sizes selected from the group of block sizes consisting of 4x4, 8x8 and 16x16, 32x32 coefficient
blocks.
10. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to perform
the adaptive entropy encoding within an image encoder which is configured for non-embedded encoding.
11. The apparatus as claimed in claim 1, wherein said computer or encoder (136) is configured to perform
the adaptive entropy encoding within an image encoder which is configured for embedded encoding, in
which encoding is performed across any desired number of bit planes and can be stopped at any desired
coding rate.
12. The apparatus as claimed in claim 1, wherein said coding is performed to a desired coding rate in
response to fitting within a bit-budget for an encoded image stream.
13. The apparatus as claimed in claim 1,
wherein said transform comprises a spectral transform; or
wherein said transform comprises either a discrete wavelet transform (DWT) or a discrete cosine transform
(DCT), or any overlapped transforms.
14. The apparatus as claimed in claim 1, further comprising:
a computer or a decoder (142) having a processing element and memory (154), said computer or decoder
(142) is configured for image decoding of the encoded output bit stream;
said computer or decoder is configured for outputting an image signal in response to performing steps
comprising,
determining the tree structure selected by said computer or encoder in encoding the block,
decoding leaves of the tree structure into coefficients of an output,
outputting zero coefficients within the output in response to decoding non-leaf nodes without non-zero
branches,
performing dequantizing of the output,30
performing an inverse transform of the output,
reconstructing the image signal in response to receipt of the output.
15. A method for adaptive entropy encoding within an image encoder, comprising:
dividing an image or a video frame into blocks;
decorrelating each block using a spectral transform;
quantizing the transform coefficients;
selecting a tree structure from multiple candidates in response to determination of
two-dimensional geometric relationships within the block for the image; and
encoding the block while clustering zero coefficients in response to the selected tree structure;
wherein a portion of the zero coefficients are eliminated from the encoded output in response to having
non-leaf nodes of said selected tree structure represent that their respective leaf nodes contain only zero
coefficients.

Documents

Orders

Section Controller Decision Date

Application Documents

# Name Date
1 Priority Document.pdf 2011-10-25
2 Power of Authority.pdf 2011-10-25
3 Form-5.pdf 2011-10-25
4 Form-3.pdf 2011-10-25
5 Form-1.pdf 2011-10-25
6 Drawings.pdf 2011-10-25
7 7299-CHENP-2011 FORM-13 02-11-2011.pdf 2011-11-02
8 7299-CHENP-2011 FORM-18 02-11-2011.pdf 2011-11-02
9 7299-CHENP-2011 CORRESPONDENCE OTHERS 02-11-2011.pdf 2011-11-02
10 7299-CHENP-2011 CORRESPONDENCE OTHERS. 02-11-2011.pdf 2011-11-02
11 7299-CHENP-2011 FORM-13 02-11-2011.pdf 2011-11-02
12 7299-CHENP-2011 FORM-1 02-11-2011.pdf 2011-11-02
13 7299-CHENP-2011 CORRESPONDENCE OTHERS 18-11-2011.pdf 2011-11-18
14 7299-CHENP-2011 ASSIGNMENT 18-11-2011.pdf 2011-11-18
15 7299-CHENP-2011 CORRESPONDENCE OTHERS 26-12-2011.pdf 2011-12-26
16 7299-CHENP-2011 FORM-3 26-12-2011.pdf 2011-12-26
17 7299-CHENP-2011 FORM-3 23-01-2012.pdf 2012-01-23
18 7299-CHENP-2011 CORRESPONDENCE OTHERS 23-01-2012.pdf 2012-01-23
19 abstract7299-CHENP-2011.jpg 2012-10-29
20 7299-CHENP-2011-FER.pdf 2017-12-22
21 7299-CHENP-2011-Information under section 8(2) (MANDATORY) [26-02-2018(online)].pdf 2018-02-26
22 7299-CHENP-2011-FORM 3 [26-02-2018(online)].pdf 2018-02-26
23 7299-CHENP-2011-OTHERS [11-04-2018(online)].pdf 2018-04-11
24 7299-CHENP-2011-FER_SER_REPLY [11-04-2018(online)].pdf 2018-04-11
25 7299-CHENP-2011-DRAWING [11-04-2018(online)].pdf 2018-04-11
26 7299-CHENP-2011-CORRESPONDENCE [11-04-2018(online)].pdf 2018-04-11
27 7299-CHENP-2011-CLAIMS [11-04-2018(online)].pdf 2018-04-11
28 7299-CHENP-2011-MARKED COPIES OF AMENDEMENTS [20-04-2018(online)].pdf 2018-04-20
29 7299-CHENP-2011-MARKED COPIES OF AMENDEMENTS [20-04-2018(online)]-1.pdf 2018-04-20
30 7299-CHENP-2011-FORM 13 [20-04-2018(online)].pdf 2018-04-20
31 7299-CHENP-2011-FORM 13 [20-04-2018(online)]-1.pdf 2018-04-20
32 7299-CHENP-2011-Annexure [20-04-2018(online)].pdf 2018-04-20
33 7299-CHENP-2011-AMMENDED DOCUMENTS [20-04-2018(online)].pdf 2018-04-20
34 7299-CHENP-2011-AMMENDED DOCUMENTS [20-04-2018(online)]-1.pdf 2018-04-20
35 7299-CHENP-2011-Amendment Of Application Before Grant - Form 13 [20-04-2018(online)].pdf 2018-04-20
36 7299-CHENP-2011-Amendment Of Application Before Grant - Form 13 [20-04-2018(online)]-1.pdf 2018-04-20
37 7299-CHENP-2011-HearingNoticeLetter-(DateOfHearing-09-12-2019).pdf 2019-11-13
38 7299-CHENP-2011-FORM-26 [06-12-2019(online)].pdf 2019-12-06
39 7299-CHENP-2011-Correspondence to notify the Controller (Mandatory) [06-12-2019(online)].pdf 2019-12-06
40 Correspondence by Agent_Power of Attorney_09-12-2019.pdf 2019-12-09
41 7299-CHENP-2011-Written submissions and relevant documents (MANDATORY) [23-12-2019(online)].pdf 2019-12-23
42 7299-CHENP-2011-FORM 3 [23-12-2019(online)].pdf 2019-12-23
43 7299-CHENP-2011_Marked up Claims_Granted 328047_24-12-2019.pdf 2019-12-24
44 7299-CHENP-2011_Drawing_Granted 328047_24-12-2019.pdf 2019-12-24
45 7299-CHENP-2011_Description_Granted 328047_24-12-2019.pdf 2019-12-24
46 7299-CHENP-2011_Claims_Granted 328047_24-12-2019.pdf 2019-12-24
47 7299-CHENP-2011_Abstract_Granted 328047_24-12-2019.pdf 2019-12-24
48 7299-CHENP-2011-PatentCertificate24-12-2019.pdf 2019-12-24
49 7299-CHENP-2011-IntimationOfGrant24-12-2019.pdf 2019-12-24
50 7299-CHENP-2011-RELEVANT DOCUMENTS [16-03-2020(online)].pdf 2020-03-16
51 7299-CHENP-2011-RELEVANT DOCUMENTS [31-08-2021(online)].pdf 2021-08-31
52 7299-CHENP-2011-RELEVANT DOCUMENTS [14-04-2022(online)].pdf 2022-04-14
53 7299-CHENP-2011-POA [14-04-2022(online)].pdf 2022-04-14
54 7299-CHENP-2011-FORM 13 [14-04-2022(online)].pdf 2022-04-14
55 7299-CHENP-2011-PROOF OF ALTERATION [20-04-2022(online)].pdf 2022-04-20
56 7299-CHENP-2011-PROOF OF ALTERATION [21-09-2022(online)].pdf 2022-09-21
57 7299-CHENP-2011-RELEVANT DOCUMENTS [26-09-2022(online)].pdf 2022-09-26
58 7299-CHENP-2011-RELEVANT DOCUMENTS [11-09-2023(online)].pdf 2023-09-11

Search Strategy

1 7299chenp2011_07-09-2017.pdf

ERegister / Renewals

3rd: 31 Jan 2020

From 08/06/2012 - To 08/06/2013

4th: 31 Jan 2020

From 08/06/2013 - To 08/06/2014

5th: 31 Jan 2020

From 08/06/2014 - To 08/06/2015

6th: 31 Jan 2020

From 08/06/2015 - To 08/06/2016

7th: 31 Jan 2020

From 08/06/2016 - To 08/06/2017

8th: 31 Jan 2020

From 08/06/2017 - To 08/06/2018

9th: 31 Jan 2020

From 08/06/2018 - To 08/06/2019

10th: 31 Jan 2020

From 08/06/2019 - To 08/06/2020

11th: 31 Jan 2020

From 08/06/2020 - To 08/06/2021

12th: 03 Jun 2021

From 08/06/2021 - To 08/06/2022

13th: 31 May 2022

From 08/06/2022 - To 08/06/2023

14th: 03 Jun 2023

From 08/06/2023 - To 08/06/2024

15th: 03 Jun 2024

From 08/06/2024 - To 08/06/2025