Sign In to Follow Application
View All Documents & Correspondence

Image Processing Device And Method

Abstract: The present invention pertains to an image processing device and method that enable large reductions in encoding efficiency to be minimized. Provided are: a limiting unit that limits the values of syntax elements pertaining to processing between images when an encoding process is performed according to a profile for encoding static images; and a transmission unit that transmits the syntax elements the values of which have been limited by the limiting unit. Further provided is an encoding unit that uses the syntax elements limited by the limiting unit to encode image data and generate a bit stream. The transmission unit may further be configured to transmit the bit stream generated by the encoding unit. The present invention can be applied to an image processing device for example.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
22 May 2015
Publication Number
48/2015
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
remfry-sagar@remfry.com
Parent Application

Applicants

SONY CORPORATION
1 7 1 Konan Minato ku Tokyo 1080075

Inventors

1. SATO Kazushi
c/o SONY CORPORATION 1 7 1 Konan Minato ku Tokyo 1080075

Specification

DESCRIPTION IMAGE PROCESSING DEVICE AND METHOD
TECHNICAL FIELD [0001]
The present disclosure relates to an image processing device and method, and more particularly, an image processing device and method which are capable of suppressing a reduction in coding efficiency.
BACKGROUND ART
[0002]
In recent years, for the purpose of digitalizing image information and transmitting and accumulating information at high efficiency at that time, devices that compress and encode images by using image information-specific redundancy employing a coding scheme that performs compression through an orthogonal transform such as a discrete cosine transform and motion compensation have been spread. As such a coding scheme, for example, there is Moving Picture Experts Group
(MPEG).
[0003]
Particularly, MPEG 2 (International Organization for Standardization/International Electrotechnical Commission
CISO/IEC} 13818-2) is a standard that is defined as a general-purpose image coding scheme, and covers interlaced scan images, progressive scan images, standard resolution images, andhighdefinition images . Currently, MPEG2isbeing vjidely used for a vjide range of applications such as professional use and consumer use. Using the MPEG 2 compression scheme, for example, in the case of an interlaced

scan image of a standard resolution having 720 x 480 pixels, a coding amount (bit rate) of 4 Mbps to 8 Mbps is allocated. Further, using the MPEG 2 compression scheme, for example, in the case of an interlaced scan image of a high resolution having 1920 x 1088 pixels, a coding amount (bit rate) of 18 Mbps to 22 Mbps is allocated. Thus, it is possible to implement a high compression rate and an excellent image quality.
[0004]
MPEG 2 is mainly intended for high definition coding suitable for broadcasting but does not support a coding scheme having a coding amount (bit rate) lovjer than that of MPEG 1, that is, a coding scheme of a higher compression rate. With the spread of mobile terminals, the need for such a coding scheme is considered to be increased in the future, and thus an MPEG 4 coding scheme has been standardized. In connection v/ith an image coding scheme, an international standard thereof has been approved as ISO/IEC 14496-2 in December, 1998.
[0005]
Further, in recent years, standardization of a standard such as H.26L (International Telecommunication Union Telecommunication Standardization Sector Q6/16 Video Coding Expert Group (ITU-TQ6/16 VCEG) ) for the purpose of image coding for video conference has been conducted, H.26L requires a larger computation amount for coding and decoding than in an existing coding scheme such as MPEG 2 or MPEG 4, but is known to implement higher coding efficiency. Further, currently, as one of activities of MPEG 4, standardization of incorporating even a function that is not supported in H.2 6L and implementing higher coding efficiency based on H.2 6L has been performed as a Joint Model of Enhanced-Compression Video Coding.

[0006]
As a standardization schedule, an international standard called H.264 and MPEG-4 PartlO {v/hich is also hereinafter referred to as "Advanced Video Coding (AVC) ") has been established in March, 2003. [0007]
Furthermore, as an extension of H.264/AVC, Fidelity Range Extension (FRExt) including an encoding tool necessary for professional use such as RGB or 4:2:2 or 4:4:4 or 8x8 DCT and a quantization matrix v/hich are specified in MPEG-2 has been standardized in February, 2005. As a result, the H . 2 64/AVC has become a coding scheme capable of also expressing a film noise included in a movie v/ell and is being used in a wide range of applications such as a Blu-Ray Disc (a trademark). [0008]
Hov/ever, in recent years, there is an increasing need for further high compression rate coding capable of compressing an image (v^hich is also referred to as a "4K image") of about 4000 X 2000 pixels which are four times as high as a high-definition image or delivering a high-definition image in a limited transmission capacity environment such as the Internet. To this end, an improvement in coding efficiency has been under continuous revievj by Video Coding Expert Group (VCEG) under ITU-T. [0009]
In this regard, currently, in order to further improve coding efficiency to be higher than in the AVC, standardization of a coding scheme called High Efficiency Video Coding (HEVC) has been being conducted by Joint Collaboration Team-Video Coding (JCTVC) v^hich is a joint standardization organization

of ITU-T and ISO/IEC . In the HEVC standard, a committee draft that is a first draft specif i cat ion has been issued in February, 2012 (see Non-Patent Document 1).
[0010]
In the case of the HEVC, generally, information that is transmitted from an encoding side to a decoding side includes syntax elements for P slices and B slices, that is, syntax elements related to an inter-screen process as vj'eii as syntaxes for I slices.
[0011]
Meanwhile, a still picture profile serving as a profile for using the HEVC as a still image codec has been proposed
{for example, see Non-Patent Document 2).
[0012]
Since the still picture profile is a profile for encoding and decoding still images, when this profile is applied, syntax elements related to the inter-screen process are unnecessary.
CITATION LIST NON-PATENT DOCUMENT
[0013]
Non-Patent Document 1: Benjamin Bross, Woo-Jin Han, Jens-Rainer Ohm, Gary J. Sullivan, Thomas Wiegand, "High efficiency video coding (HEVC) text specification draft 8," JCTVC-Hl0 03_d7, Joint Collaborative Team on Video Coding
(JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 10th Meeting: Stoc}<:holm, SE, 11-20 July 2012
Non-Patent Document 2: Kemal Ugur, Jani Lainema, MisJ^a Hannu}<:sela, "On still picture profile," JCTVC-J0037, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, lOthMeeting: Stoc}<:holm, SE, 11-20

July 2012
SUMMARY OF THE INVENTION
PROBLEMS TO BE SOLVED BY THE INVENTION
[0014]
However^ in the case of the method disclosed in Non-Patent Document 2, control on the syntax elements related to the inter-screen process is not performed. In other words, similarly to the case of the moving image profile/ the syntax elements related to the inter-screen process are transmitted from the encoding side to the decoding gide. Thus, the coding efficiency is likely to be lov;ered since unnecessary information is transmitted. [0015]
The present disclosure was made in light of the foregoing, and it is desirable to be capable of suppressing a reduction in coding efficiency.
SOLUTIONS TO PROBLEMS [0016]
An image processing device according to an aspect of the present technology includes: a restricting unit that restricts a valnft of a syntax element related to an inter-image process v;hen a coding process is performed based on a profile for encoding a still image; and a transmitting unit that transmits the syntax element having the value restricted by the restricting unit. [0017]
The image processing device may further include an encoding unit that encodes image data using the syntax element restricted by the restricting unit, and generate a bitstream.

and the transmitting unit may further transmit the bitstream
generated by the encoding unit.
[0018]
The syntax element may be stored in a sequence parameter set of the bitstream. [0019]
The syntax element may be a syntax related to a reference picture. [0020]
The syntax element may be a syntax related to the number of reference pictures. [0021]
The restricting unit may set the value of the syntax element to a predetermined value vjhen the coding process is performed based on the profile of encoding the still image. [0022]
The predetermined value may be 0. [0023]
An image processing method according to an aspect of the present technology includes: restricting a value of a syntax element related to an inter-image process when a coding process is performed based on a profile for encoding a still image; and transmitting the syntax element having the restricted value. [0024]
The image processingmethodmay further include encoding image data using the restricted syntax element^ generating a bitstream, and transmitting the bitstream. [0025]
The syntax element may be stored in a sequence parameter set of the bitstream.

[0026]
The syntax element may be a syntax related to a reference picture. [0027]
The syntax element may be a syntax related to the number of reference pictures. [0028]
The value of the syntax element may be set to a predetermined value v/hen the coding process is performed based on the profile of encoding the still image. [0029]
The predetermined value may be 0. [0030]
In an aspect of the present technology, a value of a syntax element related to an inter-image process is restricted when a coding process is performed based on a profile for encoding a still image; and the syntax element having the value restricted is transmitted by the restricting unit.
EFFECTS OF THE INVENTION [0031]
According to the present disclosure, it is possible to encode and decode an image. Particularly, it is possible to suppress a reduction in coding efficiency.
BRIEF DESCRIPTION OF DRAWINGS [0032]
Fig. 1 is a diagram for describing an exemplary configuration of a coding unit.
Fig. 2 is a diagram for describing a tile.
Fig, 3 is a diagram illustrating an exemplary profile

tier level (Profile__tier_level) .
Fig. 4 is a diagram illustrating an exemplary video parameter set (VPS).
Fig. 5 is a diagram illustrating an exemplary sequence parameter set (SPS).
Fig. 6 is a diagram illustrating an exemplary sequence parameter set (SPS), subsequently to Fig. 5.
Fig. 7 is a diagram illustrating another exemplary profile tier level (Profile_tier_level).
Fig. 8 is a diagram illustrating another exemplary video parameter set (VPS).
Fig. 9 is a diagram illustrating another exemplary sequence parameter set (SPS) .
Fig. 10 is a diagram illustrating another exemplary sequence parameter set (SPS), subsequently to Fig. 9.
Fig . 11 is a diagram illustrating still another exemplary video parameter set (VPS).
Fig. 12 is a diagram illustrating still another exemplary sequence parameter set (SPS).
Fig. 13 is a diagram illustrating still another exemplary sequence parameter set (SPS), subsequently to Fig. 12.
Fig. 14 is a diagram illustrating an exemplary picture parameter set (PPS).
Fig. 15 is a diagram illustrating an exemplary picture parameter set (PPS), subsequently to Fig. 14.
Fig. 16 is a diagram illustrating an exemplary scaling list data (scaling_list_data ()).
Fig . 17 is a diagram illustrating an exemplary semantics of a size ID (SizelD).
Fig . 18 is a diagram illustrating an exemplary semantics of a size ID (SizelD) and a matrix ID (MatrixID) .

SP351163WO001
Fig. 19 is a diagram illustrating another exemplary scaling list data (scaling_list_data ()).
Fig. 20 is a diagram illustrating an exemplary slice header (slice_header ()). 5 Fig. 21 is a diagram illustrating an exemplary slice header (slice_header ()), subseguently to Fig. 20.
Fig. 22 is a diagram illustrating an exemplary slice header (slice_header ()), subseguently to Fig. 21.
Fig . 23 is a diagram illustrating an exemplary allocation 10 of nal__unit_type.
Fig. 24 is a diagram for describing an exemplary Region of Interest (ROI) region.
Fig. 25 is a block diagram illustrating an exemplary main configuration of an image coding device. 15 Fig. 26 is a block diagram illustrating an exemplary main configuration of a lossless encoding unit.
Fig. 27 is a flowchart for describing an exemplary flov/ of a coding process.
Fig. 28 is a flov/chart for describing an exemplary flow 20 of a coding process, subseguently to Fig. 27.
Fig. 29 is a flov/chart for describing an exemplary flov; of a lossless coding process.
Fig. 30 is a flov/chart for describing an exemplary flov/ a syntax element setting process. 2 5 Fig. 31 is a block diagram illustrating another exemplary configuration of an image coding device.
Fig. 32 is a flov/chart for describing another exemplary flow of a coding process.
Fig. 33 is a flov/chart for describing another exemplary 30 flow of a coding process, subseguently to Fig. 32.
Fig. 34 is a block diagram illustrating an exemplary

10
SP351163WO001
main configuration of an image decoding device.
Fig. 35 is a block diagram illustrating an exemplary main configuration of a lossless decoding unit.
Fig. 36 is a flov/chart for describing an exemplary flow 5 of a decoding process.
Fig. 37 is a flowchart for describing an exemplary flow of a decoding process, subsequently to Fig. 36.
Fig. 38 is a flov/chart for describing an exemplary flow of a syntax element analysis process. 10 Fig . 39is ablockdiagramillustrating another exemplary configuration of an image decoding device.
Fig . 40 is ablockdiagramillustratinganother exemplary configuration of a lossless decoding unit.
Fig. 41 is a flowchart for describing another exemplary 15 flov; of a decoding process.
Fig. 42 is a flov;chart for describing another exemplary flovi of a decoding process, subsequently to Fig. 41.
Fig. 43 is a flov/chart for describing an exemplary flow of a syntax element inspection process. 20 Fig . 44 is adiagramillustrating an exemplarymulti-viev/ image coding scheme.
Fig. 45 is a diagram illustrating an exemplary main configuration of a multi-view image coding device to v/hich the present technology is applied. 25 Fig. 46 is a diagram illustrating an exemplary main configuration of a multi-vievj image decoding device to vjhich the present technology is applied.
Fig . 47 is a diagram illustrating an exemplary scalable image coding scheme. 30 Fig. 48 is a diagram for describing an exemplary spatial scalable coding.

11
SP351163WO001
Fig . 49 is a diagramf or describing an exemplary temporal scalable coding.
Fig. 5 0 is a diagram for describing an exemplary scalable coding of a signal to noise ratio. 5 Fig. 51 is a diagram illustrating an exemplary main configuration of a scalable image coding device to which the present technology is applied.
Fig. 52 is a diagram illustrating an exemplary main configuration of a scalable image decoding device to which 10 the present technology is applied.
Fig. 53 is a block diagram illustrating an exemplary main configuration of a computer.
Fig. 54 is a block diagram illustrating an exemplary schematic configuration of a television device. 15 Fig. 55 is a block diagram illustrating an exemplary schematic configuration of a mobile telephone.
Fig. 56 is a block diagram illustrating an exemplary schematic configuration of a recording/reproducing device.
Fig. 57 is a block diagram illustrating an exemplary 20 schematic configuration of an imaging device.
Fig. 58 is a block diagram illustrating a utiliisation example of scalable coding.
Fig. 59 is a block diagram illustrating another utilization example of scalable coding. 25 Fig. 60 is a block diagram illustrating still another utilization example of scalable coding.
Fig. 61 is a block diagram illustrating an exemplary schematic configuration of a video set.
Fig. 62 is a block diagram illustrating an exemplary 30 schematic configuration of a video processor.
Fig . 63 is a block diagram illustrating another exemplary

12
SP351163WO001
schematic configuration of a video processor.
Fig. 64 is an explanatory diagram illustrating a configuration of a content reproducing system.
Fig. 65 is an explanatory diagram illustrating a data 5 flov; in a content reproducing system.
Fig. 66 is an explanatory diagram illustrating a specific example of MPD.
Fig. 67 is a functional block diagram illustrating a configuration of a content server of a content reproducing 10 system.
Fig. 68 is a functional block diagram illustrating a configuration of a content reproducing device of a content reproducing system.
Fig. 69 is a functional block diagram illustrating a 15 configuration of a content server of a content reproducing system.
Fig. 70 is a sequence chart illustrating an exeraplary communication process performed by devices of a v/ireless communication system. 20 Fig. 71 is a sequence chart illustrating an exemplary communication process performed by devices of a v/ireless communication system.
Fig, 72 is a diagram schematically illustrating an exemplary configuration of a frame format transceived in a 25 communication process performed by devices of a v/ireless communication system.
Fig. 73 is a sequence chart illustrating an exemplary comiftunication process performed by devices of a v;ireless communication system.
30
MODE FOR CARRYING OUT THE INVENTION

13
SP351163WO001
[0033]
Hereinafter, modes (hereinafter, referred to as "embodiments") of carrying out the present disclosure will be described. The description v/ill proceed in the following 5 order.
0. Overviev/
1. First embodiment (image coding device)
2. Second embodiment (image coding device)
3. Third embodiment (image decoding device)
10 4. Fourth embodiment (image decoding device)
5 . Fifth embodiment (multi-viev/ image coding device and multi-viev? image decoding device)
6. Sixth embodiment (scalable image coding device and scalable image decoding device) 15 7, Seventh embodiment (computer)
8. Application examples
9. Application examples of scalable coding

10. Eighth embodiment (set/unit/module/processor)
11. Ninth embodiment (application examples of content 20 reproducing system of MPEG-DASH)
12. Tenth embodiment (application examples of wireless
communication system of Wi-Fi standard)
[0034J
<0. Overview> 25
Hereinafter, the present technology will be described in connection with an application to image coding and decoding of a HEVC scheme. [0035] 30
In the AVC, a hierarchical structure based on a

14
SP351163WO001
macroblock and a sub macroblock is defined. Hov/ever, a macroblock of 16 x 16 pixels is not optimal for a large image frame such as an Ultra High Definition (UHD) (4000 x 2000 pixels) serving as a target of a next generation coding scheme. 5 t0036]
On the other hand, in the HEVC, a coding unit (CU) is defined as illustrated in Fig. 1. [0037]
A CU is also referred to as a coding tree block (CTB) , 10 and the CU is a partial area of an image of a picture unit undertaking the same role of a macroblock in the AVC. The macroblock of the AVC is fixed to a size of 16 x 16 pixels, but a size of the CU of the HEVC is not fixed and designated in image compression information in each sequence. 15 [0038]
For example, a largest coding unit (LCU) and a smallest coding unit (SCU) of a CU are specified in a sequence parameter set (SPS) included in encoded data to be output. [0039] 20 As split__flag = 1 is set in a range in v/hich each LCU is not smaller than a SCU, a coding unit can be divided into CUs having a smaller size. In the example of Fig. 1, a size of an LCU is 128 x 128, and a largest scalable depth is b. A CU of a size of 2N x 2N is divided into CUs having a size 25 of N x N serving as the hierarchy that is one-level lower when a value of split_flag is "1." [0040]
Further, a CU is divided in prediction units (PUs) that
are areas (partial areas of an image of a picture unit) serving
30 as processing units of intra or inter prediction, and divided
into transform units (TUs) that are areas (partial areas of

15
SP351163WO001
an image of a picture unit) serving as processing units of orthogonal transform. In the HEVC, any of 4 x 4, 8x8, 16 X 16, and 32 x 32 can be used as a processing unit of orthogonal transform. 5 [0041]
In the case of the coding scheme in v/hich a CU is defined, and various kinds of processes are performed in units of CUs such as the HEVC, a macroblock in the AVC can be considered to correspond to an LCU, andablock (subblock) canbe considered
10 to correspond to a CU. Further, a motion compensation block in the AVC can be considered to correspond to a PU. Here, since a CU has a hierarchical structure, a size of an LCU of a topmost layer is comm.only set to be larger than a macroblock in the AVC, for example, such as 128 x 128 pixels.
15 [0042]
Thus, hereinafter, an LCU is assumed to include a macroblock in the AVC, and a CU is assumed to include a block {sub block) in the AVC. In other v;ords, a "block" used in the f ollov/ing description indicates an arbitrary partial area
20 in a picture, and, for example, a size, shape, and
characteristics of a block are not limited. - In other v/ords, a "block" includes an arbitrary area (a processing unit) such as a TU, a PU, an SCU, a CU, an LCU, a sub block, a macroblock, or a slice. Of course, a "block" includes any other partial
25 area (processing unit) asv/ell. When it is necessary to limit a size, a processing unit, or the like, it will be appropriately described. [0043]

30 Meanwhile, in the coding schemes such as the AVC and the HEVC, in order to achieve higher coding efficiency, it

16
SP351163WO001
is important to select an appropriate prediction mode. [0044]
As an example of such a selection method/ there is a method implemented in reference software (opened at 5 http://iphome.hhi.de/suehring/tml/index.htm) of H.264/MPEG~4 AVC called a joint model (JM). [0045]
In the JMf it is possible to select two mode determination methods/ that is, a high complexity mode and a lovj complexity 10 mode described below. In both modes, cost function values related to the respective prediction modes are calculated, and a prediction mode having a smallest cost function value is selected as an optimal mode for a current block serving as a processing target. 15 [0046]
A cost function in the high complexity mode is represented as in the following Formula (1): [0047]
[Mathematical Formula 1]
20 Cost(Mode e H) = D + X*R ... (1)
[0048]
Here, Cl indicates a universal set of a candidate mode for encoding a current block, and D indicates differential energy betv/een a decoded image and an input image v/hen encoding
25 is performed in a corresponding prediction mode . X indicates Lagrange's undetermined multiplier given as a function of a quantization parameter. R indicates a total coding amount including an orthogonal transform coefficient when encoding is performed in a corresponding prediction mode.
30 [0049]
In other v/ords, in order to perform encoding in the high

17
SP351163WO001
complexity mode/ it is necessary to perform a temporary encoding process once by all candidate modes in order to calculate the parameters D and R, and thus a larger computation amount is required. 5 [0050]
A cost function in the low complexitymode is represented by the following Formula (2): [0051]
[Mathematical Formula 2] 10 Cost(Mode e Q) = D + QP2Quant (QP) *HeaderBit ... (2) [0052]
Here, D indicates differential energy between a predicted image and an input image unlike the high complexity mode. QP2Quant(QP) is given as a function of a quantization 15 parameter QP, and HeaderBit indicates a coding amount related to information belonging to a header such as a motion vector or a mode including no orthogonal transform coefficient. [0053]
In other v;ords, in the low complexity mode, it is 20 necessary to perform a prediction process for respective
candidate modes, but since up to a decoded image is not necessary, it is unnecessary to perform up to a coding process. Thus, it can be implemented v;ith a computation amount smaller than that in the high complexity mode. 25 [0054]

Meanv/hile, in the HEVC, a tile illustrated in Fig. 2 is specified as a unit of a parallel process in addition to a slice specified in the AVC. 30 [0055]
A v;idth and a height of each tile are designated in image

SP351163WO001
compression information, and a decoding process can be
independently performed on each tile.
[0056]
5 Further, in Non-Patent Document 2, the still picture profile serving as the profile for using the HEVC as the still image codec is proposed. [0057]
Hovjever, in the case of the HEVC, generally, information
10 that is transmitted from an encoding side to a decoding side includes syntax elements for P slices and B slices, that is, syntax elements related to an inter-screen process as well as syntaxes for I slices. [0058]
15 Since the still picture profile is the profile for encoding and decoding still images, v/hen this profile is applied, the above-described syntax elements related to the inter-screen process are unnecessary. However, in the case of the method disclosed in Non-Patent Document 2, control on
20 the syntax elements related to the inter^screen process is not performed. In other v/ords, similarly to the case of the moving image profile, the syntax elements related to the inter-screen process are transmitted from the encoding side to the decoding side. Thus, the coding efficiency is liJcely
25 to be lov/ered since unnecessary information is transmitted. [0059]
In this regard, in the present technology, v/hen the coding process is performed based on the profile for encoding the still images, values of syntax elements related to the
30 inter-image process are restricted, and transmission of
unnecessary information is suppressed. As a result, it is

19
SP351163WO001
possible to suppress a reduction in coding efficiency.
[0060]
Specific examples of the restriction v/ill be described
belov;. 5 [0061]
<0-l: Restrictionof syntax element related to sub layer> Fig. 3 is a diagram illustrating an exemplary syntax
of a profile tier level (profile_tier_level () ) in the HEVC.
Numbers at the left end are given as line numbers for description 10 and not included in an actual syntax. Similarly, numbers at
the left endillustrated in Figs . 4 to 23 v/hich v/ill be described
belov/ are given as line numbers for description of figures
and not actually included in a syntax.
[0062] 15 A syntax element general^profile_idc shown in a 5-th
line in the profile tier level (profile_tier_level())
illustrated in Fig. 3 specifies that a profile of a sequence
(current sequence) of a processing target is a still picture
profile. 20 [0063]
The profile tier level (profile_tier_level()) of Fig.
3 is called by a "video parameter set (VPS) " or a "sequence
parameter set (SPS)."
[0064] 25 Fig. 4 is a diagram illustrating an exemplary video
parameter set (VPS) in the HEVC. Figs. 5 and 6 are diagrams
illustrating an exemplary sequence parameter set (SPS) in the
HEVC.
[0065] 30 As illustrated in Fig. 4, in the video parameter set
(VPS), a profile tier level (profile tier level ()) in a 7-th

20
SP351163WO001
line is called. Further, as illustrated in Fig. 5, in the seguence parameter set (SPS) , the profile tier level (profile_tier_level0) in a 5-th line is called. [0066] 5 Here, v/hen encoding is performed based on the still picture profile, there is no temporal layer depth (which is also referred to as a "sub layer") . In other words, syntax elements related to the sub layer are unnecessary. [0067] 10 In this regard, in the profile tier level
(profile_tier_level()) of Fig. 3, before the still picture profile is specif ied by the syntax element general__prof ile^idc, 0 may be designated as a value of a parameter vps_max_sub_layers_minusl (a 6-th line) related to the sub 15 layer in the video parameter set (VPS) of Fig. 4, and 0 may be designated as a value of a parameter
sps_max_sub_layers_minusl (a 3-rd line) related to the sub layer in the seguence parameter set (SPS) (Figs. 5 and 6) . [0068] 20 In other v/ords, when the syntax element general_profile^idc in the profile tier level (profile_tier_level0) of Fig. 3 specifies that the profile is the still picture profile, 0 may have to be designated as the value of the parameter vps__max_sub__layers_minusl (the 6-th 25 line) related to the sub layer in the video parameter set (VPS) of Fig. 4, and 0 may have to be designated as the value of the parameter sps_max_sub_layers_minusl (the 3-rd line) related to the sub layer in the seguence parameter set (SPS) (Figs. 5 and 6). 30 [0069]
As a result, it is possible to prevent unnecessary

21
SP351163WO001
portions of the prof lie tier level (prof ile_tier_level () ) from being read. In other words, it is possible to prevent an increase in a load caused by the reading and prevent reading and transmission of unnecessary parameters. Thus, it is 5 possible to suppress a reduction in coding efficiency. [0070]
Further, as a result, it is unnecessary to change the syntaxes of the profile tier level (profile_tier_level()), the video parameter set (VPS) , and the sequence parameter set
10 (SPS) , and it is possible to suppress a reduction in coding efficiency through control by semantics. When the syntax is changed, for exarrple, it is likely to be difficult to maintain syntax compatibility v/ith an encoder and a decoder of a related art that do not support the still picture profile.
15 Particularly, in the case of encoders and decoders implemented by hardv/are, there are cases in which it is difficult to update the syntax. A decrease in syntax compatibility is likely to reduce versatility. However, as described above, v;hen the values of the syntax element are restricted by the semantics,
20 it is possible to maintain syntax compatibility and prevent a reduction in versatility. [0071]
Further, since the syntax compatibility is maintained as described above, it is possible to easily apply a common
25 syntax even to both encoding of still images and encoding of moving images, and thus it is possible to easily implement an encoder and a decoder that process both a still image and a moving image through a common circuit. In other vjords, it can contribute to a size reduction of a device, suppression
30 of an increase in cost, and the like. [0072]

22
SP351163WO001
<0"2: Restriction of syntax element related to calling of profile tier level>
Here, it is not impossible to implement such a restriction by changing the syntax. 5 [0073]
hs described above, v/hen the profile tier level (prof ile_tier_level () ) is called from the video parameter set (VPS) or the sequence parameter set (SPS) , a value of a syntax element ProfilePresentFlag related to the calling of the 10 profile tier level v/hich is designated at the time of the calling is consistently 1. [0074]
In other words, it is redundant to transmit this syntax element. Further, an if statement of a 2-nd line of the profile 15 tier level (profile_tier_level()) of (Fig. 3) is unnecessary as v/ell. [0075]
In this regard, the syntax of the profile tier level (profile_tier_level 0 ) of Fig. 3may be changed as in an example 20 illustrated in Fig. 1, the syntax of the video parameter set (VPS) of Fig. 4 may be changed as in an example illustrated in Fig. 8, and the syntax of the sequence parameter set (SPS) of Figs. 5 and 6 may be changed as in an example illustrated in Figs. 9 and 10. 25 [0076]
In other vzords, the profile tier level (prof ile_tier_level () ) may be designated by designating only a syntax eleraentMaxNumSubLayersMinusl related to the sub layer as in the examples of Fig. 7 (a l-st line). Fig. 8 (a 7-th 30 line) , and Fig. 9 (a 5-th line) without designating the syntax element ProfilePresentFlag.

23
SP351163WO001
[0077]
Further^, as illustrated in the 1-st to 7-th lines of Fig, 1, in the profile tier level {prof ile_tier_level {)) , the if statement using the syntax element ProfilePresentFlag may 5 be omitted. [0078]
As a result, it is possible to prevent transmission of an unnecessary parameter and suppress a reduction in coding efficiency. Further, it is possible to suppress an increase 10 in the load of the process of reading the profile tier level {prof ile_tier_level () ) which is caused by the reading of the unnecessary if statement. [0079]
In other words, the value of the syntax element 15 ProfilePresentFlag related to the calling of the profile tier level may have to be fixed to 1. [0080]
<0-3: Restriction of syntax element related to profile tier level> 20 In the above method, when the syntax element
max_sub_layers_minusl related to the sub layer is encoded, a setting has to be performed after detecting information as to v/hether or not encoding is performed based on the still picture profile in a subsequent profile tier level 25 (profile_tier_level{)). [0081]
In this regard, the syntax of the video parameter set
{VPS) of Fig. 4 may be changed as in an example illustrated
in Fig. 11, and the syntax of the sequence parameter set {SPS)
30 of Figs. 5 and 6 may be changed in an example illustrated in
Figs. 12 and 13.

24
SP351163WO001
[0082]
In other words, in the video parameter set (VPS), as in 6"th to 8-th lines {Fig. 11), a syntax element prof ile_tier_level (1,0) related to the profile tier level may 5 be designated, a value of a syntax element
vps_max__sub_layers_minus! related to the sub layer may be designated, and a syntax element profile_tier_level {0, vps_max_sub__layers_minusl) related to the profile tier level may be designated.
10 [0083]
Similarly, in the seguence parameter set (SPS), as in 3-rd to 6-th lines (Fig. 12), the syntax element profile_tier__level (1, 0) related to the profile tier level may be designated, a value of a syntax element
15 sps__max_sub_layers_minus! related to the sub layer may be designated, and the syntax element profile_tier_level (0,sps_max_sub_layers_minusl) related to the profile tier level may be designated. [0084]
20 Further, for example, when a parameter set to which a syntax element belongs is not discriminated unlike vps_max_sub_layei:s_minus! and sps_max_sub_layers_minusl, the parameter sets arc simply referred to as max_sub_layers__minusl. In other v/ords,
25 vps_max_sub_layers_minus! is max__sub_layers_minus! in the video parameter set (VPS) , and sps_max_sub_layers__minusl is max_sub_layer3__minusl in the sequence parameter set (SPS) . Other syntax elements are assumed to have a similar relation. [0085]
30 As the syntax element profile__tier_level (1, 0) is
designated before the syntax element max sub layers minusl

25
SP351163WO001
related to the sub layer is designated, information related
to when all temporal layers (temporal^layer) of image data
are encoded or decoded is transmitted. [0086] 5 Here, when the still picture profile is applied, 0 is
designated as the value of the syntax element
maK_sub_layers_minusl related to the sub layer.
[0087]
After the syntax element max_sub_layers__minusl related 10 to the sub layer is encoded, information related to when some
temporal layers (temporal_layer) of image data are encoded
or decoded is transmitted through
profile_tier_level(0,nax_sub_layers_minusl).
[0088] 15 By changing the syntax as described above, it is possible
to designate the value of the syntax element
max_sub_layers_minusl related to the sub layer after it is
designated v/hether or not the profile is the still picture
profile. 20 [0089]
<0-4: Restriction of syntax element related to virtual
reference decoder>
Further, vjhen the still picture profile is applied, it
is unnecessary to control the virtual reference decoder. In 25 this regard, as illustrated in Fig. 4, 0 may be designated
as a value of a syntax element vps_num_hrd_parameters {a 14-th
line) related to the virtual reference decoder in the video
parameter set (VPS).
[0090] 30 In other words, v/hen the still picture profile is applied,
the value of the syntax element vps num hrd parameters {the

26
SP351163WO001
14-th line} related to the virtual reference decoder in the video parameter set (VPS) may have to be fixed to 0. [0091]
The syntax element vps__num_hrd_parameters related to 5 the virtual reference decoder is a positive value that is encoded by an extended Golomb coding and then transmitted. Thus, v/hen this value is 0 or 1, the coding amount becomes minimum. In other words, as 0 is designated as the value of the syntax element vps_num_hrd_parameters related to the 10 virtual reference decoder, it is possible to suppress a reduction in coding efficiency. [0092]
Further, as 0 is designated as the value of the syntax element vps_num_hrd_parameters related to the virtual 15 reference decoder, it is possible to skip a loop process (a for statement) of 15-th to 19-th lines. Thus, as a result, it is possible to suppress an increase in a load. Further, it is possible to prevent transmission of the unnecessary syntax elements in the loop process (the for statement) and 20 suppress a reduction in coding efficiency. [0093]
Further, it is possible to restrict the value of the syntax element by the semantics v/ithout changing the synLax and suppress a reduction in syntax versatility. 25 [0094]
Further, this restriction can be applied even when the video parameter set (VPS) is the example of Fig . 8 or the example of Fig. 11. [0095] 30 <0-5r Restriction of syntax element related to P slice and B slice>

27
SP351163WO0Q1
Further / v/hen the still picture profile is applied/ there is neither a P slice nor a B slice. In this regard/ as illustrated in Fig. 5/ 0 may be designated as a value of a syntax element restricted_ref_pic_lists_flag (a 32-nd line) 5 related to the P slice and the B slice in the sequence parameter set (SPS). [0096]
In other words / when the still picture profile is applied/
the value of the syntax element restricted_ref__pic__lists_f lag
10 (the 32-nd line) related to the P slice and the B slice in
the sequence parameter set (SPS) may have to be fixed to 0.
[00973
Further/ as 0 is designated as the value of the syntax element restricted_ref_pic_lists_flag related to the P slice 15 and the B slice/ it is possible to skip 33-rd to 42-nd lines, ThuS/ as a result/ it is possible to suppress an increase in a load. Further/ it is possible to prevent transmission of unnecessary syntax elements of the 33-rd to 42-nd lines and suppress a reduction in coding efficiency. 20 [0098]
Further, it is possible to restrict the value of the syntax element by the semantics viithout changing the syntax and suppress a reduction in syntax versatility. [0099] 25 Further, the restriction can be applied even v/hen the sequence parameter set (SPS) is the example of Figs. 9 and 10 or the example of Figs. 12 and 13. [0100]
<0~6: Restriction of syntax element related to short 30 term>
Further/ v/hen the still picture prof lie is applied, there

28
SP351163WO001
is no concept of time (there is no other picture) . In this regard, as illustrated in Fig. 6, 0 may be designated as a value of a syntax element num_short_term__ref_pionsets (a 56-th line) related to the short term in the sequence parameter set 5 (SPS). [0101]
In other v/ords, v/hen the still picture profile is applied, the value of the syntax element num_short_term_ref_pic_sets (the 56-th line) related to the short term in the sequence
10 parameter set (SPS) may have to be fixed to 0. [0102]
The syntax element num_short_term_ref_pic_sets related to the short term is a positive value that is encoded by extended Golomb coding and then transmitted. Thus, when the value is
15 0 or 1, the coding amount becomes minimum. In other v/ords, as 0 is designated as the value of the syntax element num_short_term_ref_pic_sets related to the short term, it is possible to suppress a reduction in coding efficiency. [0103]
20 Further, as 0 is designated as the value of the syntax element num_short_term_ref_pic_sets related to the short term, it is possible to skip 57-th and 58-th lines . Thus, as a result, it is possible to suppress an increase in a load. [0104]
25 Further, it is possible to restrict the value of the syntax element by the semantics v/ithout changing the syntax and suppress a reduction in syntax versatility. [0105]
Further, this restriction can be applied even v/hen the
30 sequence parameter set (SPS) is the example of Figs. 9 and 10 or the example of Figs. 12 and 13.

29
SP351163WO001
[0106]
Further, v/hen the still pictureprof lie is applied, there
is no concept of time (there is no other picture) . In this 5 regard, as illustrated in Fig. 6, 0 may be designated as a
value of a syntax element long_term_ref_pics_present_f lag (a
59~th line) related to the long term in the sequence parameter
set (SPS).
[0107] 10 In other words, v/hen the still picture profile is applied,
the value of the syntax element
long_term_ref_pic3_pre3ent_flag (the 59-th line) related to
the long term in the sequence parameter set (SPS) may have
to be fixed to 0. 15 [0108]
As 0 is designated as the value of the syntax element
long_term_ref__pics_present_flag related to the long term, it
is possible to skip 60-th to 66-th lines. Thus, as a result,
it is possible to suppress an increase in a load. Further, 20 it is possible to prevent transmission of an unnecessary syntax
element in the 60-th to 66-th lines and suppress a reduction
in coding efficiency.
[0109]
Further, it is possible to restrict the value of the 25 syntax element by the semantics v/ithout changing the syntax
and suppress a reduction in syntax versatility.
[0110]
Further, this restriction can be applied even when the
sequence parameter set (SPS) is the example of Figs. 9 and 30 10 or the example of Figs. 12 and 13.
[0111]

30
SP351163WO001
<0-8: Restriction of syntax element related to motion
vector>
Further, when the stillpicture prof ile is applied, there
is no concept of time {there is no other picture) . In this 5 regard/ as illustrated in Fig. 6, 0 may be designated as a
value of a syntax element sps_temporal_mvp_enable_flag (a
67"th line) related to the motion vector in the sequence
parameter set (SPS).
[0112] 10 In other v/ords, when the still picture prof lie is applied,
the value of the syntax element sps_temporal_mvp_enable_f lag
(the 67-th line) related to the motion vector in the sequence
parameter set (SPS) may have to be fixed to 0.
[0113] 15 As 0 is designated as the value of the syntax element
sps__temporal_mvp_enable__flag related to the motion vector,
it is possible to minimize the coding amount, and it is possible
to suppress a reduction in coding efficiency.
[0114] 20 Further, it is possible to restrict the value of the
syntax element by the semantics without changing the syntax
and suppress a reduction in syntax versatility.
[0115]
Further, this restriction can be applied even when the 25 sequence parameter set (SPS) is the example of Figs. 9 and
10 or the example of Figs. 12 and 13.
[0116]
<0-9: Restriction of syntax element of picture parameter
set> 30 Figs. 14 and 15 are diagrams illustrating an exemplary
picture parameter set (PPS) in the HEVC.

31
SP351163WO001
[0117]
When the still picture profile is applied, there is no concept of time (there is no other picture) . In this regard, as illustrated in Fig. 14, 0 or 1 may be designated as both 5 of values of the syntax element num_ref_idx_10_def ault_active minusl (a 6-th line) related to LO and a syntax element num_ref_idx_ll_default_active minusl (a 7-th line) related to Ll in the picture parameter set (PPS). [0118]
10 In other words, vjhen the still picture profile is applied, both of the values of the syntax element
num_ref_idx_10_default_activeminusl (the 6-th line) related to LO and the syntax element num_ref_idx_ll_default_active minusl (the 7-th line) related to Ll in the picture parameter
15 set (PPS) may have to be fixed to 0 or 1. [0119]
The syntax elements are positive values that are encoded by extended Golomb coding and then transmitted. Thus, vjhen the values are 0 or 1, the coding amount becomes minimum. In
20 other words, as 0 is designated as the values of the syntax element num_ref_idx_10_default_active minusl related to LO and the syntax element num_ref_idx_ll_default_active minusl related to Ll, it is possible to suppress a reduction in coding efficiency.
25 [0120]
Further, v/hen the still picture prof lie is applied, there is no concept of time (there is no other picture) . In this regard, as illustrated in Fig. 15, 0 may be designated as a value of a syntax element (flag)
30 lists modification_present__f lag (a 49-th line) of thepicture parameter set (PPS) indicating v/hether or not there is a syntax

32
SP351163WO001
element ref__pic_list_modification in a current slice header. [0121]
In other v/ords, v/hen the still picture profile is applied, the value of the syntax element (flag) 5 lists_modification_present_flag {the 49-th line) of the picture parameter set (PPS) indicating v/hether or not there is a syntax element ref_pic_list_modification in the current slice header may have to be fixed to 0. t0122]
10 When the value of the syntax element
lists_modification_present__flag is 1, the syntax element ref_pic_list_modification related to the reference image list is transmitted for the current slice as illustrated in 53-rd and 54-th lines of Fig. 21, but in the case of the still picture
15 profile, this syntax element is unnecessary. In other v/ords, as 0 is designated as the value of the syntax element lists_modification_present__flag, it is possible to omit transmission of the syntax element ref_pic_list_modif ication of the reference image list that is unnecessary information
2 0 for the current slice, and it is possible to suppress a reduction in coding efficiency. [0123]
Further, v/hen the still picture prof lie is applied, there is no concept of time {there is no other picture) . In this
25 regard, as illustrated in Fig. 15, 0 may be designated as a value of a syntax element log2__parallel_merge_level_minus2 {a 50-th line) of the picture parameter set {PPS) designating a parallel process level of a merge mode and a skip mode in a prediction process.
30 [0124]
In other v/ords, v/hen the still picture profile is applied.

33
SP351163WO001
the value of the syntax element
log2_parallel_merge_level_minus2 (the 50-th line) of the picture parameter set (PPS) designating the parallel process level of the merge mode and the skip mode in the prediction 5 process may have to be fixed to 0. [0125]
This syntax element is a positive value that is encoded by extended Golomb coding and then transmitted. Thus, when this value is 0, the coding amount becomes minimum. In other
10 v/ords, as 0 is designated as the value of the syntax element log2_parallel_merge_level_minus2 designating the parallel process level of the merge mode and the skip mode in the prediction process, it is possible to suppress a reduction in coding efficiency.
15 [0126]
Further, v/hen the still picture prof lie isapplied, there is no concept of time (there is no other picture) . In this regard, as illustrated in Fig. 14, 0 may be designated as both of values of a syntax element (flag) weighted_pred_flag (a
20 18-th line) related to the v/eighted prediction of the P slice and a syntax element (flag) V7eighted_bipred_flag (al9-thline) related to the v/eightedprediction of the B slice in the picture parameter set (PPS). [0127]
25 In other v/ords, v/hen the still picture profile is applied, the values of the syntax element (flag) vjeighted__pred_flag (the 18-th line) related to the v/eighted prediction of the P slice and the syntax element (flag) weighted_bipred_flag (the 19"th line) related to the v/eighted prediction of the
30 B slice in the picture parameter set (PPS) may have to be fixed to 0.

34
SP351163WO001
[0128]
When the value of the syntax element weighted_pred_f lag or v/eighted_bipred_flag is 1, as illustrated in 65-th to 68-th lines of Fig. 21, the vjeighted prediction table or the like 5 is transmitted for the current slice, but in the case of the still picture profile, this information is unnecessary. In other words, as 0 is designated as the value of the syntax element weighted_pred_flag or v,'eighted_bipred_flag, it is possible to omit transmission of unnecessary information for 10 the current slice, and it is possible to suppress a reduction in coding efficiency. [0129]
Here, as will be described later, even v/hen the slice type is restricted to the I slice, transmission of the 15 information can be omitted, and thus the above-described restriction related to the syntax element v;eighted_pred_f lag or v/eighted_bipred_flag can be omitted. [0130]
Further, it is possible to restrict the value of the 20 syntax element by the semantics v;ithout changing the syntax and suppress a reduction in syntax versatility. [0131]
<0-10: Restriction of syntax element related to prediction mode of scaling list> 25 Meanv/hile, in the sequence parameter set (SPS)
illustratedin Figs . 5 and 6, a scaling lis t (scaling_list_data 0 ) is called (a 49-th line) . Similarly, even in the picture parameter set (PPS) illustrated in Figs . 14 and 15, the scaling list (scaling_list_data ()) is called (a 48-th line). 30 [0132]
Fig. 16 illustrates an exemplary scaling list

35
SP351163WO001
(scaling_list_data () ) . In the scaling list (scaling_list_data ()) illustrated in Fig. 16, semantics of a size ID (sizelD) and amatrix ID (matrixID) are as illustrated in Figs. 17 and 18. 5 [0133]
Here, when the value of the size ID (sizelD) is 0, 1, or 2, and the value of the matrix ID (matrixID) is 3, 4, or 5 or when the value of the size ID (sizelD) is 3, and the value of the matrix ID (matrixID) is 1, in the still picture profile, 10 it is redundant to transmit the scaling list. [0134]
In this regard, in this case, 0 may be designated as a value of a syntax element scaling_list_pred_mode_flag related to the prediction mode of the scaling list, and 0 or 15 1 may be designated as a value of a syntax element
scaling_list__pred_matrix_id_delta related to a prediction matrix of the scaling list. [0135]
In other words, v/hen the still picture profile is applied, 20 the value of the syntax element 3caling_list_pred_mode_flag (a 4-th line) related to the prediction mode of the scaling list may have to be fixed to 0, and the value of the syntax element scaling_list_pred_matrix_id_delta (a 6-th line) related to the prediction matrix of the scaling list may have 25 to be fixed to 0 or 1. [0136]
Further, as 1 is designated as the value of the syntax element scaling_list_pred_matrix_id_delta related to the prediction matrix of the scaling list, it is possible to reduce 30 the necessity of inserting start code emulation prevention while keeping a code length to a minimum.

36
SP351163WO001
[01371
<0-ll: Change of syntax related to prediction mode of scaling list>
Further, instead of restricting the value of the syntax 5 element by the semantics as described above, the syntax may be changed as illustrated in Fig. 19. [0138]
In the syntax of Fig. 19, as illustrated in a 4-th line, the condition of the for statement is designated in detail 10 using the size ID (sizelD) and the matrix ID (matrixID) as described above. [0139]
As a result, the same effects can be obtained. [0140] 15 <0-12: Restriction of syntax element related to slice type>
Figs. 20 to 22 illustrate an exemplary syntax of a slice header, [0141] 20 When the still picture profile is applied, the slice type is the I slice. In this regard, as illustrated in Fig. 20, a value indicating the I slice may be designated as a value of a syntax element slice_type (an 11-th line) related to the slice type in the slice header (slice_header()). 25 [0142]
In other words, vjhen the still picture profile is applied, the value of the syntax element slice_type (the 11-th line) related to the slice type in the slice header (slice_header () ) may have to be fixed to the I slice. 30 [0143]
As a result, it is possible to skip 44-th to 68-th lines

37
SP351163WO001
of the slice header (slice_header(}). Thus, as a result, it
is possible to suppress an increase in a load. Further, it
is possible to prevent transmission of unnecessary syntax
elements of the 44-th to 68-th lines, and it is possible to 5 suppress a reduction in coding efficiency.
[0144]
Further, it is possible to restrict the value of the
syntax element by the semantics vj'ithout changing the syntax
and suppress a reduction in syntax versatility. 10 [0145]
<0-13: Restriction of syntax element related to NAL unit
type>
Meanv/hile, in Figs. 20 to 22, IdrPicFlag and RapPicFlag
are calculated based on nal_unit_type as in the follov^ing 15 Formulas (3) and (4):
[0146]
[Mathematical Formula 3]
IdrPicFlag = (nal_unit_type == IDR_W_LP | | nal_unit_type ^=
IDR_N_LP) ... (3)
20 RapPicFlag = (nal_unit_type >= 7 SSnal_unit_type <=^ 12)
(4)
[0147]
Here, a syntax element nal_unit_type related to the NAL
unit type is allocated as illustrated in Fig. 23. 25 [0148]
In this regard, vihen the still picture profile is applied,
IDR_W_LP or IDR_N_LP may be designated as the NAL unit type
(nal_unit_type) for the VCL.
[0149] 30 In other v/ords, v;hen the still picture profile is applied,
the NAL unit type (nal_unit type) for the VCL may have to be

SP351163WO001
fixed to IDR_W_LP or IDR__N_LP. [0150]
By performing the above process, it is possible to prevent transmission of redundant information and improve the 5 coding efficiency of image compression information to be output when encoding is performed based on the still picture profile . [0151]
Further, the syntax elements related to the inter-image process in v/hich the values are restricted when the coding 10 process is performed based on the profile for encoding the still image is not limited to the above example. The values of the syntax elements other than the above-described syntax elements may be restricted. At this time, the syntax may be changed by restricting the semantics. 15 [0152]
Further, as illustrated in Fig . 24, when there is a Region of Interest (ROI) in a part of a still image, for example, when a person's face is shovjn in a part of a still image, the image may be divided into tiles of Fig. 2, a tile serving as 20 a ROI region may be designated by metadata such as Supplemental Enhancement Information (SEI), and the decoding process of only the ROI region may be performed for a decoded image. [0153]
Next, application examples of the present technology 25 to specific devices v/ill be described. [0154]
<1. First embodiment>
Fig. 25 is a block diagram illustrating an exemplary
30 configuration of an image coding device as an example of an
image processing device to v;hich the present technology is

39
SP351163WO001
applied. For example, an image coding device 100 illustrated in Fig. 25 encodes image data of a moving image using the prediction process of the HEVC or a prediction process of a scheme based on the HEVC. 5 [0155]
Further, the image coding device 100 can encode image data of a still image as well as image data of a moving image. In this case, a still image profile (for example, the still picture profile) is set to the image coding device 100. 10 [0156]
As illustrated in Fig. 25, the image coding device 100 includes an A/D converter 101, a screen rearrangement buffer 102, an operation unit 103, an orthogonal transform unit 104, a quantization unit 105, a lossless encoding unit 106, an 15 accumulation buffer 107, an inverse quantization unit 108, and an inverse orthogonal transform unit 109 . The image coding device 100 further includes an operation unit 110, a loop filter 111, a frame memory 112, an intra prediction unit 113, an inter prediction unit 114, a predicted image selecting unit 115, 20 and a rate control unit 116. [0157]
The A/D converter 101 performs A/D conversion on image
data (analog data) of an input image input to the image coding
device 100 . The A/D converter 101 supplies the converted image
25 data (digital data) to the screen rearrangement buffer 102.
[0158]
The screen rearrangement buffer 102 stores each frame
image data of the input image supplied in a display order in
the order. The screen rearrangement buffer 102 rearranges
30 the order of the frames of the input image in an encoding order
according to a Group Of Picture (GOP). In other words, the

40
SP351163WO001
screen rearrangement buffer 102 reads the image data of the frames stored in the display order in the encoding order. The screen rearrangement buffer 102 supplies the read image data to the operation unit 103 . Further, the screen rearrangement 5 buffer 102 supplies the read image data to the intra prediction unit 113 and the inter prediction unit 114 as v;ell. In other v/ords, the image data of the frames are supplied to the operation unit 103/ the intra prediction unit 113, and the inter prediction unit 114 in the encoding order. Further, v?hen the
10 input image is the still image, since there is no concept of time (since the number of frames is 1), the rearranging is omitted. [0159]
The operation unit 103 generates image data of a
15 differential image obtainedby subtracting the predicted image from the input image using the image data of the input image read from the screen rearrangement buffer 102 and the image data of the predicted image supplied from the intra prediction unit 113 or the inter prediction unit 114 through the predicted
20 image selecting unit 115 . For example, in the case of an image on v/hich the intra coding is performed, the operation unit 103 generates a differential image betv;een the input image and the predicted image generated by the intra prediction unit 113. Further, for example, in the case of an image on which
25 the inter coding is performed, the operation unit 103 generates a differential image between the input image and the predicted image generated by the inter prediction unit 114. The operation unit 103 outputs the generated image data of the differential image to the orthogonal transform unit 104.
30 [0160]
The orthogonal transform unit 104 performs orthogonal

41
SP351163WO001
transform such as discrete cosine transform or Karhunen-Loeve transform on the image data of the differential image supplied from the operation unit 103. The orthogonal transform unit 104 supplies obtained transform coefficients to the 5 quantization unit 105. [0161]
The quantization unit 105 quantizes the transform coefficients supplied from the orthogonal transform unit 104 . The quantization unit 105 sets a quantization parameter based
10 on information related to a target value of a coding amount supplied from the rate control unit 116, and performs the quantization. The quantization unit 105 supplies the quantized transform coefficients to the lossless encoding unit 106.
15 [0162]
The lossless encoding unit 106 encodes the transform coefficients quantized by the quantization unit 105 according to an arbitrary coding scheme, and generates encoded data. Since coefficient data is quantized under control of the rate
20 control unit 116, the data amount (the coding amount) of the encoded data becomes the target value set by the rate control unit 116 (or approximates to the target value). [0163]
The lossless encoding unit 106 acquires, for example,
25 information indicating an intra prediction mode from the intra prediction unit 113, and acquires, for example, information indicating an inter prediction mode and differential motion vector information from the inter prediction unit 114. The lossless encodingunit 106 encodes various kinds of information
30 according toan arbitrary coding scheme, andsets (multiplexes) the encoded information as part of header information of

42
SP351163WO001
encoded data. The lossless encoding unit 106 supplies the
obtained encoded data to be accumulated in the accumulation
buffer 107.
[0164] 5 Examples of the coding scheme of the lossless encoding
unit 106 include variable length coding and arithmetic coding .
As the variable length coding, for example, there is
Context-Adaptive Variable Length Coding (CAVLC) defined in
the H. 2 64/AVC scheme. As the arithmetic coding, for example, 10 there is Context-Adaptive Binary Arithmetic Coding (CABAC) .
[0165]
The accumulation buffer 107 temporarily holds the
encoded data supplied from the lossless encoding unit 106.
The accumulation buffer 107 outputs the held encoded data to 15 the outside of the image coding device 100 at a predetermined
timing. In other words, the accumulation buffer 107 also
serves as a transmitting unit that transmits the encoded data.
[0166]
The transform coefficients quantized by the 20 quantization unit 105 are also supplied to the inverse
quantization unit 108. The inverse quantization unit 108
inversely quantizes the guantized transform coefficients by
a method corresponding to the quantization performed by the
quantization unit 105. The inverse quantization unit 108 25 supplies the obtained transform coefficients to the inverse
orthogonal transform unit 109.
[0167]
The inverse orthogonal transform unit 109 performs
inverse orthogonal transform on the transform coefficients 30 supplied from the inverse quantization unit 108 by a method
corresponding to the orthogonal transform process performed

43
SP351163WO001
by the orthogonal transform unit 104. The image data of the differential image is restored by the inverse orthogonal transform. The inverse orthogonal transform unit 109 supplies the restored image data of the differential image 5 to the operation unit 110 as the inverse orthogonal transform result. [0168]
The operation unit 110 generates image data of an image obtained by adding the restored differential image and the
10 predicted image using the inverse orthogonal transform result supplied from the inverse orthogonal transform unit 109 and the image data of the predicted image supplied from the intra prediction unit 113 or the inter prediction unit 114 through the predicted image selecting unit 115. In other words, a
15 locally reconstructed image (hereinafter, referred to as a "the reconstructed image") is obtained by the addition process . The operation unit 110 supplies the image data of the reconstructed image to the loop filter 111 or the intra prediction unit 113.
20 [0169]
The loop filter 111 includes a deblocking filter, an adaptive loop filter, or the like, and performs an appropriate filter proces.s on the image data of the reconstructed image supplied from the operation unit 110. For example, the loop
25 filter 111 performs the deblocking filter process on the image data of the reconstructed image, and removes block distortion of the reconstructed image. Further, for example, the loop filter 111 improves the image quality of the reconstructed image by performing the loop filter process on the deblocking
30 filter process result (the image data of the reconstructed image from v/hich the block distortion has been removed) using

SP351163WO001
the Wiener Filter. [0170]
The loop filter 111 may perform another arbitrary filter process on the reconstructed image. The loop filter 111 may 5 supply information used in the filter process such as a filter coefficient to the lossless encoding unit 106 as necessary so that the information can be encoded. [0171]
The loop filter 111 supplies the image data of the 10 reconstructed image (hereinafter^ referred to as a "decoded image") that has been subjected to the filter process as described above to the frame memory 112. [0172]
The frame memory 112 stores the supplied image data of 15 the decoded image. Further, the frame memory 112 supplies the stored image data of the decoded image to the inter prediction unit 114 as a reference image at a predetermined timing. [0173] 20 The intra prediction unit 113 performs the prediction process on the current picture that is the image of the frame of the processing target, and generates the predicted image. The intra prediction unit 113 performs the prediction process in units of predetermined blocks (using a block as a processing 25 unit) . In otherv/ords, the intra prediction unit 113 generates the predicted image of the current block serving as the processing target in the current picture. At this time, the intra prediction unit 113 performs the prediction process (intra-screen prediction (which is also referred to as intra 30 prediction) ) using the reconstructed image supplied from the operation unit 110 as the reference image. In other v/ords.

45
SP351163WO001
the intra prediction unit 113 generates the predicted image using pixel values of pixels neighboring the current block which are included in the reconstructed image. The pixel values of the neighboring pixels used for the intra prediction 5 are pixel values of previously processed pixels of the current picture. In intra prediction {that is, in the scheme of generating the predicted image) , a plurality of methods (v^hich are also referred to as "intra prediction modes") are prepared as candidates in advance. The intra prediction unit 113
10 performs the intra prediction in a plurality of intra prediction modes which are prepared in advance. [01743
The intra prediction unit 113 generates predicted images in all the intra prediction modes serving as the candidates,
15 evaluates cost function values of the predicted images using the input image supplied from the screen rearrangement buffer 102/ and selects an optimal mode. When the optimal intra prediction mode is selected, the intra prediction unit 113 supplies the predicted image generated in the optimal mode
20 to the predicted image selecting unit 115. [0175]
Further, as described above, the intra prediction unit 113 appropriately supplies, for example, the intra prediction mode information indicating the employed intrapredictionmode
25 to the lossless encoding unit 106 so that the information is encoded. [0176]
The inter prediction unit 114 performs the prediction process on the current picture, and generates the predicted
30 image . The inter prediction unit 1-14 perf oirms the prediction process in units of predetermined blocks (using a block as

46
SP351163WO001
a processing unit) . In other v/ords, the inter prediction unit 114 generates the predicted image of the current block serving as the processing target in the current picture . At this time, the inter prediction unit 114 performs the prediction process 5 using the image data of the input image supplied from the screen rearrangement buffer 102 and the image data of the decoded image supplied from the f ramememory 112 as the reference image . The decoded image is an image (another picture other than the current picture) of the frame processed before the current
10 picture. In other v/ords, the inter prediction unit 114 performs the prediction process (inter-screen prediction (which is also referred to as "inter prediction")) of generating the predicted image using an image of another picture-
15 [0177]
The inter prediction includes motion prediction and motion compensation . More specifically, the inter prediction unit 114 performs the motion prediction on the current block using the input image and the reference image, and detects
20 a motion vector . Then, the inter prediction unit 114 performs the motion compensation process according to the detected motion vector using the reference image, and generates the predicted image (inter predicted image information) of the current block. In the inter prediction (that is, in the scheme
25 of generating the predicted image), a plurality of methods
(v/hich are also referred to as "inter prediction modes") are
prepared as candidates in advance. The inter prediction unit
114 performs the inter prediction in a plurality of inter
prediction modes which are prepared in advance.
30 [0178]
The inter prediction unit 114 generates the predicted

47
SP351163WO001
images in all the inter prediction modes serving as the candidate. The inter prediction unit 114 evaluates cost function values of the predicted images using the input image supplied from the screen rearrangement buffer 102, information 5 of the generated differential motion vector^ and the like^ and selects an optimal mode. When the optimal inter prediction mode is selected/ the inter prediction unit 114 supplies the predicted image generated in the optimal mode to the predicted image selecting unit 115.
10 [0179]
The inter prediction unit 114 supplies the information indicating the employed inter prediction mode^ information necessary for performing processing in the inter prediction mode when the encoded data is decoded, and the like to the
15 lossless encoding unit 106 so that the information is encoded. As the necessary information, there is information of a generateddifferential motion vector, and as prediction motion vector information, there is a flag indicating an index of a prediction motion vector.
20 [0180]
The predicted image selecting unit 115 selects a supply source of the predicted image to be supplied to the operation unit 103 and the operation unit 110. For example, lii the case of the intra coding, the predicted image selecting unit 115
25 selects the intra prediction unit 113 as the supply source of the predicted image, and supplies the predicted image supplied from the intra prediction unit 113 to the operation unit 103 and the operation unit 110. Further, for example, in the case of the inter coding, the predicted image selecting
30 unit 115 selects the inter prediction unit 114 as the supply source of thepredicted image, and supplies the predicted image

48
SP351163WO001
supplied from the inter prediction unit 114 to the operation
unit 103 and the operation unit 110,
[0181]
The rate control unit 116 control a rate of a quantization 5 operation of the quantization unit 105 based on the coding amount of the encoded data accumulated in the accumulation buffer 107 such that neither an overflow nor an underflow occurs. [0182] 10 The image coding device 100 further includes a profile setting unit 121. [0183]
The profile setting unit 121 sets a profile that is applied to encoding of image data. For example, when the still 15 image is encoded, the profile setting unit 121 sets the still picture profile, For example, the profile setting unit 121 sets the profile according to an external instruction such as a user instruction. Of course, this method is arbitrary, and the profile may be set based on any information. When 20 the profile is set, the profile setting unit 121 supplies the information to the lossless encoding unit 106. [0184]
The lossless encoding unit 106 performs encoding according to the profile set by the profile setting unit 121. 2 5 For example, v/henthe still picture prof lie is set by the profile setting unit 121, the lossless encoding unit 106 restricts the value of the syntax element related to the inter-image process. The specific example of this restriction has been described in <0. Overview>. 30 [0185]


49
SP351163WO001
Fig. 2 6 is a block diagram illustrating an exemplary
main configuration of the lossless encoding unit 106 of Fig.
25 related to a syntax element setting. As illustrated in
Fig. 25, the lossless encoding unit 106 includes a syntax
5 element setting unit 131 and an encoding unit 132.
[0186]
The syntax element setting unit 131 performs processing related to a syntax element setting. For example, the syntax element setting unit 131 sets the syntax elements of various
10 NAL units (nal_unit) such as the video parameter set (VPS), the sequence parameter set (SPS), the picture parameter set (PPS), and the slice header. The syntax element setting unit 131 acquires necessary information from the processing units of the image coding device 100 such as the intra prediction
15 unit 113 and the inter prediction unit 114 as necessary, and sets the value of the syntax element based on the acquired information. [0187]
Further, the syntax element setting unit 131 receives
20 the designated profile from the profile setting unit 121. The syntax element setting unit 131 sets the syntax element according to the profile designated by the profile setting unit 121. [0188]
25 For example, v;hen the still picture profile is set by the profile setting unit 121, the syntax element setting unit 131 restricts the value of the syntax element related to the inter-image process. The specific example of this restriction has been described in <0. Overview>.
30 [0189]
The syntax element setting unit 131 supplies the set

50
SP351163WO001
syntax element to the encoding unit 132. [0190]
For example, the encoding unit 132 acguires the
quantization coefficients of the image data from the 5 quantization unit 105, encodes the acquired quantization
coefficients according to the arithmetic coding or the like,
and obtains the encoded data. The encoding unit 132 supplies
the obtained encoded data to the accumulation buffer 107.
[0191] 10 Further, the encoding unit 132 also encodes information
other than the image data, and supplies the encoded information
to the accumulation buffer 107. For example, the encoding
unit 132 encodes the syntax element set by the syntax element
setting unit 131, and supplies the encoded syntax element to 15 the accumulation buffer 107.
[0192]
As described above, v/hen the still picture profile is
set, the lossless encoding unit 106 restricts the value of
the syntax element related to the inter-image process, and 20 generates the encoded data. Thus, the image coding device
100 can suppress transmission of redundant information and
suppress a reduction in coding efficiency.
[0193]
In addition, the image coding device 100 can suppress 25 an increase of an unnecessary load in the decoding process
by reducing the redundant information of the encoded data.
[0194]
Further, the image coding device 100 can sv/itch the
profile and easily encode both the still image and the moving 30 image through a single circuit.
[0195]

51
SP351163WO001

Next, an exemplary flov/ of the coding process performed by the image coding device 100 illustrated in Fig. 25 vjill be described with reference to flov;charts of Figs. 27 and 28. 5 [0196]
When the coding process starts, in step SlOl of Fig. 27/ the profile setting unit 121 sets the profile according to the image data to be encoded/ for example/ according to the external instruction such as the user instruction. 10 [0197]
In step S102/ the lossless encoding unit 106 determines v/hether or not the profile set in step SlOl is the still image profile (the profile suitable for encoding of the image data of the still image) . When the set profile is determined to 15 be the moving image profile (the profile suitable for encoding of the image data of the moving image} , the process proceeds to step S103. [0198]
When the image data of the moving image is encoded/ in 20 step S103/ the A/D converter 101 performs A/D conversion on image of frames (pictures) of an input moving image. [0199]
In step 3104/ the screen rearrangement buffer 102 stores the images that have been subjected to the A/D conversion in 25 step 3103/ and rearranges the respective pictures arranged in the display order in the encoding order. [0200]
In step 3105/ the intra prediction unit 113 performs the intra prediction process of the intra prediction mode. 30 [0201]
In step 3106/ the inter prediction unit 114 performs

52
SP351163WO001
the inter prediction process in which the motion prediction and the motion compensation of the inter prediction mode are performed. [0202] 5 In step S107, the predicted image selecting unit 115 selects the predicted image based on the cost function value or the like. In other v;ords, the predicted image selecting unit 115 selects either of the predicted image generated by the intra prediction in step S105 and the predicted image
10 generated by the inter prediction in step S106. [0203]
In step S108, the operation unit 103 calculates a difference between the input image in v/hich the frame order is rearranged by the process of step S104 and the predicted
15 image selected by the process of step S107. In other v/ords, the operation unit 103 generates image data of a differential image between the input image and the predicted image. The obtained image data of the differential image is smaller in a data amount than original image data. Thus^ the data amount
20 can be compressed to be smaller than when the image is encoded v/ithout change. [0204]
In step S109^ the orthogonal transform unit 104 performs the orthogonal transform on the image data of the differential
25 image generated by the process of step S108. [0205]
In step SllO/ the quantization unit 105 quantizes the orthogonal transform coefficients obtained by the process of step S109 using the quantization parameter calculated by the
30 rate control unit 116. [0206]

53
SP351163WO001
In step Sill, the inverse quantization unit 10 8 inversely quantizes the quantized coefficients (which are also referred to as "quantization coefficients") generated by the process of step SllO according to characteristics corresponding to 5 characteristics of the guantization unit 105. [0207]
In step S112, the inverse orthogonal transform unit 109 performs the inverse orthogonal transform on the orthogonal transform coefficients obtained by the process of step Sill. 10 [0208]
In step S113, the operation unit 110 generates image data of a reconstructed image by adding the predicted image selected by the process of step S107 to the differential image restored by the process of step S112. 15 [0209]
In step S114/ the loop filter 111 performs the loop filter process on the image data of the reconstructed image generated by the process of step S113. As a result, for example, the block distortion of the reconstructed image is removed. 20 [0210]
In step S1.15, the frame memory 112 stores the decoded image obtained by the process of step S114.-[0211]
In step S116, the lossless encoding unit 106 encodes 25 the quantized coefficients obtained by the process of step SllO . In other v/ords, lossless coding such as variable length coding or arithmetic coding is performed on data corresponding to the differential image. [0212] 30 At this time, the lossless encoding unit 106 encodes information related to the prediction mode of the predicted

54
SP351163WO001
image selected by the process of step S107, and adds the encoded information to the encoded data obtained by encoding the differential image. In other v/ords, the lossless encoding unit 106 also encodes the optimal intra prediction mode 5 information supplied from the intra prediction unit 113, information according to the optimal inter prediction mode supplied from the inter prediction unit 114, or the like, and adds the encoded information to the encoded data. [0213]
10 Further, the lossless encoding unit 106 also sets and encodes the syntax elements of various kinds of NAL units or the like, and adds the encoded syntax elements to the encoded data. [0214]
15 In step S117, the accumulation buffer 107 accumulates the encoded data obtained by the process of step S115. The encoded data accumulated in the accumulation buffer 107 is appropriately read, and transmitted to the decoding side via a transmission path or a recording medium.
20 [0215]
In step S118, the rate control unit 116 controls the rate of the quantization operation of the quantization unit 105 based on the coding amount (the generated coding amount) of the encoded data accumulated in the accumulation buffer
25 107 by the process of step S117 such that neither an overflov/ nor an underflov; occurs. Further, the rate control unit 116 supplies information related to the quantization parameter to the quantization unit 105. When the process of step S118 ends, the coding process ends.
30 [0216]
Further, v^hen the profile set in step SlOl is determined

55
SP351163WO001
to be the still image profile (the profile suitable for encoding
of the image data of the still image) in step S102, the process
proceeds to step S121 of Fig. 28. [0217] 5 In this case, processing similar to processingperf ormed
on the moving image in respective steps of Fig. 27 is performed
on the image data of the input still image in steps S121 to
S134.
[0218] 10 Here, v/hen the image data of the still image is encoded,
since the image data has no concept of time (there is a single
picture) , the inter prediction process of step SIC 6 is omitted.
Thus, the process of selecting the predicted image in step
S107 is omitted as v/ell. 15 [0219]
In other vjords, the processes of steps S121 to S123 of
Fig. 28 correspond to the processes of steps S103 to S105 of
Fig. 27 . Further, the processes of steps S124 to S134 of Fig.
28 correspond to the processes of steps S108 to S118 of Fig. 20 27.
[0220]
Here, in the process of step S132 of Fig. 28, the value
of the syntax element related to the inter-image process is
restricted. The details of this process will be described 25 later. When the process of step S134 of Fig. 28 ends, the
coding process ends.
[0221]

Next, an exemplary flow of the lossless coding process 30 performed in step S132 of Fig. 28 will be described with
reference to a flowchart of Fig. 29.

56
SP351163WO001
[0222]
When the lossless coding process starts in the encoding
of the still image/ in step S151/ the syntax element setting
unit 131 sets the syntax element based on the restriction for 5 the still image. For example, as described above in <0.
Overviev/>, in order to reduce transmission of redundant
information/ v/hen the still picture profile is applied/ the
syntax element setting unit 131 restricts the value of the
syntax element related to the inter-image process. 10 [0223]
In step 3152/ the encoding unit 132 encodes the syntax
element set in step S151.
[0224]
In step 3153/ the encoding unit 132 encodes the 15 orthogonal transform coefficients quantized by the
quantization unit 105. When the process of step S153 endS/
the lossless coding process endS/ and the process returns to
Fig. 28.
[0225] 20
Next/ an exemplary flov? of the syntax element setting
process performed in step 3151 of Fig. 29 vjill be described
vjith reference to a f lovjchart of Fig. 30.
[0226] 25 When the syntax element setting process starts, in step
3171/ the syntax element setting unit 131 sets the parameter
vps_jnax_sub_layers_minusl related to the sub layer of the video
parameter set (VP3) and the parameter
sps_max_sub_layers_minusl related to the sub layer of the 30 sequence parameter set (3P3) to 0.
[0227]

57
SP351163WO001
In step S172/ the syntax element setting unit 131 sets
the syntax element general_profile_idc of the profile tier
level (profile_tier_level() ) to a value indicating the still
picture profile. 5 [0228]
In step S173, the syntax element setting unit 131 sets
other syntax elements of the profile tier level (profile_tier_level()).
[0229] 10 In step S174, the syntax element setting unit 131 sets
the value of the syntax element vps_num_hrd_parameters related
to the virtual reference decoder in the video parameter set
(VPS) to 0.
[0230] 15 In step S175, the syntax element setting unit 131 sets
the value of the syntax element restricted_ref_pic_lists_f lag
related to the P slice and the B slice in the sequence parameter
set (SPS) to 0.
10231] 20 In step S17 6, the syntax element setting unit 131 sets
the value of the syntax element num_short_term_ref_pic_sets
related to the short term in the sequence parameter set (SPS)
to 0.
[0232] 25 In step Sill, the syntax element setting unit 131 sets
the value of the syntax element
long_term_ref_pic3_pre3ent_flag related to the long term in
the sequence parameter set (SPS) to 0.
[0233] 30 In step S178, the syntax element setting unit 131 sets
the value of the syntax element sps_temporal_mvp enable flag

58
SP351163WO001
related to the motion vector in the sequence parameter set
(SPS) to 0.
[0234]
In step S119, the syntax element setting unit 131 sets 5 both of the value of the syntax element
num_ref_idx_10_default_active minusl related to LO and the value of the syntax element num_ref_idx_ll_default_active minusl related to LI in the picture parameter set (PPS) to 0 or 1. 10 [0235]
In step S180, the syntax element setting unit 131 sets the value of the syntax element
lists_modification_present_flag of the picture parameter set (PPS) indicating vjhether or not the syntax element 15 ref__pic_list_modification is present in the current slice header to 0. [0236]
In step S181, the syntax element setting unit 131 sets the value of the syntax element 20 log2_parallel_merge_level_minus2 of the picture parameter set (PPS) designating the parallel process level of the merge mode and the skip mode in the prediction process to 0. [0237]
In step S182, the syntax element setting unit 131 sets 25 the value of the syntax element scaling_^lxst_pred_jnode__flag related to the prediction mode of the scaling list (scaling_li3t_data () ) to 0, and sets the value of the syntax element 3caling_li3t_pred_matrix_id_delta related to the prediction matrix of the scaling list (scaling_list_data () ) 30 to 0 or 1. [0238]

59
SP351163WO001
In step S183/ the syntax element setting unit 131 sets the value of the syntax element slice_type related to the slice type in the slice header (slice_header()) to the value indicating the I slice. 5 [0239]
In step S184, the syntax element setting unit 131 sets the NAL unit type {nal_unit_type) for the VCL to IDR_W_LP or IDR_N_LP. [0240]
10 In step S185, the syntax element setting unit 131 sets other syntax elements. For example, in step S185, the syntax element setting unit 131 may set the value of the syntax element (flag) weighted_pred_flag related to the v/eighted prediction of the P slice or the syntax element (flag)
15 v;eighted__bipred_f lag related to the vjeighted prediction of the B slice in the picture parameter set (PPS) to 0. When the process of step S185 ends, the process returns to Fig. 29. [0241]
20 Of course, the processing order of the above-described respective steps is arbitrary, and the processing order of the respective steps may be changed, and processes of a plurality of steps may be performed in parallel. Particularly, as described above in <0-l> to <0-3>, the processing order
25 of steps S171 to S173 is arbitrary. [0242]
Further, since the restrictions of the values of the syntax elements are independent of one another, ail values of a group of syntax elements need not be restricted, and only
30 the values of some syntax elements may be restricted . In other words, among the above-described steps in the syntax element

60
SP351163WO001
setting process of Fig. 30, only the processes of some steps may be performed. [0243]
Further, since the syntax elements v/hose value is 5 restricted are not limited to the above-described examples, a process of restricting a value of a syntax element that is not mentioned above may be added in the syntax element setting process of Fig. 30. [0244] 10 By performing the respective processes as described above, the image coding device 100 can suppress transmission of redundant information and improve the coding efficiency in image compression information to be output v/hen encoding is performed based on the profile for encoding the still image . 15 [0245]
<2. Second embodiment>
Further, it is desirable to select a profile according to an input image. In this regard, itmay be determinedv/hether 20 the input image is the moving image or the still image, and an appropriate profile may be set according to a determination result. [0246]
Fig. 31 is a block diagram illustrating an exemplary 25 configuration of an image coding device as an example of an image processing device to v;hich the present technology is applied in this case. For example, an image coding device 200 illustrated in Fig . 31 encodes image data of a moving image and a still image using the prediction process of the HEVC 30 or a prediction process of a scheme based on the HEVC. [0247]

61
SP351163WO001
The image coding device 200 has basically the same configuration as the image coding device 10 0 and performs the same process. The image coding device 200 includes a determining unit 211 in addition to the configuration of the 5 image coding device 100. [0248]
The determining unit 211 acquires image information from the screen rearrangement buffer 102, analyzes the image information, and determines v?hether image data of an encoding 10 target is a moving image or a still image. The determining unit 211 supplies the determination result to the profile setting unit 121. [0249]
The profile setting unit 121 sets an appropriate profile 15 according to the determination result supplied from the
determining unit 211. In other words, for example, when the determining unit 211 determines that the image data of the encoding target is the moving image, the profile setting unit 121 sets the moving image prof lie. Further, for example, when 20 the determining unit 211 determines that the image data of the encoding target is the still image, the profile setting unit 121 sets the still image profile (for example, the still picture profile) . [0250] 25 When the profile is set, the profile setting unit 121 supplies the information to the lossless encoding unit 106. The lossless encoding unit 106 performs encoding according to the profile set by the profile setting unit 121. [0251] 30 As a result, the image coding device 200 can set the profile according to the input image data v/ithout designation

62
SP351163WO001
from the outside, for example, the user. In other words, the image coding device 200 can suppress transmission of the redundant information and improve the coding efficiency in the image compression information to be output v/ithout 5 designation from the outside, for example, the user. [0252]
In addition, the image coding device 200 can suppress an increase of an unnecessary load in the decoding process by reducing the redundant information of the encoded data. 10 [0253]
Further, the image coding device 200 can encode both a still image and a moving image through a single circuit. [0254]
15 Next, an exemplary flow of the coding process performed by the image coding device 200 in this case vjill be described v/ith reference to flowcharts of Figs. 32 and 33. [0255]
When the coding process starts, in step S201 of Fig. 20 32, the determining unit 211 determines whether or not an input image is a still image, [0256]
In step 3202, the profile setting unit 121 sets the profile according to the determination result obtained in step 25 S201. [0257]
Thereafter, the same process as in steps S102 to S118
of Fig. 27 is performed in steps S203 to S219 of Fig. 32.
[0258]
30 In step S203 of Fig. 32, v/hen the still image profile
is determined to have been set, the process proceeds to step S221 of Fig. 33. The same process as i n steps S121 t o S134
of Fig. 28 is performed in steps S221 to S234 of Fig. 33.

CLAIMS
1{Amended}. An image processing device, comprising:
a restricting unit that restricts a value of a syntax element related to processing of a sub layer when a coding process is performed based on a profile for encoding a still image; and.
a transmitting unit that transmits the syntax element having the value restricted by the restricting unit.
2. The image processing device according to claim 1, further
comprising/an encoding unit that encodes image data using the syntax element restricted by the restricting unit, and generates a bitstream,
v/herein the transmitting unit further transmits the bitstream generated by the encoding unit.
3. The image processing device according to claim 2,wherein the syntax element is stored in a sequence parameter set of the bitstream.
4 (Amended). The image processing device according to claim 3,
wherein the syntax element is a syntax related to a maximum of the number of sub layers.
5. The image processing device according to claim 1/
wherein the restricting unit sets the value of the syntax element to a certain value vzhen the coding process is performed based on the profile of encoding the still image.
6. The image processing device according to claim X" wherein the certain value is 0.
7.(Amended)An image processing method, comprising: restricting a value of a syntax element related to processing of a sub layer when a coding process is performed based on a profile for encoding a still image; and
transmitting the syntax element having the restricted value.
8. The image processing method according to claim7, further comprising,
encoding image data using the restricted syntax element, generating a bitstream, and transmitting the bitstream.
9. The image processing method according to claim8, wherein the syntax element is stored in a sequence parameter set of the bitstream.
10. (Amended) The image processing method according to claim 9,
wherein the syntax element is a syntax related to a maximum of the number of sub layers.
11. The image processing method according to claim 7, wherein the value of the syntax element is set to a certain value when the coding process is performed based on the profile of encoding the still image.
12. The image processing method according to claiml1, wherein the certain value is 0.

Documents

Application Documents

# Name Date
1 4390-DELNP-2015.pdf 2015-05-25
2 FORM 5.pdf 2015-06-04
3 FORM 3.pdf 2015-06-04
4 FORM 2 + SPECIFICATION.pdf 2015-06-04
5 POWER OF AUTHORITY.pdf 2015-06-25
6 PCT-IB-304.pdf 2015-06-25
7 OTHER RELEVANT DOCUMENTS.pdf 2015-06-25
8 FORM 5.pdf_1241.pdf 2015-06-25
9 FORM 3.pdf_1242.pdf 2015-06-25
10 FORM 2 + SPECIFICATION.pdf_1243.pdf 2015-06-25
11 DRAWING.pdf 2015-06-25
12 4390-delnp-2015-Form-3-(26-08-2015).pdf 2015-08-26
13 4390-delnp-2015-Correspondence Others-(26-08-2015).pdf 2015-08-26
14 4390-delnp-2015-GPA-(17-12-2015).pdf 2015-12-17
15 4390-delnp-2015-Form-3-(17-12-2015).pdf 2015-12-17
16 4390-delnp-2015-Correspondence Others-(17-12-2015).pdf 2015-12-17
17 4390-delnp-2015-Assignment-(17-12-2015).pdf 2015-12-17
18 4390-delnp-2015-Form-3-(04-04-2016).pdf 2016-04-04
19 4390-delnp-2015-Correspondence Others-(04-04-2016).pdf 2016-04-04
20 Form 18 [06-10-2016(online)].pdf 2016-10-06
21 4390-DELNP-2015-FER.pdf 2019-09-16
22 4390-DELNP-2015-PETITION UNDER RULE 137 [22-01-2020(online)].pdf 2020-01-22
23 4390-DELNP-2015-FER_SER_REPLY [22-01-2020(online)].pdf 2020-01-22
24 4390-DELNP-2015-DRAWING [22-01-2020(online)].pdf 2020-01-22
25 4390-DELNP-2015-CORRESPONDENCE [22-01-2020(online)].pdf 2020-01-22
26 4390-DELNP-2015-CLAIMS [22-01-2020(online)].pdf 2020-01-22
27 4390-DELNP-2015-Power of Attorney-240120.pdf 2020-01-27
28 4390-DELNP-2015-Correspondence-240120.pdf 2020-01-27
29 4390-DELNP-2015-US(14)-HearingNotice-(HearingDate-21-12-2023).pdf 2023-10-10

Search Strategy

1 Search4390-DELNP-2015_11-09-2019.pdf