DESCRIPTION
DECODING DEVICE AND DECODING METHOD, ENCODING DEVICE, AND
ENCODING METHOD
5 TECHNICAL FIELD
[0001]
The present disclosure relates to a decoding device,
a decoding method, an encoding device, and an encoding method,
and more particularly, a decoding device, a decoding method,
10 an encoding device, and an encoding method, which are capable
of enabling a decoding side to accurately recognize a color
gamut of an encoding target image.
BACKGROUND ART
15 [0002]
In recent years, devices complying with a scheme such
as a Moving Picture Experts Group phase (MPEG) in which
compression is performed by orthogonal transform such as
discrete cosine transform (DCT) and motion compensation using
20 specific redundancy of image information have been spread for
both information delivery of broadcasting stations or the like
and information reception in general households.
[0003]
Particularly, an MPEG 2 (ISO/IEC 13818-2) scheme is
25 defined as a general-purpose image coding scheme, and now being
widely used for a wide range of applications of professional
use and consumer use as a standard converting an interlaced
scanned image, a progressive scanned image, a standard
resolution image, and a high-definition image. Using the MPEG
30 2 scheme, for example, a high compression rate and an excellent
image quality can be implemented by allocating a bit rate of
2
SP353806WO00
4 to 8 Mbps in the case of an interlaced scanned image of a
standard resolution having 720  480 pixels and a bit rate
of 18 to 22 MBps in the case of an interlaced scanned image
of a high resolution having 1920  1088 pixels.
5 [0004]
The MPEG 2 mainly aims for high-quality encoding suitable
for broadcasting, but does not support a coding scheme of a
bit rate lower than that of MPEG 1, that is, a coding scheme
of a high compression rate. As mobile terminals are spread,
10 a need for such a coding scheme has been considered to increase
in the near future, and accordingly an MPEG 4 coding scheme
has been standardized. ISO/IEC 14496-2 has been approved as
an international standard for the MPEG4 image coding scheme
in December, 1998.
15 [0005]
Further, in recent years, standardization of a standard
such as H.26L (ITU-T Q6/16 VCEG) designed for image coding
for video conferencing at first is being conducted. Although
H.26L is known to require a more computation amount for encoding
20 and decoding than in a coding scheme such as MPEG 2 or MPEG
4, H.26L is also known to be able to implement high coding
efficiency.
[0006]
Further, in recent years, as one of MPEG 4 activities,
25 standardization of incorporating a function that is not
supported by H.26L based on H.26L and implementing high coding
efficiency has been conducted as Joint Model of
Enhanced-Compression Video Coding. This standardization has
been approved in the name of H.264 or MPEG-4 Part 10 (Advanced
30 Video Coding (AVC)) in March, 2003.
[0007]
3
SP353806WO00
Furthermore, as an extension thereof, Fidelity Range
Extension (FRExt) including an encoding tool necessary for
professional use such as RGB or YUV422 or YUV444 or 8  8 DCT
and a quantization matrix which are specified in MPEG-2 has
been standardized in February, 2005. As a result, 5 the AVC
scheme has become a coding scheme capable of also expressing
a film noise included in a movie well and is being used in
a wide range of applications such as a BD (Blu-ray (a registered
trademark) Disc).
10 [0008]
However, in recent years, there is an increasing need
for high compression rate coding capable of compressing an
image of about 4000  2000 pixels which are 4 times as high
as a high-definition image or delivering a high-definition
15 image in a limited transmission capacity environment such as
the Internet. To this end, an improvement in coding efficiency
has been under continuous review by Video Coding Expert Group
(VCEG) under ITU-T.
[0009]
20 Currently, in order to further improve coding efficiency
to be higher than in the AVC, standardization of a coding scheme
called High Efficiency Video Coding (HEVC) has been being
conducted by Joint Collaboration Team-Video Coding (JCTVC)
which is a joint standardization organization of ITU-T and
25 ISO/IEC. Non Patent Document 1 has been issued as a draft
as of August, 2013.
[0010]
Meanwhile, in the AVC scheme and the HEVC scheme, a color
gamut of an encoding target image is defined by
30 colour_primaries of video usability information (VUI).
4
SP353806WO00
CITATION LIST
NON PATENT DOCUMENT
[0011]
Non Patent Document 1: Benjamin Bross, Gary J. Sullivan,
Ye-Kui Wang, "Editors' proposed corrections to HEVC 5 version
1," JCTVC-M0432_v3, 2013.4.18-4.26
SUMMARY OF THE INVENTION
PROBLEMS TO BE SOLVED BY THE INVENTION
10 [0012]
However, a color gamut of an encoding target image is
defined by an index identifying any one of color gamuts defined
in another standard. Thus, it is difficult to define a color
gamut other than a fixed color gamut as a color gamut of an
15 encoding target image, and it is difficult to accurately
recognize a color gamut of an encoding target image at a decoding
side.
[0013]
The present disclosure was made in light of the foregoing,
20 and it is desirable to enable a decoding side to accurately
recognize a color gamut of an encoding target image.
SOLUTIONS TO PROBLEMS
[0014]
25 A decoding device according to a first aspect of the
present disclosure includes: a receiving unit that receives
an encoded stream including encoded data of an image and color
gamut information indicating a color gamut of the image from
an encoding device that transmits the encoded stream; an
30 extracting unit that extracts the encoded data and the color
gamut information from the encoded stream received by the
5
SP353806WO00
receiving unit; and a decoding unit that decodes the encoded
data extracted by the extracting unit, and generates the image.
[0015]
A decoding method according to the first aspect of the
5 present disclosure corresponds to the decoding device
according to the first aspect of the present disclosure.
[0016]
In the first aspect of the present disclosure, an encoded
stream including encoded data of an image and color gamut
10 information indicating a color gamut of the image is received
from an encoding device that transmits the encoded stream,
the encoded data and the color gamut information are extracted
from the encoded stream, and the encoded data is decoded to
generate the image.
15 [0017]
An encoding device according to a second aspect of the
present disclosure includes: an encoding unit that encodes
an image, and generates encoded data; a setting unit that sets
color gamut information indicating a color gamut of the image;
20 and a transmitting unit that transmits an encoded stream
including the encoded data generated by the encoding unit and
the color gamut information generated by the setting unit.
[0018]
An encoding method according to the second aspect of
25 the present disclosure corresponds to the encoding device
according to the second aspect of the present disclosure.
[0019]
In the second aspect of the present disclosure, an image
is encoded to generate encoded data, color gamut information
30 indicating a color gamut of the image is set, and an encoded
stream including the encoded data and the color gamut
6
SP353806WO00
information is transmitted.
[0020]
A decoding device according to a third aspect of the
present disclosure includes: a receiving unit that receives
5 an encoded stream including encoded data of an image,
identification information identifying a certain color gamut,
and a cover ratio of a color gamut of the image to the certain
color gamut from an encoding device that transmits the encoded
stream; an extracting unit that extracts the encoded data,
10 the identification information, and the cover ratio from the
encoded stream received by the receiving unit; and a decoding
unit that decodes the encoded data extracted by the extracting
unit, and generates the image.
[0021]
15 A decoding method according to the third aspect of the
present disclosure corresponds to the decoding device
according to the third aspect of the present disclosure.
[0022]
In the third aspect of the present disclosure, an encoded
20 stream including encoded data of an image, identification
information identifying a certain color gamut, and a cover
ratio of a color gamut of the image to the certain color gamut
is received from an encoding device that transmits the encoded
stream, the encoded data, the identification information, and
25 the cover ratio are extracted from the encoded stream, and
the encoded data is decoded to generate the image.
[0023]
An encoding device according to a fourth aspect of the
present disclosure includes: an encoding unit that encodes
30 an image and generates encoded data; a setting unit that sets
identification information identifying a certain color gamut
7
SP353806WO00
and a cover ratio of a color gamut of the image to the certain
color gamut; and a transmitting unit that transmits an encoded
stream including the encoded data generated in the encoding
unit and the identification information and the cover ratio
generated 5 in the setting unit.
[0024]
An encoding method according to the fourth aspect of
the present disclosure corresponds to the encoding device
according to the fourth aspect of the present disclosure.
10 [0025]
In the fourth aspect of the present disclosure, an image
is encoded to generate encoded data, identification
information identifying a certain color gamut and a cover ratio
of a color gamut of the image to the certain color gamut are
15 set, and an encoded stream including the encoded data, the
identification information, and the cover ratio is
transmitted.
[0026]
The decoding devices according to the first and third
20 aspects and the encoding devices according to the second and
fourth aspects may be implemented by causing a computer to
execute a program.
[0027]
The program executed by the computer to implement the
25 decoding devices according to the first and third aspects and
the encoding devices according to the second and fourth aspects
may be provided such that the program is transmitted via a
transmission medium or recorded in a recording medium.
[0028]
30 The decoding device according to the first or third
aspect and the encoding device according to the second or fourth
8
SP353806WO00
aspect may be an independent device or may be an internal block
configuring a single device.
EFFECTS OF THE INVENTION
5 [0029]
According to the first and third aspects of the present
disclosure, it is possible to decode encoded data of an image.
Further, according to the first and third aspects of the present
disclosure, it is possible to accurately recognize a color
10 gamut of an encoding target image.
[0030]
Further, according to the second and fourth aspects of
the present disclosure, it is possible to encode an image.
Further, according to the second and fourth aspects of the
15 present disclosure, it is possible to enable a decoding side
to accurately recognize a color gamut of an encoding target
image.
[0031]
The effects described above are not necessarily limited,
20 and may include any effect described in the present disclosure.
BRIEF DESCRIPTION OF DRAWINGS
[0032]
Fig. 1 is a block diagram illustrating an exemplary
25 configuration of an encoding device according to a first
embodiment of the present disclosure.
Fig. 2 is a diagram illustrating an exemplary syntax
of a colour_primaries_info SEI.
Fig. 3 is a diagram for describing content of information
30 of the colour_primaries_info SEI.
Fig. 4 is a diagram for describing content of information
9
SP353806WO00
of the colour_primaries_info SEI.
Fig. 5 is a diagram illustrating an exemplary syntax
of colour_primaries_info_sei_element.
Fig. 6 is a diagram for describing content of information
5 of colour_primaries_info_sei_element.
Fig. 7 is a diagram for describing content of information
of colour_primaries_info_sei_element.
Fig. 8 is a diagram illustrating an exemplary syntax
of a ref_display_luminance_info SEI.
10 Fig. 9 is a diagram for describing content of information
of the ref_display_luminance_info SEI.
Fig. 10 is a flowchart for describing a stream generation
process of an encoding device.
Fig. 11 is a block diagram illustrating an exemplary
15 configuration of a decoding device according to the first
embodiment of the present disclosure.
Fig. 12 is a flowchart for describing an image generation
process of the decoding device of Fig. 11.
Fig. 13 is a block diagram illustrating an exemplary
20 configuration of an encoding device according to a second
embodiment of the present disclosure.
Fig. 14 is a diagram illustrating an exemplary syntax
of a colour_primaries_info SEI.
Fig. 15 is a diagram for describing information of the
25 colour_primaries_info SEI.
Fig. 16 is a diagram for describing information of the
colour_primaries_info SEI.
Fig. 17 is a diagram for describing information of the
colour_primaries_info SEI.
30 Fig. 18 is a diagram for describing information of the
colour_primaries_info SEI.
10
SP353806WO00
Fig. 19 is a diagram for describing information of the
colour_primaries_info SEI.
Fig. 20 is a flowchart for describing a stream generation
process of an encoding device.
Fig. 21 is a block diagram illustrating 5 an exemplary
configuration of a decoding device according to the second
embodiment of the present disclosure.
Fig. 22 is a flowchart for describing an image generation
process of the decoding device of Fig. 21.
10 Fig. 23 is a diagram for describing an MP4 box as a system
layer in which color gamut information and luminance
information are arranged.
Fig. 24 is a block diagram illustrating an exemplary
hardware configuration of a computer.
15 Fig. 25 is a diagram illustrating an exemplary multi-view
image coding scheme.
Fig. 26 is a diagram illustrating an exemplary
configuration of a multi-view image encoding device to which
the present disclosure is applied.
20 Fig. 27 is a diagram illustrating an exemplary
configuration of a multi-view image decoding device to which
the present disclosure is applied.
Fig. 28 is a diagram illustrating an exemplary scalable
image coding scheme.
25 Fig. 29 is a diagram for describing exemplary spatial
scalable coding.
Fig. 30 is a diagram for describing exemplary temporal
scalable coding.
Fig. 31 is a diagram for describing exemplary scalable
30 coding of a signal-to-noise ratio.
Fig. 32 is a diagram illustrating an exemplary
11
SP353806WO00
configuration of a scalable image encoding device to which
the present disclosure is applied.
Fig. 33 is a diagram illustrating an exemplary
configuration of a scalable image decoding device to which
5 the present disclosure is applied.
Fig. 34 is a diagram illustrating an exemplary schematic
configuration of a television device to which the present
disclosure is applied.
Fig. 35 is a diagram illustrating an exemplary schematic
10 configuration of a mobile telephone to which the present
disclosure is applied.
Fig. 36 is a diagram illustrating an exemplary schematic
configuration of a recording/reproducing device to which the
present disclosure is applied.
15 Fig. 37 is a diagram illustrating an exemplary schematic
configuration of an imaging device to which the present
disclosure is applied.
Fig. 38 is a block diagram illustrating a scalable coding
application example.
20 Fig. 39 is a block diagram illustrating another scalable
coding application example.
Fig. 40 is a block diagram illustrating another scalable
coding application example.
Fig. 41 illustrates an exemplary schematic
25 configuration of a video set to which the present disclosure
is applied.
Fig. 42 illustrates an exemplary schematic
configuration of a video processor to which the present
disclosure is applied.
30 Fig. 43 illustrates another exemplary schematic
configuration of a video processor to which the present
12
SP353806WO00
disclosure is applied.
MODE FOR CARRYING OUT THE INVENTION
[0033]
5
(Exemplary configuration of encoding device according
to first embodiment)
Fig. 1 is a block diagram illustrating an exemplary
configuration of an encoding device according to a first
10 embodiment of the present disclosure.
[0034]
An encoding device 10 of Fig. 1 includes a setting unit
11, an encoding unit 12, and a transmitting unit 13, and encodes
an image according to a scheme based on the HEVC scheme.
15 [0035]
Specifically, the setting unit 11 of the encoding device
10 sets parameter sets such as a sequence parameter set (SPS),
a picture parameter set (PPS), a VUI, and a supplemental
enhancement information (SEI).
20 [0036]
Examples of the SEI include a colour_primaries_info SEI,
a ref_display_luminance_info SEI, and the like. The
colour_primaries_info SEI is an SEI including color gamut
information indicating a (boundary of) a color gamut. The
25 ref_display_luminance_info SEI is an SEI including luminance
information (color gamut information of a master display)
indicating luminance levels of white, gray, and black of the
master display (display unit) that displays an encoding target
image at the time of authoring of the encoding target image.
30 The setting unit 11 provides the set parameter sets to the
encoding unit 12.
13
SP353806WO00
[0037]
The encoding target image is input to the encoding unit
12 in units of frames. The encoding unit 12 encodes the input
encoding target image according to the HEVC scheme. The
encoding unit 12 generates an encoded stream based 5 on encoded
data obtained as a result of encoding and the parameter sets
provided from the setting unit 11, and provides the encoded
stream to the transmitting unit 13.
[0038]
10 The transmitting unit 13 transmits the encoded stream
provided from the encoding unit 12 to a decoding device which
will be described later.
[0039]
(Exemplary syntax of colour_primaries_info SEI)
15 Fig. 2 is a diagram illustrating an exemplary syntax
of the colour_primaries_info SEI.
[0040]
As illustrated in a second line of Fig. 2,
colour_primaries_info_id is described in the
20 colour_primaries_info SEI. As illustrated in Fig. 3,
colour_primaries_info_id is an ID identifying the purpose of
the color gamut information.
[0041]
As illustrated in a third line of Fig. 2,
25 colour_primaries_type is described in the
colour_primaries_info SEI. As illustrated in Fig. 3,
colour_primaries_type indicates a color space type. For
example, as illustrated in a table of Fig. 3,
colour_primaries_type is 1 when a color space type is an RGB
30 color coordinate system, and colour_primaries_type is 2 when
a color space type is an XYZ color coordinate system.
14
SP353806WO00
[0042]
As illustrated in a fourth line of Fig. 2,
colour_primaries_info_present_flag is described in the
colour_primaries_info SEI. As illustrated in Fig. 3,
5 colour_primaries_info_present_flag is a flag indicating
whether or not primary color information indicating a position
of the primary color in the color space in the color gamut
information is described in the colour_primaries_info SEI.
colour_primaries_info_present_flag is 1 when the primary
10 color information is described, and
colour_primaries_info_present_flag is 0 when the primary
color information is not described.
[0043]
As illustrated in a fifth line of Fig. 2,
15 white_point_info_present_flag is described in the
colour_primaries_info SEI. As illustrated in Fig. 3,
white_point_info_present_flag is a flag indicating whether
or not white information indicating a position (white point)
of white in the color space in the color gamut information
20 is described in the colour_primaries_info SEI.
White_point_info_present_flag is 1 when the white information
is described, and white_point_info_present_flag is 0 when the
white information is not described.
[0044]
25 As illustrated in sixth and seventh lines of Fig. 2,
when colour_description_present_flag included in a VUI is 1,
limited_colour_gamut_boundaries_flag is described in the
colour_primaries_info SEI. Further,
colour_description_present_flag is a flag indicating whether
30 or not an index identifying a color gamut defined in a VUI
in another standard is described.
15
SP353806WO00
Colour_description_present_flag is 1 when an index is
described in a VUI, and colour_description_present_flag is
0 when an index is not described in a VUI.
[0045]
5 Further, limited_colour_gamut_boundaries_flag is a
flag indicating whether or not a color gamut of an encoding
target image is limited to a color gamut identified by an index
described in a VUI as illustrated in Fig. 4.
Limited_colour_gamut_boundaries_flag is 0 when a color gamut
10 is limited, and limited_colour_gamut_boundaries_flag is 1
when a color gamut is not limited.
[0046]
As illustrated in eighth and ninth lines of Fig. 2, when
limited_colour_gamut_boundaries_flag is 1,
15 limited_colour_gamut_range_in_percent is described in the
colour_primaries_info SEI. As illustrated in Fig. 4,
limited_colour_gamut_range_in_percent indicates a cover
ratio of a color gamut of an encoding target image to a color
gamut identified by an index described in a VUI. In other
20 words, limited_colour_gamut_range_in_percent is a ratio of
a color gamut of an encoding target image to a color gamut
identified by an index described in a VUI.
[0047]
As illustrated in tenth and eleventh lines of Fig. 2,
25 when colour_primaries_info_present_flag is 1,
colour_primaries_order_type is described in the
colour_primaries_info SEI. As illustrated in Fig. 4,
colour_primaries_order_type is a type of a description order
of the primary color information.
30 [0048]
For example, as illustrated in a table of Fig. 4, when
16
SP353806WO00
the color space type is the RGB color coordinate system, the
primary color information is described in the order of red,
green, and blue, red, green, and blue, and then described in
the descending order of wavelengths of the other colors (for
5 example, the order of yellow and cyan),
colour_primaries_order_type is 1. Further, when the color
space type is the RGB color coordinate system and the primary
color information is described in the descending order of
wavelengths (for example, the order of red, yellow, green,
10 cyan, and blue), colour_primaries_order_type is 2. When the
color space type is the XYZ color coordinate system and the
primary color information is described in the order of X, Y,
and Z, colour_primaries_order_type is 3.
[0049]
15 Further, as illustrated in a twelfth line of Fig. 2,
when colour_primaries_info_present_flag is 1,
num_colour_primaries_minus3 is described in the
colour_primaries_info SEI. As illustrated in Fig. 4,
num_colour_primaries_minus3 is a value obtained by
20 subtracting three from the number of pieces of primary color
information described in the colour_primaries_info SEI.
[0050]
As illustrated in thirteenth and sixteenth lines of Fig.
2, when colour_primaries_info_present_flag is 1, primary
25 color information is described in the colour_primaries_info
SEI by the number obtained by adding three to
num_colour_primaries_minus3. The primary color information
includes colour_primaries_info_sei_element
(ColourPrimaryXSign[i], ColourPrimaryXExp[i],
30 ColourPrimaryXMantissa[i], and ColourPrimaryXManlen[i])
indicating positions of primary colors in an X direction in
17
SP353806WO00
the color space and colour_primaries_info_sei_element
(ColourPrimaryYSign[i], ColourPrimaryYExp[i],
ColourPrimaryYMantissa[i], and ColourPrimaryYManlen[i])
indicating positions in a Y direction.
5 [0051]
As illustrated in seventeenth to nineteenth lines of
Fig. 2, when white_point_info_present_flag is 1, white
information is described in the colour_primaries_info SEI.
The white information includes
10 colour_primaries_info_sei_element (WhitePointXSign,
WhitePointXExp, WhitePointXMantissa, WhitePointXManlen)
indicating a position of white in the X direction in the color
space and colour_primaries_info_sei_element
(WhitePointYSign, WhitePointYExp, WhitePointYMantissa,
15 WhitePointYManlen) indicating a position in the Y direction.
[0052]
(Exemplary syntax of
colour_primaries_info_sei_element)
Fig. 5 is a diagram illustrating an exemplary syntax
20 of colour_primaries_info_sei_element configuring the primary
color information and the white information.
[0053]
As illustrated in Fig. 5,
colour_primaries_info_sei_element includes
25 colour_primaries_info_sign,
colour_primaries_info_exponent,
colour_primaries_info_mantissa_len_minus1, and
colour_primaries_info_mantissa.
[0054]
30 In Fig. 5, ColourPrimaryXSign[i],
ColourPrimaryYSign[i], WhitePointXSign, and WhitePointYSign
18
SP353806WO00
are referred to collectively as "OutSign." Similarly,
ColourPrimaryXExp[i], ColourPrimaryYExp[i], WhitePointXExp,
and WhitePointYExp are referred to collectively as "OutExp,"
and ColourPrimaryXMantissa[i], ColourPrimaryYMantissa[i],
WhitePointXMantissa, and WhitePointYMantissa are 5 referred to
collectively as "OutMantissa." Further,
ColourPrimaryXManlen[i], ColourPrimaryYManlen[i],
WhitePointXManlen, and WhitePointYManlen are referred to
collectively as "OutManLen."
10 [0055]
As illustrated in Fig. 6, colour_primaries_info_sign
indicates a sign of a floating point of coordinates a position
of a corresponding color in a color space.
colour_primaries_info_sign is 0 when the sign is positive,
15 and colour_primaries_info_sign is 1 when the sign is negative.
[0056]
As illustrated in Fig. 6,
colour_primaries_info_exponent indicates an exponent of a
floating point of coordinates a position of a corresponding
20 color in a color space.
[0057]
As illustrated in Fig. 6,
colour_primaries_info_mantissa_len_minus1 is a value
obtained by subtracting 1 from the number of bits of
25 colour_primaries_info_mantissa. As illustrated in Fig. 6,
colour_primaries_info_mantissa is a mantissa of a floating
point of coordinates of a position of a corresponding color
in a color space.
[0058]
30 As described above, colour_primaries_info_sei_element
can indicate coordinates x of a position of a corresponding
19
SP353806WO00
color in a color space. In other words, as illustrated in
Fig. 7, the coordinates x can be obtained by the following
Equations (1) using colour_primaries_info_sign,
colour_primaries_info_exponent,
5 colour_primaries_info_mantissa_len_minus1, and
colour_primaries_info_mantissa.
[0059]
[Mathematical Formula 1]
If o < e < 127, x = (-1)s*2e-31*(1 + n ÷ 2V)
10 If e = 0, x = (-1)s*2-(30+V)*n ... (1)
[0060]
In Equation (1), s denotes colour_primaries_info_sign,
and e indicates colour_primaries_info_exponent. Further, n
denotes colour_primaries_info_mantissa, and v denotes
15 colour_primaries_info_mantissa_len_minus1.
[0061]
For example, when colour_primaries_info_sei_element is
colour_primaries_info_sei_element (ColourPrimaryXSign[i],
ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], and
20 ColourPrimaryXManlen[i]) indicating coordinates
ColourPrimariesX of the primary colors in the x direction in
the color space, ColourPrimariesXSign that is
colour_primaries_info_sign of
colour_primaries_info_sei_element (ColourPrimaryXSign[i],
25 ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], and
ColourPrimaryXManlen[i]) is substituted into s of Equation
(1) as illustrated in a table of Fig. 7.
[0062]
Further, ColourPrimariesXExp that is
30 colour_primaries_info_exponent of
colour_primaries_info_sei_element (ColourPrimaryXSign[i],
20
SP353806WO00
ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], and
ColourPrimaryXManlen[i]) is substituted into e of Equation
(1). Furthermore, ColourPrimaryXMantissa that is
colour_primaries_info_mantissa of
colour_primaries_info_sei_5 i_element (ColourPrimaryXSign[i],
ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], and
ColourPrimaryXManlen[i]) is substituted into n of Equation
(1), and ColourPrimaryXManlen that is
colour_primaries_info_mantissa_len_minus1 is substituted
10 into v. Thus, coordinates ColourPrimariesX of the positions
of the primary colors in the x direction in the color space
are calculated as the coordinates x.
[0063]
Similarly, when colour_primaries_info_sei_element is
15 colour_primaries_info_sei_element (ColourPrimaryYSign[i],
ColourPrimaryYExp[i], and ColourPrimaryYMantissa[i],
ColourPrimaryYManlen[i]), coordinates ColourPrimariesY of
the positions of the primary colors in the y direction in the
color space are calculated as the coordinates x.
20 [0064]
When colour_primaries_info_sei_element is
colour_primaries_info_sei_element (WhitePointXSign,
WhitePointXExp, WhitePointXMantissa, and WhitePointXManlen),
coordinates WhitePointX of the position of white in the x
25 direction in the color space are calculated as the coordinates
x.
[0065]
When colour_primaries_info_sei_element is
colour_primaries_info_sei_element (WhitePointYSign,
30 WhitePointYExp, WhitePointYMantissa, and WhitePointYManlen),
coordinates WhitePointY of the position of white in the y
21
SP353806WO00
direction in the color space are calculated as the coordinates
x.
[0066]
(Exemplary syntax of ref_display_luminance_info SEI)
Fig. 8 is a diagram illustrating an 5 exemplary syntax
of the ref_display_luminance_info SEI.
[0067]
As illustrated in a second line of Fig. 8,
ref_display_luminance_info_id is described in the
10 ref_display_luminance_info SEI. As illustrated in Fig. 9,
ref_display_luminance_info_id an ID identifying the purpose
of luminance information of white, gray, and black of the master
display (reference display).
[0068]
15 As illustrated in a third line of Fig. 8,
ref_display_luminance_white_present_flag is described in the
ref_display_luminance_info SEI. As illustrated in Fig. 9,
ref_display_luminance_white_present_flag is a flag
indicating whether or not luminance information of white of
20 the master display is described in the
ref_display_luminance_info SEI. When the luminance
information of white of the master display is described in
the ref_display_luminance_info SEI,
ref_display_luminance_white_present_flag is 1, and when the
25 luminance information of white of the master display is not
described in the ref_display_luminance_info SEI,
ref_display_luminance_white_present_flag is 0.
[0069]
As illustrated in fourth and fifth lines of Fig. 8, even
30 for black and gray, similarly,
ref_display_luminance_black_present_flag and
22
SP353806WO00
ref_display_luminance_gray_present_flag are described in the
ref_display_luminance_info SEI.
[0070]
Further, as illustrated in sixth and seventh lines of
Fig. 8, when ref_display_luminance_white_present_flag is 5 s 1,
ref_display_luminance_white is described in the
ref_display_luminance_info SEI. As illustrated in Fig. 9,
ref_display_luminance_white is luminance information of
white.
10 [0071]
As illustrated in eighth and ninth lines of Fig. 8, for
black, similarly, when
ref_display_luminance_black_present_flag is 1,
ref_display_luminance_black serving as luminance information
15 of black is described in the ref_display_luminance_info SEI.
[0072]
Further, as illustrated in tenth and eleventh lines of
Fig. 8, even for gray, similarly, when
ref_display_luminance_gray_present_flag is 1,
20 ref_display_luminance_gray serving as luminance information
of gray is described in the ref_display_luminance_info SEI.
[0073]
(Description of processing of encoding device)
Fig. 10 is a flowchart for describing a stream generation
25 process of the encoding device 10.
[0074]
In step S11 of Fig. 10, the setting unit 11 of the encoding
device 10 sets an SPS. In step S12, the setting unit 11 sets
a VUI including an index (identification information)
30 identifying a color gamut defined in another standard.
[0075]
23
SP353806WO00
In step S13, the setting unit 11 sets a PPS. In step
S14, the setting unit 11 determines whether or not a color
gamut of an encoding target image is narrower than a color
gamut identified by the index included in the VUI.
5 [0076]
When it is determined in step S14 that the color gamut
of the encoding target image is narrower than the color gamut
identified by the index included in the VUI, the process
proceeds to step S15. In step S15, the setting unit 11 sets
10 the colour_primaries_info SEI including color gamut
information of the encoding target image, and the process
proceeds to step S16.
[0077]
Meanwhile, when it is determined in step S14 that the
15 color gamut of the encoding target image is not narrower than
the color gamut identified by the index included in the VUI,
the colour_primaries_info SEI including the color gamut
information of the encoding target image is not set. For
example, the colour_primaries_info SEI including
20 limited_colour_gamut_range_in_percent is set. Then, the
process proceeds to step S16.
[0078]
In step S16, the setting unit 11 sets the
ref_display_luminance_info SEI including the luminance
25 information of white, gray, and black of the master display.
The setting unit 11 provides the parameter sets such as the
set SPS, the PPS, the VUI, the colour_primaries_info SEI, and
the ref_display_luminance_info SEI to the encoding unit 12.
[0079]
30 In step S17, the encoding unit 12 encodes an encoding
target image of frame units input from the outside according
24
SP353806WO00
to the HEVC scheme. In step S18, the encoding unit 12 generates
encoded stream based on encoded data obtained as a result of
encoding and the parameter sets provided from the setting unit
11, and provides the encoded stream to the transmitting unit
5 13.
[0080]
In step S19, the transmitting unit 13 transmits the
encoded stream provided from the encoding unit 12 to the
decoding device which will be described later, and then the
10 process ends.
[0081]
As described above, the encoding device 10 sets and
transmits the colour_primaries_info SEI including the color
gamut information, and thus even when an encoding target image
15 has a color gamut different from a color gamut defined in another
standard, it is possible to enable the decoding side to
accurately recognize a color gamut of an encoding target image.
[0082]
Further, the encoding device 10 sets and transmits the
20 ref_display_luminance_info SEI including the luminance
information of white, black, and gray, and thus it is possible
to enable the decoding side to recognize the luminance
information of the master display.
[0083]
25 The above description has been made in connection with
the example in which the colour_primaries_info SEI including
the color gamut information is set when the color gamut of
the encoding target image is narrower than the color gamut
identified by the index included in the VUI, but the
30 colour_primaries_info SEI including the color gamut
information may be set when the color gamut of the encoding
25
SP353806WO00
target image is broader than the color gamut identified by
the index included in the VUI.
[0084]
(Exemplary configuration of decoding device according
5 to first embodiment)
Fig. 11 is a block diagram illustrating an exemplary
configuration of a decoding device that decodes the encoded
stream transmitted from the encoding device 10 of Fig. 1
according to the first embodiment of the present disclosure.
10 [0085]
A decoding device 50 of Fig. 11 includes a receiving
unit 51, an extracting unit 52, a decoding unit 53, an adjusting
unit 54, a display control unit 55, and a display unit 56.
[0086]
15 The receiving unit 51 of the decoding device 50 receives
the encoded stream transmitted from the encoding device 10
of Fig. 1, and provides the encoded stream to the extracting
unit 52.
[0087]
20 The extracting unit 52 extracts parameter sets and
encoded data from the encoded stream provided from the
receiving unit 51. The extracting unit 52 provides the
parameter sets and the encoded data to the decoding unit 53.
Further, the extracting unit 52 provides the VUI, the
25 colour_primaries_info SEI, the ref_display_luminance_info
SEI among the parameter sets to the adjusting unit 54.
[0088]
The decoding unit 53 decodes the encoded data provided
from the extracting unit 52 according to the HEVC scheme. At
30 this time, the decoding unit 53 also refers to the parameter
sets provided from the extracting unit 52 as necessary. The
26
SP353806WO00
decoding unit 53 provides an image obtained as a result of
decoding to the adjusting unit 54.
[0089]
The adjusting unit 54 acquires color gamut information
5 from the colour_primaries_info SEI provided from the
extracting unit 52 or recognizes a color gamut based on the
index included in the VUI. The adjusting unit 54 adjusts a
color gamut of the image provided from the decoding unit 53
based on either a color gamut indicated by the acquired color
10 gamut information or the recognized color gamut and a color
gamut of the display unit 56.
[0090]
Further, the adjusting unit 54 acquires the luminance
information of white, black, and gray from the
15 ref_display_luminance_info SEI provided from the extracting
unit 52. The adjusting unit 54 adjusts a luminance dynamic
range of the image whose color gamut has been adjusted based
on the acquired luminance information and the luminance
information of the display unit 56. The adjusting unit 54
20 provides the image whose luminance dynamic range has been
adjusted to the display control unit 55.
[0091]
Here, the adjusting of the luminance dynamic range is
assumed to be performed after the adjusting of the color gamut,
25 but the adjusting of the luminance dynamic range may be
performed before the adjusting of the color gamut.
[0092]
The display control unit 55 causes the image provided
from the adjusting unit 54 to be displayed on the display unit
30 56.
[0093]
27
SP353806WO00
(Description of processing of decoding device)
Fig. 12 is a flowchart for describing an image generation
process of the decoding device 50 of Fig. 11.
[0094]
In step S51 of Fig. 12, the receiving unit 51 of 5 the
decoding device 50 receives the encoded stream transmitted
from the encoding device 10 of Fig. 1, and provides the encoded
stream to the extracting unit 52.
[0095]
10 In step S52, the extracting unit 52 extracts parameter
sets and encoded data from the encoded stream provided from
the receiving unit 51. The extracting unit 52 provides the
parameter sets and the encoded data to the decoding unit 53.
Further, the extracting unit 52 provides the VUI, the
15 colour_primaries_info SEI, the ref_display_luminance_info
SEI among the parameter sets to the adjusting unit 54.
[0096]
In step S53, the decoding unit 53 decodes the encoded
data provided from the extracting unit 52 according to the
20 HEVC scheme. At this time, the decoding unit 53 refers to
the parameter sets provided from the extracting unit 52 as
necessary. The decoding unit 53 provides an image obtained
as a result of decoding to the adjusting unit 54.
[0097]
25 In step S54, the adjusting unit 54 determines whether
or not the colour_primaries_info SEI has been provided from
the extracting unit 52. When it is determined in step S54
that the colour_primaries_info SEI has been provided, the
process proceeds to step S55.
30 [0098]
In step S55, the adjusting unit 54 acquires the color
28
SP353806WO00
gamut information from the colour_primaries_info SEI, and
recognizes a color gamut indicated by the acquired color gamut
information. Further, when the color gamut information is
not included in the colour_primaries_info SEI, for example,
5 a color gamut is recognized based on
limited_colour_gamut_range_in_percent. Then, the process
proceeds to step S57.
[0099]
Meanwhile, when it is determined in step S54 that the
10 colour_primaries_info SEI has not been provided, in step S56,
the adjusting unit 54 recognizes a color gamut defined in
another standard based on the index included in the VUI provided
from the extracting unit 52. Then, the process proceeds to
step S57.
15 [0100]
In step S57, the adjusting unit 54 adjusts a color gamut
of the image provided from the decoding unit 53 based on the
color gamut of the display unit 56 or the color gamut recognized
in step S55 or step S56.
20 [0101]
In step S58, the adjusting unit 54 acquires the luminance
information of white, black, and gray from the
ref_display_luminance_info SEI provided from the extracting
unit 52.
25 [0102]
In step S59, the adjusting unit 54 adjusts a luminance
dynamic range of the image whose color gamut has been adjusted
based on the luminance information of the display unit 56 and
the acquired luminance information. The adjusting unit 54
30 provides the image whose luminance dynamic range has been
adjusted to the display control unit 55.
29
SP353806WO00
[0103]
In step S60, the display control unit 55 causes the image
provided from the adjusting unit 54 to be displayed on the
display unit 56, and then the process ends.
5 [0104]
As described above, the decoding device 50 receives the
colour_primaries_info SEI including the color gamut
information, and thus can accurately recognize a color gamut
of an encoding target image. As a result, it is possible to
10 optimize a color gamut of a decoded image. In other words,
when a color gamut of an encoding target image has a color
gamut different from a color gamut defined in another standard,
it is possible to a color gamut of a decoded image from being
reduced or enlarged in vain.
15 [0105]
Further, the decoding device 50 receives the
ref_display_luminance_info SEI including the luminance
information of white, black, and gray and thus accurately
recognize the luminance information of the master display.
20 As a result, it is possible to optimize a luminance dynamic
range of a decoded image.
[0106]
Furthermore, when a color gamut of an encoding target
image is larger than a color gamut identified by an index
25 included in the VUI, the color gamut information may not be
described in the colour_primaries_info SEI. In this case,
the decoding device 50 recognizes a color gamut of an encoding
target image and adjusts a color gamut based on
limited_colour_gamut_range_in_percent and a color gamut
30 identified by an index included in a VUI.
[0107]
30
SP353806WO00
As described above, when the color gamut information
is not described, the decoding device 50 can accurately
recognize a color gamut of an encoding target image based on
limited_colour_gamut_range_in_percent, compared to when a
color gamut of an encoding target is defined by an 5 index of
a VUI.
[0108]

(Exemplary configuration of encoding device according
10 to second embodiment)
Fig. 13 is a block diagram illustrating an exemplary
configuration of an encoding device according to a second
embodiment of the present disclosure.
[0109]
15 Among components illustrated in Fig. 13, the same
components as the components illustrated in Fig. 1 are denoted
by the same reference numerals. A repeated description will
be appropriately omitted.
[0110]
20 A configuration of an encoding device 70 of Fig. 13
differs from the configuration of Fig. 1 in that a setting
unit 72 is provided instead of the setting unit 11, and an
image adjusting unit 71 is newly provided.
[0111]
25 An image is input to the image adjusting unit 71 of the
encoding device 70 from the outside. The image adjusting unit
71 performs, for example, an operation of editing an image
input from the outside while causing the image to be displayed
on the master display (not illustrated) according to a user's
30 authoring work. The image adjusting unit 71 provides color
gamut information of an edited image and luminance information
31
SP353806WO00
of white and black of the master display(not illustrated) to
the setting unit 72. Further, the image adjusting unit 71
inputs the edited image to the encoding unit 12 as an encoding
target image.
5 [0112]
The setting unit 72 sets an SPS, a PPS, and a VUI. Further,
the setting unit 72 sets the colour_primaries_info SEI
including the color gamut information and the luminance
information provided from the image adjusting unit 71. The
10 setting unit 72 provides the parameter sets such as the set
SPS, the PPS, the VUI, and the colour_primaries_info SEI to
the encoding unit 12.
[0113]
(Exemplary syntax of colour_primaries_info SEI)
15 Fig. 14 is a diagram illustrating an exemplary syntax
of the colour_primaries_info SEI, and Figs. 15 to 19 are
diagrams for describing information of the
colour_primaries_info SEI.
[0114]
20 As illustrated in Fig. 14, colour_primaries_info_id is
described in the colour_primaries_info SEI. As illustrated
in Fig. 15, colour_primaries_info_id is an ID identifying the
purpose of the color gamut information.
[0115]
25 Further, as illustrated in Fig. 14,
colour_primaries_cancel_flag is described in the
colour_primaries_info SEI. As illustrated in Fig. 15,
colour_primaries_cancel_flag is a flag indicating whether or
not continuity of a previous colour_primaries_info SEI is
30 canceled. Colour_primaries_cancel_flag is 1 when the
continuity of the previous colour_primaries_info SEI is
32
SP353806WO00
canceled, and it is 0 when the continuity of the previous
colour_primaries_info SEI is not canceled.
[0116]
As illustrated in Fig. 14, when
5 colour_primaries_cancel_flag is 0,
colour_primaries_persistence_flag is described in the
colour_primaries_info SEI. As illustrated in Fig. 15,
colour_primaries_persistence_flag is a flag indicating
whether or not the color gamut information and the luminance
10 information included in the colour_primaries_info SEI is
applied to a plurality of consecutive pictures.
colour_primaries_persistence_flag is 1 when the color gamut
information and the luminance information are applied to a
plurality of consecutive pictures, and it is 0 when the color
15 gamut information and the luminance information are applied
to only one picture.
[0117]
Further, as illustrated in Fig. 14,
white_level_display_luminance_present_flag is described in
20 the colour_primaries_info SEI. As illustrated in Fig. 16,
white_level_display_luminance_present_flag is a flag
indicating whether or not white_level_display_luminance is
described in the colour_primaries_info SEI. As illustrated
in Fig. 19, white_level_display_luminance is the luminance
25 information of white of the master display.
White_level_display_luminance_present_flag is 1 when the
luminance information of white of the master display is
described in the colour_primaries_info SEI, and
white_level_display_luminance_present_flag is 0 when the
30 luminance information of white of the master display is not
described in the colour_primaries_info SEI.
33
SP353806WO00
[0118]
As illustrated in Figs. 14 and 16, for black, similarly,
black_level_display_luminance_present_flag is described in
the colour_primaries_info SEI.
5 [0119]
Further, as illustrated in Fig. 14,
colour_gamut_coverage_present_flag is described in the
colour_primaries_info SEI. As illustrated in Fig. 16,
colour_gamut_coverage_present_flag is a flag indicating
10 whether or not colour_gamut_coverage is described in the
colour_primaries_info SEI. As illustrated in Fig. 19,
colour_gamut_coverage is information indicating a cover ratio
of a color gamut of an encoding target image to a color gamut
identified by an index described in a VUI.
15 Colour_gamut_coverage_present_flag is 1 when
colour_gamut_coverage is described in the
colour_primaries_info SEI, and
colour_gamut_coverage_present_flag is 0 when
colour_gamut_coverage is not described in the
20 colour_primaries_info SEI.
[0120]
As illustrated in Figs. 14 and 17, colour_primary_Red_x
indicating a chromaticity of red in the x direction in the
CIE color coordinate system in the color gamut information
25 and colour_primary_Red_y indicating a chromaticity of red in
the y direction are also described in the colour_primaries_info
SEI. As illustrated in Figs. 14 and 18, for green, blue, and
white, similarly, colour_primary_Green_x,
colour_primary_Green_y, colour_primary_Blue_x,
30 colour_primary_Blue_y, white_point_x, and white_point_y are
described in the colour_primaries_info SEI as the color gamut
34
SP353806WO00
information.
[0121]
The color gamut information is described using a 16-bit
fixed point. In other words, the color gamut information is
considered to be transmitted from the image 5 adjusting unit
71 or the like, for example, through Extended display
identification data (EDID) of High-Definition Multimedia
Interface (HDMI) (a registered trademark) in which a size of
transmittable information is limited. Further, the applicant
10 has currently proposed metadata related to a color gamut
described using a fixed point as International
Electrotechnical Commission (IEC) 61966-12-2. Thus, in order
not to change the size of the color gamut information or in
order to cause the proposed metadata to be used as the color
15 gamut information, the color gamut information is described
using a fixed point.
[0122]
Further, the color gamut information according to the
first embodiment may be described using a 16-bit fixed point
20 as well.
[0123]
As illustrated in Fig. 14, when
white_level_display_luminance_present_flag is 1,
white_level_display_luminance is described in the
25 colour_primaries_info SEI. When
black_level_display_luminance_present_flag is 1,
blak_level_display_luminance is described. As illustrated
in Fig. 19, blak_level_display_luminance is the luminance
information of black of the master display.
30 [0124]
As described above, white_level_display_luminance and
35
SP353806WO00
blak_level_display_luminance are described in the
colour_primaries_info SEI. In other words, the applicant has
currently proposed metadata related to luminance including
luminance information of white and black as IEC 61966-12-2.
Thus, in order to cause the proposed metadata to be used 5 as
white_level_display_luminance and
blak_level_display_luminance,
white_level_display_luminance and
blak_level_display_luminance are described in the
10 colour_primaries_info SEI.
[0125]
Further, as illustrated in Fig. 14, when
colour_gamut_coverage_present_flag is 1,
colour_gamut_coverage is described in the
15 colour_primaries_info SEI.
[0126]
(Description of processing of encoding device)
Fig. 20 is a flowchart for describing a stream generation
process of the encoding device 70.
20 [0127]
In step S80 of Fig. 20, the image adjusting unit 71
performs an operation of editing an image input from the outside
while causing the image to be displayed on the master display
(not illustrated) according to the user's authoring work. The
25 image adjusting unit 71 provides color gamut information of
an edited image and luminance information of white and black
of the master display(not illustrated) to the setting unit
72. Further, the image adjusting unit 71 inputs the edited
image to the encoding unit 12 as an encoding target image.
30 [0128]
A process of steps S81 to S83 is the same as the process
36
SP353806WO00
of steps S11 to S13 of Fig. 10, and thus a description thereof
is omitted.
[0129]
In step S84, the setting unit 72 sets the
5 colour_primaries_info SEI including the color gamut
information of the encoding target image and the luminance
information of the master display provided from the image
adjusting unit 71.
[0130]
10 A process of steps S85 to S87 is the same as the process
of steps S17 to S19 of Fig. 20, and thus a description thereof
is omitted.
[0131]
As described above, the encoding device 70 sets and
15 transmits the colour_primaries_info SEI including the color
gamut information, and thus even when an encoding target image
has a color gamut different from a color gamut defined in another
standard, it is possible to enable the decoding side to
accurately recognize a color gamut of an encoding target image.
20 [0132]
Further, the encoding device 70 sets
white_level_display_luminance and
black_level_display_luminance to the colour_primaries_info
SEI and transmits the colour_primaries_info SEI, and thus it
25 is possible to enable the decoding side to recognize the
luminance information of the master display.
[0133]
(Exemplary configuration of decoding device according
to second embodiment)
30 Fig. 21 is a block diagram illustrating an exemplary
configuration of a decoding device that decodes the encoded
37
SP353806WO00
stream transmitted from the encoding device 70 of Fig. 13
according to the second embodiment of the present disclosure.
[0134]
Among components illustrated in Fig. 21, the same
components as the components illustrated in Fig. 11 5 are denoted
by the same reference numerals. A repeated description will
be appropriately omitted.
[0135]
A configuration of a decoding device 90 of Fig. 21 differs
10 from the configuration of Fig. 11 in that an extracting unit
91, an adjusting unit 92, and a display control unit 93 are
provided instead of the extracting unit 52, the adjusting unit
54, and the display control unit 55.
[0136]
15 The extracting unit 91 of the decoding device 90 of Fig.
21 extracts parameter sets and encoded data from the encoded
stream provided from the receiving unit 51. The extracting
unit 91 provides the parameter sets and the encoded data to
the decoding unit 53. Further, the extracting unit 91 provides
20 the VUI and the colour_primaries_info SEI among the parameter
sets to the adjusting unit 92, and provides the
colour_primaries_info SEI to the display control unit 93.
[0137]
The adjusting unit 92 acquires color gamut information
25 and colour_gamut_coverage from the colour_primaries_info SEI
provided from the extracting unit 91. Further, the adjusting
unit 92 recognizes a color gamut based on an index included
in the VUI provided from the extracting unit 91. The adjusting
unit 92 adjusts the color gamut of the image provided from
30 the decoding unit 53 based on either of the color gamut indicated
by the acquired color gamut information and the recognized
38
SP353806WO00
color gamut, the color gamut based on colour_gamut_coverage,
and the color gamut of the display unit 56. The adjusting
unit 92 provides the image whose color gamut has been adjusted
to the display control unit 93.
5 [0138]
The display control unit 93 acquires luminance
information of white and black from the colour_primaries_info
SEI provided from the extracting unit 91. The display control
unit 93 adjusts a luminance dynamic range of the image of the
10 adjusted color gamut provided from the adjusting unit 92 based
on the acquired luminance information and the luminance
information of the display unit 56. The display control unit
93 provides the image whose luminance dynamic range has been
adjusted to be displayed on the display unit 56.
15 [0139]
(Description of processing of decoding device)
Fig. 22 is a flowchart for describing an image generation
process of the decoding device 90 of Fig. 21.
[0140]
20 In step S101 of Fig. 22, the receiving unit 51 of the
decoding device 90 receives the encoded stream transmitted
from the encoding device 70 of Fig. 13, and provides the encoded
stream to the extracting unit 91.
[0141]
25 In step S102, the extracting unit 91 extracts parameter
sets and encoded data from the encoded stream provided from
the receiving unit 51. The extracting unit 91 provides the
parameter sets and the encoded data to the decoding unit 53.
Further, the extracting unit 91 provides the VUI and the
30 colour_primaries_info SEI among the parameter sets to the
adjusting unit 92, and provides the colour_primaries_info SEI
39
SP353806WO00
to the display control unit 93.
[0142]
In step S103, the decoding unit 53 decodes the encoded
data provided from the extracting unit 91 according to the
HEVC scheme. At this time, the decoding unit 53 5 refers to
the parameter sets provided from the extracting unit 91 as
necessary. The decoding unit 53 provides an image obtained
as a result of decoding to the adjusting unit 92.
[0143]
10 In step S104, the adjusting unit 92 recognizes a color
gamut defined in another standard based on an index included
in the VUI provided from the extracting unit 91.
[0144]
In step S105, the adjusting unit 92 determines whether
15 or not the colour_primaries_info SEI has been provided from
the extracting unit 91. When it is determined in step S105
that the colour_primaries_info SEI has been provided, the
process proceeds to step S106.
[0145]
20 In step S106, the adjusting unit 92 acquires the color
gamut information from the colour_primaries_info SEI, and
recognizes a color gamut indicated by the acquired color gamut
information. Further, when the color gamut information is
not included in the colour_primaries_info SEI, for example,
25 a color gamut is recognized based on colour_gamut_coverage
and the color gamut recognized in step S104. Then, the process
proceeds to step S107.
[0146]
Meanwhile, when it is determined in step S105 that the
30 colour_primaries_info SEI has not been provided, the process
proceeds to step S107.
40
SP353806WO00
[0147]
In step S107, the adjusting unit 92 adjusts a color gamut
of the image provided from the decoding unit 53 based on the
color gamut of the display unit 56 or the color gamut recognized
5 in step S104 or step S106.
[0148]
In step S108, the display control unit 93 acquires
luminance information of white and black from the
colour_primaries_info SEI provided from the extracting unit
10 91. In step S109, the display control unit 93 adjusts a
luminance dynamic range of the image of the adjusted color
gamut provided from the adjusting unit 92 based on the luminance
information of the display unit 56 and the acquired luminance
information.
15 [0149]
In step S110, the display control unit 93 provides the
image whose luminance dynamic range has been adjusted to be
displayed on the display unit 56, and then the process ends.
[0150]
20 As described above, the decoding device 90 receives the
colour_primaries_info SEI including the color gamut
information, and thus can accurately recognize a color gamut
of an encoding target image. As a result, it is possible to
optimize a color gamut of a decoded image. In other words,
25 when a color gamut of an encoding target image has a color
gamut different from a color gamut defined in another standard,
it is possible to a color gamut of a decoded image from being
reduced or enlarged in vain.
[0151]
30 For example, when a color gamut of the display unit 56
is larger than a color gamut of an encoding target image, the
41
SP353806WO00
decoding device 90 can display a decoded image without
adjusting a color gamut of the decoded image. As a result,
it is possible to cause an image desired by an authoring operator
to be displayed on the display unit 56.
5 [0152]
Further, the decoding device 90 can display a
high-quality decoded image by adjusting a color gamut of a
decoded image based on an accurately recognized color gamut.
[0153]
10 Furthermore, since white_level_display_luminance and
blak_level_display_luminance are also included in the
colour_primaries_info SEI, the decoding device 90 can
accurately recognize the luminance information of the master
display. As a result, it is possible to optimize a luminance
15 dynamic range of a decoded image.
[0154]
The above description has been made in connection with
the example in which the color gamut information and the
luminance information are arranged in the SEI, but the color
20 gamut information and the luminance information may be arranged
in a system layer.
[0155]

25 (Description of MP4 box in which color gamut information
and luminance information are arranged)
Fig. 23 is a diagram for describing an MP4 box as a system
layer in which the color gamut information and the luminance
information are arranged.
30 [0156]
As illustrated in Fig. 23, when the color gamut
42
SP353806WO00
information and the luminance information are arranged in the
MP4 box, a Colour Primaries Information Box (tinf) box storing
ColourPrimariesInfo as the color gamut information and the
luminance information is newly defined. The tinf box is stored
in (a stbl box stored in) a trak box or a track fragment 5 gment box
(traf box).
[0157]
ColourPrimariesInfo has a configuration similar to the
colour_primaries_info SEI of Fig. 2 and the
10 ref_display_luminance_info SEI of Fig. 8 or the
colour_primaries_info SEI of Fig. 14 except that padding_value
for byte alignment is inserted.
[0158]
The present disclosure can be applied even to the AVC
15 scheme.
[0159]

(Description of computer according to present
disclosure)
20 The above-described series of processes may be executed
by hardware or software. When the series of processes are
executed by software, a program configuring the software is
installed in a computer. Here, examples of the computer
includes a computer incorporated into dedicated hardware and
25 a general purpose personal computer that includes various
programs installed therein and is capable of executing various
kinds of functions.
[0160]
Fig. 24 is a block diagram illustrating an exemplary
30 hardware configuration of a computer that executes the
above-described series of processes by a program.
43
SP353806WO00
[0161]
In a computer, a central processing unit (CPU) 201, a
read only memory (ROM) 202, and a random access memory (RAM)
203 are connected with one another via a bus 204.
5 [0162]
An input/output (I/O) interface 205 is further connected
to the bus 204. An input unit 206, an output unit 207, a storage
unit 208, a communication unit 209, and a drive 210 are connected
to the I/O interface 205.
10 [0163]
The input unit 206 includes a keyboard, a mouse, a
microphone, and the like. The output unit 207 includes a
display, a speaker, and the like. The storage unit 208 includes
a hard disk, a non-volatile memory, and the like. The
15 communication unit 209 includes a network interface or the
like. The drive 210 drives a removable medium 211 such as
a magnetic disk, an optical disk, a magneto optical disk, or
a semiconductor memory.
[0164]
20 In the computer having the above configuration, the CPU
201 executes the above-described series of processes, for
example, by loading the program stored in the storage unit
208 onto the RAM 203 through the I/O interface 205 and the
bus 204 and executing the program.
25 [0165]
For example, the program executed by the computer (the
CPU 201) may be recorded in the removable medium 211 as a package
medium or the like and provided. Further, the program may
be provided through a wired or wireless transmission medium
30 such as a local area network (LAN), the Internet, or digital
satellite broadcasting.
44
SP353806WO00
[0166]
In the computer, the removable medium 211 is mounted
to the drive 210, and then the program may be installed in
the storage unit 208 through the I/O interface 205. Further,
the program may be received by the communication unit 209 5 via
a wired or wireless transmission medium and then installed
in the storage unit 208. In addition, the program may be
installed in the ROM 202 or the storage unit 208 in advance.
[0167]
10 Further, the program may be a program in which the
processes are chronologically performed in the order described
in this disclosure or may be a program in which the processes
are performed in parallel or at necessary timings such as called
timings.
15 [0168]

(Application to multi-view image coding and multi-view
image decoding)
The above-described series of processes can be applied
20 to multi-view image coding and multi-view image decoding. Fig.
25 illustrates an exemplary multi-view image coding scheme.
[0169]
As illustrated in Fig. 25, a multi-view image includes
images of a plurality of views. The plurality of views of
25 the multi-view image include a base view in which encoding
and decoding are performed using only an image of its own view
without using images of other views and a non-base view in
which encoding and decoding are performed using images of other
views. As the non-base view, an image of a base view may be
30 used, and an image of another non-base view may be used.
[0170]
45
SP353806WO00
When the multi-view image of Fig. 25 is encoded and
decoded, an image of each view is encoded and decoded, but
the technique according to the first embodiment may be applied
to encoding and decoding of respective views. Accordingly,
a color gamut of an encoding target image can be 5 accurately
recognized at a decoding side.
[0171]
Furthermore, the flags or the parameters used in the
technique according to the first embodiment may be shared in
10 encoding and decoding of respective views. More specifically,
for example, the syntax elements of the colour_primaries_info
SEI or the ref_display_luminance_info SEI may be shared in
encoding and decoding of respective views. Of course, any
other necessary information may be shared in encoding and
15 decoding of respective views.
[0172]
Accordingly, it is possible to prevent transmission of
redundant information and reduce an amount (bit rate) of
information to be transmitted (that is, it is possible to
20 prevent coding efficiency from degrading.
[0173]
(Multi-view image encoding device)
Fig. 26 is a diagram illustrating a multi-view image
encoding device that performs the above-described multi-view
25 image coding. A multi-view image encoding device 600 includes
an encoding unit 601, an encoding unit 602, and a multiplexing
unit 603 as illustrated in Fig. 26.
[0174]
The encoding unit 601 encodes a base view image, and
30 generates a base view image encoded stream. The encoding unit
602 encodes a non-base view image, and generates a non-base
46
SP353806WO00
view image encoded stream. The multiplexing unit 603 performs
multiplexing of the base view image encoded stream generated
by the encoding unit 601 and the non-base view image encoded
stream generated by the encoding unit 602, and generates a
5 multi-view image encoded stream.
[0175]
The encoding device 10 (Fig. 1) can be applied as the
encoding unit 601 and the encoding unit 602 of the multi-view
image encoding device 600. In other words, it is possible
10 to enable a decoding side to accurately recognize a color gamut
of an encoding target image when encoding of each view is
performed. Further, the encoding unit 601 and the encoding
unit 602 can perform encoding using the same flags or parameters
(for example, syntax elements related to inter-image
15 processing) (that is, can share the flags or the parameters),
and thus it is possible to prevent the coding efficiency from
degrading.
[0176]
(Multi-view image decoding device)
20 Fig. 27 is a diagram illustrating a multi-view image
decoding device that performs the above-described multi-view
image decoding. A multi-view image decoding device 610
includes a demultiplexing unit 611, a decoding unit 612, and
a decoding unit 613 as illustrated in Fig. 27.
25 [0177]
The demultiplexing unit 611 performs demultiplexing of
the multi-view image encoded stream obtained by multiplexing
the base view image encoded stream and the non-base view image
encoded stream, and extracts the base view image encoded stream
30 and the non-base view image encoded stream. The decoding unit
612 decodes the base view image encoded stream extracted by
47
SP353806WO00
the demultiplexing unit 611, and obtains the base view image.
The decoding unit 613 decodes the non-base view image encoded
stream extracted by the demultiplexing unit 611, and obtains
the non-base view image.
5 [0178]
The decoding device 50 (Fig. 11) can be applied as the
decoding unit 612 and the decoding unit 613 of the multi-view
image decoding device 610. In other words, a color gamut of
an encoding target image can be accurately recognized when
10 decoding of each view is performed. Further, the decoding
unit 612 and the decoding unit 613 can perform decoding using
the same flags or parameters (for example, syntax elements
related to inter-image processing) (that is, can share the
flags or the parameters), and thus it is possible to prevent
15 the coding efficiency from degrading.
[0179]

(Application to scalable image coding and scalable image
decoding)
20 The above-described series of processes can be applied
to scalable image coding and scalable image decoding (scalable
coding and scalable decoding). Fig. 28 illustrates an
exemplary scalable image coding scheme.
[0180]
25 The scalable image coding (scalable coding) is a scheme
in which an image is divided into a plurality of layers
(hierarchized) so that image data has a scalable function for
a certain parameter, and encoding is performed on each layer.
The scalable image decoding (scalable decoding) is decoding
30 corresponding to the scalable image coding.
[0181]
48
SP353806WO00
As illustrated in Fig. 28, for hierarchization of an
image, an image is divided into a plurality of images (layers)
based on a certain parameter having a scalable function. In
other words, a hierarchized image (a scalable image) includes
images of a plurality of layers that differ in a value 5 of the
certain parameter from one another. The plurality of layers
of the scalable image include a base layer in which encoding
and decoding are performed using only an image of its own layer
without using images of other layers and non-base layers (which
10 are also referred to as "enhancement layers") in which encoding
and decoding are performed using images of other layers. As
the non-base layer, an image of the base layer may be used,
and an image of any other non-base layer may be used.
[0182]
15 Generally, the non-base layer is configured with data
(differential data) of a differential image between its own
image and an image of another layer so that the redundancy
is reduced. For example, when one image is hierarchized into
two layers, that is, a base layer and a non-base layer (which
20 is also referred to as an enhancement layer), an image of a
quality lower than an original image is obtained when only
data of the base layer is used, and an original image (that
is, a high quality image) is obtained when both data of the
base layer and data of the non-base layer are combined.
25 [0183]
As an image is hierarchized as described above, images
of various qualities can be obtained depending on the situation.
For example, for a terminal having a low processing capability
such as a mobile terminal, image compression information of
30 only the base layer is transmitted, and a moving image of low
spatial and temporal resolutions or a low quality is reproduced,
49
SP353806WO00
and for a terminal having a high processing capability such
as a television or a personal computer, image compression
information of the enhancement layer as well as the base layer
is transmitted, and a moving image of high spatial and temporal
resolutions or a high quality is reproduced. In 5 other words,
without performing the transcoding process, image compression
information according to a capability of a terminal or a network
can be transmitted from a server.
[0184]
10 When the scalable image illustrated in Fig. 28 is encoded
and decoded, images of respective layers are encoded and
decoded, but the technique according to the first embodiment
may be applied to encoding and decoding of the respective layers.
Accordingly, a color gamut of an encoding target image can
15 be accurately recognized at the decoding side.
[0185]
Furthermore, the flags or the parameters used in the
technique according to the first embodiment may be shared in
encoding and decoding of respective layers. More
20 specifically, for example, the syntax elements of the
colour_primaries_info SEI or the ref_display_luminance_info
SEI may be shared in encoding and decoding of respective layers.
Of course, any other necessary information may be shared in
encoding and decoding of respective views.
25 [0186]
Accordingly, it is possible to prevent transmission of
redundant information and reduce an amount (bit rate) of
information to be transmitted (that is, it is possible to
prevent coding efficiency from degrading.
30 [0187]
(Scalable parameter)
50
SP353806WO00
In the scalable image coding and the scalable image
decoding (the scalable coding and the scalable decoding), any
parameter has a scalable function. For example, a spatial
resolution may be used as the parameter (spatial scalability)
as illustrated in Fig. 5 29. In the case of the spatial
scalability, respective layers have different image
resolutions. In other words, in this case, each picture is
hierarchized into two layers, that is, a base layer of a
resolution spatially lower than that of an original image and
10 an enhancement layer that is combined with the base layer to
obtain an original spatial resolution as illustrated in Fig.
29. Of course, the number of layers is an example, and each
picture can be hierarchized into an arbitrary number of layers.
[0188]
15 As another parameter having such scalability, for
example, a temporal resolution may be applied (temporal
scalability) as illustrated in Fig. 30. In the case of the
temporal scalability, respective layers having different
frame rates. In other words, in this case, each picture is
20 hierarchized into two layers, that is, a base layer of a frame
rate lower than that of an original moving image and an
enhancement layer that is combined with the base layer to obtain
an original frame rate as illustrated in Fig. 30. Of course,
the number of layers is an example, and each picture can be
25 hierarchized into an arbitrary number of layers.
[0189]
As another parameter having such scalability, for
example, a signal-to-noise ratio (SNR) may be applied (SNR
scalability). In the case of the SNR scalability, respective
30 layers having different SNRs. In other words, in this case,
each picture is hierarchized into two layers, that is, a base
51
SP353806WO00
layer of a SNR lower than that of an original image and an
enhancement layer that is combined with the base layer to obtain
an original SNR as illustrated in Fig. 31. Of course, the
number of layers is an example, and each picture can be
5 hierarchized into an arbitrary number of layers.
[0190]
A parameter other than the above-described examples may
be applied as a parameter having scalability. For example,
a bit depth may be used as a parameter having scalability
10 (bit-depth scalability). In the case of the bit-depth
scalability, respective layers have different bit depths. In
this case, for example, the base layer (base layer) includes
a 8-bit image, and a 10-bit image can be obtained by adding
the enhancement layer to the base layer.
15 [0191]
As another parameter having scalability, for example,
a chroma format may be used (chroma scalability). In the case
of the chroma scalability, respective layers have different
chroma formats. In this case, for example, the base layer
20 (base layer) includes a component image of a 4 : 2 : 0 format,
and a component image of a 4 : 2 : 2 format can be obtained
by adding the enhancement layer to the base layer.
[0192]
(Scalable image encoding device)
25 Fig. 32 is a diagram illustrating a scalable image
encoding device that performs the above-described scalable
image coding. A scalable image encoding device 620 includes
an encoding unit 621, an encoding unit 622, and a multiplexing
unit 623 as illustrated in Fig. 32.
30 [0193]
The encoding unit 621 encodes a base layer image, and
52
SP353806WO00
generates a base layer image encoded stream. The encoding
unit 622 encodes a non-base layer image, and generates a
non-base layer image encoded stream. The multiplexing unit
623 performs multiplexing the base layer image encoded stream
generated by the encoding unit 621 and the non-base layer 5 image
encoded stream generated by the encoding unit 622, and
generates a scalable image encoded stream.
[0194]
The encoding device 10 (Fig. 1) can be applied as the
10 encoding unit 621 and the encoding unit 622 of the scalable
image encoding device 620. In other words, it is possible
to enable the decoding side to accurately recognize a color
gamut of an encoding target image when encoding of each layer
is performed. Further, the encoding unit 621 and the encoding
15 unit 622 can perform, for example, control of an
intra-prediction filter process using the same flags or
parameters (for example, syntax elements related to
inter-image processing) (that is, can share the flags or the
parameters), and thus it is possible to prevent the coding
20 efficiency from degrading.
[0195]
(Scalable image decoding device)
Fig. 33 is a diagram illustrating a scalable image
decoding device that performs the above-described scalable
25 image decoding. A scalable image decoding device 630 includes
a demultiplexing unit 631, a decoding unit 632, and a decoding
unit 633 as illustrated in Fig. 33.
[0196]
The demultiplexing unit 631 performs demultiplexing of
30 the scalable image encoded stream obtained by multiplexing
the base layer image encoded stream and the non-base layer
53
SP353806WO00
image encoded stream, and extracts the base layer image encoded
stream and the non-base layer image encoded stream. The
decoding unit 632 decodes the base layer image encoded stream
extracted by the demultiplexing unit 631, and obtains the base
layer image. The decoding unit 633 decodes the non-5 base layer
image encoded stream extracted by the demultiplexing unit 631,
and obtains the non-base layer image.
[0197]
The decoding device 50 (Fig. 11) can be applied as the
10 decoding unit 632 and the decoding unit 633 of the scalable
image decoding device 630. In other words, a color gamut of
an encoding target image can be accurately recognized when
decoding of each layer is performed. Further, the decoding
unit 612 and the decoding unit 613 can perform decoding using
15 the same flags or parameters (for example, syntax elements
related to inter-image processing) (that is, can share the
flags or the parameters), and thus it is possible to prevent
the coding efficiency from degrading.
[0198]
20
(Exemplary configuration of television device)
Fig. 34 illustrates a schematic configuration of a
television device to which the present technology is applied.
A television device 900 includes an antenna 901, a tuner 902,
25 a demultiplexer 903, a decoder 904, a video signal processing
unit 905, a display unit 906, an audio signal processing unit
907, a speaker 908, and an external I/F unit 909. The
television device 900 further includes a control unit 910,
a user I/F unit 911, and the like.
30 [0199]
The tuner 902 tunes to a desired channel from a broadcast
54
SP353806WO00
signal received by the antenna 901, performs demodulation,
and outputs an obtained encoded bitstream to the demultiplexer
903.
[0200]
The demultiplexer 903 extracts video or audio 5 packets
of a program of a viewing target from the encoded bitstream,
and outputs data of the extracted packets to the decoder 904.
The demultiplexer 903 provides data of packets of data such
as an electronic program guide (EPG) to the control unit 910.
10 Further, when scrambling has been performed, descrambling is
performed by the demultiplexer or the like.
[0201]
The decoder 904 performs a decoding process of decoding
the packets, and outputs video data and audio data generated
15 by the decoding process to the video signal processing unit
905 and the audio signal processing unit 907.
[0202]
The video signal processing unit 905 performs a noise
canceling process or video processing according to a user
20 setting on the video data. The video signal processing unit
905 generates video data of a program to be displayed on the
display unit 906, image data according to processing based
on an application provided via a network, or the like. The
video signal processing unit 905 generates video data for
25 displaying, for example, a menu screen used to select an item,
and causes the video data to be superimposed on video data
of a program. The video signal processing unit 905 generates
a drive signal based on the video data generated as described
above, and drives the display unit 906.
30 [0203]
The display unit 906 drives a display device (for example,
55
SP353806WO00
a liquid crystal display device or the like) based on the drive
signal provided from the video signal processing unit 905,
and causes a program video or the like to be displayed.
[0204]
The audio signal processing unit 907 performs a 5 certain
process such as a noise canceling process on the audio data,
performs a digital to analog (D/A) conversion process and an
amplification process on the processed audio data, and provides
resultant data to the speaker 908 to output a sound.
10 [0205]
The external I/F unit 909 is an interface for a connection
with an external device or a network, and performs transmission
and reception of data such as video data or audio data.
[0206]
15 The user I/F unit 911 is connected with the control unit
910. The user I/F unit 911 includes an operation switch, a
remote control signal receiving unit, and the like, and
provides an operation signal according to the user's operation
to the control unit 910.
20 [0207]
The control unit 910 includes a central processing unit
(CPU), a memory, and the like. The memory stores a program
executed by the CPU, various kinds of data necessary when the
CPU performs processing, EPG data, data acquired via a network,
25 and the like. The program stored in the memory is read and
executed by the CPU at a certain timing such as a timing at
which the television device 900 is activated. The CPU executes
the program, and controls the respective units such that the
television device 900 is operated according to the user's
30 operation.
[0208]
56
SP353806WO00
The television device 900 is provided with a bus 912
that connects the tuner 902, the demultiplexer 903, the video
signal processing unit 905, the audio signal processing unit
907, the external I/F unit 909, and the like with the control
5 unit 910.
[0209]
In the television device having the above configuration,
the decoder 904 is provided with the function of the decoding
device (decoding method) according to the present application.
10 Thus, it is possible to accurately recognize a color gamut
of an encoding target image.
[0210]

(Exemplary configuration of mobile telephone)
15 Fig. 35 illustrates a schematic configuration of a mobile
telephone to which the present technology is applied. A mobile
telephone 920 includes a communication unit 922, a voice codec
923, a camera unit 926, an image processing unit 927, a
multiplexing/demultiplexing unit 928, a
20 recording/reproducing unit 929, a display unit 930, and a
control unit 931. These units are connected with one another
via a bus 933.
[0211]
Further, an antenna 921 is connected to the communication
25 unit 922, and a speaker 924 and a microphone 925 are connected
to the voice codec 923. Further, an operating unit 932 is
connected to the control unit 931.
[0212]
The mobile telephone 920 performs various kinds of
30 operations such as transmission and reception of a voice signal,
transmission and reception of an electronic mail or image data,
57
SP353806WO00
image capturing, or data recording in various modes such as
a voice call mode and a data communication mode.
[0213]
In the voice call mode, a voice signal generated by the
microphone 925 is converted to voice data through the 5 he voice
codec 923, compressed, and then provided to the communication
unit 922. The communication unit 922 performs, for example,
a modulation process and a frequency transform process of the
voice data, and generates a transmission signal. Further,
10 the communication unit 922 provides the transmission signal
to the antenna 921 so that the transmission signal is
transmitted to a base station (not illustrated). Further,
the communication unit 922 performs an amplification process,
a frequency transform process, and a demodulation process of
15 a reception signal received through the antenna 921, and
provides the obtained voice data to the voice codec 923. The
voice codec 923 decompresses the voice data, converts the
compressed data to an analog voice signal, and outputs the
analog voice signal to the speaker 924.
20 [0214]
In the data communication mode, when mail transmission
is performed, the control unit 931 receives text data input
by operating the operating unit 932, and causes the input text
to be displayed on the display unit 930. Further, the control
25 unit 931 generates mail data, for example, based on a user
instruction input through the operating unit 932, and provides
the mail data to the communication unit 922. The communication
unit 922 performs, for example, a modulation process and a
frequency transform process of the mail data, and transmits
30 an obtained transmission signal through the antenna 921.
Further, the communication unit 922 performs, for example,
58
SP353806WO00
an amplification process, a frequency transform process, and
a demodulation process of a reception signal received through
the antenna 921, and restores the mail data. The mail data
is provided to the display unit 930 so that mail content is
5 displayed.
[0215]
The mobile telephone 920 can store the received mail
data in a storage medium through the recording/reproducing
unit 929. The storage medium is an arbitrary rewritable
10 storage medium. Examples of the storage medium include a
semiconductor memory such as a RAM or an internal flash memory,
a hard disk, a magnetic disk, a magneto optical disk, an optical
disk, and a removable medium such as a universal serial bus
(USB) memory or a memory card.
15 [0216]
In the data communication mode, when image data is
transmitted, image data generated through the camera unit 926
is provided to the image processing unit 927. The image
processing unit 927 performs an encoding process of encoding
20 the image data, and generates encoded data.
[0217]
The multiplexing/demultiplexing unit 928 multiplexes
the encoded data generated through the image processing unit
927 and the voice data provided from the voice codec 923
25 according to a certain scheme, and provides resultant data
to the communication unit 922. The communication unit 922
performs, for example, a modulation process and a frequency
transform process of the multiplexed data, and transmits an
obtained transmission signal through the antenna 921.
30 Further, the communication unit 922 performs, for example,
an amplification process, a frequency transform process, and
59
SP353806WO00
a demodulation process of a reception signal received through
the antenna 921, and restores multiplexed data. The
multiplexed data is provided to the
multiplexing/demultiplexing unit 928. The
5 multiplexing/demultiplexing unit 928 demultiplexes the
multiplexed data, and provides the encoded data and the voice
data to the image processing unit 927 and the voice codec 923.
The image processing unit 927 performs a decoding process of
decoding the encoded data, and generates image data. The image
10 data is provided to the display unit 930 so that a received
image is displayed. The voice codec 923 converts the voice
data into an analog voice signal, provides the analog voice
signal to the speaker 924, and outputs a received voice.
[0218]
15 In the mobile telephone having the above configuration,
the image processing unit 927 is provided with the function
of the encoding device and the decoding device (the encoding
method and the decoding method) according to the present
application. Thus, it is possible to enable the decoding side
20 to accurately recognize a color gamut of an encoding target
image. Further, it is possible to accurately recognize a color
gamut of an encoding target image.
[0219]

25 (Exemplary configuration of recording/reproducing
device)
Fig. 36 illustrates a schematic configuration of a
recording/reproducing device to which the present technology
is applied. A recording/reproducing device 940 records, for
30 example, audio data and video data of a received broadcast
program in a recording medium, and provides the recorded data
60
SP353806WO00
to the user at a timing according to the user's instruction.
Further, the recording/reproducing device 940 can acquire,
for example, audio data or video data from another device and
cause the acquired data to be recorded in a recording medium.
Furthermore, the recording/reproducing device 940 5 decodes and
outputs the audio data or the video data recorded in the
recording medium so that an image display or a sound output
can be performed in a monitor device.
[0220]
10 The recording/reproducing device 940 includes a tuner
941, an external I/F unit 942, an encoder 943, a hard disk
drive (HDD) unit 944, a disk drive 945, a selector 946, a decoder
947, an on-screen display (OSD) unit 948, a control unit 949,
and a user I/F unit 950.
15 [0221]
The tuner 941 tunes to a desired channel from a broadcast
signal received through an antenna (not illustrated). The
tuner 941 demodulates a reception signal of the desired channel,
and outputs an obtained encoded bitstream to the selector 946.
20 [0222]
The external I/F unit 942 is configured with at least
one of an IEEE1394 interface, a network interface, a USB
interface, a flash memory interface, and the like. The
external I/F unit 942 is an interface for a connection with
25 an external device, a network, a memory card, and the like,
and receives data such as video data to audio data to be recorded.
[0223]
The encoder 943 ends non-encoded video data or audio
data provided from the external I/F unit 942 according to a
30 certain scheme, and outputs an encoded bitstream to the
selector 946.
61
SP353806WO00
[0224]
The HDD unit 944 records content data such as a video
or a sound, various kinds of programs, and other data in an
internal hard disk, and reads recorded data from the hard disk
5 at the time of reproduction or the like.
[0225]
The disk drive 945 records a signal in a mounted optical
disk, and reproduces a signal from the optical disk. Examples
of the optical disk include a DVD disk (DVD-Video, DVD-RAM,
10 DVD-R, DVD-RW, DVD+R, DVD+RW, and the like) and a Blu-ray (a
registered trademark) disk.
[0226]
When a video or a sound is recorded, the selector 946
selects either of an encoded bitstream provided the tuner 941
15 and an encoded bitstream provided from the encoder 943, and
provides the selected encoded bitstream to either of the HDD
unit 944 or the disk drive 945. Further, when a video or a
sound is reproduced, the selector 946 provides the encoded
bitstream output from the HDD unit 944 or the disk drive 945
20 to the decoder 947.
[0227]
The decoder 947 performs the decoding process of decoding
the encoded bitstream. The decoder 947 provides video data
generated by performing the decoding process to the OSD unit
25 948. Further, the decoder 947 outputs audio data generated
by performing the decoding process.
[0228]
The OSD unit 948 generates video data used to display,
for example, a menu screen used to, for example, select an
30 item, and outputs the video data to be superimposed on the
video data output from the decoder 947.
62
SP353806WO00
[0229]
The user I/F unit 950 is connected to the control unit
949. The user I/F unit 950 includes an operation switch, a
remote control signal receiving unit, and the like, and
provides an operation signal according to the user's 5 operation
to the control unit 949.
[0230]
The control unit 949 is configured with a CPU, a memory,
and the like. The memory stores a program executed by the
10 CPU and various kinds of data necessary when the CPU performs
processing. The program stored in the memory is read and
executed by the CPU at a certain timing such as a timing at
which the recording/reproducing device 940 is activated. The
CPU executes the program, and controls the respective units
15 such that the recording/reproducing device 940 is operated
according to the user's operation.
[0231]
In the recording/reproducing device having the above
configuration, the decoder 947 is provided with the function
20 of the decoding device (decoding method) according to the
present application. Thus, it is possible to accurately
recognize a color gamut of an encoding target image.
[0232]

25 (Exemplary configuration of imaging device)
Fig. 37 illustrates a schematic configuration of an
imaging device to which the present technology is applied.
An imaging device 960 photographs a subject, and causes an
image of the subject to be displayed on a display unit or records
30 image data in a recording medium.
[0233]
63
SP353806WO00
The imaging device 960 includes an optical block 961,
an imaging unit 962, a camera signal processing unit 963, an
image data processing unit 964, a display unit 965, an external
I/F unit 966, a memory unit 967, a medium drive 968, an OSD
unit 969, and a control unit 970. Further, a user 5 I/F unit
971 is connected to the control unit 970. Furthermore, the
image data processing unit 964, the external I/F unit 966,
the memory unit 967, the medium drive 968, the OSD unit 969,
the control unit 970, and the like are connected with one another
10 via a bus 972.
[0234]
The optical block 961 is configured with a focus lens,
a diaphragm mechanism, and the like. The optical block 961
forms an optical image of a subject on an imaging plane of
15 the imaging unit 962. The imaging unit 962 is configured with
a CCD image sensor or a CMOS image sensor, and generates an
electrical signal according to an optical image obtained by
photoelectric conversion, and provides the electrical signal
to the camera signal processing unit 963.
20 [0235]
The camera signal processing unit 963 performs various
kinds of camera signal processes such as knee correction, gamma
correction, and color correction on the electrical signal
provided from the imaging unit 962. The camera signal
25 processing unit 963 provides the image data that has been
subjected to the camera signal processes to the image data
processing unit 964.
[0236]
The image data processing unit 964 performs the encoding
30 process of encoding the image data provided from the camera
signal processing unit 963. The image data processing unit
64
SP353806WO00
964 provides encoded data generated by performing the encoding
process to the external I/F unit 966 or the medium drive 968.
Further, the image data processing unit 964 performs the
decoding process of decoding encoded data provided from the
external I/F unit 966 or the medium drive 968. The image 5 age data
processing unit 964 provides image data generated by performing
the decoding process to the display unit 965. Further, the
image data processing unit 964 performs a process of providing
the image data provided from the camera signal processing unit
10 963 to the display unit 965, or provides display data acquired
from the OSD unit 969 to the display unit 965 to be superimposed
on image data.
[0237]
The OSD unit 969 generates a menu screen including a
15 symbol, a text, or a diagram or display data such as an icon,
and outputs the generated menu screen or the display data to
the image data processing unit 964.
[0238]
The external I/F unit 966 is configured with, for example,
20 an USB I/O terminal or the like, and connected with a printer
when an image is printed. Further, a drive is connected to
the external I/F unit 966 as necessary, a removable medium
such as a magnetic disk or an optical disk is appropriately
mounted, and a computer program read from the removable medium
25 is installed as necessary. Furthermore, the external I/F unit
966 is connected to a certain network such as an LAN or the
Internet, and includes a network interface. The control unit
970 can read encoded data from the medium drive 968, for example,
according to an instruction given through the user I/F unit
30 971 and provide the read encoded data to another device
connected via a network through the external I/F unit 966.
65
SP353806WO00
Further, the control unit 970 can acquire encoded data or image
data provided from another device via a network through the
external I/F unit 966 and provide the acquire encoded data
or the image data to the image data processing unit 964.
5 [0239]
As a recording medium driven by the medium drive 968,
for example, an arbitrary readable/writable removable medium
such as a magnetic disk, a magneto optical disk, an optical
disk, or a semiconductor memory is used. Further, the
10 recording medium may be a tape device, a disk, or a memory
card regardless of a type of a removable medium. Of course,
the recording medium may be a non-contact integrated circuit
(IC) card or the like.
[0240]
15 Further, the medium drive 968 may be integrated with
the recording medium to configure a non-portable storage medium
such as an internal HDD or a solid state drive (SSD).
[0241]
The control unit 970 is configured with a CPU. The memory
20 unit 967 stores a program executed by the control unit 970,
various kinds of data necessary when the control unit 970
performs processing, and the like. The program stored in the
memory unit 967 is read and executed by the control unit 970
at a certain timing such as a timing at which the imaging device
25 960 is activated. The control unit 970 executes the program,
and controls the respective units such that the imaging device
960 is operated according to the user's operation.
[0242]
In the imaging device having the above configuration,
30 the image data processing unit 964 is provided with the function
of the decoding device (decoding method) according to the
66
SP353806WO00
present application. Thus, it is possible to enable the
decoding side to accurately recognize a color gamut of an
encoding target image. Further, it is possible to accurately
recognize a color gamut of an encoding target image.
5 [0243]

(First system)
Next, concrete application examples of scalable encoded
data generated by scalable coding will be described. The
10 scalable coding is used for selection of data to be transmitted,
for example, as illustrated in Fig. 38.
[0244]
In a data transmission system 1000 illustrated in Fig.
38, a delivery server 1002 reads scalable encoded data stored
15 in a scalable encoded data storage unit 1001, and delivers
the scalable encoded data to terminal devices such as a personal
computer 1004, an AV device 1005, a tablet device 1006, and
a mobile telephone 1007 via a network 1003.
[0245]
20 At this time, the delivery server 1002 selects an
appropriate high-quality encoded data according to the
capabilities of the terminal devices or a communication
environment, and transmits the selected high-quality encoded
data. Although the delivery server 1002 transmits
25 unnecessarily high-quality data, the terminal devices do not
necessarily obtains a high-quality image, and a delay or an
overflow may occur. Further, a communication band may be
unnecessarily occupied, and a load of a terminal device may
be unnecessarily increased. On the other hand, although the
30 delivery server 1002 transmits unnecessarily low-quality data,
the terminal devices are unlikely to obtain an image of a
67
SP353806WO00
sufficient quality. Thus, the delivery server 1002 reads
scalable encoded data stored in the scalable encoded data
storage unit 1001 as encoded data of a quality appropriate
for the capability of the terminal device or a communication
5 environment, and then transmits the read data.
[0246]
For example, the scalable encoded data storage unit 1001
is assumed to stores scalable encoded data (BL+EL) 1011 that
is encoded by the scalable coding. The scalable encoded data
10 (BL+EL) 1011 is encoded data including both of a base layer
and an enhancement layer, and both an image of the base layer
and an image of the enhancement layer can be obtained by decoding
the scalable encoded data (BL+EL) 1011.
[0247]
15 The delivery server 1002 selects an appropriate layer
according to the capability of a terminal device to which data
is transmitted or a communication environment, and reads data
of the selected layer. For example, for the personal computer
1004 or the tablet device 1006 having a high processing
20 capability, the delivery server 1002 reads the high-quality
scalable encoded data (BL+EL) 1011 from the scalable encoded
data storage unit 1001, and transmits the scalable encoded
data (BL+EL) 1011 without change. On the other hand, for
example, for the AV device 1005 or the mobile telephone 1007
25 having a low processing capability, the delivery server 1002
extracts data of the base layer from the scalable encoded data
(BL+EL) 1011, and transmits a scalable encoded data (BL) 1012
that is the same content as the scalable encoded data (BL+EL)
1011 but lower in quality than the scalable encoded data (BL+EL)
30 1011.
[0248]
68
SP353806WO00
As described above, an amount of data can be easily
adjusted using scalable encoded data, and thus it is possible
to prevent the occurrence of a delay or an overflow and prevent
a load of a terminal device or a communication medium from
being unnecessarily increased. Further, the 5 scalable encoded
data (BL+EL) 1011 is reduced in redundancy between layers,
and thus it is possible to reduce an amount of data to be smaller
than when individual data is used as encoded data of each layer.
Thus, it is possible to more efficiently use a memory area
10 of the scalable encoded data storage unit 1001.
[0249]
Further, various devices such as the personal computer
1004 to the mobile telephone 1007 can be applied as the terminal
device, and thus the hardware performance of the terminal
15 devices differ according to each device. Further, since
various applications can be executed by the terminal devices,
software has various capabilities. Furthermore, all
communication line networks including either or both of a wired
network and a wireless network such as the Internet or a local
20 area network (LAN), can be applied as the network 1003 serving
as a communication medium, and thus various data transmission
capabilities are provided. Ina addition, a change may be made
by another communication or the like.
[0250]
25 In this regard, the delivery server 1002 may be
configured to perform communication with a terminal device
serving as a transmission destination of data before starting
data transmission and obtain information related to a
capability of a terminal device such as hardware performance
30 of a terminal device or a performance of an application
(software) executed by a terminal device and information
69
SP353806WO00
related to a communication environment such as an available
bandwidth of the network 1003. Then, the delivery server 1002
may select an appropriate layer based on the obtained
information.
5 [0251]
Further, the extracting of the layer may be performed
in a terminal device. For example, the personal computer 1004
may decode the transmitted scalable encoded data (BL+EL) 1011
and display the image of the base layer or the image of the
10 enhancement layer. Further, for example, the personal
computer 1004 may extract the scalable encoded data (BL) 1012
of the base layer from the transmitted scalable encoded data
(BL+EL) 1011, store the scalable encoded data (BL) 1012 of
the base layer, transfer the scalable encoded data (BL) 1012
15 of the base layer to another device, decode the scalable encoded
data (BL) 1012 of the base layer, and display the image of
the base layer.
[0252]
Of course, the number of the scalable encoded data
20 storage units 1001, the number of the delivery servers 1002,
the number of the networks 1003, and the number of terminal
devices are arbitrary. The above description has been made
in connection with the example in which the delivery server
1002 transmits data to the terminal devices, but the
25 application example is not limited to this example. The data
transmission system 1000 can be applied to any system in which
when encoded data generated by the scalable coding is
transmitted to a terminal device, an appropriate layer is
selected according to a capability of a terminal devices or
30 a communication environment, and the encoded data is
transmitted.
70
SP353806WO00
[0253]
(Second system)
The scalable coding is used for transmission using a
plurality of communication media, for example, as illustrated
5 in Fig. 39.
[0254]
In a data transmission system 1100 illustrated in Fig.
39, a broadcasting station 1101 transmits scalable encoded
data (BL) 1121 of a base layer through terrestrial broadcasting
10 1111. Further, the broadcasting station 1101 transmits
scalable encoded data (EL) 1122 of an enhancement layer (for
example, packetizes the scalable encoded data (EL) 1122 and
then transmits resultant packets) via an arbitrary network
1112 configured with a communication network including either
15 or both of a wired network and a wireless network.
[0255]
A terminal device 1102 has a reception function of
receiving the terrestrial broadcasting 1111 broadcast by the
broadcasting station 1101, and receives the scalable encoded
20 data (BL) 1121 of the base layer transmitted through the
terrestrial broadcasting 1111. The terminal device 1102
further has a communication function of performing
communication via the network 1112, and receives the scalable
encoded data (EL) 1122 of the enhancement layer transmitted
25 via the network 1112.
[0256]
The terminal device 1102 decodes the scalable encoded
data (BL) 1121 of the base layer acquired through the
terrestrial broadcasting 1111, for example, according to the
30 user's instruction or the like, obtains the image of the base
layer, stores the obtained image, and transmits the obtained
71
SP353806WO00
image to another device.
[0257]
Further, the terminal device 1102 combines the scalable
encoded data (BL) 1121 of the base layer acquired through the
terrestrial broadcasting 1111 with the scalable 5 encoded data
(EL) 1122 of the enhancement layer acquired through the network
1112, for example, according to the user's instruction or the
like, obtains the scalable encoded data (BL+EL), decodes the
scalable encoded data (BL+EL) to obtain the image of the
10 enhancement layer, stores the obtained image, and transmits
the obtained image to another device.
[0258]
As described above, it is possible to transmit scalable
encoded data of respective layers, for example, through
15 different communication media. Thus, it is possible to
distribute a load, and it is possible to prevent the occurrence
of a delay or an overflow.
[0259]
Further, it is possible to select a communication medium
20 used for transmission for each layer according to the situation,
transmission. For example, the scalable encoded data (BL)
1121 of the base layer having a relative large amount of data
may be transmitted through a communication medium having a
large bandwidth, and the scalable encoded data (EL) 1122 of
25 the enhancement layer having a relative small amount of data
may be transmitted through a communication medium having a
small bandwidth. Further, for example, a communication
medium for transmitting the scalable encoded data (EL) 1122
of the enhancement layer may be switched between the network
30 1112 and the terrestrial broadcasting 1111 according to an
available bandwidth of the network 1112. Of course, the same
72
SP353806WO00
applies to data of an arbitrary layer.
[0260]
As control is performed as described above, it is
possible to further suppress an increase in a load in data
5 transmission.
[0261]
Of course, the number of layers is an arbitrary, and
the number of communication media used for transmission is
also arbitrary. Further, the number of the terminal devices
10 1102 serving as a data delivery destination is also arbitrary.
The above description has been described in connection with
the example of broadcasting from the broadcasting station 1101,
and the application example is not limited to this example.
The data transmission system 1100 can be applied to any system
15 in which encoded data generated by the scalable coding is
divided into two or more in units of layers and transmitted
through a plurality of lines.
[0262]
(Third system)
20 The scalable coding is used for storage of encoded data,
for example, as illustrated in Fig. 40.
[0263]
In an imaging system 1200 illustrated in Fig. 40, an
imaging device 1201 photographs a subject 1211, performs the
25 scalable coding on obtained image data, and provides scalable
encoded data (BL+EL) 1221 to a scalable encoded data storage
device 1202.
[0264]
The scalable encoded data storage device 1202 stores
30 the scalable encoded data (BL+EL) 1221 provided from the
imaging device 1201 in a quality according to the situation.
73
SP353806WO00
For example, during a normal time, the scalable encoded data
storage device 1202 extracts data of the base layer from the
scalable encoded data (BL+EL) 1221, and stores the extracted
data as scalable encoded data (BL) 1222 of the base layer having
a small amount of data in a low quality. On the 5 other hand,
for example, during an observation time, the scalable encoded
data storage device 1202 stores the scalable encoded data
(BL+EL) 1221 having a large amount of data in a high quality
without change.
10 [0265]
Accordingly, the scalable encoded data storage device
1202 can store an image in a high quality only when necessary,
and thus it is possible to suppress an increase in an amount
of data and improve use efficiency of a memory area while
15 suppressing a reduction in a value of an image caused by quality
deterioration.
[0266]
For example, the imaging device 1201 is a monitoring
camera. When monitoring target (for example, intruder) is
20 not shown on a photographed image (during a normal time),
content of the photographed image is likely to be
inconsequential, and thus a reduction in an amount of data
is prioritized, and image data (scalable encoded data) is
stored in a low quality. On the other hand, when a monitoring
25 target is shown on a photographed image as the subject 1211
(during an observation time), content of the photographed image
is likely to be consequential, and thus an image quality is
prioritized, and image data (scalable encoded data) is stored
in a high quality.
30 [0267]
It may be determined whether it is the normal time or
74
SP353806WO00
the observation time, for example, by analyzing an image
through the scalable encoded data storage device 1202.
Further, the imaging device 1201 may perform the determination
and transmits the determination result to the scalable encoded
5 data storage device 1202.
[0268]
Further, a determination criterion as to whether it is
the normal time or the observation time is arbitrary, and
content of an image serving as the determination criterion
10 is arbitrary. Of course, a condition other than content of
an image may be a determination criterion. For example,
switching may be performed according to the magnitude or a
waveform of a recorded sound, switching may be performed at
certain time intervals, or switching may be performed according
15 an external instruction such as the user's instruction.
[0269]
The above description has been described in connection
with the example in which switching is performed between two
states of the normal time and the observation time, but the
20 number of states is arbitrary. For example, switching may
be performed among three or more states such as a normal time,
a low-level observation time, an observation time, a high-level
observation time, and the like. Here, an upper limit number
of states to be switched depends on the number of layers of
25 scalable encoded data.
[0270]
Further, the imaging device 1201 may decide the number
of layers for the scalable coding according to a state. For
example, during the normal time, the imaging device 1201 may
30 generate the scalable encoded data (BL) 1222 of the base layer
having a small amount of data in a low quality and provide
75
SP353806WO00
the scalable encoded data (BL) 1222 of the base layer to the
scalable encoded data storage device 1202. Further, for
example, during the observation time, the imaging device 1201
may generate the scalable encoded data (BL+EL) 1221 of the
base layer having a large amount of data in a 5 high quality
and provide the scalable encoded data (BL+EL) 1221 of the base
layer to the scalable encoded data storage device 1202.
[0271]
The above description has been made in connection with
10 the example of a monitoring camera, but the purpose of the
imaging system 1200 is arbitrary and not limited to a monitoring
camera.
[0272]

15 (Other embodiments)
The above embodiments have been described in connection
with the example of the device, the system, or the like according
to the present technology, but the present technology is not
limited to the above examples and may be implemented as any
20 component mounted in the device or the device configuring the
system, for example, a processor serving as a system (large
scale integration) LSI or the like, a module using a plurality
of processors or the like, a unit using a plurality of modules
or the like, a set (that is, some components of the device)
25 in which any other function is further added to a unit, or
the like.
[0273]
(Exemplary configuration of video set)
An example in which the present technology is implemented
30 as a set will be described with reference to Fig. 41. Fig.
41 illustrates an exemplary schematic configuration of a video
76
SP353806WO00
set to which the present technology is applied.
[0274]
In recent years, functions of electronic devices have
become diverse, and when some components are implemented as
sale, provision, or the like in development or 5 manufacturing,
there are many cases in which a plurality of components having
relevant functions are combined and implemented as a set having
a plurality of functions as well as cases in which an
implementation is performed as a component having a single
10 function.
[0275]
A video set 1300 illustrated in Fig. 41 is a
multi-functionalized configuration in which a device having
a function related to image encoding and/or image decoding
15 is combined with a device having any other function related
to the function.
[0276]
As illustrated in Fig. 41, the video set 1300 includes
a module group such as a video module 1311, an external memory
20 1312, a power management module 1313, and a front end module
1314 and a device having relevant functions such as a
connectivity 1321, a camera 1322, and a sensor 1323.
[0277]
A module is a part having multiple functions into which
25 several relevant part functions are integrated. A concrete
physical configuration is arbitrary, but, for example, it is
configured such that a plurality of processes having respective
functions, electronic circuit elements such as a resistor and
a capacitor, and other devices are arranged and integrated
30 on a wiring substrate. Further, a new module may be obtained
by combining another module or a processor with a module.
77
SP353806WO00
[0278]
In the case of the example of Fig. 41, the video module
1311 is a combination of components having functions related
to image processing, and includes an application processor,
a video processor, a broadband modem 1333, and a 5 radio frequency
(RF) module 1334.
[0279]
A processor is one in which a configuration having a
certain function is integrated into a semiconductor chip
10 through System On a Chip (SoC), and also refers to, for example,
a system LSI (Large Scale Integration) or the like. The
configuration having the certain function may be a logic
circuit (hardware configuration), may be a CPU, a ROM, a RAM,
and a program (software configuration) executed using the CPU,
15 the ROM, and the RAM, and may be a combination of a hardware
configuration and a software configuration. For example, a
processor may include a logic circuit, a CPU, a ROM, a RAM,
and the like, some functions may be implemented through the
logic circuit (hardware component), and the other functions
20 may be implemented through a program (software component)
executed by the CPU.
[0280]
The application processor 1331 of Fig. 41 is a processor
that executes an application related to image processing. An
25 application executed by the application processor 1331 can
not only perform a calculation process but also control
components inside and outside the video module 1311 such as
the video processor 1332 as necessary in order to implement
a certain function.
30 [0281]
The video processor 1332 is a process having a function
78
SP353806WO00
related to image encoding and/or image decoding.
[0282]
The broadband modem 1333 is a processor (or module) that
performs a process related to wired and/or wireless broadband
communication that is performed via broadband line 5 such as
the Internet or a public telephone line network. For example,
the broadband modem 1333 converts data (digital signal) to
be transmitted into an analog signal, for example, through
digital modulation, demodulates a received analog signal, and
10 converts the analog signal into data (digital signal). For
example, the broadband modem 1333 can perform digital
modulation and demodulation on arbitrary information such as
image data processed by the video processor 1332, a stream
in which image data is encoded, an application program, or
15 setting data.
[0283]
The RF module 1334 is a module that performs a frequency
transform process, a modulation/demodulation process, an
amplification process, a filtering process, and the like on
20 an radio frequency (RF) signal transceived through an antenna.
For example, the RF module 1334 performs, for example,
frequency transform on a baseband signal generated by the
broadband modem 1333, and generates an RF signal. Further,
for example, the RF module 1334 performs, for example,
25 frequency transform on an RF signal received through the front
end module 1314, and generates a baseband signal.
[0284]
Further, a dotted line 1341, that is, the application
processor 1331 and the video processor 1332 may be integrated
30 into a single processor as illustrated in Fig. 41.
[0285]
79
SP353806WO00
The external memory 1312 is installed outside the video
module 1311, and a module having a storage device used by the
video module 1311. The storage device of the external memory
1312 can be implemented by any physical configuration, but
is commonly used to store large capacity data such as 5 image
data of frame units, and thus it is desirable to implement
the storage device of the external memory 1312 using a relative
chip large-capacity semiconductor memory such as a dynamic
random access memory (DRAM).
10 [0286]
The power management module 1313 manages and controls
power supply to the video module 1311 (the respective
components in the video module 1311).
[0287]
15 The front end module 1314 is a module that provides a
front end function (a circuit of a transceiving end at an antenna
side) to the RF module 1334. As illustrated in Fig. 41, the
front end module 1314 includes, for example, an antenna unit
1351, a filter 1352, and an amplifying unit 1353.
20 [0288]
The antenna unit 1351 includes an antenna that
transceives a radio signal and a peripheral configuration.
The antenna unit 1351 transmits a signal provided from the
amplifying unit 1353 as a radio signal, and provides a received
25 radio signal to the filter 1352 as an electrical signal (RF
signal). The filter 1352 performs, for example, a filtering
process on an RF signal received through the antenna unit 1351,
and provides a processed RF signal to the RF module 1334. The
amplifying unit 1353 amplifies the RF signal provided from
30 the RF module 1334, and provides the amplified RF signal to
the antenna unit 1351.
80
SP353806WO00
[0289]
The connectivity 1321 is a module having a function
related to a connection with the outside. A physical
configuration of the connectivity 1321 is arbitrary. For
example, the connectivity 1321 includes a 5 configuration having
a communication function other than a communication standard
supported by the broadband modem 1333, an external I/O terminal,
or the like.
[0290]
10 For example, the connectivity 1321 may include a module
having a communication function based on a wireless
communication standard such as Bluetooth (a registered
trademark), IEEE 802.11 (for example, Wireless Fidelity
(Wi-Fi) (a registered trademark)), Near Field Communication
15 (NFC), InfraRed Data Association (IrDA), an antenna that
transceives a signal satisfying the standard, or the like.
Further, for example, the connectivity 1321 may include a
module having a communication function based on a wired
communication standard such as Universal Serial Bus (USB),
20 or High-Definition Multimedia Interface (HDMI) (a registered
trademark) or a terminal that satisfies the standard.
Furthermore, for example, the connectivity 1321 may include
any other data (signal) transmission function or the like such
as an analog I/O terminal.
25 [0291]
Further, the connectivity 1321 may include a device of
a transmission destination of data (signal). For example,
the connectivity 1321 may include a drive (including a hard
disk, a solid state drive (SSD), a Network Attached Storage
30 (NAS), or the like as well as a drive of a removable medium)
that reads/writes data from/in a recording medium such as a
81
SP353806WO00
magnetic disk, an optical disk, a magneto optical disk, or
a semiconductor memory. Furthermore, the connectivity 1321
may include an output device (a monitor, a speaker, or the
like) that outputs an image or a sound.
5 [0292]
The camera 1322 is a module having a function of
photographing a subject and obtaining image data of the subject.
For example, image data obtained by the photographing of the
camera 1322 is provided to and encoded by the video processor
10 1332.
[0293]
The sensor 1323 is a module having an arbitrary sensor
function such as a sound sensor, an ultrasonic sensor, an
optical sensor, an illuminance sensor, an infrared sensor,
15 an image sensor, a rotation sensor, an angle sensor, an angular
velocity sensor, a velocity sensor, an acceleration sensor,
an inclination sensor, a magnetic identification sensor, a
shock sensor, or a temperature sensor. For example, data
detected by the sensor 1323 is provided to the application
20 processor 1331 and used by an application or the like.
[0294]
A configuration described above as a module may be
implemented as a processor, and a configuration described as
a processor may be implemented as a module.
25 [0295]
In the video set 1300 having the above configuration,
the present technology can be applied to the video processor
1332 as will be described later. Thus, the video set 1300
can be implemented as a set to which the present technology
30 is applied.
[0296]
82
SP353806WO00
(Exemplary configuration of video processor)
Fig. 42 illustrates an exemplary schematic
configuration of the video processor 1332 (Fig. 41) to which
the present technology is applied.
5 [0297]
In the case of the example of Fig. 42, the video processor
1332 has a function of receiving an input of a video signal
and an audio signal and encoding the video signal and the audio
signal according to a certain scheme and a function of decoding
10 encoded video data and audio data, and reproducing and
outputting a video signal and an audio signal.
[0298]
The video processor 1332 includes a video input
processing unit 1401, a first image enlarging/reducing unit
15 1402, a second image enlarging/reducing unit 1403, a video
output processing unit 1404, a frame memory 1405, and a memory
control unit 1406 as illustrated in Fig. 42. The video
processor 1332 further includes an encoding/decoding engine
1407, video elementary stream (ES) buffers 1408A and 1408B,
20 and audio ES buffers 1409A and 1409B. The video processor
1332 further includes an audio encoder 1410, an audio decoder
1411, a multiplexing unit (multiplexer (MUX)) 1412, a
demultiplexing unit (demultiplexer (DMUX)) 1413, and a stream
buffer 1414.
25 [0299]
For example, the video input processing unit 1401
acquires a video signal input from the connectivity 1321 (Fig.
41) or the like, and converts the video signal into digital
image data. The first image enlarging/reducing unit 1402
30 performs, for example, a format conversion process and an image
enlargement/reduction process on the image data. The second
83
SP353806WO00
image enlarging/reducing unit 1403 performs an image
enlargement/reduction process on the image data according to
a format of a destination to which the image data is output
through the video output processing unit 1404 or performs the
format conversion process and the 5 image enlargement/reduction
process which are identical to those of the first image
enlarging/reducing unit 1402 on the image data. The video
output processing unit 1404 performs format conversion and
conversion into an analog signal on the image data, and outputs
10 a reproduced video signal, for example, the connectivity 1321
(Fig. 41) or the like.
[0300]
The frame memory 1405 is an image data memory that is
shared by the video input processing unit 1401, the first image
15 enlarging/reducing unit 1402, the second image
enlarging/reducing unit 1403, the video output processing unit
1404, and the encoding/decoding engine 1407. The frame memory
1405 is implemented as, for example, a semiconductor memory
such as a DRAM.
20 [0301]
The memory control unit 1406 receives a synchronous
signal from the encoding/decoding engine 1407, and controls
writing/reading access to the frame memory 1405 according to
an access schedule for the frame memory 1405 written in an
25 access management table 1406A. The access management table
1406A is updated through the memory control unit 1406 according
to processing executed by the encoding/decoding engine 1407,
the first image enlarging/reducing unit 1402, the second image
enlarging/reducing unit 1403, or the like.
30 [0302]
The encoding/decoding engine 1407 performs an encoding
84
SP353806WO00
process of encoding image data and a decoding process of
decoding a video stream that is data obtained by encoding image
data. For example, the encoding/decoding engine 1407 encodes
image data read from the frame memory 1405, and sequentially
writes the encoded image data in the video ES buffer 5 r 1408A
as a video stream. Further, for example, the
encoding/decoding engine 1407 sequentially reads the video
stream from the video ES buffer 1408B, sequentially decodes
the video stream, and sequentially the decoded image data in
10 the frame memory 1405. The encoding/decoding engine 1407 uses
the frame memory 1405 as a working area at the time of the
encoding or the decoding. Further, the encoding/decoding
engine 1407 outputs the synchronous signal to the memory
control unit 1406, for example, at a timing at which processing
15 of each macro block starts.
[0303]
The video ES buffer 1408A buffers the video stream
generated by the encoding/decoding engine 1407, and then
provides the video stream to the multiplexing unit (MUX) 1412.
20 The video ES buffer 1408B buffers the video stream provided
from the demultiplexing unit (DMUX) 1413, and then provides
the video stream to the encoding/decoding engine 1407.
[0304]
The audio ES buffer 1409A buffers an audio stream
25 generated by the audio encoder 1410, and then provides the
audio stream to the multiplexing unit (MUX) 1412. The audio
ES buffer 1409B buffers an audio stream provided from the
demultiplexing unit (DMUX) 1413, and then provides the audio
stream to the audio decoder 1411.
30 [0305]
For example, the audio encoder 1410 converts an audio
85
SP353806WO00
signal input from, for example, the connectivity 1321 (Fig.
41) or the like into a digital signal, and encodes the digital
signal according to a certain scheme such as an MPEG audio
scheme or an AudioCode number 3 (AC3) scheme. The audio encoder
1410 sequentially writes the audio stream that is data 5 obtained
by encoding the audio signal in the audio ES buffer 1409A.
The audio decoder 1411 decodes the audio stream provided from
the audio ES buffer 1409B, performs, for example, conversion
into an analog signal, and provides a reproduced audio signal
10 to, for example, the connectivity 1321 (Fig. 41) or the like.
[0306]
The multiplexing unit (MUX) 1412 performs multiplexing
of the video stream and the audio stream. A multiplexing method
(that is, a format of a bitstream generated by multiplexing)
15 is arbitrary. Further, at the time of multiplexing, the
multiplexing unit (MUX) 1412 may add certain header information
or the like to the bitstream. In other words, the multiplexing
unit (MUX) 1412 may convert a stream format by multiplexing.
For example, the multiplexing unit (MUX) 1412 multiplexes the
20 video stream and the audio stream to be converted into a
transport stream that is a bitstream of a transfer format.
Further, for example, the multiplexing unit (MUX) 1412
multiplexes the video stream and the audio stream to be
converted into data (file data) of a recording file format.
25 [0307]
The demultiplexing unit (DMUX) 1413 demultiplexes the
bitstream obtained by multiplexing the video stream and the
audio stream by a method corresponding to the multiplexing
performed by the multiplexing unit (MUX) 1412. In other words,
30 the demultiplexing unit (DMUX) 1413 extracts the video stream
and the audio stream (separates the video stream and the audio
86
SP353806WO00
stream) from the bitstream read from the stream buffer 1414.
In other words, the demultiplexing unit (DMUX) 1413 can perform
conversion (inverse conversion of conversion performed by the
multiplexing unit (MUX) 1412) of a format of a stream through
5 the demultiplexing. For example, the demultiplexing unit
(DMUX) 1413 can acquire the transport stream provided from,
for example, the connectivity 1321 or the broadband modem 1333
(both Fig. 41) through the stream buffer 1414 and convert the
transport stream into a video stream and an audio stream through
10 the demultiplexing. Further, for example, the demultiplexing
unit (DMUX) 1413 can acquire file data read from various kinds
of recording media (Fig. 41) by, for example, the connectivity
1321 through the stream buffer 1414 and converts the file data
into a video stream and an audio stream by the demultiplexing.
15 [0308]
The stream buffer 1414 buffers the bitstream. For
example, the stream buffer 1414 buffers the transport stream
provided from the multiplexing unit (MUX) 1412, and provides
the transport stream to, for example, the connectivity 1321
20 or the broadband modem 1333 (both Fig. 41) at a certain timing
or based on an external request or the like.
[0309]
Further, for example, the stream buffer 1414 buffers
file data provided from the multiplexing unit (MUX) 1412,
25 provides the file data to, for example, the connectivity 1321
(Fig. 41) or the like at a certain timing or based on an external
request or the like, and causes the file data to be recorded
in various kinds of recording media.
[0310]
30 Furthermore, the stream buffer 1414 buffers the
transport stream acquired through, for example, the
87
SP353806WO00
connectivity 1321 or the broadband modem 1333 (both Fig. 41),
and provides the transport stream to the demultiplexing unit
(DMUX) 1413 at a certain timing or based on an external request
or the like.
5 [0311]
Further, the stream buffer 1414 buffers file data read
from various kinds of recording media in, for example, the
connectivity 1321 (Fig. 41) or the like, and provides the file
data to the demultiplexing unit (DMUX) 1413 at a certain timing
10 or based on an external request or the like.
[0312]
Next, an operation of the video processor 1332 having
the above configuration will be described. The video signal
input to the video processor 1332, for example, from the
15 connectivity 1321 (Fig. 41) or the like is converted into
digital image data according to a certain scheme such as a
4 : 2 : 2 Y/Cb/Cr scheme in the video input processing unit
1401 and sequentially written in the frame memory 1405. The
digital image data is read out to the first image
20 enlarging/reducing unit 1402 or the second image
enlarging/reducing unit 1403, subjected to a format conversion
process of performing a format conversion into a certain scheme
such as a 4 : 2 : 0 Y/Cb/Cr scheme and an enlargement/reduction
process, and written in the frame memory 1405 again. The image
25 data is encoded by the encoding/decoding engine 1407, and
written in the video ES buffer 1408A as a video stream.
[0313]
Further, an audio signal input to the video processor
1332 from the connectivity 1321 (Fig. 41) or the like is encoded
30 by the audio encoder 1410, and written in the audio ES buffer
1409A as an audio stream.
88
SP353806WO00
[0314]
The video stream of the video ES buffer 1408A and the
audio stream of the audio ES buffer 1409A are read out to and
multiplexed by the multiplexing unit (MUX) 1412, and converted
into a transport stream, file data, or the like. The 5 transport
stream generated by the multiplexing unit (MUX) 1412 is
buffered in the stream buffer 1414, and then output to an
external network through, for example, the connectivity 1321
or the broadband modem 1333 (both Fig. 41). Further, the file
10 data generated by the multiplexing unit (MUX) 1412 is buffered
in the stream buffer 1414, then output to, for example, the
connectivity 1321 (Fig. 41) or the like, and recorded in various
kinds of recording media.
[0315]
15 Further, the transport stream input to the video
processor 1332 from an external network through, for example,
the connectivity 1321 or the broadband modem 1333 (both Fig.
41) is buffered in the stream buffer 1414 and then demultiplexed
by the demultiplexing unit (DMUX) 1413. Further, the file
20 data that is read from various kinds of recording media in,
for example, the connectivity 1321 (Fig. 41) or the like and
then input to the video processor 1332 is buffered in the stream
buffer 1414 and then demultiplexed by the demultiplexing unit
(DMUX) 1413. In other words, the transport stream or the file
25 data input to the video processor 1332 is demultiplexed into
the video stream and the audio stream through the
demultiplexing unit (DMUX) 1413.
[0316]
The audio stream is provided to the audio decoder 1411
30 through the audio ES buffer 1409B and decoded, and so an audio
signal is reproduced. Further, the video stream is written
89
SP353806WO00
in the video ES buffer 1408B, sequentially read out to and
decoded by the encoding/decoding engine 1407, and written in
the frame memory 1405. The decoded image data is subjected
to the enlargement/reduction process performed by the second
image enlarging/reducing unit 1403, and written in the 5 he frame
memory 1405. Then, the decoded image data is read out to the
video output processing unit 1404, subjected to the format
conversion process of performing format conversion to a certain
scheme such as a 4 : 2 : 2 Y/Cb/Cr scheme, and converted into
10 an analog signal, and so a video signal is reproduced.
[0317]
When the present technology is applied to the video
processor 1332 having the above configuration, it is preferable
that the above embodiments of the present technology be applied
15 to the encoding/decoding engine 1407. In other words, for
example, the encoding/decoding engine 1407 preferably has the
function of the encoding device or the decoding device
according to the first embodiment. Accordingly, the video
processor 1332 can obtain the same effects as the effects
20 described above with reference to Figs. 1 to 12.
[0318]
Further, in the encoding/decoding engine 1407, the
present technology (that is, the functions of the image
encoding devices or the image decoding devices according to
25 the above embodiment) may be implemented by either or both
of hardware such as a logic circuit or software such as an
embedded program.
[0319]
(Another exemplary configuration of video processor)
30 Fig. 43 illustrates another exemplary schematic
configuration of the video processor 1332 (Fig. 41) to which
90
SP353806WO00
the present technology is applied. In the case of the example
of Fig. 43, the video processor 1332 has a function of encoding
and decoding video data according to a certain scheme.
[0320]
More specifically, the video processor 5 ssor 1332 includes
a control unit 1511, a display interface 1512, a display engine
1513, an image processing engine 1514, and an internal memory
1515 as illustrated in Fig. 43. The video processor 1332
further includes a codec engine 1516, a memory interface 1517,
10 a multiplexing/demultiplexing unit (MUX DMUX) 1518, a network
interface 1519, and a video interface 1520.
[0321]
The control unit 1511 controls an operation of each
processing unit in the video processor 1332 such as the display
15 interface 1512, the display engine 1513, the image processing
engine 1514, and the codec engine 1516.
[0322]
The control unit 1511 includes, for example, a main CPU
1531, a sub CPU 1532, and a system controller 1533 as illustrated
20 in Fig. 43. The main CPU 1531 executes, for example, a program
for controlling an operation of each processing unit in the
video processor 1332. The main CPU 1531 generates a control
signal, for example, according to the program, and provides
the control signal to each processing unit (that is, controls
25 an operation of each processing unit). The sub CPU 1532 plays
a supplementary role of the main CPU 1531. For example, the
sub CPU 1532 executes a child process or a subroutine of a
program executed by the main CPU 1531. The system controller
1533 controls operations of the main CPU 1531 and the sub CPU
30 1532, for examples, designates a program executed by the main
CPU 1531 and the sub CPU 1532.
91
SP353806WO00
[0323]
The display interface 1512 outputs image data to, for
example, the connectivity 1321 (Fig. 41) or the like under
control of the control unit 1511. For example, the display
interface 1512 converts image data of digital data 5 into an
analog signal, and outputs the analog signal to, for example,
the monitor device of the connectivity 1321 (Fig. 41) as a
reproduced video signal or outputs the image data of the digital
data to, for example, the monitor device of the connectivity
10 1321 (Fig. 41).
[0324]
The display engine 1513 performs various kinds of
conversion processes such as a format conversion process, a
size conversion process, and a color gamut conversion process
15 on the image data under control of the control unit 1511 to
comply with, for example, a hardware specification of the
monitor device that displays the image.
[0325]
The image processing engine 1514 performs certain image
20 processing such as a filtering process for improving an image
quality on the image data under control of the control unit
1511.
[0326]
The internal memory 1515 is a memory that is installed
25 in the video processor 1332 and shared by the display engine
1513, the image processing engine 1514, and the codec engine
1516. The internal memory 1515 is used for data transfer
performed among, for example, the display engine 1513, the
image processing engine 1514, and the codec engine 1516. For
30 example, the internal memory 1515 stores data provided from
the display engine 1513, the image processing engine 1514,
92
SP353806WO00
or the codec engine 1516, and provides the data to the display
engine 1513, the image processing engine 1514, or the codec
engine 1516 as necessary (for example, according to a request).
The internal memory 1515 can be implemented by any storage
device, but since the internal memory 1515 is mostly 5 used for
storage of small-capacity data such as image data of block
units or parameters, it is desirable to implement the internal
memory 1515 using a semiconductor memory that is relatively
small in capacity (for example, compared to the external memory
10 1312) and fast in response speed such as a static random access
memory (SRAM).
[0327]
The codec engine 1516 performs processing related to
encoding and decoding of image data. An en coding/decoding
15 scheme supported by the codec engine 1516 is arbitrary, and
one or more schemes may be supported by the codec engine 1516.
For example, the codec engine 1516 may have a codec function
of supporting a plurality of encoding/decoding schemes and
perform encoding of image data or decoding of encoded data
20 using a scheme selected from among the schemes.
[0328]
In the example illustrated in Fig. 43, the codec engine
1516 includes, for example, an MPEG-2 Video 1541, an AVC/H.264
1542, a HEVC/H.265 1543, a HEVC/H.265 (Scalable) 1544, a
25 HEVC/H.265 (Multi-view) 1545, and an MPEG-DASH 1551 as
functional blocks of processing related to a codec.
[0329]
The MPEG-2 Video 1541 is a functional block of encoding
or decoding image data according to an MPEG-2 scheme. The
30 AVC/H.264 1542 is a functional block of encoding or decoding
image data according to an AVC scheme. The HEVC/H.265 1543
93
SP353806WO00
is a functional block of encoding or decoding image data
according to a HEVC scheme. The HEVC/H.265 (Scalable) 1544
is a functional block of performing scalable encoding or
scalable decoding on image data according to a HEVC scheme.
The HEVC/H.265 (Multi-5 view) 1545 is a functional block of
performing multi-view encoding or multi-view decoding on image
data according to a HEVC scheme.
[0330]
The MPEG-DASH 1551 is a functional block of transmitting
10 and receiving image data according to an MPEG-Dynamic Adaptive
Streaming over HTTP (MPEG-DASH). The MPEG-DASH is a technique
of streaming a video using a HyperText Transfer Protocol (HTTP),
and has a feature of selecting appropriate one from among a
plurality of pieces of encoded data that differ in a previously
15 prepared resolution or the like in units of segments and
transmitting a selected one. The MPEG-DASH 1551 performs
generation of a stream complying with a standard, transmission
control of the stream, and the like, and uses the MPEG-2 Video
1541 or the HEVC/H.265 (Multi-view) 1545 for encoding and
20 decoding of image data.
[0331]
The memory interface 1517 is an interface for the
external memory 1312. Data provided from the image processing
engine 1514 or the codec engine 1516 is provided to the external
25 memory 1312 through the memory interface 1517. Further, data
read from the external memory 1312 is provided to the video
processor 1332 (the image processing engine 1514 or the codec
engine 1516) through the memory interface 1517.
[0332]
30 The multiplexing/demultiplexing unit (MUX DMUX) 1518
performs multiplexing and demultiplexing of various kinds of
94
SP353806WO00
data related to an image such as a bitstream of encoded data,
image data, and a video signal. The
multiplexing/demultiplexing method is arbitrary. For
example, at the time of multiplexing, the
multiplexing/demultiplexing unit (MUX DMUX) 1518 can not 5 ot only
combine a plurality of data into one but also add certain header
information or the like to the data. Further, at the time
of demultiplexing, the multiplexing/demultiplexing unit (MUX
DMUX) 1518 can not only divide one data into a plurality of
10 data but also add certain header information or the like to
each divided data. In other words, the
multiplexing/demultiplexing unit (MUX DMUX) 1518 can converts
a data format through multiplexing and demultiplexing. For
example, the multiplexing/demultiplexing unit (MUX DMUX) 1518
15 can multiplex a bitstream to be converted into a transport
stream serving as a bitstream of a transfer format or data
(file data) of a recording file format. Of course, inverse
conversion can be also performed through demultiplexing.
[0333]
20 The network interface 1519 is an interface for, for
example, the broadband modem 1333 or the connectivity 1321
(both Fig. 41). The video interface 1520 is an interface for,
for example, the connectivity 1321 or the camera 1322 (both
Fig. 41).
25 [0334]
Next, an exemplary operation of the video processor 1332
will be described. For example, when the transport stream
is received from the external network through, for example,
the connectivity 1321 or the broadband modem 1333 (both Fig.
30 41), the transport stream is provided to the
multiplexing/demultiplexing unit (MUX DMUX) 1518 through the
95
SP353806WO00
network interface 1519, demultiplexed, and then decoded by
the codec engine 1516. Image data obtained by the decoding
of the codec engine 1516 is subjected to certain image
processing performed, for example, by the image processing
engine 1514, subjected to certain conversion performed 5 by the
display engine 1513, and provided to, for example, the
connectivity 1321 (Fig. 41) or the like through the display
interface 1512, and so the image is displayed on the monitor.
Further, for example, image data obtained by the decoding of
10 the codec engine 1516 is encoded by the codec engine 1516 again,
multiplexed by the multiplexing/demultiplexing unit (MUX
DMUX) 1518 to be converted into file data, output to, for example,
the connectivity 1321 (Fig. 41) or the like through the video
interface 1520, and then recorded in various kinds of recording
15 media.
[0335]
Furthermore, for example, file data of encoded data
obtained by encoding image data read from a recording medium
(not illustrated) through the connectivity 1321 (Fig. 41) or
20 the like is provided to the multiplexing/demultiplexing unit
(MUX DMUX) 1518 through the video interface 1520, and
demultiplexed, and decoded by the codec engine 1516. Image
data obtained by the decoding of the codec engine 1516 is
subjected to certain image processing performed by the image
25 processing engine 1514, subjected to certain conversion
performed by the display engine 1513, and provided to, for
example, the connectivity 1321 (Fig. 41) or the like through
the display interface 1512, and so the image is displayed on
the monitor. Further, for example, image data obtained by
30 the decoding of the codec engine 1516 is encoded by the codec
engine 1516 again, multiplexed by the
96
SP353806WO00
multiplexing/demultiplexing unit (MUX DMUX) 1518 to be
converted into a transport stream, provided to, for example,
the connectivity 1321 or the broadband modem 1333 (both Fig.
41) through the network interface 1519, and transmitted to
another device (5 not illustrated).
[0336]
Further, transfer of image data or other data between
the processing units in the video processor 1332 is performed,
for example, using the internal memory 1515 or the external
10 memory 1312. Furthermore, the power management module 1313
controls, for example, power supply to the control unit 1511.
[0337]
When the present technology is applied to the video
processor 1332 having the above configuration, it is desirable
15 to apply the above embodiments of the present technology to
the codec engine 1516. In other words, for example, it is
preferable that the codec engine 1516 have a functional block
of implementing the encoding device and the decoding device
according to the first embodiment. Furthermore, for example,
20 as the codec engine 1516 operates as described above, the video
processor 1332 can have the same effects as the effects
described above with reference to Figs. 1 to 12.
[0338]
Further, in the codec engine 1516, the present technology
25 (that is, the functions of the image encoding devices or the
image decoding devices according to the above embodiment) may
be implemented by either or both of hardware such as a logic
circuit or software such as an embedded program.
[0339]
30 The two exemplary configurations of the video processor
1332 have been described above, but the configuration of the
97
SP353806WO00
video processor 1332 is arbitrary and may have any
configuration other than the above two exemplary configuration.
Further, the video processor 1332 may be configured with a
single semiconductor chip or may be configured with a plurality
of semiconductor chips. For example, the video processor 5 or 1332
may be configured with a three-dimensionally stacked LSI in
which a plurality of semiconductors are stacked. Further,
the video processor 1332 may be implemented by a plurality
of LSIs.
10 [0340]
(Application examples to devices)
The video set 1300 may be incorporated into various kinds
of devices that process image data. For example, the video
set 1300 may be incorporated into the television device 900
15 (Fig. 34), the mobile telephone 920 (Fig. 35), the
recording/reproducing device 940 (Fig. 36), the imaging device
960 (Fig. 37), or the like. As the video set 1300 is
incorporated, the devices can have the same effects as the
effects described above with reference to Figs. 1 to 12.
20 [0341]
Further, the video set 1300 may be also incorporated
into a terminal device such as the personal computer 1004,
the AV device 1005, the tablet device 1006, or the mobile
telephone 1007 in the data transmission system 1000 of Fig.
25 38, the broadcasting station 1101 or the terminal device 1102
in the data transmission system 1100 of Fig. 39, or the imaging
device 1201 or the scalable encoded data storage device 1202
in the imaging system 1200 of Fig. 40. As the video set 1300
is incorporated, the devices can have the same effects as the
30 effects described above with reference to Figs. 1 to 12.
[0342]
98
SP353806WO00
Further, even each component of the video set 1300 can
be implemented as a component to which the present technology
is applied when the component includes the video processor
1332. For example, only the video processor 1332 can be
5 implemented as a video processor to which the present
technology is applied. Further, for example, the processors
indicated by the dotted line 1341 as described above, the video
module 1311, or the like can be implemented as, for example,
a processor or a module to which the present technology is
10 applied. Further, for example, a combination of the video
module 1311, the external memory 1312, the power management
module 1313, and the front end module 1314 can be implemented
as a video unit 1361 to which the present technology is applied.
These configurations can have the same effects as the effects
15 described above with reference to Figs. 1 to 12.
[0343]
In other words, a configuration including the video
processor 1332 can be incorporated into various kinds of
devices that process image data, similarly to the case of the
20 video set 1300. For example, the video processor 1332, the
processors indicated by the dotted line 1341, the video module
1311, or the video unit 1361 can be incorporated into the
television device 900 (Fig. 34), the mobile telephone 920 (Fig.
35), the recording/reproducing device 940 (Fig. 36), the
25 imaging device 960 (Fig. 37), the terminal device such as the
personal computer 1004, the AV device 1005, the tablet device
1006, or the mobile telephone 1007 in the data transmission
system 1000 of Fig. 38, the broadcasting station 1101 or the
terminal device 1102 in the data transmission system 1100 of
30 Fig. 39, the imaging device 1201 or the scalable encoded data
storage device 1202 in the imaging system 1200 of Fig. 40,
99
SP353806WO00
or the like. Further, as the configuration to which the present
technology is applied, the devices can have the same effects
as the effects described above with reference to Figs. 1 to
12, similarly to the video set 1300.
5 [0344]
In the present disclosure, the description has been made
in connection with the example in which various kinds of
information such as the color gamut information and the
luminance information is multiplexed into encoded data and
10 transmitted from an encoding side to a decoding side. However,
the technique of transmitting the information is not limited
to this example. For example, the information may be
transmitted or recorded as individual data associated with
encoded data without being multiplexed into encoded data.
15 Here, a term "associated" means that an image (or a part of
an image such as a slice or a block) included in a bitstream
can be linked with information corresponding to the image at
the time of decoding. In other words, the information may
be transmitted through a transmission path different from
20 encoded data. Further, the information may be recorded in
a recording medium (or a different recording area of the same
recording medium) different from encoded data. Furthermore,
the information and the encoded data may be associated with
each other, for example, in units of a plurality of frames,
25 frames, or arbitrary units such as parts of a frame.
[0345]
In the present disclosure, a system represents a set
of a plurality of components (devices, modules (parts), and
the like), and all components need not be necessarily arranged
30 in a single housing. Thus, both a plurality of devices that
are arranged in individual housings and connected with one
100
SP353806WO00
another via a network and a single device including a plurality
of modules arranged in a single housing are regarded as a system.
[0346]
The effects described in the present disclosure are
5 merely examples, and other effects may be obtained.
[0347]
Further, an embodiment of the present disclosure is not
limited to the above embodiments, and various changes can be
made within a scope not departing from the gist of the present
10 disclosure.
[0348]
For example, the present disclosure may have a cloud
computing configuration in which one function is shared and
jointly processed by a plurality of devices via a network.
15 [0349]
The steps described above with reference to the flowchart
may be performed by a single device or may be shared and performed
by a plurality of devices.
[0350]
20 Furthermore, when a plurality of processes are included
in a single step, the plurality of processes included in the
single step may be performed by a single device or may be shared
and performed by a plurality of devices.
[0351]
25 The present disclosure can have the following
configurations as well.
[0352]
(1)
A decoding device, including:
30 a receiving unit that receives an encoded stream
including encoded data of an image and color gamut information
101
SP353806WO00
indicating a color gamut of the image from an encoding device
that transmits the encoded stream;
an extracting unit that extracts the encoded data and
the color gamut information from the encoded stream received
5 by the receiving unit; and
a decoding unit that decodes the encoded data extracted
by the extracting unit, and generates the image.
(2)
The decoding device according to (1), further including
10 an adjusting unit that adjusts the color gamut of the
image generated by the decoding unit based on the color gamut
information extracted by the extracting unit.
(3)
The decoding device according to (2),
15 wherein the encoded stream includes luminance
information indicating luminance of a display unit that
displays the image at a time of authoring of the image,
the extracting unit extracts the luminance information
from the encoded stream, and
20 the adjusting unit adjusts a luminance dynamic range
of the image generated by the decoding unit based on the
luminance information extracted by the extracting unit.
(4)
The decoding device according to (3),
25 wherein the luminance information indicates luminance
of white and black of the display unit.
(5)
A decoding method performed by a decoding device,
including:
30 a receiving step of receiving an encoded stream including
encoded data of an image and color gamut information indicating
102
SP353806WO00
a color gamut of the image from an encoding device that transmits
the encoded stream;
an extracting step of extracting the encoded data and
the color gamut information from the encoded stream received
5 in the receiving step; and
a decoding step of decoding the encoded data extracted
in the extracting step and generating the image.
(6)
An encoding device, including:
10 an encoding unit that encodes an image, and generates
encoded data;
a setting unit that sets color gamut information
indicating a color gamut of the image; and
a transmitting unit that transmits an encoded stream
15 including the encoded data generated by the encoding unit and
the color gamut information generated by the setting unit.
(7)
The encoding device according to (6),
wherein the setting unit sets luminance information
20 indicating luminance of a display unit that displays the image
at a time of authoring of the image, and
the transmitting unit transmits an encoded stream
including the encoded data, the color gamut information, and
the luminance information.
25 (8)
The encoding device according to (7),
wherein the luminance information indicates luminance
of white and black of the display unit.
(9)
30 An encoding method performed by an encoding device,
including:
103
SP353806WO00
an encoding step of encoding an image and generating
encoded data;
a setting step of setting color gamut information
indicating a color gamut of the image; and
a transmitting step of transmitting an encoded 5 stream
including the encoded data generated in the encoding step and
the color gamut information generated in the setting step.
(10)
A decoding device, including:
10 a receiving unit that receives an encoded stream
including encoded data of an image, identification information
identifying a certain color gamut, and a cover ratio of a color
gamut of the image to the certain color gamut from an encoding
device that transmits the encoded stream;
15 an extracting unit that extracts the encoded data, the
identification information, and the cover ratio from the
encoded stream received by the receiving unit; and
a decoding unit that decodes the encoded data extracted
by the extracting unit, and generates the image.
20 (11)
The decoding device according to (10), further including
an adjusting unit that adjusts the color gamut of the
image generated by the decoding unit based on the
identification information and the cover ratio extracted by
25 the extracting unit.
(12)
The decoding device according to (11),
wherein the encoded stream includes luminance
information indicating luminance of a display unit that
30 displays the image at a time of authoring of the image,
the extracting unit extracts the luminance information
104
SP353806WO00
from the encoded stream, and
the adjusting unit adjusts a luminance dynamic range
of the image generated by the decoding unit based on the
luminance information extracted by the extracting unit.
5 (13)
The decoding device according to (12),
wherein the luminance information indicates luminance
of white and black of the display unit.
(14)
10 A decoding method performed by a decoding device,
including:
a receiving step of receiving an encoded stream including
encoded data of an image, identification information
identifying a certain color gamut, and a cover ratio of a color
15 gamut of the image to the certain color gamut from an encoding
device that transmits the encoded stream;
an extracting step of extracting the encoded data, the
identification information, and the cover ratio from the
encoded stream received in the receiving step; and
20 a decoding step of decoding the encoded data extracted
in the extracting step and generating the image.
(15)
An encoding device, including:
an encoding unit that encodes an image, and generates
25 encoded data;
a setting unit that sets identification information
identifying a certain color gamut and a cover ratio of a color
gamut of the image to the certain color gamut; and
a transmitting unit that transmits an encoded stream
30 including the encoded data generated by the encoding unit and
the identification information and the cover ratio generated
105
SP353806WO00
by the setting unit.
(16)
The encoding device according to (15),
wherein the setting unit sets luminance information
indicating luminance of a display unit that displays the 5 he image
at a time of authoring of the image, and
the transmitting unit transmits an encoded stream
including the encoded data, the color gamut information, and
the luminance information.
10 (17)
The encoding device according to (16),
wherein the luminance information indicates luminance
of white and black of the display unit.
(18)
15 An encoding method performed by an encoding device,
including:
an encoding step of encoding an image and generating
encoded data;
a setting step of setting identification information
20 identifying a certain color gamut and a cover ratio of a color
gamut of the image to the certain color gamut; and
a transmitting step of transmitting an encoded stream
including the encoded data generated in the encoding step and
the identification information and the cover ratio generated
25 in the setting step.
REFERENCE SIGNS LIST
[0353]
10 Encoding device
30 11 Setting unit
12 Encoding unit
106
SP353806WO00
13 Transmitting unit
50 Decoding device
51 Receiving unit
52 Extracting unit
5 53 Decoding unit
54 Adjusting unit
70 Encoding device
72 Setting unit
90 Decoding device
10 91 Extracting unit
92 Adjusting unit
107
SP353806WO00
CLAIMS
1. (Amended) A decoding device, comprising:
a receiving unit that receives an encoded stream
including encoded data of an image and 5 luminance information
indicating luminance of a certain color of a display unit that
displays the image at a time of authoring of the image from
an encoding device that transmits the encoded stream;
an extracting unit that extracts the encoded data and
10 the luminance information from the encoded stream received
by the receiving unit; and
a decoding unit that decodes the encoded data extracted
by the extracting unit, and generates the image.
15 2. (Amended) The decoding device according to claim 1,
further comprising
an adjusting unit that adjusts a dynamic range of the
image generated by the decoding unit based on the luminance
information extracted by the extracting unit.
20
3. (Amended) The decoding device according to claim 2,
wherein the luminance information indicates luminance
of at least one color of white and black of the display unit.
25 4. The decoding device according to claim 3,
wherein the luminance information indicates luminance
of white and black of the display unit.
5. (Amended) A decoding method performed by a decoding
30 device, comprising:
a receiving step of receiving an encoded stream including
108
SP353806WO00
encoded data of an image and luminance information indicating
luminance of a certain color of a display unit that displays
the image at a time of authoring of the image from an encoding
device that transmits the encoded stream;
an extracting step of extracting the encoded data 5 and
the luminance information from the encoded stream received
in the receiving step; and
a decoding step of decoding the encoded data extracted
in the extracting step and generating the image.
10
6. (Amended) The decoding method according to claim 5,
further comprising
an adjusting step of adjusting a dynamic range of the
image generated in the decoding step based on the luminance
15 information extracted in the extracting step.
7. (Amended) The decoding method according to claim 6,
wherein the luminance information indicates luminance
of at least one color of white and black of the display unit.
20
8. (Amended) The decoding method according to claim 7,
wherein the luminance information indicates luminance
of white and black of the display unit.
25 9. (Amended) An encoding device, comprising:
an encoding unit that encodes an image, and generates
encoded data;
a setting unit that sets luminance information
indicating luminance of a certain color of a display unit that
30 displays the image at a time of authoring of the image; and
a transmitting unit that transmits an encoded stream
109
SP353806WO00
including the encoded data generated by the encoding unit and
the luminance information generated by the setting unit.
10. (Amended) The encoding device according to claim 9,
wherein the luminance information 5 indicates luminance
of at least one color of white and black of the display unit.
11. (Amended) The encoding device according to claim 10,
wherein the luminance information indicates luminance
10 of white and black of the display unit.
12. (Amended) A recording medium having recorded therein
an encoded stream including encoded data of an image and
luminance information indicating luminance of a certain color
15 of a display unit that displays the image at a time of authoring
of the image, the recording medium configuring an image
decoding system together with a decoding device,
wherein the image is generated by extracting the encoded
data and the luminance information from the encoded stream
20 and decoding the extracted encoded data in the decoding device.
13. (Amended) The recording medium according to claim 12,
wherein a dynamic range of the image is adjusted in the
decoding device based on the luminance information.
25
14. (Amended) The recording medium according to claim 13,
wherein the luminance information indicates luminance
of at least one color of white and black of the display unit.
30 15. (Amended) The recording medium according to claim 14,
wherein the luminance information indicates luminance
110
SP353806WO00
of white and black of the display unit.