Sign In to Follow Application
View All Documents & Correspondence

Transmitting Device Transmitting Method Receiving Device And Receiving Method

Abstract: The objective of the present invention is to make it possible for a reception side electro optical conversion process to be performed satisfactorily with respect to transmission video data obtained using HDR opto electrical conversion characteristics. Transmission video data are obtained by subjecting high dynamic range video data to high dynamic range opto electrical conversion. A video stream is obtained by subjecting the transmission video data to an encoding process. A container having a prescribed format containing the video stream is transmitted. Meta information indicating electro optical conversion characteristics corresponding to the high dynamic range opto electrical conversion characteristics is inserted into a parameter set region in the video stream.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
22 June 2017
Publication Number
32/2017
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
Parent Application
Patent Number
Legal Status
Grant Date
2023-10-18
Renewal Date

Applicants

SONY CORPORATION
1 7 1 Konan Minato Ku Tokyo 1080075

Inventors

1. TSUKAGOSHI Ikuo
c/o SONY CORPORATION 1 7 1 Konan Minato Ku Tokyo 1080075

Specification

FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
“TRANSMITTING DEVICE, TRANSMITTING METHOD, RECEIVING
DEVICE AND RECEIVING METHOD”
SONY CORPORATION, of 1-7-1, Konan, Minato-ku, Tokyo 108-
0075, Japan
The following specification particularly describes the
invention and the manner in which it is to be performed.
2
DESCRIPTION
TECHNICAL FIELD
5 [0001]
The present technology relates to a transmission device,
a transmission method, a reception device, and a reception
method. More specifically, the present technology relates
to a transmission device and so on configured to transmit
10 transmission video data obtained by applying high dynamic range
optoelectrical conversion to high dynamic range video data.
BACKGROUND ART
[0002]
15 Transmitting transmission video data obtained by
applying high dynamic range optoelectrical conversion to high
dynamic range video data has been considered in the past.
Hereinafter, the high dynamic range will be abbreviated as
“HDR” as appropriate. For example, Non-patent Document 1 has
20 mentioned an HDR optoelectrical conversion characteristic
(new gamma characteristic) including a compatibility field
with a conventional optoelectrical conversion characteristic
(gamma characteristic), by taking the reception by a
conventional reception apparatus into account.
25
CITATION LIST
NON-PATENT DOCUMENT
[0003]
Non-patent Document 1: Tim Borer, "Non-Linear Opto-Electrical
30 Transfer Functions for High Dynamic Range Television",
Research & Development White Paper WHP 283, July 2014
3
SUMMARY OF THE INVENTION
PROBLEMS TO BE SOLVED BY THE INVENTION
[0004]
5 An object of the present technology is to ensure that
electrooptical conversion processing for transmission video
data obtained using an HDR optoelectrical conversion
characteristic is favorably carried out at a receiving side.
10 SOLUTIONS TO PROBLEMS
[0005]
A concept of the present technology is a transmission
device including:
an optoelectrical converter that performs high dynamic
15 range optoelectrical conversion on high dynamic range video
data to obtain transmission video data;
an encoding unit that applies encoding processing to
the transmission video data to obtain a video stream;
a transmitter that transmits a container in a
20 predetermined format including the video stream; and
an information inserter that inserts meta information
indicating an electrooptical conversion characteristic
corresponding to a characteristic of the high dynamic range
optoelectrical conversion into a parameter set field in the
25 video stream.
[0006]
According to the present technology, the high dynamic
range optoelectrical conversion is performed on the high
dynamic range video data by the optoelectrical converter,
30 whereby the transmission video data is obtained. The encoding
processing is applied to the transmission video data by the
4
encoding unit, whereby the video stream is obtained. The
container in the predetermined format including this video
stream is transmitted by the transmitter.
[0007]
5 The meta information indicating the electrooptical
conversion characteristic corresponding to the
characteristic of the high dynamic range optoelectrical
conversion is inserted into the parameter set field in the
video stream by the information inserter. For example, the
10 parameter set field may be a field in an SPS NAL unit.
[0008]
As described above, the present technology is designed
to insert the meta information indicating the electrooptical
conversion characteristic corresponding to the
15 characteristic of the high dynamic range optoelectrical
conversion into the parameter set field in the video stream.
Consequently, electrooptical conversion processing for the
transmission video data obtained using the HDR optoelectrical
conversion characteristic can be favorably carried out at a
20 receiving side.
[0009]
In addition, for example, the present technology may
be configured in such a manner that the information inserter
further inserts, into a layer of the container, identification
25 information indicating that the video stream supports the high
dynamic range. This identification information allows the
receiving side to easily recognize that the video stream
supports the high dynamic range, whereby it is made possible
to extract the meta information indicating the electrooptical
30 conversion characteristic corresponding to the
characteristic of the high dynamic range optoelectrical
5
conversion from the parameter set field in the video stream
and perform proper electrooptical conversion on the
transmission video data.
[0010]
5 For example, this case may be configured in such a manner
that information indicating whether the video stream has
display compatibility with a normal dynamic range is added
to the identification information. Alternatively, for
example, this case may be configured in such a manner that
10 information indicating whether display brightness adjustment
for the video stream is prohibited is added to the
identification information.
[0011]
Additionally, for example, this case may be configured
15 in such a manner that the container is a transport stream,
and the information inserter inserts the identification
information into a section belonging to one of a program map
table and an event information table. Furthermore, for
example, this case may be configured in such a manner that
20 the container is an MMT stream, and the information inserter
inserts the identification information into a section
belonging to an MMT package table.
[0012]
Meanwhile, for example, the present technology may be
25 configured in such a manner that the information inserter
further inserts the meta information for display control into
a field different from the parameter set field in the video
stream. For example, this case may be configured in such a
manner that the meta information for display control includes
30 peak brightness information. Alternatively, for example,
this case may be configured in such a manner that the meta
6
information for display control includes field information
indicating a field where the display brightness adjustment
is allowed. In this case, it is made possible to properly
carry out display control using the meta information for
5 display control.
[0013]
Additionally, for example, this case may be configured
in such a manner that the meta information for display control
includes information indicating whether display brightness
10 adjustment for the video stream is prohibited. With this,
adjustment exceeding the intent of a creator can be suppressed
regarding the display brightness, or alternatively, eye
fatigue of a viewer can be suppressed.
[0014]
15 Meanwhile, another concept of the present technology
is a reception device including:
a receiver that receives a container in a predetermined
format including a video stream obtained by encoding
transmission video data;
20 a decoding unit that applies decoding processing to the
video stream to obtain the transmission video data; and
an electrooptical converter that performs
electrooptical conversion on the transmission video data
obtained at the decoding unit to obtain display video data,
25 in which
the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic
range data, and
meta information indicating an electrooptical
30 conversion characteristic corresponding to a characteristic
of the high dynamic range optoelectrical conversion is inserted
7
into a parameter set field in the video stream,
the reception device further including an information
extractor that extracts the meta information from the video
stream, in which
5 the electrooptical converter uses the electrooptical
conversion characteristic indicated by the meta information
extracted at the information extractor.
[0015]
According to the present technology, the container in
10 the predetermined format including the video stream obtained
by encoding the transmission video data is received by the
receiver. The decoding processing is applied to the video
stream by the decoding unit, whereby the transmission video
data is obtained. Subsequently, the electrooptical
15 conversion is performed on the transmission video data by the
electrooptical converter, whereby the display video data is
obtained.
[0016]
The transmission video data is data obtained by applying
20 the high dynamic range optoelectrical conversion to the high
dynamic range data. The meta information indicating the
electrooptical conversion characteristic corresponding to
the characteristic of the high dynamic range optoelectrical
conversion is inserted into the parameter set field in the
25 video stream. The meta information is extracted from the video
stream by the information extractor. In the electrooptical
converter, the electrooptical conversion characteristic
indicated by this meta information is used to apply the
electrooptical conversion to the transmission video data.
30 For example, the parameter set field may be a field in an SPS
NAL unit.
8
[0017]
As described above, the present technology is designed
to extract the meta information indicating the electrooptical
conversion characteristic corresponding to the
5 characteristic of the high dynamic range optoelectrical
conversion from the parameter set field in the video stream
such that the electrooptical conversion characteristic
indicated by this meta information is used to perform the
electrooptical conversion on the transmission video data.
10 Consequently, electrooptical conversion processing for the
transmission video data obtained using the characteristic of
the high dynamic range optoelectrical conversion can be
favorably carried out.
[0018]
15 In addition, for example, the present technology may
be configured in such a manner that identification information
indicating that the video stream supports the high dynamic
range is inserted into a layer of the container, and the
information extractor extracts the meta information from the
20 parameter set field in the video stream on the basis of the
identification information. In this case, the meta
information is correctly extracted from the parameter set field
in the video stream and accordingly, it is made possible to
perform proper electrooptical conversion on the transmission
25 video data.
[0019]
Meanwhile, for example, the present technology may be
configured in such a manner that the meta information for
display control is included in a field different from the
30 parameter set field in the video stream, and a brightness
adjustment unit is further provided, which adjusts display
9
brightness of the display video data on the basis of the meta
information for display control. For example, this case may
be configured in such a manner that the meta information for
display control includes field information indicating a field
5 where the display brightness adjustment is allowed, and the
brightness adjustment unit adjusts the display brightness of
the field where the display brightness adjustment is allowed.
In this case, the display brightness can be properly adjusted.
[0020]
10 Alternatively, for example, this case may be configured
in such a manner that information indicating whether the
display brightness adjustment for the video stream is
prohibited is inserted into a layer of the container and/or
a layer of the video stream, and the brightness adjustment
15 unit does not adjust the display brightness of the display
video data in a case where the information indicating whether
the display brightness adjustment for the video stream is
prohibited indicates the prohibition thereof. With this,
adjustment exceeding the intent of a creator can be suppressed
20 regarding the display brightness, or alternatively, eye
fatigue of a viewer can be suppressed.
EFFECTS OF THE INVENTION
[0021]
25 According to the present technology, the electrooptical
conversion processing for the transmission video data obtained
using the HDR optoelectrical conversion characteristic can
be favorably carried out at the receiving side. Note that
the effects described in the present description merely serve
30 as examples and not construed to be limited. There may be
an additional effect as well.
10
BRIEF DESCRIPTION OF DRAWINGS
[0022]
Fig. 1 is a block diagram illustrating an exemplary
5 configuration of a transmission/reception system serving as
an embodiment.
Fig. 2 is a block diagram illustrating an exemplary
configuration of a transmission device constituting the
transmission/reception system.
10 Fig. 3 is a diagram for explaining a characteristic of
HDR optoelectrical conversion.
Figs. 4(a) and 4(b) are diagrams for explaining that
a reference level “Reference level” and a threshold level
“Threshold level” can be directly or indirectly specified
15 depending on types of HDR electrooptical conversion
characteristics.
Fig. 5 is a diagram illustrating a top access unit in
a GOP in a case where an HEVC encoding technique is used.
Fig. 6 is a diagram illustrating an access unit other
20 than the top access unit in the GOP in a case where the HEVC
encoding technique is used.
Fig. 7 is a diagram illustrating an exemplary structure
of a dynamic range SEI message.
Fig. 8 is a diagram illustrating content of primary
25 information in the exemplary structure of the dynamic range
SEI message.
Fig. 9 is a diagram illustrating an exemplary structure
of a high dynamic range descriptor.
Fig. 10 is a diagram illustrating content of primary
30 information in the exemplary structure of the high dynamic
range descriptor.
11
Fig. 11 is a diagram illustrating an exemplary
configuration of a transport stream.
Fig. 12 is a block diagram illustrating an exemplary
configuration of a reception device constituting the
5 transmission/reception system.
Fig. 13 is a diagram for explaining a characteristic
of the HDR electrooptical conversion, HDR display mapping
processing and so on.
Fig. 14 is a block diagram illustrating another exemplary
10 configuration of the transmission/reception system.
Fig. 15 is a diagram illustrating exemplary structures
of a seventh byte and subsequent bytes in a packet of “Vender
Specific InfoFrame” sent from a set top box to a monitor.
Fig. 16 is a diagram illustrating content of primary
15 information in the respective exemplary structures in the
packet of “Vender Specific InfoFrame”.
Fig. 17 is a diagram illustrating an exemplary
configuration of an MMT stream.
20 MODE FOR CARRYING OUT THE INVENTION
[0023]
Modes for carrying out the invention (hereinafter,
referred to as “embodiments”) will be described below. Note
that the description will be given in the following order.
25 1. Embodiment
2. Variation
[0024]
<1. Embodiment>
[Exemplary Configuration of Transmission/Reception
30 system]
Fig. 1 illustrates an exemplary configuration of a
12
transmission/reception system 10 serving as an embodiment.
This transmission/reception system 10 is constituted by a
transmission device 100 and a reception device 200.
[0025]
5 The transmission device 100 generates a transport stream
TS in MPEG2 as a container and incorporates this transport
stream TS into a broadcasting wave or a packet in a network
to transmit. This transport stream TS includes a video stream
obtained by applying encoding processing to a transmission
10 video data obtained by performing HDR optoelectrical
conversion on HDR video data.
[0026]
Meta information indicating an electrooptical
conversion characteristic corresponding to an HDR
15 optoelectrical conversion characteristic is inserted into a
parameter set field in the video stream. In addition,
identification information indicating that the video stream
supports HDR is inserted into a layer of the container. This
identification information includes information indicating
20 whether the video stream has display compatibility with a
normal dynamic range, information indicating whether display
brightness adjustment for the video stream is prohibited and
so on. Hereinafter, the normal dynamic range will be
abbreviated as “LDR” as appropriate.
25 [0027]
Meanwhile, information for display control is inserted
into a field different from the parameter set field in the
video stream. This meta information for display control
includes peak brightness information, field information
30 indicating a field where the display brightness adjustment
is allowed, information indicating whether the display
13
brightness adjustment for the video stream is prohibited and
so on.
[0028]
The reception device 200 applies decoding processing
5 to the video stream included in the received container to obtain
the transmission video data. The reception device 200
performs optoelectrical conversion on the transmission video
data on the basis of a transmission conversion characteristic
indicated by the meta information inserted into the parameter
10 set field in the video stream, thereby obtaining display video
data. In this case, the reception device 200 extracts the
meta information inserted into the parameter set field in the
video stream, on the basis of the identification information
inserted into the layer of the container to indicate that the
15 video stream supports the high dynamic range.
[0029]
The reception device 200 also carries out display mapping
processing on the display video data, namely, adjusts the
display brightness thereof on the basis of the information
20 for display control inserted into the parameter set field in
the video stream. In a case where information inserted into
the layer of the container and/or a layer of the video stream
to indicate whether the display brightness adjustment is
prohibited indicates the prohibition thereof, this display
25 brightness adjustment is not carried out.
[0030]
[Exemplary Configuration of Transmission Device]
Fig. 2 illustrates an exemplary configuration of the
transmission device 100. This transmission device 100 has
30 a control unit 101, an HDR camera 102, an HDR optoelectrical
converter 103, a video encoder 104, a system encoder 105, and
14
a transmitter 106. The control unit 101 includes a central
processing unit (CPU) in the configuration thereof and controls
actions of respective members in the transmission device 100
on the basis of a control program.
5 [0031]
The HDR camera 102 images an object and outputs high
dynamic range (HDR) video data. This HDR video data has a
contrast ratio exceeding the brightness of a white peak of
a conventional SDR image, specifically, 0 to 100%*N (where
10 N is a numeral larger than one) such as 0 to 1000%. For example,
a level of 100% here equivalents to a white brightness value
of 100 cd/m2.
[0032]
A master monitor 103a is a monitor used to carry out
15 grading on the HDR video data obtained at the HDR camera 102.
This master monitor 103a has a display brightness level
supporting the HDR video data or suitable for the grading of
the HDR video data.
[0033]
20 The HDR optoelectrical converter 103 applies the HDR
optoelectrical conversion characteristic to the HDR video data
obtained at the HDR camera 102 to obtain transmission video
data V1. Both of a solid line a and a dashed line b in Fig.
3 represent examples of HDR OETF curves indicating the HDR
25 optoelectrical conversion characteristics. Meanwhile, a
dashed line c in Fig. 3 is an SDR OETF curve indicating an
SDR optoelectrical conversion characteristic. In Fig. 3, a
lateral axis represents an input brightness level, whereas
a longitudinal axis represents a transmission code value.
30 [0034]
The HDR optoelectrical conversion characteristic can
15
be configured so as to include a compatibility field with the
SDR optoelectrical conversion characteristic, as in the HDR
optoelectrical conversion characteristics indicated by the
aforementioned solid line a and dashed line b in Fig. 3. In
5 other words, the curved lines of both of the characteristics
match with each other until the input brightness level reaches
a compatibility limit value for both of the characteristics.
At a point where the input brightness level reaches the
compatibility limit value, the transmission code value is
10 obtained as a compatibility level SP. According to the HDR
optoelectrical conversion characteristic, at a point where
the input brightness level reaches peak brightness PL, the
transmission code value is obtained as a peak level MP.
[0035]
15 An HDR display reference threshold CL represents an
boundary between a field where matching brightness is required
and a field where the dependency on the CE monitor is allowed
as brightness used for display on a monitor of a reception
apparatus (CE monitor). At a point where the input brightness
20 level reaches the HDR display reference threshold CL, the
transmission code value is obtained as a threshold level CP
in, for example, the HDR OETF curve by the solid line a in
Fig. 3. Meanwhile, according to the SDR optoelectrical
conversion characteristic, at a point where the input
25 brightness level reaches SDR characteristic expression limit
brightness SL, the transmission code value is obtained as the
peak level MP. SL here is assigned to 100 cd/m2. Note that
the HDR display reference threshold CL can be also configured
to match the compatibility limit value and, in this case, the
30 threshold level CP can be substituted by the compatibility
level SP.
16
[0036]
Referring back to Fig. 2, the video encoder 104 applies
the encoding such as MPEG4-AVC or HEVC to the transmission
video data V1 to obtain encoded video data. This video encoder
5 104 also uses a stream formatter (not illustrated) included
therein in a latter stage to generate the video stream including
this encoded video data (video elementary stream).
[0037]
At this time, the video encoder 104 inserts the meta
10 information indicating an HDR electrooptical conversion
characteristic corresponding to the HDR optoelectrical
conversion characteristic into the parameter set field in the
video stream. The video encoder 104 according to this
embodiment inserts meta information “Transfer
15 characteristics” into a field for video usability information
(VUI) in an SPS NAL unit in an access unit (AU).
[0038]
This meta information “Transfer characteristics”
specifies the HDR electrooptical conversion characteristic.
20 Specifically, the above-mentioned “Transfer characteristics”
represents “New Type” as a type of the HDR electrooptical
conversion characteristic. In this case, a reference level
“Reference level” and a threshold level “Threshold level” can
be directly or indirectly specified. The reference level
25 “Reference level” here is assigned to, for example, 100%
equivalent to a white brightness value of 100 cd/m2. Meanwhile,
the threshold level “Threshold level” represents an boundary
between a field where matching brightness is required and a
field where the dependency on the CE monitor is allowed as
30 brightness used for display on the monitor of the reception
apparatus (CE monitor).
17
[0039]
In the case of the direct specification, “Reference
level” and “Threshold level” are assumed to be defined as
identification values in the VUI, as illustrated in Fig. 4(a).
5 This case indicates that respective elements are mentioned
in semantics rules for the VUI to be referenced. Note that
“Reference level” and “Threshold level” do not necessarily
need to be separately determined but one of the levels can
be determined by setting “Reference level” = “Threshold level”.
10 [0040]
In the case of the indirect specification, “Reference
level” and “Threshold level” are not assumed to be defined
as the identification values in the VUI, as illustrated in
Fig. 4(b). In this case, respective elements are not mentioned
15 in the semantics rules for the VUI. This case indicates that
Reference level = Lr (Lx > Lr > Lc)
Threshold level = Lt (Ly > Lt > Lr)
are determined in a standard defining “Transfer
characteristics” specified in the VUI as characteristics of
20 “New Type”. Note that “Reference level” and “Threshold level”
do not necessarily need to be separately determined but one
of the levels can be determined by setting “Reference level”
= “Threshold level”.
[0041]
25 Additionally, the video encoder 104 inserts the meta
information for display control into a field other than the
parameter set field in the video stream. The video encoder
104 according to this embodiment inserts a dynamic range SEI
message (Dynamic Range SEI message) to be newly defined into
30 a section of “SEIs” in the access unit (AU).
[0042]
18
Fig. 5 illustrates a top access unit in a group of pictures
(GOP) in a case where an HEVC encoding technique is used.
Meanwhile, Fig. 6 illustrates an access unit other than the
top access unit in the GOP in a case where the HEVC encoding
5 technique is used. In the case of the HEVC encoding technique,
an SEI message group “Prefix_SEIs” for decoding is arranged
before slices (Slices) in which pixel data is encoded, whereas
an SEI message group “Suffix_SEIs” for display is arranged
after the above-mentioned slices (Slices). As illustrated
10 in Figs. 5 and 6, the dynamic range SEI message may be configured
to be arranged as the SEI message group “Suffix_SEIs”.
[0043]
Fig. 7 illustrates an exemplary structure (Syntax) of
the dynamic range SEI message. Fig. 8 illustrates content
15 of primary information (Semantics) in the above exemplary
structure. An eight-bit field of “transfer_characteristics”
specifies the HDR electrooptical conversion characteristic.
Specifically, this field represents “New Type” as a type of
the HDR electrooptical conversion characteristic.
20 [0044]
An eight-bit field of “number_of_bits” represents the
number of encoded pixel bits. A sixteen-bit field of
“minimum_brightness_value” represents a minimum level of the
brightness (cd/m2). A sixteen-bit field of “peak_level”
25 represents a relative value (%) at a maximum level. A
sixteen-bit field of “peak_level_brightness” represents a
maximum level of the brightness (cd/m2) and corresponds to
the peak brightness PL in Fig. 3.
[0045]
30 A sixteen-bit field of “compliant_threshold_level”
represents a threshold (%) during display level mapping. A
19
sixteen-bit field of “compliant_threshold_level_value”
represents the brightness (cd/m2) functioning as the threshold
during the display level mapping and corresponds to the HDR
display reference threshold CL in Fig. 3. Note that threshold
5 information constituted by “Compliant_threshold_level” and
“Compliant_threshold_level_value” can be sent as 100%
indicating reference brightness and the reference brightness,
respectively. A flag of “mapping_protection_flag” indicates
whether display mapping (display brightness adjustment) after
10 decoding is prohibited. “1” indicates that the display
mapping is prohibited. “0” indicates that the display mapping
is not prohibited.
[0046]
Referring back to Fig. 2, the system encoder 105
15 generates the transport stream TS including the video stream
VS generated at the video encoder 104. Subsequently, the
transmitter 106 incorporates this transport stream TS into
a broadcasting wave or a packet in a network to transmit to
the reception device 200.
20 [0047]
At this time, the system encoder 105 inserts, into the
layer of the transport stream (container), the identification
information indicating that the video stream supports the high
dynamic range. The system encoder 105 according to this
25 embodiment inserts a high dynamic range descriptor (High
Dynamic Range descriptor) into a section belonging to a program
map table (PMT) or a section belonging to an event information
table (EIT).
[0048]
30 Fig. 9 illustrates an exemplary structure (Syntax) of
the high dynamic range descriptor. Fig. 10 illustrates
20
content of primary information (Semantics) in the above
exemplary structure. An eight-bit field of “descriptor_tag”
represents a descriptor type and here indicates that the high
dynamic range descriptor is used. An eight-bit field of
5 “descriptor_length” represents a length (size) of the
descriptor and indicates the number of subsequent bytes as
the length of the descriptor.
[0049]
A flag of “HDR_flag” indicates whether a service stream
10 (video stream) is of a type supporting the HDR. “1” indicates
that the video stream supports the HDR and additionally
indicates whether the VUI has the HDR characteristic, or the
VUI is conventional but the SEI provides HDR information, or
the VUI has the HDR characteristic and also the SEI has the
15 HDR information. “0” indicates that the video stream does
not support the HDR.
[0050]
A flag of “SDR_compatible_flag” indicates whether the
service stream (video stream) has the display compatibility
20 with the SDR in a case where the service stream (video stream)
supports the HDR. “1” indicates that the service stream (video
stream) has the display compatibility with the SDR. “0”
indicates that the service stream (video stream) does not have
the display compatibility with the SDR. A flag of
25 “mapping_protection flag” indicates whether the display
mapping (display brightness adjustment) is prohibited in the
service stream (video stream). “1” indicates that the display
mapping is prohibited. “0” indicates that the display mapping
is not prohibited.
30 [0051]
An action of the transmission device 100 illustrated
21
in Fig. 2 will be briefly described. The HDR video data
obtained through imaging by the HDR camera 102 is supplied
to the HDR optoelectrical converter 103. The HDR video data
obtained at the HDR camera 102 is subjected to the grading
5 using the master monitor 103a. In this HDR optoelectrical
converter 103, the HDR optoelectrical conversion
characteristic (HDR OETF curve) is applied to this HDR video
data while the optoelectrical conversion is performed such
that the transmission video data V1 is obtained. This
10 transmission video data V1 is supplied to the video encoder
104.
[0052]
In the video encoder 104, the encoding such as MPEG4-AVC
or HEVC is applied to the transmission video data V1 such that
15 the encoded video data is obtained. In addition, in this video
encoder 104, the video stream including this encoded video
data is generated by the stream formatter included therein
in a latter stage.
[0053]
20 At this time, in the video encoder 104, the meta
information indicating the HDR electrooptical conversion
characteristic corresponding to the HDR optoelectrical
conversion characteristic is inserted into the layer of the
video stream. Specifically, in the video encoder 104, the
25 meta information “Transfer characteristics” is inserted into
a field for the video usability information (VUI) in the SPS
NAL unit in the access unit (AU).
[0054]
Additionally, in the video encoder 104, the meta
30 information for display control is inserted into the layer
of the video stream. Specifically, in the video encoder 104,
22
the high dynamic range SEI message to be newly defined is
inserted into a section of “SEIs” in the access unit (AU).
[0055]
The video stream VS generated at the video encoder 104
5 is supplied to the system encoder 105. In this system encoder
105, the transport stream TS in MPEG2 including the video stream
is generated. This transport stream TS is incorporated into
the broadcasting wave or a packet in a network by the transmitter
106 to be transmitted to the reception device 200.
10 [0056]
At this time, in the system encoder 105, the
identification information indicating that the video stream
supports the high dynamic range is inserted into the layer
of the transport stream (container). Specifically, in the
15 system encoder 105, the high dynamic range descriptor (High
Dynamic Range descriptor) is inserted into a section belonging
to the program map table (PMT) or a section belonging to the
event information table (EIT).
[0057]
20 [Configuration of Transport Stream TS]
Fig. 11 illustrates an exemplary configuration of the
transport stream TS. According to this exemplary
configuration, there is a PES packet “video PES1” for the video
stream identified by PID1. The meta information “Transfer
25 characteristics” specifying the HDR electrooptical
conversion characteristic is inserted into a field for the
VUI in the SPS in the access unit. Meanwhile, the dynamic
range SEI message in which the peak level “Peak level”, the
threshold level “Threshold level”, a mapping protection flag
30 “mapping_protection_flag” and so on are stated is inserted
into the access unit.
23
[0058]
Additionally, the program map table (PMT) is included
in the transport stream TS as program specific information
(PSI). The PSI is information mentioning which program is
5 the one to which each of the elementary streams included in
the transport stream belongs. The PMT has a program loop
stating information relating to the whole program.
[0059]
The PMT has an elementary stream loop having information
10 relating to each of the elementary streams. According to this
exemplary configuration, there is a video elementary stream
loop (Video ES loop) corresponding to the video stream.
Information such as a stream type and a packet identifier (PID)
is arranged in the video elementary stream loop (Video ES loop)
15 so as to correspond to the video stream and at the same time,
the descriptor stating information relating to this video
stream is also arranged therein.
[0060]
The value of “Stream_type” for this video stream is set
20 to, for example, a value indicating an HEVC video stream,
whereas the PID information is configured so as to indicate
PID1 given to a PES packet “video PES” in the video stream.
The high dynamic range descriptor in which an HDR flag
“HDR_flag”, an SDR compatible flag “SDR_compatible_flag”, the
25 mapping protection flag “mapping_protection_flag” and so on
are stated is inserted as one of the descriptors.
[0061]
Additionally, the event information table (EIT) serving
as service information (SI) managing each of events (video
30 programs) is included in the transport stream TS. Inserting
the high dynamic range descriptor into a section belonging
24
to this EIT is also acceptable.
[0062]
[Exemplary Configuration of Reception Device]
Fig. 12 illustrates an exemplary configuration of the
5 reception device 200. This reception device 200 has a control
unit 201, a receiver 202, a system decoder 203, a video decoder
204, an HDR electrooptical converter 205, an HDR display
mapping unit 206, and a CE monitor 207. The control unit 201
includes a central processing unit (CPU) in the configuration
10 thereof and controls actions of respective members in the
reception device 200 on the basis of a control program.
[0063]
The receiver 202 receives the transport stream TS sent
from the transmission device 100 by being incorporated into
15 the broadcasting wave or a packet in a network. The system
decoder 203 extracts the video stream (elementary stream) VS
from this transport stream TS. The system decoder 203 also
extracts various items of information inserted into the layer
of the container (transport stream) to send to the control
20 unit 201.
[0064]
In the embodiment, this extracted information includes
the information in the high dynamic range descriptor (refer
to Fig. 9) as well. The control unit 201 recognizes that the
25 video stream supports the HDR, while also recognizing that
the SEI (dynamic range SEI) should be referenced during the
HDR display, since the “HDR flag” in the high dynamic range
descriptor is assigned to “1”.
[0065]
30 The video decoder 204 carries out decoding processing
on the video stream VS extracted at the system decoder 203
25
to output the transmission video data V1. The video decoder
204 also extracts the parameter set and the SEI message inserted
into each of the access units constituting the video stream
VS to send to the control unit 201.
5 [0066]
According to the embodiment, as described above, the
control unit 201 recognizes that the video stream supports
the HDR, while also recognizing that the SEI should be
referenced during the HDR display. Accordingly, the meta
10 information “Transfer characteristics” specifying the HDR
electrooptical conversion characteristic, which is inserted
into a field for the VUI in the SPS NAL unit, as well as the
dynamic range SEI message (refer to Fig. 7) are correctly
extracted.
15 [0067]
The control unit 201 sets the HDR electrooptical
converter 205 with the HDR electrooptical conversion
characteristic specified by the meta information “Transfer
characteristics”, namely, the HDR electrooptical conversion
20 characteristic corresponding to the HDR optoelectrical
conversion characteristic used at a transmitting side. The
HDR electrooptical converter 205 applies the set HDR
electrooptical conversion characteristic to the transmission
video data V1 output from the video decoder 204 to obtain the
25 display video data for displaying an HDR image.
[0068]
A solid line a in Fig. 13 represents an HDR EOTF curve
(Type A) indicating the HDR electrooptical conversion
characteristic. This HDR EOTF curve (Type A) corresponds to
30 the HDR OETF curve indicated by the solid line a in Fig. 3.
Meanwhile, a dashed line b in Fig. 13 represents an HDR EOTF
26
curve (Type B) indicating another HDR electrooptical
conversion characteristic. This HDR EOTF curve (Type B)
corresponds to the HDR OETF curve indicated by the dashed line
b in Fig. 3. In addition, a dashed line c in Fig. 13 represents
5 an SDR EOTF curve (Type C) corresponding to the SDR OETF curve
indicated by the dashed line c in Fig. 3.
[0069]
According to the HDR electrooptical conversion
characteristic, at a point where the transmission code value
10 reaches the peak level MP, the display brightness level is
obtained as PL. Meanwhile, at a point where the transmission
code value reaches the threshold level CP, an output brightness
level is obtained as the HDR display reference threshold CL.
Additionally, in Fig. 13, in the case of the HDR EOTF curve
15 (Type A), brightness mapping such as one indicated by a two-dot
chain line a’ is performed at a display side until reaching
the display brightness level EP as long as the threshold level
CP and the HDR display reference threshold CL are provided
and mapping protection is not enabled. Compared to this, in
20 the case of the HDR EOTF curve (Type B), brightness mapping
such as one indicated by a one-dot chain line b’ is performed
at a display side until reaching the display brightness level
EP as long as the compatibility level SP and the reference
level defined therefor are detected and the mapping protection
25 is not enabled. Note that, as described earlier, the threshold
CL represents an boundary between a field where matching
brightness is required and a field where the dependency on
the CE monitor is allowed as brightness used for display on
the monitor of the reception apparatus (CE monitor).
30 [0070]
Brightness information on PL and CL is included in the
27
dynamic range SEI message inserted into the layer of the video
stream as the meta information for display control (refer to
Fig. 7). The HDR display mapping unit 206 adjusts the display
brightness of the display video data obtained at the HDR
5 electrooptical converter 205 on the basis of the meta
information for display control. Specifically, in a case
where the CE monitor 207 has maximum brightness display
capability equal to EP higher than PL, it is also made possible
for the HDR display mapping unit 206 to carry out, as one approach
10 for a display function, the display mapping processing, namely,
the display brightness adjustment processing such that a
maximum display brightness level is shifted to EP for levels
exceeding the brightness at CL from among the output brightness
levels of the HDR electrooptical converter 205. The two-dot
15 chain line a’ in Fig. 13 represents an example of the display
brightness adjustment processing in this case.
[0071]
In addition, the HDR display mapping unit 206 does not
carry out the display brightness adjustment processing on the
20 basis of the control of the control unit 201 in a case where
“mapping_protection_flag” in the high dynamic range
descriptor and the dynamic range SEI message is assigned to
“1” to indicate that the display mapping is prohibited. With
this, adjustment exceeding the intent of a creator is
25 suppressed regarding the display brightness, or alternatively,
eye fatigue of a viewer is suppressed.
[0072]
An action of the reception device 200 illustrated in
Fig. 12 will be briefly described. In the receiver 202, the
30 transport stream TS sent from the transmission device 100 by
being incorporated into the broadcasting wave or a packet in
28
a network is received. This transport stream TS is supplied
to the system decoder 203. In the system decoder 203, the
video stream VS is extracted from this transport stream TS.
[0073]
5 Additionally, in the system decoder 203, various items
of information inserted into the layer of the container are
extracted to be sent to the control unit 201. This extracted
information includes the information in the high dynamic range
descriptor (refer to Fig. 9) as well. In the control unit
10 201, a fact that the video stream supports the HDR is recognized
on the basis of the “HDR flag” in the high dynamic range
descriptor being assigned to “1”, while a fact that the SEI
should be referenced during the HDR display is also recognized
similarly.
15 [0074]
The video stream VS extracted at the system decoder 203
is supplied to the video decoder 204. In the video decoder
204, the decoding processing is applied to the video stream
VS extracted at the system decoder 203, whereby the
20 transmission video data V1 is obtained.
[0075]
In addition, in the video decoder 204, the parameter
set and the SEI message inserted into each of the access units
constituting the video stream VS are extracted to be sent to
25 the control unit 201. As described above, in the control unit
201, a fact that the video stream supports the HDR is recognized,
while a fact that the SEI should be referenced during the HDR
display is also recognized. Accordingly, the meta
information “Transfer characteristics” specifying the HDR
30 electrooptical conversion characteristic, which is inserted
into a field for the VUI in the SPS NAL unit, as well as the
29
dynamic range SEI message (refer to Fig. 7) are extracted.
[0076]
Under the control of the control unit 201, the HDR
electrooptical converter 205 is set with the HDR electrooptical
5 conversion characteristic specified by the meta information
“Transfer characteristics”, namely, the HDR electrooptical
conversion characteristic corresponding to the HDR
optoelectrical conversion characteristic used at the
transmitting side. In the HDR electrooptical converter 205,
10 the set HDR electrooptical conversion characteristic is
applied to the transmission video data V1 output from the video
decoder 204, whereby the display video data for displaying
the HDR image is obtained.
[0077]
15 The display video data obtained at the HDR electrooptical
converter 205 is supplied to the HDR display mapping unit 206.
In the HDR display mapping unit 206, the display brightness
of the display video data is adjusted on the basis of the meta
information for display control. Specifically, in a case
20 where the CE monitor 207 has the maximum brightness display
capability equal to EP higher than PL, the display mapping
processing, namely, brightness conversion processing is
carried out in the HDR display mapping unit 206 such that the
maximum display brightness level is shifted to EP for levels
25 exceeding the brightness at CL from among the output brightness
levels of the HDR electrooptical converter 205 (refer to the
two-dot chain line a’ in Fig. 13). Alternatively, the display
mapping processing, namely, the brightness conversion
processing is carried out for levels exceeding the reference
30 brightness level such that the maximum display brightness level
is shifted to EP (refer to the one-dot chain line b’ in Fig.
30
13).
[0078]
In addition, the display brightness adjustment
processing is not carried out in the HDR display mapping unit
5 206 in a case where “mapping_protection_flag” in the high
dynamic range descriptor and the dynamic range SEI message
is assigned to “1” to indicate that the display mapping is
prohibited. Accordingly, the display video data obtained at
the HDR electrooptical converter 205 is output as it is.
10 [0079]
The output video data from the display mapping unit 206
is supplied to the CE monitor 207. The HDR image is displayed
on this CE monitor 207.
[0080]
15 As described thus far, in the transmission/reception
system 10 illustrated in Fig. 1, the meta information “Transfer
characteristics” specifying the electrooptical conversion
characteristic corresponding to the high dynamic range
optoelectrical conversion characteristic is inserted into a
20 field for the VUI in the SPS NAL unit in the video stream.
Consequently, the electrooptical conversion processing for
the transmission video data obtained using the HDR
optoelectrical conversion characteristic can be favorably
carried out at the receiving side when the HDR electrooptical
25 conversion characteristic specified by the meta information
“Transfer characteristics” is used therefor.
[0081]
Additionally, in the transmission/reception system 10
illustrated in Fig. 1, the high dynamic range descriptor (High
30 Dynamic Range descriptor) is inserted into the layer of the
container (transport stream). This descriptor includes
31
“HDR_flag” indicating whether the service stream (video
stream) is of a type supporting the HDR. This allows the
receiving side to easily recognize that the video stream
supports the high dynamic range, whereby it is made possible
5 to correctly extract the meta information “Transfer
characteristics” indicating the electrooptical conversion
characteristic corresponding to the high dynamic range
optoelectrical conversion characteristic from the parameter
set field in the video stream and perform proper electrooptical
10 conversion on the transmission video data.
[0082]
Meanwhile, in the transmission/reception system 10
illustrated in Fig. 1, the dynamic range SEI message (Dynamic
Range SEI message) is inserted into the layer of the video
15 stream. This SEI message includes the meta information for
display control. Consequently, the display brightness
control can be properly carried out at the receiving side using
this meta information for display control. In this case, the
meta information for display control includes the field
20 information indicating a field where the display brightness
adjustment is allowed such that the brightness conversion in
accordance with, for example, the display brightness
capability of the CE monitor 207 is performed only for the
field where the brightness conversion is allowed. As a
25 consequence, it is made possible to favorably reproduce a
brightness atmosphere intended by the creator.
[0083]
Furthermore, in the transmission/reception system 10
illustrated in Fig. 1, the high dynamic range descriptor and
30 the dynamic range SEI message include the flag of
“mapping_protection flag” indicating whether the display
32
mapping (display brightness adjustment) is prohibited in the
service stream (video stream). Consequently, adjustment
exceeding the intent of the creator can be suppressed regarding
the display brightness, or alternatively, eye fatigue of a
5 viewer can be suppressed.
[0084]
<2. Variation>
Note that the above embodiment has indicated an example
where, in the reception device 200, the HDR electrooptical
10 converter 205 carries out the electrooptical conversion
processing and additionally, the HDR display mapping unit 206
carries out the brightness conversion processing in accordance
with the maximum brightness display capability of the CE
monitor 207. However, by reflecting a brightness conversion
15 characteristic in the electrooptical conversion
characteristic (EOTF) in advance, the electrooptical
conversion processing and the brightness conversion
processing can be simultaneously carried out by the HDR
electrooptical converter 205 alone.
20 [0085]
In addition, the above embodiment has indicated the
transmission/reception system 10 constituted by the
transmission device 100 and the reception device 200. However,
the configuration of the transmission/reception system to
25 which the present technology can be applied is not limited
thereto. For example, as in a transmission/reception system
10A illustrated in Fig. 14, a section of the reception device
200 may be substituted by a configuration including a set top
box (STB) 200A and a monitor 200B interconnected through a
30 digital interface such as a High-Definition Multimedia
Interface (HDMI). Note that “HDMI” is a registered trademark.
33
[0086]
In this case, for example, the video decoder 204 and
its preceding members are included in the set top box 200A
and the electrooptical converter 205 and its subsequent members
5 are included in the monitor 200B. The set top box 200A uses,
for example, a packet of “Vender Specific InfoFrame” to send
the meta information indicating the HDR optoelectrical
conversion characteristic, the meta information for display
control and so on to the monitor 200B.
10 [0087]
Fig. 15 illustrates exemplary structures of a seventh
byte and subsequent bytes in the packet of “Vender Specific
InfoFrame” sent from the set top box 200A to the monitor 200B.
Meanwhile, Fig. 16 illustrates content of primary information
15 in the respective exemplary structures.
[0088]
Three-bit information of “Display_control_type” is
arranged from a seventh bit to a fifth bit in the seventh byte.
This three-bit information represents a classification of a
20 display type. “001” indicates SD display control, whereas
“010” indicates HDR display control. “010” is employed here.
[0089]
The flag of “mapping_protection_flag” is arranged in
a fourth bit in the seventh byte. This flag indicates whether
25 the display mapping (display brightness adjustment) after
decoding is prohibited. “1” indicates that the display
mapping is prohibited. “0” indicates that the display mapping
is not prohibited. Four-bit information of
“Display_control_metadata_length” is arranged from a third
30 bit to a zeroth bit in the seventh byte. This four-bit
information represents the size of
34
“Display_control_metadata” arranged at the following place,
in number of bytes. “12” is employed here.
[0090]
Eight-bit information of “Transfer characteristics” is
5 arranged in an eighth byte. This eight-bit information
specifies the HDR electrooptical conversion characteristic.
The electrooptical conversion characteristic for display is
detected through this information. “0x10” is employed here.
Eight-bit information of “Number of bits” is arranged in an
10 8+1st byte. This eight-bit information represents the number
of encoded pixel bits.
[0091]
Sixteen-bit information of “Minimum brightness value”
is arranged in an 8+2nd byte and an 8+3rd byte. This
15 sixteen-bit information represents a minimum level of the
brightness (cd/m2). Sixteen-bit information of “Peak Level”
is arranged in an 8+4th byte and an 8+5th byte. This
sixteen-bit information represents a relative value (%) at
a maximum level.
20 [0092]
Sixteen-bit information of “Peak Level Brightness” is
arranged in an 8+6th byte and an 8+7th byte. This sixteen-bit
information represents a maximum level of the brightness
(cd/m2). Sixteen-bit information of
25 “Compliant_threshold_level” is arranged in an 8+8th byte and
an 8+9th byte. This sixteen-bit information represents a
threshold (%) during the display level mapping. Sixteen-bit
information of “Compliant_threshold_level_value” is arranged
in an 8+10th byte and an 8+11th byte. This sixteen-bit
30 information represents the brightness (cd/m2) functioning as
the threshold during the display level mapping. Note that
35
threshold information constituted by
“Compliant_threshold_level” and
“Compliant_threshold_level_value” can be sent as 100%
indicating reference brightness and the reference brightness,
5 respectively. In addition, the above-mentioned information
transmission from the set top box 200A to the monitor 200B
is not limited to a case using the packet of “Vender Specific
InfoFrame” and it is apparent that defining another packet
of InfoFrame enables the transmission similarly.
10 [0093]
Furthermore, the above embodiment has indicated an
example where the transport stream (MPEG-2 TS) serves as the
container. However, the transport according to the present
technology is not limited to TS and, also in the case of another
15 packet such as ISOBMFF or MMT, the video layers can be
implemented using the same method.
[0094]
Fig. 17 illustrates an MMT structure. An MMT stream
has an MMT packet for each of assets such as video and audio.
20 According to the illustrated example, the MMT packet identified
by ID1 is provided as the video asset. The meta information
“Transfer characteristics” specifying the HDR electrooptical
conversion characteristic is inserted into a field for the
VUI in the SPS in the access unit. Meanwhile, the dynamic
25 range SEI message in which the peak level “Peak level”, the
threshold level “Threshold level”, a mapping protection flag
“mapping_protection_flag” and so on are stated is inserted
into the access unit.
[0095]
30 In addition, the MMT stream has a message packet such
as a packet access (PA) message packet. The PA message packet
36
includes tables such as an MP table (MMT Package Table). The
MP table includes information on each of the assets. Here,
the high dynamic range descriptor in which the HDR flag
“HDR_flag”, the SDR compatible flag “SDR_compatible_flag”,
5 the mapping protection flag “mapping_protection_flag” and so
on are stated is inserted in association with the video asset.
[0096]
Note that the present technology can be also configured
as described below.
10 (1) A transmission device including:
an optoelectrical converter that performs high dynamic
range optoelectrical conversion on high dynamic range video
data to obtain transmission video data;
an encoding unit that applies encoding processing to
15 the transmission video data to obtain a video stream;
a transmitter that transmits a container in a
predetermined format including the video stream; and
an information inserter that inserts meta information
indicating an electrooptical conversion characteristic
20 corresponding to a characteristic of the high dynamic range
optoelectrical conversion into a parameter set field in the
video stream.
(2) The transmission device according to the
aforementioned (1), in which
25 the parameter set field is a field in an SPS NAL unit.
(3) The transmission device according to the
aforementioned (1) or (2), in which
the information inserter further inserts, into a layer
of the container, identification information indicating that
30 the video stream supports the high dynamic range.
(4) The transmission device according to the
37
aforementioned (3), in which
information indicating whether the video stream has
display compatibility with a normal dynamic range is added
to the identification information.
5 (5) The transmission device according to the
aforementioned (3) or (4), in which
information indicating whether display brightness
adjustment for the video stream is prohibited is added to the
identification information.
10 (6) The transmission device according to any one of the
aforementioned (3) to (5), in which
the container is a transport stream, and
the information inserter inserts the identification
information into a section belonging to one of a program map
15 table and an event information table.
(7) The transmission device according to any one of the
aforementioned (3) to (5), in which
the container is an MMT stream, and
the information inserter inserts the identification
20 information into a section belonging to an MMT package table.
(8) The transmission device according to any one of the
aforementioned (1) to (7), in which
the information inserter further inserts the meta
information for display control into a field different from
25 the parameter set field in the video stream.
(9) The transmission device according to the
aforementioned (8), in which
the meta information for display control includes peak
brightness information.
30 (10) The transmission device according to the
aforementioned (8) or (9), in which
38
the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed.
(11) The transmission device according to any one of
5 the aforementioned (8) to (10), in which
the meta information for display control includes
information indicating whether display brightness adjustment
for the video stream is prohibited.
(12) The transmission device according to any one of
10 the aforementioned (8) to (11), in which
the field different from the parameter set field is a
field in an SEI NAL unit.
(13) A transmission method including:
an optoelectrical conversion step of performing high
15 dynamic range optoelectrical conversion on high dynamic range
video data to obtain transmission video data;
an encoding step of applying encoding processing to the
transmission video data to obtain a video stream;
a transmission step of transmitting a container in a
20 predetermined format including the video stream through a
transmitter; and
an information insertion step of inserting meta
information indicating an electrooptical conversion
characteristic corresponding to a characteristic of the high
25 dynamic range optoelectrical conversion into a parameter set
field in the video stream.
(14) A reception device including:
a receiver that receives a container in a predetermined
format including a video stream obtained by encoding
30 transmission video data;
a decoding unit that applies decoding processing to the
39
video stream to obtain the transmission video data; and
an electrooptical converter that performs
electrooptical conversion on the transmission video data
obtained at the decoding unit to obtain display video data,
5 in which
the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic
range data, and
meta information indicating an electrooptical
10 conversion characteristic corresponding to a characteristic
of the high dynamic range optoelectrical conversion is inserted
into a parameter set field in the video stream,
the reception device further including an information
extractor that extracts the meta information from the video
15 stream, in which
the electrooptical converter uses the electrooptical
conversion characteristic indicated by the meta information
extracted at the information extractor.
(15) The reception device according to the
20 aforementioned (14), in which
the parameter set field is a field in an SPS NAL unit.
(16) The reception device according to the
aforementioned (14) or (15), in which
identification information indicating that the video
25 stream supports the high dynamic range is inserted into a layer
of the container, and
the information extractor extracts the meta information
from the parameter set field in the video stream on the basis
of the identification information.
30 (17) The reception device according to any one of the
aforementioned (14) to (16), in which
40
the meta information for display control is included
in a field different from the parameter set field in the video
stream,
the reception device further including a brightness
5 adjustment unit that adjusts display brightness of the display
video data on the basis of the meta information for display
control.
(18) The reception device according to the
aforementioned (17), in which
10 the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed, and
the brightness adjustment unit adjusts the display
brightness of the field where the display brightness adjustment
15 is allowed.
(19) The reception device according to the
aforementioned (17) or (18), in which
information indicating whether the display brightness
adjustment for the video stream is prohibited is inserted into
20 a layer of the container and/or a layer of the video stream,
and
the brightness adjustment unit does not adjust the
display brightness of the display video data in a case where
the information indicating whether the display brightness
25 adjustment for the video stream is prohibited indicates the
prohibition thereof.
(20) A reception method including:
a reception step of receiving, through a receiver, a
container in a predetermined format including a video stream
30 obtained by encoding transmission video data;
a decoding step of applying decoding processing to the
41
video stream to obtain the transmission video data; and
an electrooptical conversion step of performing
electrooptical conversion on the transmission video data
obtained through the decoding step to obtain display video
5 data, in which
the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic
range data,
meta information indicating an electrooptical
10 conversion characteristic corresponding to a characteristic
of the high dynamic range optoelectrical conversion is inserted
into a parameter set field in the video stream, and
the electrooptical conversion characteristic indicated
by the meta information is used during the electrooptical
15 conversion step.
[0097]
The principal characteristic of the present technology
is to insert the meta information specifying the electrooptical
conversion characteristic corresponding to the high dynamic
20 range optoelectrical conversion characteristic into the SPS
NAL unit in the video stream, thereby ensuring that the
electrooptical conversion processing for the transmission
video data obtained using high dynamic range optoelectrical
conversion characteristic is favorably carried out at the
25 receiving side (refer to Fig. 11).
REFERENCE SIGNS LIST
[0098]
10, 10A Transmission/reception system
30 100 Transmission device
101 Control unit
42
102 HDR camera
103 HDR optoelectrical converter
103a Master monitor
104 Video encoder
5 105 System encoder
106 Transmitter
200 Reception device
200A Set top box
200B Monitor
10 201 Control unit
202 Receiver
203 System decoder
204 Video decoder
205 HDR electrooptical converter
15 206 HDR display mapping unit
207 CE monitor
43
CLAIMS
1. A transmission device comprising:
an optoelectrical converter that performs high dynamic
5 range optoelectrical conversion on high dynamic range video
data to obtain transmission video data;
an encoding unit that applies encoding processing to
the transmission video data to obtain a video stream;
a transmitter that transmits a container in a
10 predetermined format including the video stream; and
an information inserter that inserts meta information
indicating an electrooptical conversion characteristic
corresponding to a characteristic of the high dynamic range
optoelectrical conversion into a parameter set field in the
15 video stream.
2. The transmission device according to claim 1, wherein
the parameter set field is a field in an SPS NAL unit.
20 3. The transmission device according to claim 1, wherein
the information inserter further inserts, into a layer
of the container, identification information indicating that
the video stream supports the high dynamic range.
25 4. The transmission device according to claim 3, wherein
information indicating whether the video stream has
display compatibility with a normal dynamic range is added
to the identification information.
30 5. The transmission device according to claim 3, wherein
information indicating whether display brightness
44
adjustment for the video stream is prohibited is added to the
identification information.
6. The transmission device according to claim 3, wherein
5 the container is a transport stream, and
the information inserter inserts the identification
information into a section belonging to one of a program map
table and an event information table.
10 7. The transmission device according to claim 3, wherein
the container is an MMT stream, and
the information inserter inserts the identification
information into a section belonging to an MMT package table.
15 8. The transmission device according to claim 1, wherein
the information inserter further inserts the meta
information for display control into a field different from
the parameter set field in the video stream.
20 9. The transmission device according to claim 8, wherein
the meta information for display control includes peak
brightness information.
10. The transmission device according to claim 8, wherein
25 the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed.
11. The transmission device according to claim 8, wherein
30 the meta information for display control includes
information indicating whether display brightness adjustment
45
for the video stream is prohibited.
12. The transmission device according to claim 8, wherein
the field different from the parameter set field is a
5 field in an SEI NAL unit.
13. A transmission method comprising:
an optoelectrical conversion step of performing high
dynamic range optoelectrical conversion on high dynamic range
10 video data to obtain transmission video data;
an encoding step of applying encoding processing to the
transmission video data to obtain a video stream;
a transmission step of transmitting a container in a
predetermined format including the video stream through a
15 transmitter; and
an information insertion step of inserting meta
information indicating an electrooptical conversion
characteristic corresponding to a characteristic of the high
dynamic range optoelectrical conversion into a parameter set
20 field in the video stream.
14. A reception device comprising:
a receiver that receives a container in a predetermined
format including a video stream obtained by encoding
25 transmission video data;
a decoding unit that applies decoding processing to the
video stream to obtain the transmission video data; and
an electrooptical converter that performs
electrooptical conversion on the transmission video data
30 obtained at the decoding unit to obtain display video data,
wherein
46
the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic
range data, and
meta information indicating an electrooptical
5 conversion characteristic corresponding to a characteristic
of the high dynamic range optoelectrical conversion is inserted
into a parameter set field in the video stream,
the reception device further comprising an information
extractor that extracts the meta information from the video
10 stream, wherein
the electrooptical converter uses the electrooptical
conversion characteristic indicated by the meta information
extracted at the information extractor.
15 15. The reception device according to claim 14, wherein
the parameter set field is a field in an SPS NAL unit.
16. The reception device according to claim 14, wherein
identification information indicating that the video
20 stream supports the high dynamic range is inserted into a layer
of the container, and
the information extractor extracts the meta information
from the parameter set field in the video stream on the basis
of the identification information.
25
17. The reception device according to claim 14, wherein
the meta information for display control is included
in a field different from the parameter set field in the video
stream,
30 the reception device further comprising a brightness
adjustment unit that adjusts display brightness of the display
47
video data on the basis of the meta information for display
control.
18. The reception device according to claim 17, wherein
5 the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed, and
the brightness adjustment unit adjusts the display
brightness of the field where the display brightness adjustment
10 is allowed.
19. The reception device according to claim 17, wherein
information indicating whether the display brightness
adjustment for the video stream is prohibited is inserted into
15 a layer of the container and/or a layer of the video stream,
and
the brightness adjustment unit does not adjust the
display brightness of the display video data in a case where
the information indicating whether the display brightness
20 adjustment for the video stream is prohibited indicates the
prohibition thereof.
20. A reception method comprising:
a reception step of receiving, through a receiver, a
25 container in a predetermined format including a video stream
obtained by encoding transmission video data;
a decoding step of applying decoding processing to the
video stream to obtain the transmission video data; and
an electrooptical conversion step of performing
30 electrooptical conversion on the transmission video data
obtained through the decoding step to obtain display video
48
data, wherein
the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic
range data,
5 meta information indicating an electrooptical
conversion characteristic corresponding to a characteristic
of the high dynamic range optoelectrical conversion is inserted
into a parameter set field in the video stream, and
the electrooptical conversion characteristic indicated
10 by the meta information is used during the electrooptical
conversion step.

Documents

Application Documents

# Name Date
1 Priority Document [22-06-2017(online)].pdf 2017-06-22
2 Power of Attorney [22-06-2017(online)].pdf 2017-06-22
3 Form 5 [22-06-2017(online)].pdf 2017-06-22
4 Form 3 [22-06-2017(online)].pdf 2017-06-22
5 Form 1 [22-06-2017(online)].pdf 2017-06-22
6 Drawing [22-06-2017(online)].pdf 2017-06-22
7 Description(Complete) [22-06-2017(online)].pdf_34.pdf 2017-06-22
8 Description(Complete) [22-06-2017(online)].pdf 2017-06-22
9 201727021850-ORIGINAL UNDER RULE 6 (1A)-27-06-2017.pdf 2017-06-27
10 201727021850-FORM 3 [16-11-2017(online)].pdf 2017-11-16
11 ABSTRACT 1.jpg 2018-08-11
12 201727021850.pdf 2018-08-11
13 201727021850-FORM 18 [04-12-2018(online)].pdf 2018-12-04
14 201727021850-FER.pdf 2020-03-11
15 201727021850-OTHERS [09-09-2020(online)].pdf 2020-09-09
16 201727021850-FER_SER_REPLY [09-09-2020(online)].pdf 2020-09-09
17 201727021850-COMPLETE SPECIFICATION [09-09-2020(online)].pdf 2020-09-09
18 201727021850-CLAIMS [09-09-2020(online)].pdf 2020-09-09
19 201727021850-US(14)-HearingNotice-(HearingDate-04-08-2023).pdf 2023-06-30
20 201727021850-FORM-26 [01-08-2023(online)].pdf 2023-08-01
21 201727021850-Correspondence to notify the Controller [01-08-2023(online)].pdf 2023-08-01
22 201727021850-Written submissions and relevant documents [17-08-2023(online)].pdf 2023-08-17
23 201727021850-PETITION UNDER RULE 137 [17-08-2023(online)].pdf 2023-08-17
24 201727021850-MARKED COPY [17-08-2023(online)].pdf 2023-08-17
25 201727021850-CORRECTED PAGES [17-08-2023(online)].pdf 2023-08-17
26 201727021850-PatentCertificate18-10-2023.pdf 2023-10-18
27 201727021850-IntimationOfGrant18-10-2023.pdf 2023-10-18

Search Strategy

1 2020-03-1113-47-12E_11-03-2020.pdf

ERegister / Renewals

3rd: 12 Jan 2024

From 16/12/2017 - To 16/12/2018

4th: 12 Jan 2024

From 16/12/2018 - To 16/12/2019

5th: 12 Jan 2024

From 16/12/2019 - To 16/12/2020

6th: 12 Jan 2024

From 16/12/2020 - To 16/12/2021

7th: 12 Jan 2024

From 16/12/2021 - To 16/12/2022

8th: 12 Jan 2024

From 16/12/2022 - To 16/12/2023

9th: 12 Jan 2024

From 16/12/2023 - To 16/12/2024

10th: 23 Oct 2024

From 16/12/2024 - To 16/12/2025