Description
Title of Invention
REPRODUCTION DEVICE, REPRODUCTION METHOD, AND RECORDING
5 MEDIUM
Technical Field
[0001]
The present technology relates to a reproduction device, a reproduction
10 method, and a recording medium and, in particular, relates to a reproduction device,
a reproduction method, and a recording medium that enable content having a wide
dynamic range of brightness to be displayed with an appropriate brightness.
Background Art
15 [0002]
There is a Blu-ray (registered trademark) Disc (hereinafter, as appropriate,
referred to as a BD) serving as a recording medium of content such as a movie.
Hitherto, in authoring a video recorded on a BD, a dynamic range of the master video
is compressed on the premise that the video is viewed on a monitor with a standard
20 brightness (100 nit = 100 cd/m2).
[0003]
The video that is to be the master is taken by a high-quality camera and
includes a dynamic range that is equivalent to or greater than a dynamic range that
can be displayed on a monitor with the standard brightness. It goes without saying
25 that the dynamic range of the master video is deteriorated by being compressed.
Citation List
Patent Literature
[0004]
30 Patent Literature1: JP 2009-58692A
Patent Literature2: JP 2009-89209A
3
Summary of Invention
Technical Problem
[0005]
Owing to technological progresses in displays 5 such as organic
electroluminescence (EL) displays and liquid crystal displays (LCDs), monitors with
brightness, such as 500 nit and 1000 nit, that is brighter than standard monitors are
commercially available. Content that can take advantage of the performance of
such monitors having such a wide dynamic range is in demand.
10 [0006]
The present technology has been made in view of the above situation and
enables content having a wide dynamic range of brightness to be displayed with an
appropriate brightness.
15 Solution to Problem
[0007]
A reproduction device according to an aspect of the present technology
includes: a readout unit configured to read out, from a recording medium that has
recorded coded data of an extended video that is a video having a second brightness
20 range that is wider than a first brightness range, brightness characteristic information
that represents a brightness characteristic of the extended video, and brightness
conversion definition information used when performing a brightness conversion of
the extended video to a standard video that is a video having the first brightness
range, the coded data, the brightness characteristic information, and the brightness
25 conversion definition information; a decoding unit configured to decode the coded
data; a conversion unit configured to convert the extended video obtained by
decoding the coded data to the standard video on a basis of the brightness conversion
definition information; and an output unit configured to output data of the extended
video and the brightness characteristic information to a display device that is capable
30 of displaying the extended video and configured to output data of the standard video
to a display device that is not capable of displaying the extended video.
4
[0008]
The brightness characteristic information and the brightness conversion
definition information can be inserted, as auxiliary information of the coded data, in
a stream including the coded data and are recorded in the recording medium.
5 [0009]
The coded data can be coded data of an HEVC, and the brightness
characteristic information and the brightness conversion definition information can
be each an SEI of an HEVC stream.
[0010]
10 The brightness conversion definition information can be first Tone mapping
information in which either one of values 0, 2, and 3 is set as a value of a
tone_map_model_id. The brightness characteristic information can be second Tone
mapping information in which 4 is set as the value of the tone_map_model_id.
[0011]
15 The tone_map_model_id of the first Tone mapping information and the
tone_map_model_id of the second Tone mapping information can be each set with a
same value representing a recording mode of the recording medium.
[0012]
Information related to reproduction of the coded data, the information
20 including a flag representing whether a recording of the extended video as a master is
being performed, can be further recorded in the recording medium. When the flag
represents that the recording of the extended video as the master is being performed,
the decoding unit can decode the coded data.
[0013]
25 The recording medium can be a Blu-ray Disc. The flag can be included in
a Clip Information file serving as the information related to the reproduction.
[0014]
The recording medium can be a Blu-ray Disc. The flag can be included in
a PlayList file serving as the information related to the reproduction.
30 [0015]
According to an aspect of the present technology, from a recording medium
5
that has recorded coded data of an extended video that is a video having a second
brightness range that is wider than a first brightness range, brightness characteristic
information that represents a brightness characteristic of the extended video, and
brightness conversion definition information used when performing a brightness
conversion of the extended video to a standard video that is a video 5 having the first
brightness range, the coded data, the brightness characteristic information, and the
brightness conversion definition information are read out. The coded data is
decoded. The extended video obtained by decoding the coded data is converted to
the standard video on a basis of the brightness conversion definition information.
10 Data of the extended video and the brightness characteristic information are output to
a display device that is capable of displaying the extended video. Data of the
standard video is output to a display device that is not capable of displaying the
extended video.
[0016]
15 A reproduction device according to another aspect of the present technology
includes: a readout unit configured to read out, from a recording medium that has
recorded coded data of a standard video that is obtained by performing a brightness
conversion of an extended video that is a video having a second brightness range that
is wider than a first brightness range, the standard video being a video having the
20 first brightness range, brightness characteristic information that represents a
brightness characteristic of the extended video, and brightness conversion definition
information used when performing the brightness conversion of the standard video to
the extended video, the coded data, the brightness characteristic information, and the
brightness conversion definition information; a decoding unit configured to decode
25 the coded data; a conversion unit configured to convert the standard video obtained
by decoding the coded data to the extended video on a basis of the brightness
conversion definition information; and an output unit configured to output data of the
extended video and the brightness characteristic information to a display device that
is capable of displaying the extended video and configured to output data of the
30 standard video to a display device that is not capable of displaying the extended
video.
6
[0017]
The brightness characteristic information and the brightness conversion
definition information can be inserted, as auxiliary information of the coded data, in
a stream including the coded data and are recorded in the recording medium.
5 [0018]
The coded data can be coded data of an HEVC, and the brightness
characteristic information and the brightness conversion definition information can
be each an SEI of an HEVC stream.
[0019]
10 The brightness conversion definition information can be first Tone mapping
information in which either one of values 0, 2, and 3 is set as a value of a
tone_map_model_id. The brightness characteristic information can be second Tone
mapping information in which 4 is set as the value of the tone_map_model_id.
[0020]
15 The tone_map_model_id of the first Tone mapping information and the
tone_map_model_id of the second Tone mapping information can be each set with a
same value representing a recording mode of the recording medium.
[0021]
Information related to reproduction of the coded data, the information
20 including a flag representing whether a recording of the extended video as a master is
being performed, can be further recorded in the recording medium. When the flag
represents that the recording of the extended video as the master is being performed,
the decoding unit can decode the coded data.
[0022]
25 The recording medium can be a Blu-ray Disc. The flag can be included in
a Clip Information file serving as the information related to the reproduction.
[0023]
The recording medium can be a Blu-ray Disc. The flag can be included in
a PlayList file serving as the information related to the reproduction.
30 [0024]
According to another aspect of the present technology, from a recording
7
medium that has recorded coded data of a standard video that is obtained by
performing a brightness conversion of an extended video that is a video having a
second brightness range that is wider than a first brightness range, the standard video
being a video having the first brightness range, brightness characteristic information
that indicates a brightness characteristic of the extended video, 5 and brightness
conversion definition information used when performing the brightness conversion
of the standard video to the extended video, the coded data, the brightness
characteristic information, and the brightness conversion definition information are
read out. The coded data is decoded. The standard video obtained by decoding
10 the coded data is converted to the extended video on a basis of the brightness
conversion definition information. Data of the extended video and the brightness
characteristic information are output to a display device that is capable of displaying
the extended video. Data of the standard video is output to a display device that is
not capable of displaying the extended video.
15
Advantageous Effects of Invention
[0025]
According to the present technology, content having a wide dynamic range
of brightness can be displayed with an appropriate brightness.
20
Brief Description of Drawings
[0026]
[FIG. 1] FIG. 1 is a diagram illustrating an exemplary configuration of a
recording/reproduction system according to an embodiment of the present technology.
25 [FIG. 2] FIG. 2 is a diagram illustrating an example of signal processing in mode-i.
[FIG. 3] FIG. 3 is a diagram illustrating a flow of a signal processed in mode-i.
[FIG. 4] FIG. 4 is a diagram illustrating an example of signal processing in mode-ii.
[FIG. 5] FIG. 5 is a diagram illustrating a flow of a signal processed in mode-ii.
[FIG. 6] FIG. 6 is a diagram illustrating a configuration of an access unit of an HEVC.
30 [FIG. 7] FIG. 7 is a diagram illustrating syntax of Tone mapping information.
[FIG. 8] FIG. 8 is a diagram illustrating an example of information used as tone
8
mapping definition information and HDR information.
[FIG. 9] FIG. 9 is a diagram illustrating an example of a tone curve drawn with the
tone mapping information of tone_map_model_id = 0.
[FIG. 10] FIG. 10 is a diagram illustrating an example of a step function drawn with
the tone mapping information of tone_5 map_model_id = 2.
[FIG. 11] FIG. 11 is a diagram illustrating an example of a polygonal line function
drawn with the tone mapping information of tone_map_model_id = 3.
[FIG. 12] FIG. 12 is a diagram illustrating an example of each pieces of information
included in the HDR information.
10 [FIG. 13] FIG. 13 is a diagram illustrating an example of a management structure of
an AV stream in BD-ROM format.
[FIG. 14] FIG. 14 is a diagram illustrating a structures of Main Path and Sub Paths.
[FIG. 15] FIG. 15 is a diagram illustrating an example of a management structure of a
file.
15 [FIG. 16] FIG. 16 is a diagram illustrating syntax of a PlayList file.
[FIG. 17] FIG. 17 is a diagram illustrating syntax of a Clip Information file.
[FIG. 18] FIG. 18 is a diagram illustrating syntax of ProgramInfo () in FIG. 17.
[FIG. 19] FIG. 19 is a diagram illustrating syntax of StreamCodingInfo in FIG. 18.
[FIG. 20] FIG. 20 is a block diagram illustrating an exemplary configuration of a
20 recording device.
[FIG. 21] FIG. 21 is a block diagram illustrating an exemplary configuration of an
coding processing unit in FIG. 20.
[FIG. 22] FIG. 22 is a diagram illustrating an example of signal processing performed
by an HDR-STD conversion unit.
25 [FIG. 23] FIG. 23 is a diagram illustrating an example of tone mapping.
[FIG. 24] FIG. 24 is a block diagram illustrating an exemplary configuration of a
reproduction device.
[FIG. 25] FIG. 25 is a block diagram illustrating an exemplary configuration of a
decoding processing unit in FIG. 24.
30 [FIG. 26] FIG. 26 is a block diagram illustrating an exemplary configuration of a
display device.
9
[FIG. 27] FIG. 27 is a flowchart illustrating recording processing of the recording
device.
[FIG. 28] FIG. 28 is a flowchart illustrating coding processing in mode-i performed in
step S2 in FIG. 27.
[FIG. 29] FIG. 29 is a flowchart illustrating coding processing 5 in mode-ii performed
in step S3 in FIG. 27.
[FIG. 30] FIG. 30 is a flowchart illustrating Data Base information generation
processing performed in step S4 in FIG. 27.
[FIG. 31] FIG. 31 is a flowchart illustrating reproduction processing of the
10 reproduction device.
[FIG. 32] FIG. 32 is a flowchart illustrating the decoding processing in mode-i
performed in step S44 in FIG. 31.
[FIG. 33] FIG. 33 is a flowchart illustrating the decoding processing in mode-ii
performed in step S45 in FIG. 31.
15 [FIG. 34] FIG. 34 is a flowchart illustrating display processing of the display device.
[FIG. 35] FIG. 35 is a diagram illustrating an example of syntax of AppInfoPlayList
() included in the PlayList file in FIG. 16.
[FIG. 36] FIG. 36 is a diagram illustrating syntax of PlayList () included in the
PlayList file in FIG. 16.
20 [FIG. 37] FIG. 37 is a diagram illustrating syntax of PlayItem () in FIG. 36.
[FIG. 38] FIG. 38 is a diagram illustrating syntax of STN_table () in FIG. 37.
[FIG. 39] FIG. 39 is a diagram illustrating syntax of stream_attributes () in FIG. 38.
[FIG. 40] FIG. 40 is a diagram illustrating an example of an allocation of PSR.
[FIG. 41] FIG. 41 is a diagram illustrating an example of signal processing in mode-i
25 in a case in which an adjustment of a brightness of an HDR video is performed on a
reproduction device side.
[FIG. 42] FIG. 42 is a diagram illustrating an example of signal processing in mode-ii
in a case in which an adjustment of the brightness of the HDR video is performed on
a reproduction device side.
30 [FIG. 43] FIG. 43 is a block diagram illustrating an exemplary configuration of an
HDR video output unit in FIG. 25.
10
[FIG. 44] FIG. 44 is a flowchart illustrating the decoding processing in mode-i
performed in step S44 in FIG. 31.
[FIG. 45] FIG. 45 is a flowchart illustrating the decoding processing in mode-ii
performed in step S45 in FIG. 31.
[FIG. 46] FIG. 46 is a flowchart illustrating the display processing 5 of the display
device.
[FIG. 47] FIG. 47 is a diagram illustrating an example of a recognition on the basis of
information transmitted and received through HDMI.
[FIG. 48] FIG. 48 is a diagram illustrating another example of the recognition on the
10 basis of the information transmitted and received through the HDMI.
[FIG. 49] FIG. 49 is a diagram illustrating an example of HDR EDID.
[FIG. 50] FIG. 50 is a diagram illustrating an example of HDR InfoFrame.
[FIG. 51] FIG. 51 is a flowchart illustrating setting processing of the HDR EDID of
the display device.
15 [FIG. 52] FIG. 52 is a flowchart illustrating the reproduction processing of the
reproduction device.
[FIG. 53] FIG. 53 is a flowchart illustrating HDR/raw output processing performed in
step S227 in FIG. 52.
[FIG. 54] FIG. 54 is a flowchart illustrating HDR/cooked output processing
20 performed in step S228 in FIG. 52.
[FIG. 55] FIG. 55 is a flowchart illustrating STD output processing performed in step
S229 in FIG. 52.
[FIG. 56] FIG. 56 is a flowchart illustrating the display processing of the display
device.
25 [FIG. 57] FIG. 57 is a block diagram illustrating an exemplary configuration of a
computer.
Description of Embodiments
[0027]
30 Hereinafter, a mode to implement the present technology will be described.
The description will be given in the following order.
11
1. Recording/Reproduction System
2. HEVC
3. BD Format
4. Configuration of Each Device
5. Operation 5 of Each Device
6. Modifications
7. Exemplary Case in Which Brightness Is Adjusted on Reproduction
Device Side
8. Exemplary Application to HDMI
10 9. Other Modifications
[0028]
<1. Recording/Reproduction System>
FIG. 1 is a diagram illustrating an exemplary configuration of a
recording/reproduction system according to an embodiment of the present technology.
15 [0029]
The recording/reproduction system in FIG. 1 includes a recording device 1,
a reproduction device 2, and a display device 3. The reproduction device 2 and the
display device 3 are connected to each other through a high-definition multimedia
interface (HDMI) (registered trademark) cable 4. The reproduction device 2 and
20 the display device 3 may be connected to each other through a cable of another
standard or may be connected via radio communication.
[0030]
The recording device 1 records content, and the reproduction device 2
reproduces the content. An optical disc 11 is used to provide the content from the
25 recording device 1 to the reproduction device 2. The optical disc 11 is a disc on
which the content is recorded in a Blu-ray (registered trademark) Disc Read-Only
(BD-ROM) Format, for example.
[0031]
The content may be recorded on the optical disc 11 in another format such
30 as a BD-R or BD-RE format. Furthermore, the content may be provided from the
recording device 1 to the reproduction device 2 by using a removable media other
12
than an optical disc, such as a memory card mounted with a flash memory.
[0032]
When the optical disc 11 is a BD-ROM disc, the recording device 1 is a
device used by the author of the content, for example. Hereinafter, while a
description will be appropriately given assuming that the optical disc 5 11 on which the
content has been recorded with the recording device 1 is provided to the reproduction
device 2, in actuality, an optical disc 11 that is one of the optical discs that are copies
of a master disc on which the content is recorded with the recording device 1 is
provided to the reproduction device 2.
10 [0033]
A high dynamic range (HDR) video that is a video having a dynamic range
that is equivalent to or greater than a dynamic range (a brightness range) that can be
displayed on a monitor having a standard brightness is input to the recording device
1. The standard brightness is 100 cd/m2 (= 100 nit).
15 [0034]
The recording device 1 records, on the optical disc 11, the input master
HDR video as it is, that is, as a video having a dynamic range that is equivalent to or
greater than the dynamic range that can be displayed on a monitor with a standard
brightness. In such a case, information representing the brightness characteristic of
20 the master HDR video and, also, information used when converting an HDR video to
an STD video are recorded on the optical disc 11.
[0035]
A standard video (the STD video) is a video having a dynamic range that
can be displayed on a monitor having a standard brightness. When the dynamic
25 range of the STD video is 0-100%, the dynamic range of the HDR video is expressed
as a range of 0% to 101% or more, such as 0-500% or 0-1000%.
[0036]
Furthermore, after converting the input master HDR video to an STD video,
that is, after converting the input master HDR video to a video that has a dynamic
30 range that is capable of being displayed on a monitor having a standard brightness,
the recording device 1 records the video on the optical disc 11. In such a case,
13
information representing the brightness characteristic of the master HDR video and,
also, information used when converting an STD video to an HDR video are recorded
on the optical disc 11.
[0037]
The HDR video that the recording device 1 records or 5 the STD video that is
obtained by converting the HDR video are videos having a so-called 4K resolution in
which the horizontal/vertical resolution is 4096/2160 pixels, 3840/2160 pixels, or the
like. For example, High Efficiency Video Coding (HEVC) is used in coding the
video data with the recording device 1.
10 [0038]
Information representing the brightness characteristic of the master HDR
video and information used when converting an HDR video to an STD video or
when converting an STD video to an HDR video are inserted into the coded data of
the HEVC as supplemental enhancement information (SEI). An HEVC stream,
15 which is coded data of HEVC in which the SEI is inserted, is recorded on the optical
disc 11 in BD format.
[0039]
The reproduction device 2 communicates with the display device 3 through
the HDMI cable 4 and acquires information related to the display performance of the
20 display device 3. The reproduction device 2 specifies whether the display device 3
is a device having an HDR monitor that is a monitor that is capable of displaying an
HDR video or whether the display device 3 is a device having an STD monitor that is
a monitor that can only display an STD video.
[0040]
25 Furthermore, the reproduction device 2 drives a drive and reads out and
decodes the HEVC stream recorded on the optical disc 11.
[0041]
For example, when the video data obtained through decoding is data of an
HDR video and when the display device 3 includes an HDR monitor, the
30 reproduction device 2 outputs the data of the HDR video obtained through decoding
the HEVC stream to the display device 3. In such a case, the reproduction device 2
14
outputs, together with the data of the HDR video, data representing the brightness
characteristic of the master HDR video to the display device 3.
[0042]
On the other hand, when the video data obtained through decoding is data of
an HDR video and when the display device 3 includes 5 an STD monitor, the
reproduction device 2 converts the HDR video, which has been obtained by decoding
the HEVC stream, to an STD video and outputs the data of the STD video. The
conversion of the HDR video to an STD video is performed by using information
that is recorded on the optical disc 11 and that is used when converting an HDR
10 video to an STD video.
[0043]
When the video data obtained through decoding is data of an STD video and
when the display device 3 includes an HDR monitor, the reproduction device 2
converts the STD video, which has been obtained by decoding the HEVC stream, to
15 an HDR video and outputs the data of the HDR video to the display device 3. The
conversion of the STD video to an HDR video is performed by using information
that is recorded on the optical disc 11 and that is used when converting an STD video
to an HDR video. In such a case, the reproduction device 2 outputs, together with
the HDR video, data representing the brightness characteristic of the master HDR
20 video to the display device 3.
[0044]
On the other hand, when the video data obtained through decoding is data of
an STD video and when the display device 3 includes an STD monitor, the
reproduction device 2 outputs the data of the STD video obtained through decoding
25 the HEVC stream to the display device 3.
[0045]
The display device 3 receives video data transmitted from the reproduction
device 2 and displays an image of the content on the monitor. Audio data of the
content is also transmitted from the reproduction device 2. On the basis of the
30 audio data transmitted from the reproduction device 2, the display device 3 outputs
audio of the content from a loudspeaker.
15
[0046]
For example, when information representing the brightness characteristic of
the master HDR video is transmitted together with the video data, the display device
3 recognizes that the video data transmitted from the reproduction device 2 is data of
an HDR video. As described above, information representing 5 the brightness
characteristic of the master HDR video is transmitted together with the data of the
HDR video to the display device 3 including an HDR monitor.
[0047]
In such a case, the display device 3 displays the image of the HDR video in
10 accordance with the characteristics specified by the information representing the
brightness characteristic of the master HDR video. In other words, when the
monitor included in the display device 3 is a monitor having a dynamic range of 0-
500% and when the dynamic range of the HDR video is designated to have a
predetermined characteristic of 0-500% from the information representing the
15 brightness characteristic of the master HDR video, then in accordance with the
predetermined characteristic, the display device 3 displays an image while adjusting
the brightness in the range of 0-500%.
[0048]
By enabling the brightness characteristic of the master HDR video to be
20 designated, the author of the content is capable of displaying an image at an intended
brightness.
[0049]
Typically, a display device such as a TV recognizes the video input from the
outside as a video having a dynamic range of 0-100%. Furthermore, when the
25 monitor of the display device has a dynamic range that is wider than the input video,
the display device displays the image while disadvantageously extending the
brightness in accordance with the characteristics of the monitor. By designating the
brightness characteristic and by adjusting the brightness of the HDR video according
to the designated characteristic, an adjustment of the brightness unintended by the
30 author can be prevented from being performed on the display device side.
[0050]
16
Furthermore, a reproduction device that outputs a video on a display device
such as a TV typically outputs the video after converting the brightness in
accordance with the characteristics of the transmission line. The display device that
has received the video will display the image after converting the brightness of the
received video in accordance with the characteristics of 5 the monitor. By not
converting the brightness in the reproduction device 2 and by having the HDR video
from the reproduction device 2 be output as it is on the display device 3, the number
of brightness conversions can be reduced and an image with a brightness that is more
close to the master can be displayed on the display device 3.
10 [0051]
Meanwhile, when the video data transmitted from the reproduction device 2
is data of an STD video, the display device 3 displays an image of the STD video.
An STD video being transmitted from the reproduction device 2 indicates that the
display device 3 is a device including an STD monitor.
15 [0052]
Hereinafter, as appropriate, a mode in which the master HDR video is
recorded on the optical disc 11 as it is will be referred to as mode-i. In mode-i,
information representing the brightness characteristic of the master HDR video and
information used when converting an HDR video to an STD video are recorded on
20 the optical disc 11.
[0053]
Furthermore, a mode in which the master HDR video is recorded on the
optical disc 11 after being converted to an STD video will be referred to as mode-ii.
In mode-ii, information representing the brightness characteristic of the master HDR
25 video and information used when converting an STD video to an HDR video are
recorded on the optical disc 11.
[0054]
[Signal processing in mode-i]
FIG. 2 is a diagram illustrating an example of signal processing in mode-i.
30 [0055]
The processing on the left side illustrated by surrounding a solid line L1
17
illustrates coding processing performed in the recording device 1, and the processing
on the right side illustrated by surrounding a solid line L2 illustrates decoding
processing performed in the reproduction device 2.
[0056]
When a master HDR video is input, the recording 5 device 1 detects the
brightness of the master HDR video and, as illustrated at the end of arrow #1, HDR
information that is information representing the brightness characteristic of the
master HDR video is generated. Furthermore, as illustrated at the end of arrow #2,
the recording device 1 performs coding on the master HDR video by HEVC.
10 [0057]
As illustrated at the end of arrow #3, the recording device 1 converts the
master HDR video to an STD video. An image of the STD video obtained by the
conversion is displayed on a monitor (not shown). The conversion of the HDR
video to the STD video is carried out, as appropriate, while the author visually
15 checks the image of the STD video after the conversion and while adjusting the
conversion parameter.
[0058]
As illustrated at the end of arrow #4, on the basis of the adjustment
performed by the author, the recording device 1 generates tone mapping definition
20 information for HDR-STD conversion that is used when converting an HDR video to
an STD video.
[0059]
The tone mapping definition information is information that defines the
correlation between each pixel value representing the brightness of the dynamic
25 range of 0-400% or the like that is a dynamic range that is wider than the standard
dynamic range and each pixel value representing the brightness of the dynamic range
of 0-100% that is the standard dynamic range.
[0060]
As illustrated at the end of arrow #5, the recording device 1 generates an
30 HEVC stream by inserting the HDR information and the tone mapping definition
information as SEI into the coded data of the HEVC. The recording device 1
18
records the generated HEVC stream on the optical disc 11 in BD format and, as
illustrated by arrow #11, provides the HEVC stream to the reproduction device 2.
[0061]
As described above, information representing the brightness characteristic
of the master HDR video and information used when converting 5 an HDR video to an
STD video are provided to the reproduction device 2 in the form of insertion into the
stream by using the SEI of the HEVC.
[0062]
The reproduction device 2 reads out the HEVC stream from the optical disc
10 11 and, as illustrated at the ends of arrows #21 and #22, extracts the HDR
information and the tone mapping definition information from the SEI of the HEVC
stream.
[0063]
Furthermore, as illustrated at the end of arrow #23, the reproduction device
15 2 decodes the coded data of the HEVC. As illustrated at the end of arrow #24,
when the display device 3 includes an HDR monitor, the reproduction device 2 adds
the HDR information to the data of the HDR video obtained by decoding the coded
data and, as illustrated at the end of arrow #25, outputs the data to the display device
3.
20 [0064]
On the other hand, as illustrated at the end of arrow #26, when the display
device 3 includes an STD monitor, the reproduction device 2 converts the HDR
video, which has been obtained by decoding the coded data, to an STD video by
using the tone mapping definition information for HDR-STD conversion extracted
25 from the HEVC stream. As illustrated at the end of arrow #27, the reproduction
device 2 outputs the data of the STD video, which has been obtained by the
conversion, to the display device 3.
[0065]
As described above, the HDR video data obtained by decoding the coded
30 data of the HEVC is, together with the HDR information, output to the display
device 3 including an HDR monitor. Furthermore, the HDR video data obtained by
19
decoding the coded data of the HEVC is, after being converted to an STD video,
output to the display device 3 including an STD monitor.
[0066]
FIG. 3 is a diagram illustrating a flow of a process from when the master
HDR video is input to the recording device 1 until the video data 5 is output from the
reproduction device 2.
[0067]
As illustrated at the end of hollow arrow #51, the master HDR video is
provided to the reproduction device 2 together with the HDR information and the
10 tone mapping definition information for HDR-STD conversion that are generated in
the recording device 1 on the basis of the master HDR video. Information
representing that the dynamic range is extended to a range of 0-400%, for example,
is included in the HDR information.
[0068]
15 When the display device 3 includes an HDR monitor, as illustrated at the
ends of arrows #52 and #53, in the reproduction device 2, the HDR information is
added to the HDR video data that has been obtained by decoding the coded data of
the HEVC. Furthermore, as illustrated at the end of arrow #54, the HDR video data
to which the HDR information has been added is output to the display device 3.
20 [0069]
On the other hand, when the display device 3 includes an STD monitor, as
illustrated at the ends of arrows #55 and #56, in the reproduction device 2, the HDR
video that has been obtained by decoding the coded data of the HEVC is converted to
an STD video by using the tone mapping definition information for HDR-STD
25 conversion. Furthermore, as illustrated at the end of arrow #57, the STD video data
obtained by the conversion is output to the display device 3. In FIG. 3, the
waveform amplitude representing the HDR video and the waveform amplitude
representing the STD video each represents a dynamic range.
[0070]
30 As described above, in mode-i, the master HDR video is recorded on the
optical disc 11 as it is. Furthermore, switching between outputting the HDR video,
20
which has been obtained by decoding the coded data, as it is after adding the HDR
information, and outputting the HDR video after converting to an STD video can be
performed according to the performance of the display device 3 serving as an output
destination.
5 [0071]
[Signal processing in mode-ii]
FIG. 4 is a diagram illustrating an example of signal processing in mode-ii.
[0072]
When a master HDR video is input, the recording device 1 detects the
10 brightness of the master HDR video and, as illustrated at the end of arrow #71, HDR
information is generated.
[0073]
As illustrated at the end of the arrow #72, the recording device 1 converts
the master HDR video to an STD video. An image of the STD video obtained by
15 the conversion is displayed on a monitor (not shown).
[0074]
As illustrated at the end of arrow #73, on the basis of the adjustment
performed by the author, the recording device 1 generates tone mapping definition
information for STD-HDR conversion that is used when converting an STD video to
20 an HDR video.
[0075]
Furthermore, as illustrated at the end of the arrow #74, the recording device
1 performs coding on the STD video, which has been obtained by converting the
master HDR video, by HEVC.
25 [0076]
As illustrated at the end of arrow #75, the recording device 1 generates an
HEVC stream by inserting the HDR information and the tone mapping definition
information as SEI into the coded data of the HEVC. The recording device 1
records the generated HEVC stream on the optical disc 11 in BD format and, as
30 illustrated by arrow #91, provides the HEVC stream to the reproduction device 2.
[0077]
21
The reproduction device 2 reads out the HEVC stream from the optical disc
11 and, as illustrated at the ends of arrows #101 and #102, extracts the HDR
information and the tone mapping definition information from the SEI of the HEVC
stream.
5 [0078]
Furthermore, as illustrated at the end of arrow #103, the reproduction device
2 decodes the coded data of the HEVC. As illustrated at the end of arrow #104,
when the display device 3 includes an STD monitor, the reproduction device 2
outputs the STD video data obtained by decoding the coded data to the display
10 device 3.
[0079]
On the other hand, as illustrated at the end of arrow #105, when the display
device 3 includes an HDR monitor, the reproduction device 2 converts the STD
video, which has been obtained by decoding the coded data, to an HDR video by
15 using the tone mapping definition information for STD-HDR conversion extracted
from the HEVC stream. As illustrated at the end of arrow #106, the reproduction
device 2 adds the HDR information to the data of the HDR video obtained by the
conversion and, as illustrated at the end of arrow #107, outputs the data to the display
device 3.
20 [0080]
As described above, the STD video data obtained by decoding the coded
data of the HEVC is, after being converted to an HDR video, output to the display
device 3 including an HDR monitor together with the HDR information.
Furthermore, the STD video data obtained by decoding the coded data of the HEVC
25 is output as it is to the display device 3 including an STD monitor.
[0081]
FIG. 5 is a diagram illustrating a flow of a process from when the master
HDR video is input to the recording device 1 until the video data is output from the
reproduction device 2.
30 [0082]
As illustrated at the end of hollow arrow #121, after being converted to an
22
STD video, the master HDR video is provided to the reproduction device 2 together
with the HDR information and the tone mapping definition information for STDHDR
conversion that are generated in the recording device 1 on the basis of the
master HDR video.
5 [0083]
When the display device 3 includes an HDR monitor, as illustrated at the
ends of arrows #122 and #123, in the reproduction device 2, the STD video that has
been obtained by decoding the coded data of the HEVC is converted to an HDR
video by using the tone mapping definition information for STD-HDR conversion.
10 Furthermore, as illustrated at the ends of arrows #124 and #125, the HDR
information is added to the data of the HDR video obtained by the conversion of the
STD video and, as illustrated at the end of arrow #126, the data is output to the
display device 3.
[0084]
15 On the other side, when the display device 3 includes an STD monitor, as
illustrated at the end of arrows #127, in the reproduction device 2, the STD video
data that has been obtained by decoding the coded data of the HEVC is output to the
display device 3.
[0085]
20 As described above, in mode-ii, the master HDR video is converted to an
STD video and is recorded on the optical disc 11. Furthermore, switching between
outputting the STD video, which has been obtained by decoding the coded data, after
converting the STD video to an HDR video and adding HDR information, and
outputting the STD video as it is is performed according to the performance of the
25 display device 3 serving as an output destination.
[0086]
Detailed configurations and operations of such recording device 1 and
reproduction device 2 will be described later.
[0087]
30 <2. HEVC>
Herein, a description of the HEVC will be given.
23
[0088]
FIG. 6 is a diagram illustrating a configuration of an access unit of the
HEVC.
[0089]
An HEVC stream is configured of an access unit that is 5 a group of network
abstraction layer (NAL) units. Video data of a single picture is included in a single
access unit.
[0090]
As illustrated in FIG. 6, a single access unit is configured of an access unit
10 delimiter (AU delimiter), a video parameter set (VPS), a sequence parameter set
(SPS), a picture parameter set (PPS), an SEI, a video coding layer (VCL), an end of
sequence (EOS), and an end of stream (EOS).
[0091]
The AU delimiter represents the head of the access unit. The VPS includes
15 metadata representing the content of the bitstream. The SPS includes information,
such as the picture size, the coding tree block (CTB) size, and the like that the HEVC
decoder needs to refer to through the decoding processing of the sequence. The
PPS includes information that needs to be referred to in order for the HEVC decoder
to execute the decoding processing of the picture. The VPS, the SPS, and the PPS
20 are used as the header information.
[0092]
The SEI is auxiliary information including information related to timing
information and random access of each picture, and the like. The HDR information
and the tone mapping definition information are included in Tone mapping
25 information that is one of the SEIs. The VCL is data of a single picture. The end
of sequence (EOS) represents the end position of the sequence and the end of stream
(EOS) represents the end position of the stream.
[0093]
FIG. 7 is a diagram illustrating syntax of the Tone mapping information.
30 [0094]
The brightness and the color of the picture obtained by decoding are
24
converted in accordance with the performance of the monitor serving as an output
destination of the picture by using the Tone mapping information. Note that the line
numbers and the colons (:) on the left side in FIG. 7 are described for convenience of
description and are not information included in the Tone mapping information.
Main information included in the Tone mapping information 5 will be described.
[0095]
Tone_map_id on the second line is identification information of the Tone
mapping information. An object of the Tone mapping information is identified by
the tone_map_id.
10 [0096]
For example, an ID for mode-i and an ID for mode-ii are secured. When
the recording mode is mode-i, an ID for mode-i is set in the tone_map_id of the Tone
mapping information that is inserted into the SEI of the coded data of the HDR video.
Furthermore, when the recording mode is mode-ii, an ID for mode-ii is set in the
15 tone_map_id of the Tone mapping information that is inserted into the SEI of the
coded data of the STD video. In the optical disc 11, either of the IDs among the ID
for mode-i and the ID for mode-ii is set in the tone_map_id.
[0097]
Tone_map_model_id on the eighth line represents a model of the tone map
20 used to convert the coded data.
[0098]
In the recording device 1, a single Tone mapping information in which
either one of 0, 2, and 3 is set as the value of the tone_map_model_id, and a single
Tone mapping information in which 4 is set as the value of the tone_map_model_id
25 are generated.
[0099]
As illustrated in FIG. 8, the Tone mapping information in which either one
of the values 0, 2, and 3 is set as the tone_map_model_id is used as the tone mapping
definition information for HDR-STD conversion or for STD-HDR conversion.
30 Furthermore, information included in the Tone mapping information in which 4 is set
as the value of the tone_map_model_id is used as the HDR information.
25
[0100]
Lines 9 to 11 in FIG. 7 are a description relating to tone_map_model_id = 0.
When tone_map_model_id = 0, min_value and max_value are described.
[0101]
FIG. 9 is a diagram illustrating an example of a tone curve 5 drawn with the
Tone mapping information of tone_map_model_id = 0.
[0102]
The axis of abscissas in FIG. 9 represents coded_data (an RGB value before
conversion) and the axis of ordinates represents target_data (an RGB value after
10 conversion). When the tone curve in FIG. 9 is used, as indicated by hollow arrow
#151, the RGB value equivalent to or below coded_data D1 is converted to an RGB
value expressed by min_value. Furthermore, as indicated by hollow arrow #152,
the RGB value equivalent to or above coded_data D2 is converted to an RGB value
expressed by max_value.
15 [0103]
The tone mapping information of tone_map_model_id = 0 is used as the
tone mapping definition information for HDR-STD conversion. When the Tone
mapping information of tone_map_model_id = 0 is used, the brightness (the
brightness expressed by RGB values) equivalent to or above max_value and
20 equivalent to or below min_value are lost; however, the load on the conversion
processing becomes lighter.
[0104]
Lines 15 to 17 in FIG. 7 are a description relating to tone_map_model_id =
2. Tone_map_model_id = 2 draws a step function and the number of
25 start_of_coded_interval[i] that is the same as the number of max_target_data is
described.
[0105]
FIG. 10 is a diagram illustrating an example of a step function drawn with
the Tone mapping information of tone_map_model_id = 2.
30 [0106]
When the step function in FIG. 10 is used, coded_data = 5 is converted to
26
target_data = 3, for example. When start_of_coded_interval[i] is {1, 3, 4, 5, 5, 5, 7,
7 ...}, a conversion table of the coded_data-target_data is expressed as {0, 1, 1, 2, 3,
5, 5 ...}.
[0107]
The tone mapping information of tone_map_model_id 5 = 2 is used as the
tone mapping definition information for STD-HDR conversion or for HDR-STD
conversion. Since the amount of data of the Tone mapping information of
tone_map_model_id = 2 is large, when creating the tone_map_model_id = 2,
convolution with the conversion table needs to be performed; however, the load on
10 the conversion processing is light.
[0108]
Lines 18 to 23 in FIG. 7 are a description relating to tone_map_model_id =
3. When tone_map_model_id = 3, the coded_pivot_value[i] and
target_pivot_value[i], the numbers of which are designated by num_pivots, that draw
15 a polygonal line function are described.
[0109]
FIG. 11 is a diagram illustrating an example of a polygonal line function
drawn with the Tone mapping information of tone_map_model_id = 3.
[0110]
20 When the polygonal line function in FIG. 11 is used, the coded_data = D11
is converted to target_data = D11', and the coded_data = D12 is converted to
target_data = D12', for example. The tone mapping information of
tone_map_model_id = 3 is used as the tone mapping definition information for STDHDR
conversion or for HDR-STD conversion.
25 [0111]
As described above, the Tone mapping information in which either one of
the values 0, 2, and 3 is set as the tone_map_model_id is used as the tone mapping
definition information for STD-HDR conversion or for HDR-STD conversion and is
transmitted to the reproduction device 2 from the recording device 1.
30 [0112]
Lines 24 to 39 in FIG. 7 are a description relating to tone_map_model_id =
27
4. Among the information related to tone_map_model_id = 4,
ref_screen_luminance_white, extended_range_white_level,
nominal_black_level_code_value, nominal_white_level_code_value, and
extended_white_level_code_value are parameters configuring the HDR information.
5 [0113]
FIG. 12 is a diagram illustrating an example of each pieces of information
included in the HDR information.
[0114]
The axis of abscissas in FIG. 12 represents pixel values of the RGB. When
10 the bit length is 10 bits, each pixel value is a value in the rage of 0-1023. The axis
of ordinates in FIG. 12 represents brightness. Curve L11 represents the relationship
between the pixel value and the brightness of a monitor with a standard brightness.
The dynamic range of the monitor with a standard brightness is 0-100%.
[0115]
15 The ref_screen_luminance_white represents the brightness (cd/m2) of the
monitor that is to be the standard. The extended_range_white_level represents the
maximum value of the brightness of the dynamic range after extension. In the case
of FIG. 12, 400 is set as the value of the extended_range_white_level.
[0116]
20 The nominal_black_level_code_value represents the pixel value of black
(brightness 0%), and the nominal_white_level_code_value represents the pixel value
of white (brightness 100%) in a monitor having a standard brightness. The
extended_white_level_code value represents the pixel value of white in the dynamic
range after extension.
25 [0117]
In the case of FIG. 12, as illustrated by hollow arrow #161, the dynamic
range of 0-100% is extended to a dynamic range of 0-400% in accordance with the
value of the extended_range_white_level. Furthermore, a pixel value
corresponding to the brightness of 400% is designated by the
30 extended_white_level_code_value.
[0118]
28
The brightness characteristic of the HDR video is represented by curve L12
in which the values of the nominal_black_level_code_value, the
nominal_white_level_code_value, and the extended_white_level_code_value are 0%,
100%, and 400%, respectively.
5 [0119]
As described above, with the Tone mapping information in which 4 is set as
the value of the tone_map_model_id, the brightness characteristic of the master HDR
video is represented and is transmitted to the reproduction device 2 from the
recording device 1.
10 [0120]
<3. BD Format>
Herein, description of a BD-ROM format will be given.
[0121]
[Data management structure]
15 FIG. 13 is a diagram illustrating an example of a management structure of
an AV stream in BD-ROM format.
[0122]
The management of the AV stream including the HEVC stream is performed
using two layers, namely, PlayList and Clip. The AV stream may, in some cases, be
20 recorded not only on an optical disc 11 but also in a local storage of the reproduction
device 2.
[0123]
A pair of a single AV stream and Clip Information, which is information
associated with the AV stream, is managed as a single object. A pair of the AV
25 stream and the Clip Information is referred to as a Clip.
[0124]
The AV stream is developed on a time axis and an access point of each Clip
is, mainly, designated in the PlayList with a time stamp. The Clip Information is
used to, for example, find the address to start decoding in the AV stream.
30 [0125]
The PlayList is a group of reproduction sections of the AV stream. A
29
single reproduction section in the AV stream is referred to as a PlayItem. The
PlayItem is expressed by a pair of an IN point and an OUT point in the reproduction
section on the time axis. As illustrated in FIG. 13, the PlayList is configured of a
single or a plurality of PlayItems.
5 [0126]
The first PlayList from the left in FIG. 13 is configured of two PlayItems,
and with the two PlayItems, reference is made to a former portion and a latter portion
of the AV stream included in the Clip on the left side.
[0127]
10 The second PlayList from the left is configured of a single PlayItem, and
with the PlayItem, reference is made to the entire AV stream included in the Clip on
the right side.
[0128]
The third PlayList from the left is configured of two PlayItems, and with the
15 two PlayItems, reference is made to a certain portion of the AV stream included in
the Clip on the left side and a certain portion of the AV stream included in the Clip on
the right side.
[0129]
For example, when the PlayItem on the left side included in the first
20 PlayList from the left is designated as a target to be reproduced by a disc navigation
program, reproduction of the former portion of the AV stream included in the clip on
the left side, which the PlayItem refers to, is performed. As described above, the
PlayList is used as reproduction management information for managing the
reproduction of the AV stream.
25 [0130]
In the PlayList, a reproduction path formed of a line of one or more
PlayItems is referred to as a Main Path. Furthermore, in the PlayList, a
reproduction path that runs parallel to the Main Path and that is formed of a line of
one or more SubPlayItems is referred to as a Sub Path.
30 [0131]
FIG. 14 is a diagram illustrating structures of the Main Path and the Sub
30
Paths.
[0132]
A PlayList includes a single Main Path and one or more Sub Paths. The
PlayList in FIG. 14 is formed of a line of three PlayItems including a single Main
Path 5 and three Sub Paths.
[0133]
The PlayItems configuring the Main Path are each set with an ID in order
from the top. The Sub Pathes are also set with IDs, namely, Subpath_id = 0,
Subpath_id = 1, and Subpath_id = 2, in order from the top.
10 [0134]
In the example in FIG. 14, a single SubPlayItem is included in the Sub Path
of SubPath_id = 0, and two SubPlayItems are included in the Sub Path of SubPath_id
= 1. Furthermore, a single SubPlayItem is included in the Sub Path of SubPath_id
= 2.
15 [0135]
The AV stream that a single PlayItem refers to at least includes a video
stream (a main image data). The AV stream may include one or more audio streams
that are reproduced at the same timing (in synchronization) with the video stream
included in the AV stream or may not include any audio stream.
20 [0136]
The AV stream may include one or more streams of bitmap caption data
(presentation graphics (PG)) that are reproduced in synchronization with the video
stream included in the AV stream or may not include any stream of caption data.
[0137]
25 The AV stream may include one or more streams of interactive graphics (IG)
that are reproduced in synchronization with the video stream included in the AV
stream file or may not include any stream of interactive graphics. The IG stream is
used for displaying graphics such as a button that is operated by the user.
[0138]
30 In the AV stream referred to by a single PlayItem, an video stream and an
audio steam, a PG stream, and an IG stream that synchronize with the video steam
31
are multiplexed.
[0139]
Furthermore, one SubPlayItem refers to a video steam, an audio stream, a
PG stream, and the like that are different from the streams of the AV stream referred
5 to by the PlayItem.
[0140]
As described above, the reproduction of the AV stream including the HEVC
stream is performed using the PlayList and the Clip Information. The PlayList and
the Clip Information including the information related to the reproduction of the AV
10 stream will be referred to as Data Base information, as appropriate.
[0141]
[Directory structure ]
FIG. 15 is a diagram illustrating a structure in which the file that is recorded
in the optical disc 11 is managed.
15 [0142]
Each of the files that is recorded on the optical disc 11 is managed in a
hierarchical manner with the directory structure. A single root directory is created
on the optical disc 11.
[0143]
20 A BDMV directory is located under the root directory.
[0144]
An Index file that is a file set with a name "Index.bdmv" and a MovieObject
file that is a file set with a name "MovieObject.bdmv" are stored under the BDMV
directory.
25 [0145]
A PLAYLIST directory, a CLIPINF directory, a STREAM directory, and the
like are provided under the BDMV directory.
[0146]
The PLAYLIST directory stores PlayList files in which PlayLists are
30 described. Each PlayList is named with a combination of a five-digit number and
an extension ".mpls". One of the PlayList files illustrated in FIG. 15 is set with a
32
file name of "00000.mpls".
[0147]
The CLIPINF directory stores Clip Information files. Each Clip
Information file is named with a combination of a five-digit number and an extension
".clpi". The three Clip Information files in FIG. 15 are set 5 with file names of
"00001.clpi", "00002.clpi", and "00003.clpi".
[0148]
Stream files are stored in the STREAM directory. Each stream file is
named with a combination of a five-digit number and an extension ".m2ts ". The
10 three stream files in FIG. 15 are set with file names of "00001.m2ts", "00002.m2ts",
and "00003.m2ts".
[0149]
The Clip Information file and the stream file that have the same five-digit
numbers set in the file names are files that constitute a single Clip. When
15 reproducing the stream file "00001.m2ts", the Clip Information file "00001.clpi" is
used, and when reproducing the stream file "00002.m2ts", the Clip Information file
"00002.clpi" is used. As will be described later, information related to HDR video
processing is included in the Clip Information file used to reproduce the AV stream
including the HEVC stream.
20 [0150]
[Syntax of Each File]
Herein, main descriptions of the syntax of each file will be described.
[0151]
FIG. 16 is a diagram illustrating syntax of the PlayList file.
25 [0152]
The PlayList file is stored in the PLAYLIST directory in FIG. 15 and is a
file that is set with the extension ".mpls".
[0153]
AppInfoPlayList () stores parameters that is related to the reproduction
30 control of the PlayList, such as a reproduction restriction.
[0154]
33
PlayList () stores parameters related to the Main Path and the Sub Path.
[0155]
PlayListMark () stores mark information of the PlayList, in other words, the
PlayListMark () stores information related to marks that are jump destinations (jump
points) in an user operation, a command, or the like commanding 5 a chapter jump.
[0156]
FIG. 17 is a diagram illustrating syntax of the Clip Information file.
[0157]
The Clip Information file is stored in the CLIPINF directory in FIG. 15 and
10 is a file that is set with the extension ".clpi ".
[0158]
ClipInfo () stores information, such as information representing the type of
AV stream configuring the Clip, information representing the recording rate of the
AV stream, and the like.
15 [0159]
SequenceInfo () includes information representing, on the time axis, the
position of the source packet configuring the AV stream, information representing the
displayed clock time, and the like.
[0160]
20 ProgramInfo () includes information related to the PID of the AV stream
configuring the Clip, information related to coding of the AV stream, and the like.
[0161]
FIG. 18 is a diagram illustrating syntax of the ProgramInfo () in FIG. 17.
[0162]
25 Number_of_program_sequences represents the number of program
sequences described in the ProgramInfo (). A program sequence is constituted by a
line of source packets constituting a program.
[0163]
SPN_program_sequence_start[i] represents the source packet number at the
30 head of the program sequence.
[0164]
34
StreamCodingInfo includes information related to coding of the AV stream
configuring the Clip.
[0165]
FIG. 19 is a diagram illustrating syntax of the StreamCodingInfo in FIG. 18.
5 [0166]
Stream_coding_type represents the coding method of an elementary stream
included in the AV stream. For example, in the StreamCodingInfo of the Clip
Information used for reproduction of the HEVC stream, a value representing that the
coding method is HEVC is set as stream_coding_type.
10 [0167]
Video_format represents the video scanning method. In the video_format
used to reproduce the HEVC stream, a value representing a 4K scanning method
such as 2160p (2160 line progressive) is set as stream_coding_type.
[0168]
15 Frame_rate represents the frame rate of the video stream.
[0169]
Aspect_ratio represents the aspect ratio of the video.
[0170]
Cc_flag is a one-bit flag and represents whether closed caption data is
20 included in the video stream.
[0171]
HDR_flag is a one-bit flag and represents whether an HDR video is
recorded as a master. For example, HDR_flag = 1 represents that recoding of an
HDR video as a master is being performed. Furthermore, HDR_flag = 0 represents
25 that recoding of an STD video as a master is being performed.
[0172]
Mode_flag is a one-bit flag and represents the recording mode of the HEVC
stream. The mode_flag becomes valid when HDR_flag = 1. For example,
mode_flag = 1 represents that the recording mode is mode-i. Furthermore,
30 mode_flag = 0 represents that the recording mode is mode-ii.
[0173]
35
As described above, the Clip Information includes a flag representing
whether the HEVC stream included in the AV stream in which reproduction is
performed using the Clip Information is a stream in which the master is the HDR
video, and a flag representing the recording mode of the HEVC stream.
5 [0174]
By referring to the flag included in the Clip Information, the reproduction
device 2 is capable of specifying whether the master video is an HDR video without
actually analyzing the HEVC stream.
[0175]
10 <4. Configuration of Each Device>
Herein, a configuration of each device will be described.
[0176]
[Configuration of recording device 1]
FIG. 20 is a block diagram illustrating an exemplary configuration of the
15 recording device 1.
[0177]
The recording device 1 includes a controller 21, a coding processing unit 22,
and a disc drive 23. The master HDR video is input to the coding processing unit
22.
20 [0178]
The controller 21 includes a central processing unit (CPU), a read-only
memory (ROM), and a random access memory (RAM). The controller 21 executes
a predetermined program and controls the overall operation of the recording device 1.
[0179]
25 In the controller 21, a Data Base information generation unit 21A is
implemented by executing a predetermined program. The Data Base information
generation unit 21A generates a PlayList and a Clip that are Data Base information
and outputs the PlayList and the Clip to the disc drive 23.
[0180]
30 The coding processing unit 22 performs coding of the master HDR video.
The coding processing unit 22 outputs the HEVC stream, which has been obtained
36
by coding the master HDR video, to the disc drive 23.
[0181]
The disc drive 23 records a file that stores the PlayList and the Clip
Information supplied from the controller 21 and the HEVC stream supplied from the
coding processing unit 22 on the optical disc 11 according to the 5 directory structure
in FIG. 15.
[0182]
FIG. 21 is a block diagram illustrating an exemplary configuration of the
coding processing unit 22 in FIG. 20.
10 [0183]
The coding processing unit 22 includes an HDR information generation unit
31, an HEVC encoder 32, an HDR-STD conversion unit 33, a definition information
generation unit 34, and an HEVC stream generation unit 35.
[0184]
15 The HDR information generation unit 31 detects the brightness of the input
master HDR video and generates HDR information including each of the pieces of
information that have been described while referring to FIG. 12. The HDR
information generation unit 31 outputs the generated HDR information to the HEVC
stream generation unit 35.
20 [0185]
When the recording mode is mode-i, the HEVC encoder 32 performs coding
of the input master HDR video with HEVC. Furthermore, when the recording
mode is mode-ii, the HEVC encoder 32 performs coding of the STD video, which
has been supplied from the HDR-STD conversion unit 33, with HEVC. The HEVC
25 encoder 32 outputs the coded data of the HDR video or the coded data of the STD
video to the HEVC stream generation unit 35.
[0186]
The HDR-STD conversion unit 33 converts the input master HDR video to
an STD video. The conversion by the HDR-STD conversion unit 33 is performed,
30 as appropriate, in accordance with a conversion parameter input by the author. The
HDR-STD conversion unit 33 outputs information representing the correlation
37
between an input data, which is the RGB signal of the HDR video, and an output
data, which is the RGB signal of the STD video, to the definition information
generation unit 34.
[0187]
FIG. 22 is a diagram illustrating an example of signal processing 5 performed
by the HDR-STD conversion unit 33.
[0188]
As illustrated at the end of arrow #201, the HDR-STD conversion unit 33
converts an YCrCb signal of the input master HDR video to an RGB signal, and
10 performs conversion (tone mapping) of each RGB signal to the corresponding RGB
signal of the STD video.
[0189]
The HDR-STD conversion unit 33 outputs information representing the
correlation between the RGB signal of the HDR video, which is an input data, and
15 the RGB signal of the STD video, which is an output data, to the definition
information generation unit 34. As illustrated at the end of arrow #202, the
information output to the definition information generation unit 34 is used to
generate the tone mapping definition information.
[0190]
20 Furthermore, as illustrated at the end of #203, the HDR-STD conversion
unit 33 converts the RGB signal of the STD video to an YCrCb signal and outputs
the YCrCb signal.
[0191]
FIG. 23 is a diagram illustrating an example of tone mapping.
25 [0192]
As illustrated in FIG. 23, for example, the RGB signal of the HDR video is
converted to the RGB signal of the STD video by compressing the high brightness
components and by extending the intermediate and low brightness components.
Information expressing a function F that correlates the RGB signal of the HDR video
30 and the RGB signal of the STD video is, as illustrated in FIG. 23, generated by the
definition information generation unit 34. Note that the function F illustrated in FIG.
38
23 is the Tone mapping information of tone_map_model_id = 3 that draws a
relationship between the coded_data and the target_data with a polygonal line
function that have been described while referring to FIG. 11.
[0193]
Returning back to the description of FIG. 21, when the 5 recording mode is
mode-ii, the HDR-STD conversion unit 33 outputs the STD video that has been
obtained by converting the HDR video to the HEVC encoder 32.
[0194]
On the basis of the information supplied from the HDR-STD conversion
10 unit 33, the definition information generation unit 34 generates tone mapping
definition information for HDR-STD conversion.
[0195]
For example, when tone_map_model_id = 0 is used, the definition
information generation unit 34 generates Tone mapping information including the
15 values min_value and max_value in FIG. 9 as tone mapping definition information
for HDR-STD conversion.
[0196]
Furthermore, when tone_map_model_id = 2 is used, the definition
information generation unit 34 generates Tone mapping information including
20 start_of_coded_interval[i] in FIG. 10 as tone mapping definition information for
HDR-STD conversion.
[0197]
Furthermore, when tone_map_model_id = 3 is used, the definition
information generation unit 34 generates Tone mapping information including
25 coded_pivot_value[i] and target_pivot_value[i], the numbers of which are designated
by the num_pivots in FIG. 11, as tone mapping definition information for HDR-STD
conversion.
[0198]
In accordance with the recording mode, the HEVC stream generation unit
30 35 sets the same value to the Tone mapping information including HDR information
supplied from the HDR information generation unit 31 and to the tone_map_id of the
39
Tone mapping information including the tone mapping definition information
supplied from the definition information generation unit 34. Furthermore, the
HEVC stream generation unit 35 inserts, as SEI, the Tone mapping information
including the HDR information and the Tone mapping information including the tone
mapping definition information into the coded data and generates 5 the HEVC stream.
The HEVC stream generation unit 35 outputs the generated HEVC stream to the disc
drive 23.
[0199]
[Configuration of reproduction device 2]
10 FIG. 24 is a block diagram illustrating an exemplary configuration of the
reproduction device 2.
[0200]
The reproduction device 2 includes a controller 51, a disc drive 52, a
memory 53, a local storage 54, a network interface 55, a decoding processing unit 56,
15 an operation input unit 57, and an HDMI communication unit 58.
[0201]
The controller 51 includes a CPU, a ROM, and a RAM. The controller 51
executes a predetermined program and controls the overall operation of the
reproduction device 2.
20 [0202]
The disc drive 52 reads out data from the optical disc 11 and outputs the
read out data to the controller 51, the memory 53, or the decoding processing unit 56.
For example, the disc drive 52 outputs the Data Base information read out from the
optical disc 11 to the controller 51 and outputs an HEVC stream to the decoding
25 processing unit 56.
[0203]
The memory 53 stores data that is needed by the controller 51 to execute
various processing. A register 53A that is a player status register (PSR) is formed in
the memory 53. Various information that the reproduction device 2, which is the
30 BD Player, refers to when reproducing the optical disc 11 is stored in the register
53A.
40
[0204]
The local storage 54 includes, for example, a hard disk drive (HDD). A
stream and the like downloaded from a server is recorded in the local storage 54.
[0205]
The network interface 55 communicates with the server 5 through a network
such as the Internet and supplies the data downloaded from the server to the local
storage 54.
[0206]
The decoding processing unit 56 decodes the HEVC stream supplied from
10 the disc drive 52 and outputs the data of the HDR video or the STD video to the
HDMI communication unit 58. When the decoding processing unit 56 outputs the
HDR video, the HDR information is output to the HDMI communication unit 58
together with the data of the HDR video.
[0207]
15 The operation input unit 57 includes input devices such as a button, a key,
and a touch panel and a receiving section that receives a signal such as an infrared
signal that is transmitted from a predetermined remote commander. The operation
input unit 57 detects the operation of the user and supplies a signal that represents the
details of the detected operation to the controller 51.
20 [0208]
The HDMI communication unit 58 performs communication with the
display device 3 through the HDMI cable 4. For example, the HDMI
communication unit 58 acquires information related to the performance of the
monitor included in the display device 3 and outputs the information to the controller
25 51. Furthermore, the HDMI communication unit 58 outputs the data of the HDR
video or the STD video, which has been supplied from the decoding processing unit
56, to the display device 3.
[0209]
FIG. 25 is a block diagram illustrating an exemplary configuration of the
30 decoding processing unit 56 in FIG. 24.
[0210]
41
The decoding processing unit 56 includes a parameter extraction unit 71, an
HEVC decoder 72, an HDR-STD conversion unit 73, an STD-HDR conversion unit
74, and an output unit 75. The output unit 75 includes an HDR video output unit
75A and an STD video output unit 75B.
5 [0211]
The HEVC stream read out from the disc drive 52 is input to the parameter
extraction unit 71. For example, the information representing the recording mode
that is specified by mode_flag included in the Clip Information, and information that
is related to the performance of the monitor included in the display device 3 and that
10 is specified by information acquired from the display device 3 are supplied to the
decoding processing unit 56 from the controller 51.
[0212]
The parameter extraction unit 71 extracts HDR information and tone
mapping definition information from the SEI of the HEVC stream. For example,
15 when the recording mode is mode-i and when an HDR video is output to the display
device 3, the parameter extraction unit 71 outputs the HDR information to the HDR
video output unit 75A. Furthermore, when the recording mode is mode-i and when
an STD video is output to the display device 3, the parameter extraction unit 71
outputs tone mapping definition information for HDR-STD conversion to the HDR20
STD conversion unit 73.
[0213]
On the other hand, when the recording mode is mode-ii and when an HDR
video is output to the display device 3, the parameter extraction unit 71 outputs the
HDR information to the HDR video output unit 75A and also outputs tone mapping
25 definition information for STD-HDR conversion to the STD-HDR conversion unit
74. When the recording mode is mode-ii and when an STD video is output to the
display device 3, the extracted HDR information and tone mapping definition
information are not used.
[0214]
30 Furthermore, the parameter extraction unit 71 outputs the coded data
included in the HEVC stream to the HEVC decoder 72.
42
[0215]
The HEVC decoder 72 decodes the coded data of the HEVC supplied from
the parameter extraction unit 71. When the recording mode is mode-i, the HEVC
decoder 72 outputs the HDR video, which has been obtained by decoding, to the
HDR-STD conversion unit 73 and the HDR video output unit 5 75A. Furthermore,
when the recording mode is mode-ii, the HEVC decoder 72 outputs the STD video,
which has been obtained by decoding, to the STD-HDR conversion unit 74 and the
STD video output unit 75B.
[0216]
10 The HDR-STD conversion unit 73 converts the HDR video, which has been
supplied from the HEVC decoder 72, to an STD video on the basis of the tone
mapping definition information for HDR-STD conversion supplied from the
parameter extraction unit 71. The HDR-STD conversion unit 73 outputs the STD
video obtained by conversion to the STD video output unit 75B.
15 [0217]
The STD-HDR conversion unit 74 converts the STD video supplied from
the HEVC decoder 72 to an HDR video on the basis of the tone mapping definition
information for STD-HDR conversion supplied from the parameter extraction unit 71.
The STD-HDR conversion unit 74 outputs the HDR video obtained by conversion to
20 the HDR video output unit 75A.
[0218]
When outputting the HDR video to the display device 3, the HDR video
output unit 75A of the output unit 75 outputs the HDR video supplied from the
HEVC decoder 72 or the HDR video supplied from the STD-HDR conversion unit
25 74, together with the HDR information supplied from the parameter extraction unit
71.
[0219]
When outputting the STD video to the display device 3, the STD video
output unit 75B outputs the STD video supplied from the HEVC decoder 72 or the
30 STD video supplied from the HDR-STD conversion unit 73.
[0220]
43
The data output from the HDR video output unit 75A and the STD video
output unit 75B is transmitted to the display device 3 by the HDMI communication
unit 58.
[0221]
[Configuration of 5 display device 3]
FIG. 26 is a block diagram illustrating an exemplary configuration of the
display device 3.
[0222]
The display device 3 includes a controller 101, an HDMI communication
10 unit 102, a signal processing unit 103, and a monitor 104. The controller 101
includes a memory 101A.
[0223]
The controller 101 includes a CPU, a ROM, and a RAM. The controller
101 executes a predetermined program and controls the overall operation of the
15 display device 3.
[0224]
For example, the controller 101 makes the memory 101A store extended
display identification data (EDID) that represents the performance of the monitor 104
and performs management. When performing authentication between the
20 reproduction device 2, the controller 101 outputs the EDID that is stored in the
memory 101A to the HDMI communication unit 102 and transmits the EDID to the
reproduction device 2. On the basis of the EDID, the reproduction device 2
specifies the performance of the monitor 104 of the display device 3.
[0225]
25 The HDMI communication unit 102 performs communication with the
reproduction device 2 through the HDMI cable 4. The HDMI communication unit
102 receives video data transmitted from the reproduction device 2 and outputs the
data to the signal processing unit 103. Furthermore, the HDMI communication unit
102 transmits the EDID supplied from the controller 101 to the reproduction device 2.
30 [0226]
The signal processing unit 103 performs processing on the video data
44
supplied from the HDMI communication unit 102 and displays an image on the
monitor 104.
[0227]
<5. Operation of Each Device>
Herein, an operation of each device having 5 the above-described
configuration will be described.
[0228]
[Recording processing]
Referring first to the flowchart in FIG. 27, recording processing of the
10 recording device 1 will be described. The processing in FIG. 27 starts when the
master HDR video is input to the recording device 1.
[0229]
In step S1, the controller 21 of the recording device 1 determines whether
the recording mode is mode-i. The recording mode is set by the author, for example.
15 [0230]
When it is determined that the recording mode is mode-i in step S1, in step
S2, the coding processing unit 22 performs coding processing in mode-i. The
HEVC stream generated by the coding processing in mode-i is supplied to the disc
drive 23.
20 [0231]
On the other hand, when it is determined that the recording mode is mode-ii
in step S1, in step S3, the coding processing unit 22 performs coding processing in
mode-ii. The HEVC stream generated by the coding processing in mode-ii is
supplied to the disc drive 23.
25 [0232]
In step S4, the Data Base information generation unit 21A performs Data
Base information generation processing. The PlayList file and the Clip Information
file generated by the Data Base information generation processing are supplied to the
disc drive 23.
30 [0233]
In step S5, the disc drive 23 records the PlayList file, the Clip Information
45
file, and the stream file that stores the HEVC stream on the optical disc 11.
Subsequently, the processing is ended.
[0234]
Referring next to the flowchart in FIG. 28, the coding processing in mode-i
performed in step S2 in FIG. 27 5 will be described.
[0235]
In step S11, the HDR information generation unit 31 of the coding
processing unit 22 detects the brightness of the master HDR video and generates
HDR information.
10 [0236]
In step S12, the HEVC encoder 32 performs coding on the master HDR
video by HEVC and generates coded data of the HDR video.
[0237]
In step S13, the HDR-STD conversion unit 33 converts the input master
15 HDR video to an STD video. Information representing the correlation between an
input data, which is the RGB signal of the HDR video, and an output data, which is
the RGB signal of the STD video, is supplied to the definition information generation
unit 34.
[0238]
20 In step S14, on the basis of the information supplied from the HDR-STD
conversion unit 33, the definition information generation unit 34 generates tone
mapping definition information for HDR-STD conversion.
[0239]
In step S15, the HEVC stream generation unit 35 sets an ID for mode-i to
25 the Tone mapping information including the HDR information generated by the HDR
information generation unit 31 and to the tone_map_id of the Tone mapping
information including the tone mapping definition information generated by
definition information generation unit 34. Furthermore, the HEVC stream
generation unit 35 inserts the Tone mapping information including the HDR
30 information and the Tone mapping information including the tone mapping definition
information in the coded data and generates an HEVC stream. Subsequently, the
46
process returns to step S2 in FIG. 27 and the processing thereafter is performed.
[0240]
Referring next to the flowchart in FIG. 29, the coding processing in mode-ii
performed in step S3 in FIG. 27 will be described.
5 [0241]
In step S21, the HDR information generation unit 31 of the coding
processing unit 22 detects the brightness of the master HDR video and generates
HDR information.
[0242]
10 In step S22, the HDR-STD conversion unit 33 converts the input master
HDR video to an STD video. Information representing the correlation between an
input data, which is the RGB signal of the HDR video, and an output data, which is
the RGB signal of the STD video, is supplied to the definition information generation
unit 34.
15 [0243]
In step S23, on the basis of the information supplied from the HDR-STD
conversion unit 33, the definition information generation unit 34 generates tone
mapping definition information for STD-HDR conversion.
[0244]
20 In step S24, the HEVC encoder 32 performs, by HEVC, coding on the STD
video obtained by converting the master HDR video and generates coded data of the
STD video.
[0245]
In step S25, the HEVC stream generation unit 35 sets an ID for mode-ii to
25 the Tone mapping information including the HDR information generated by the HDR
information generation unit 31 and to the tone_map_id of the Tone mapping
information including the tone mapping definition information generated by
definition information generation unit 34. Furthermore, the HEVC stream
generation unit 35 inserts the Tone mapping information including the HDR
30 information and the Tone mapping information including the tone mapping definition
information in the coded data and generates an HEVC stream. Subsequently, the
47
process returns to step S3 in FIG. 27 and the processing thereafter is performed.
[0246]
Referring next to the flowchart in FIG. 30, the Data Base information
generation processing performed in step S4 in FIG. 27 will be described.
5 [0247]
In step S31, the Data Base information generation unit 21A of the controller
21 generates a PlayList including various information described while referring to
FIG. 16. The PlayList that the Data Base information generation unit 21A generates
includes information relating to a PlayItem that designates the HEVC stream as a
10 reproduction section.
[0248]
In step S32, the Data Base information generation unit 21A generates Clip
Information including the HDR_flag and the mode_flag in the StreamCodingInfo of
the ProgramInfo (). In the present example, since the master video is an HDR video,
15 the Data Base information generation unit 21A sets 1 that represents that the master
video is an HDR video as a value of the HDR_flag.
[0249]
Furthermore, in step S2 in FIG. 27, when the coding processing is performed
in mode-i, the Data Base information generation unit 21A sets 1 that represents that
20 the recording mode is mode-i as a value of the mode_flag. On the other hand, in
step S3 in FIG. 27, when the coding processing is performed in mode-ii, the Data
Base information generation unit 21A sets 0 that represents that the recording mode
is mode-ii as a value of the mode_flag. Subsequently, the process returns to step S4
in FIG. 27 and the processing thereafter is performed.
25 [0250]
In the recording device 1, the HEVC stream and the Data Base information
generated with the above processing are recorded on the optical disc 11.
[0251]
[Reproduction Processing]
30 Referring next to the flowchart in FIG. 31, reproduction processing of the
reproduction device 2 will be described.
48
[0252]
At a predetermined timing such as when starting reproduction of the optical
disc 11, the controller 51 of the reproduction device 2 controls the HDMI
communication unit 58 and communicates with the display device 3 to read out the
EDID from the memory 101A of the display device 3. The controller 5 51 stores the
information representing the performance of the monitor included in the display
device 3 in the register 53A and performs management.
[0253]
In step S41, the controller 51 controls the disc drive 52 and reads out the
10 PlayList and the Clip Information, which are Data Base information, from the optical
disc 11. Furthermore, on the basis of the information included in the PlayList, the
controller 51 specifies the HEVC stream to be reproduced and controls the disc drive
52 to read out the AV stream including the specified HEVC stream from the optical
disc 11.
15 [0254]
In step S42, the controller 51 refers to the HDR_flag and the mode_flag
included in the Clip Information. In the present example, the HDR_flag is set with
a value that represents that recording of the HDR video as a master is being
performed. With the above, the reproduction device 2 is brought into a state in
20 which reproduction of the HDR video or the STD video obtained by converting the
HDR video can be performed.
[0255]
In step S43, the controller 51 determines whether the recording mode is
mode-i on the basis of the value of the mode_flag.
25 [0256]
When it is determined that the recording mode is mode-i in step S43, in step
S44, the decoding processing unit 56 performs decoding processing in mode-i.
[0257]
On the other hand, when it is determined that the recording mode is mode-ii
30 in step S43, in step S45, the decoding processing unit 56 performs decoding
processing in mode-ii.
49
[0258]
After the decoding processing is performed in step S44 or step S45, the
process is ended.
[0259]
Note that, herein, while the determination on whether the 5 recording mode is
mode-i is made on the basis of the value of the mode_flag, the determination may be
made on the basis of the tone_map_id of the Tone mapping information inserted into
the HEVC stream.
[0260]
10 Referring next to the flowchart in FIG. 32, the decoding processing in modei
performed in step S44 in FIG. 31 will be described.
[0261]
In step S61, the parameter extraction unit 71 of the decoding processing unit
56 extracts HDR information and tone mapping definition information from the SEI
15 of the HEVC stream. The parameter extraction unit 71 outputs the coded data of
the HEVC included in the HEVC stream to the HEVC decoder 72.
[0262]
In step S62, the HEVC decoder 72 decodes the coded data of the HEVC and
outputs the HDR video obtained by decoding to the HDR-STD conversion unit 73
20 and the HDR video output unit 75A.
[0263]
In step S63, on the basis of the information stored in the register 53A, the
controller 51 determines whether the monitor included in the display device 3 is an
HDR monitor. As described above, information related to the performance of the
25 monitor included in the display device 3 is stored in the register 53A on the basis of
the EDID of the HDMI read out from the display device 3.
[0264]
When it is determined that the monitor included in the display device 3 is an
HDR monitor in step S63, in step S64, the HDR video output unit 75A outputs the
30 HDR video supplied from the HEVC decoder 72 together with the HDR information
supplied from the parameter extraction unit 71.
50
[0265]
On the other hand, when it is determined that the monitor included in the
display device 3 is not an HDR monitor but is an STD monitor in step S63, in step
S65, the HDR-STD conversion unit 73 converts the HDR video supplied from the
HEVC decoder 72 to an STD video on the basis of the tone 5 mapping definition
information for HDR-STD conversion supplied from the parameter extraction unit 71.
[0266]
In step S66, the STD video output unit 75B outputs the STD video obtained
by performing conversion in the HDR-STD conversion unit 73.
10 [0267]
In step S67, after the HDR video has been output in step S64 or after the
STD video has been output in step S66, the controller 51 determines whether the
reproduction is to be ended.
[0268]
15 When it is determined in step S67 that the reproduction is not to be ended,
the controller 51 returns the process to step S61 and performs repetition of the above
processing. When it is determined in step S67 that the reproduction is to be ended,
the process returns to step S44 in FIG. 31 and the processing thereafter is performed.
[0269]
20 Referring next to the flowchart in FIG. 33, the decoding processing in modeii
performed in step S45 in FIG. 31 will be described.
[0270]
In step S81, the parameter extraction unit 71 of the decoding processing unit
56 extracts HDR information and tone mapping definition information from the SEI
25 of the HEVC stream. The parameter extraction unit 71 outputs the coded data of
the HEVC included in the HEVC stream to the HEVC decoder 72.
[0271]
In step S82, the HEVC decoder 72 decodes the coded data of the HEVC and
outputs the STD video obtained by decoding to the STD-HDR conversion unit 74
30 and the STD video output unit 75B.
[0272]
51
In step S83, on the basis of the information stored in the register 53A, the
controller 51 determines whether the monitor included in the display device 3 is an
HDR monitor.
[0273]
When it is determined that the monitor included in the display 5 device 3 is an
HDR monitor in step S83, in step S84, the STD-HDR conversion unit 74 converts
the STD video supplied from the HEVC decoder 72 to an HDR video on the basis of
the tone mapping definition information for STD-HDR conversion supplied from the
parameter extraction unit 71.
10 [0274]
In step S85, the HDR video output unit 75A outputs the HDR video, which
has been obtained by conversion with the STD-HDR conversion unit 74, together
with the HDR information supplied from the parameter extraction unit 71.
[0275]
15 On the other hand, when it is determined that the monitor included in the
display device 3 is an STD monitor in step S83, in step S86, the STD video output
unit 75B outputs the STD video supplied from the HEVC decoder 72.
[0276]
In step S87, after the HDR video has been output in step S85 or after the
20 STD video has been output in step S86, the controller 51 determines whether the
reproduction is to be ended.
[0277]
When it is determined in step S87 that the reproduction is not to be ended,
the controller 51 returns the process to step S81 and performs repetition of the above
25 processing. When it is determined in step S87 that the reproduction is to be ended,
the process returns to step S45 in FIG. 31 and the processing thereafter is performed.
[0278]
[Display Processing]
Referring next to the flowchart in FIG. 34, display processing of the display
30 device 3 will be described.
[0279]
52
Herein, a case in which the monitor 104 included in the display device 3 is
an HDR monitor will be described. An HDR video to which HDR information is
added is transmitted to the display device 3 including an HDR monitor from the
reproduction device 2.
5 [0280]
In step S101, the HDMI communication unit 102 of the display device 3
receives the HDR video and the HDR information transmitted from the reproduction
device 2.
[0281]
10 In step S102, the controller 101 refers to the HDR information and
determines whether the HDR video transmitted from the reproduction device 2 can
be displayed as it is. The HDR information includes information of the master
HDR video, that is, information representing the brightness characteristic of the HDR
video transmitted from the reproduction device 2. The determination in step S102
15 is performed by comparing the brightness characteristic of the HDR video specified
by the HDR information and the display performance of the monitor 104 with each
other.
[0282]
For example, in a case in which the dynamic range of the HDR video
20 specified by the HDR information is 0-400% and the dynamic range of the monitor
104 is 0-500% (500cd/m2 assuming that the brightness of 100% is 100cd/m2, for
example), it is determined that the HDR video can be displayed as it is. On the
other hand, in a case in which the dynamic range of the HDR video specified by the
HDR information is 0-400% and the dynamic range of the monitor 104 is 0-300%, it
25 is determined that the HDR video cannot be displayed as it is.
[0283]
When it is determined that the HDR video can be displayed as it is in step
S102, in step S103, the signal processing unit 103 displays an image of the HDR
video on the monitor 104 in accordance with the brightness designated by the HDR
30 information. For example, in a case in which the brightness characteristic drawn by
the curve L12 in FIG. 12 is designated by the HDR information, each of the pixel
53
values expresses a brightness in the range of 0-400% that is drawn by the curve L12.
[0284]
On the other hand, when it is determined that the HDR video cannot be
displayed as it is in step S102, in step S104, the signal processing unit 103 adjusts the
brightness in accordance with the display performance of 5 the monitor 104 and
displays an image of the HDR video, the brightness of which has been adjusted, on
the monitor 104. For example, in a case in which the brightness characteristic
drawn by the curve L12 in FIG. 12 is designated by the HDR information and when
the dynamic range of the monitor 104 is 0-300%, compression is performed so that
10 each of the pixel values expresses the brightness in the range of 0-300%.
[0285]
After the image of the HDR video has been displayed in step S103 or in step
S104, in step S105, the controller 101 determines whether the display is to be ended
and when it is determined that the display is not to be ended, processing from step
15 S101 and after is repeated. When determination is made to end the display in step
S105, the controller 101 ends the processing.
[0286]
With the above sequential processing, the recording device 1 can record the
master HDR video on the optical disc 11 as it is and have the reproduction device 2
20 perform reproduction so that the image of the HDR video is displayed on the display
device 3.
[0287]
Furthermore, the recording device 1 can convert the master HDR video to
an STD video, record the STD video on the optical disc 11, and have the
25 reproduction device 2 restore the STD video into an HDR video so that the image of
the HDR video is displayed on the display device 3.
[0288]
When reproducing the HDR video, by enabling the brightness characteristic
of the master HDR video to be designated with the HDR information, the author of
30 the content is capable of displaying an image of the HDR video at an intended
brightness.
54
[0289]
<6. Modifications>
[Storing position of flag]
While it has been described above that the HDR_flag and the mode_flag are
stored in the Clip Information, the HDR_flag and the mode_flag may 5 be stored in the
PlayList.
[0290]
• A first example of storing position
FIG. 35 is a diagram illustrating an example of syntax of the
10 AppInfoPlayList () included in the PlayList file in FIG. 16.
[0291]
As it has been described above, the AppInfoPlayList () stores parameters
that is related to the reproduction control of the PlayList, such as a reproduction
restriction. In the example in FIG. 35, the HDR_flag and the mode_flag are
15 described continuously after MVC_Base_view_R_flag.
[0292]
As described above, the HDR_flag and the mode_flag may be described in
the AppInfoPlayList () of the PlayList file.
[0293]
20 • A second example of storing position
FIG. 36 is a diagram illustrating syntax of PlayList () included in the
PlayList file in FIG. 16.
[0294]
Number_of_PlayItems represents the number of PlayItems in the PlayList.
25 In the case of the example in FIG. 14, the number of PlayItems is three. The
PlayItem_ids are each allocated with a number as its value, in the order of
appearance of the PlayItem () in the PlayList, starting from 0.
[0295]
Number_of_SubPaths represents the number of Sub Paths in the PlayList.
30 In the case of the example in FIG. 14, the number of Sub Paths is three. The
SubPath_ids are each allocated with a number as its value, in the order of appearance
55
of the SubPath () in the PlayList, starting from 0.
[0296]
As illustrated in FIG. 36, in the PlayList, the PlayItem () is described the
number of times that corresponds to the number of the PlayItems, and the SubPath ()
is described the number of times that corresponds to the number 5 of the Sub Paths.
[0297]
FIG. 37 is a diagram illustrating syntax of the PlayItem () in FIG. 36.
[0298]
Clip_Information_file_name[0] represents the name of the Clip Information
10 file of the Clip to which the PlayItem refers. Clip_codec_identifier[0] represents
the codec system of the Clip.
[0299]
IN_time represents the start position of the reproduction section of the
PlayItem and OUT_time represents the end position. UO_mask_table (),
15 PlayItem_random_access_mode, still_mode are included after the OUT_time.
[0300]
Information of the AV stream to which the PlayItem refers is included in
STN_table (). In a case in which there is a Sub Path that is reproduced in
association with the PlayItem, the AV steam information that the SubPlayItem, which
20 constitutes the Sub Path, refers to is also included.
[0301]
FIG. 38 is a diagram illustrating syntax of the STN_table () in FIG. 37.
[0302]
Number_of_video_stream_entries represents the number of video streams
25 that are entered (registered) in the STN_table (). Number_of_audio_stream_entries
represents the number of streams of the first audio stream that is entered in the
STN_table (). Number_of_audio_stream2_entries represents the number of streams
of the second audio stream that is entered in the STN_table ().
[0303]
30 Number_of_PG_textST_stream_entries represents the number of
PG_textST streams entered in the STN_table (). PG_textST stream is a
56
presentation graphics (PG) stream and a text caption file (textST) that are run-length
coded bitmap captions. Number_of_IG_stream_entries represents the number of
interactive graphics (IG) streams that is entered in the STN_table ().
[0304]
Stream_entry () and stream_attributes () that are information 5 of each of the
video streams, the first video stream, the second video stream, the PG_textST stream
and the IG stream are described in the STN_table (). PID of the stream is included
in the stream_entry (), and attribute information of the stream is included in the
stream_attributes ().
10 [0305]
FIG. 39 is a diagram illustrating an example of a description related to the
video stream, which is a description in the description of the stream_attributes () in
FIG. 38.
[0306]
15 In the example of the stream_attributes () in FIG. 39, stream_coding_type,
video_format, and frame_rate are described as the attribute information of the video
stream and the HDR_flag and the mode_flag are described after that. Note that the
stream_coding_type represents the coding method of the video stream and the
video_format represents the video format. The frame_rate represents the frame rate
20 of the video.
[0307]
As described above, the HDR_flag and the mode_flag may be described in
the STN_table () of the PlayList file.
[0308]
25 The HDR_flag and the mode_flag may be described in a position in the
PlayList file other than the AppInfoPlayList () and the STN_table (). In a similar
manner, the HDR_flag and the mode_flag may be described in a position in the Clip
Information file other than the StreamCodingInfo described while referring to FIG.
19.
30 [0309]
The positions where the HDR_flag and the mode_flag are described are
57
optional, such as one of the HDR_flag and the mode_flag being described in the Clip
Information file and the other being described in the PlayList file.
[0310]
[PSR]
FIG. 40 is a diagram illustrating an example of an 5 allocation of the PSR.
[0311]
As described above, the register 53A of the reproduction device 2 is used as
a PSR. On the BD, each PSR is allocated with a PSR number defining the intended
use of the relevant PSR.
10 [0312]
HDR_capability_flag is stored in PSR29 that is a PSR with a PSR number
of 29. For example, the value of the HDR_capability_flag of the PSR29 being 1
represents that the reproduction device 2 supports reproduction of an HDR video.
Furthermore, the value of the HDR_capability_flag of the PSR29 being 0 represents
15 that the reproduction device 2 does not support reproduction of an HDR video.
[0313]
For example, when an optical disc in which the value of the HDR_flag of
the Clip Information is set to 1 is inserted, in other words, when an optical disc that
have recorded a master HDR video is inserted, the HDR_capability_flag is referred
20 to by the controller 51 that executes the disc navigation program. When the value
of the HDR_capability_flag is set to 0, a message that requests a display device
supporting the processing of the HDR video to be connected to the reproduction
device 2 is displayed.
[0314]
25 PSR25 that is a PSR with a PSR number of 25 is used as a PSR to record the
information representing the correspondence of the connected monitor to an HDR
video. In such a case, the information representing the performance of the monitor
included in the display device 3, which is represented by the EDID acquired from the
display device 3, is stored in the PSR25.
30 [0315]
For example, HDR_display_capability_flag and information representing
58
the brightness specification are stored in the PSR25 for HDR Display Capability.
The value of the HDR_display_capability_flag being 1 represents that the connected
monitor is capable of displaying an HDR video. Furthermore, the value of the
HDR_display_capability_flag being 0 represents that the connected monitor is not
capable of displaying 5 an HDR video.
[0316]
For example, information representing the extent of brightness, in percent,
that can be displayed is stored as information representing the brightness
specification.
10 [0317]
Rather than using the PSR25 for HDR Display Capability, the PSR23 that is
a PSR for Display Capability may store information representing the
HDR_display_capability_flag and the brightness specification.
[0318]
15 <7. Exemplary Case in Which Brightness is Adjusted on Reproduction Device Side>
In the above description, when the HDR video that has been transmitted
from the reproduction device 2 cannot be displayed as it is, the display device 3 itself
adjusted the brightness; however, the adjustment of the brightness of the HDR video
may be performed by the reproduction device 2. The display device 3 will be
20 receiving an HDR video whose brightness has been adjusted by the reproduction
device 2 and will be displaying an image of the HDR video.
[0319]
[Signal processing in mode-i]
FIG. 41 is a diagram illustrating an example of signal processing in mode-i
25 in a case in which the adjustment of the brightness of the HDR video is performed by
the reproduction device 2.
[0320]
Among the processing illustrated in FIG. 41, the processing performed by
the recording device 1 and the processing related to the output of the STD video
30 performed by the reproduction device 2 are the same as the processing described
while referring to FIG. 2. Redundant descriptions will be appropriately omitted. It
59
is assumed that the HDR_display_capability_flag described above and the
information representing the brightness specification are stored in the register 53A of
the reproduction device 2.
[0321]
The reproduction device 2 reads out the HEVC stream 5 from the optical disc
11 and, as illustrated at the ends of arrows #21 and #22, extracts the HDR
information and the tone mapping definition information from the SEI of the HEVC
stream.
[0322]
10 Furthermore, as illustrated at the end of arrow #23, the reproduction device
2 decodes the coded data of the HEVC. As illustrated at the end of arrow #301,
when the display device 3 includes an HDR monitor but cannot display the HDR
video as it is, the reproduction device 2 adjusts the brightness of the HDR video
obtained by decoding the coded data.
15 [0323]
For example, when the dynamic range of the HDR video represented by the
HDR information is 0-400% and when it is represented that the dynamic range of the
monitor 104 is 0-300% from the information representing the brightness
specification stored in the register 53A, the reproduction device 2 performs
20 adjustment of the brightness. In the above case, the brightness of each pixel value
is compressed to the range of 0-300%.
[0324]
When the brightness of the HDR video is adjusted, as illustrated at the end
of arrow #302, the reproduction device 2 rewrites the HDR information. The HDR
25 information after the rewriting becomes information representing the brightness
characteristic of the HDR video on which the adjustment of the brightness has been
performed.
[0325]
As illustrated at the end of arrow #303, the reproduction device 2 adds the
30 HDR information to the data of the HDR video on which the adjustment of the
brightness has been performed and, as illustrated at the end of arrow #304, outputs
60
the data to the display device 3.
[0326]
[Signal processing in mode-ii]
FIG. 42 is a diagram illustrating an example of signal processing in mode-ii
in a case in which the adjustment of the brightness of the HDR video 5 is performed by
the reproduction device 2.
[0327]
Among the processing illustrated in FIG. 42, the processing performed by
the recording device 1 and the processing related to the output of the STD video
10 performed by the reproduction device 2 are the same as the processing described
while referring to FIG. 4. Redundant descriptions will be appropriately omitted.
[0328]
The reproduction device 2 reads out the HEVC stream from the optical disc
11 and, as illustrated at the ends of arrows #101 and #102, extracts the HDR
15 information and the tone mapping definition information from the SEI of the HEVC
stream.
[0329]
Furthermore, as illustrated at the end of arrow #103, the reproduction device
2 decodes the coded data of the HEVC. As illustrated at the end of arrow #105,
20 when the display device 3 includes an HDR monitor, the reproduction device 2
converts the STD video, which has been obtained by decoding the coded data, to an
HDR video by using the tone mapping definition information for STD-HDR
conversion extracted from the HEVC stream.
[0330]
25 As illustrated at the end of arrow #311, when the display device 3 includes
an HDR monitor but cannot display the HDR video as it is, the reproduction device 2
adjusts the brightness of the HDR video and as illustrated at the end of arrow #312,
rewrites the HDR information.
[0331]
30 As illustrated at the end of arrow #313, the reproduction device 2 adds the
HDR information to the data of the HDR video on which the adjustment of the
61
brightness has been performed and, as illustrated at the end of arrow #314, outputs
the data to the display device 3.
[0332]
As described above, when the adjustment of the brightness of the HDR
video is performed by the reproduction device 2, the HDR information 5 is rewritten so
as to represent the brightness characteristic after the adjustment and is transmitted
together with the data of the HDR video to the display device 3.
[0333]
On the basis of the HDR information, the display device 3 recognizes that
10 the HDR video is going to be transmitted, and the display device 3 is capable of
displaying the image of the HDR video on the monitor 104 in accordance with the
brightness designated by the HDR information after the rewriting.
[0334]
[Configuration of reproduction device 2]
15 FIG. 43 is a block diagram illustrating an exemplary configuration of the
HDR video output unit 75A in FIG. 25.
[0335]
The HDR video output unit 75A includes a brightness adjustment unit 111
and a rewriting unit 112. The HDR video supplied from the HEVC decoder 72 or
20 the STD-HDR conversion unit 74 is input to the brightness adjustment unit 111.
Furthermore, the HDR information supplied from the parameter extraction unit 71 is
input to the rewriting unit 112.
[0336]
The brightness adjustment unit 111 adjusts the brightness of the HDR video
25 and outputs the HDR video on which the adjustment of the brightness has been
performed.
[0337]
On the basis of the result of the adjustment by the brightness adjustment unit
111, the rewriting unit 112 rewrites the HDR information so as to represent the
30 brightness characteristic on which the adjustment has been performed. The HDR
information that has been rewritten is added to the HDR video on which the
62
adjustment of the brightness has been performed and is transmitted to the display
device 3.
[0338]
[Decoding processing of reproduction device 2]
Herein, referring to the flowchart in FIG. 44, the decoding 5 processing in
mode-i performed in step S44 in FIG. 31 will be described. In the processing in FIG.
44, the adjustment of the brightness of the HDR video is appropriately performed.
[0339]
Among the processing illustrated in FIG. 44, the processing of steps S151 to
10 S153 and S158 to S160 is the same as the processing of steps S61 to S63 and S65 to
S67 of FIG. 32, respectively. Redundant descriptions will be appropriately omitted.
[0340]
In step S151, the parameter extraction unit 71 of the decoding processing
unit 56 extracts HDR information and tone mapping definition information from the
15 SEI of the HEVC stream.
[0341]
In step S152, the HEVC decoder 72 decodes the coded data of the HEVC
and outputs the HDR video obtained by the decoding.
[0342]
20 In step S153, the controller 51 determines whether the monitor included in
the display device 3 is an HDR monitor.
[0343]
When it is determined in step S153 that the monitor included in the display
device 3 is an HDR monitor, in step S154, the controller 51 determines whether the
25 HDR video can be displayed as it is on the monitor 104 of the display device 3.
[0344]
When it is determined in step S154 that the HDR video cannot be displayed
as it is, in step S155, the brightness adjustment unit 111 of the HDR video output unit
75A adjusts, in accordance with the display performance of the monitor 104, the
30 brightness of the HDR video that has been decoded by the HEVC decoder 72.
[0345]
63
In step S156, the rewriting unit 112 performs rewriting of the HDR
information on the basis of the result of the adjustment of the brightness.
[0346]
In step S157, the HDR video output unit 75A outputs the HDR video, on
which adjustment of the brightness has been performed, together 5 with the HDR
information, which has been rewritten.
[0347]
When it is determined in step S154 that the HDR video can be displayed as
it is, the processing of steps S155 and S156 is skipped. In the above case, in step
10 S157, the HDR video output unit 75A outputs the HDR video, which has been
decoded by the HEVC decoder 72, together with the HDR information, which has
been extracted by the parameter extraction unit 71.
[0348]
Determination of whether the reproduction is to be ended is made in step
15 S160, and when determination is made that the reproduction is to be ended, the
processing is ended. Subsequently, the process returns to step S44 in FIG. 31 and
the processing thereafter is performed.
[0349]
Referring next to the flowchart in FIG. 45, the decoding processing in mode20
ii performed in step S45 in FIG. 31 will be described. In the processing in FIG. 45,
the adjustment of the brightness of the HDR video is appropriately performed.
[0350]
Among the processing illustrated in FIG. 45, the processing of steps S171 to
S174, S179, and S180 is the same as the processing of steps S81 to S84, S86, and
25 S87 of FIG. 33, respectively. Redundant descriptions will be appropriately omitted.
[0351]
In step S171, the parameter extraction unit 71 of the decoding processing
unit 56 extracts HDR information and tone mapping definition information from the
SEI of the HEVC stream.
30 [0352]
In step S172, the HEVC decoder 72 decodes the coded data of the HEVC
64
and outputs the STD video obtained by the decoding.
[0353]
In step S173, the controller 51 determines whether the monitor included in
the display device 3 is an HDR monitor.
5 [0354]
When it is determined that the monitor included in the display device 3 is an
HDR monitor in step S173, in step S174, the STD-HDR conversion unit 74 converts
the decoded STD video to an HDR video on the basis of the tone mapping definition
information for STD-HDR conversion.
10 [0355]
In step S175, the controller 51 determines whether the HDR video obtained
by converting the STD video can be displayed as it is on the monitor 104 of the
display device 3.
[0356]
15 When it is determined in step S175 that the HDR video cannot be displayed
as it is, in step S176, the brightness adjustment unit 111 of the HDR video output unit
75A adjusts, in accordance with the display performance of the monitor 104, the
brightness of the HDR video that has been obtained by converting the STD video.
[0357]
20 In step S177, the rewriting unit 112 performs rewriting of the HDR
information on the basis of the result of the adjustment of the brightness.
[0358]
In step S178, the HDR video output unit 75A outputs the HDR video, on
which adjustment of the brightness has been performed, together with the HDR
25 information, which has been rewritten.
[0359]
When it is determined in step S175 that the HDR video can be displayed as
it is, the processing of steps S176 and S177 is skipped. In the above case, in step
S178, the HDR video output unit 75A outputs the HDR video, which has been
30 obtained by converting the STD video, together with the HDR information, which
has been extracted by the parameter extraction unit 71.
65
[0360]
Determination of whether the reproduction is to be ended is made in step
S180, and when determination is made to end the reproduction, the processing is
ended. Subsequently, the process returns to step S45 in FIG. 31 and the processing
thereafter 5 is performed.
[0361]
[Display processing of display device 3]
Referring next to the flowchart in FIG. 46, display processing of the display
device 3 will be described.
10 [0362]
The processing in FIG. 46 is performed after the processing in FIG. 44 or
FIG. 45 performed by the reproduction device 2. Together with the HDR
information, the original HDR video on which no adjustment of the brightness has
been performed or the HDR video on which adjustment of the brightness has been
15 performed are transmitted from the reproduction device 2 to the display device 3
including an HDR monitor.
[0363]
In step S191, the HDMI communication unit 102 of the display device 3
receives the HDR video and the HDR information transmitted from the reproduction
20 device 2.
[0364]
In step S192, the signal processing unit 103 displays an image of the HDR
video on the monitor 104 in accordance with the brightness designated by the HDR
information.
25 [0365]
In step S193, the controller 101 determines whether the display is to be
ended and when it is determined that the display is not to be ended, processing from
step S191 and after is repeated. When determination is made to end the display in
step S193, the controller 101 ends the processing.
30 [0366]
As described above, when the adjustment of the brightness is performed by
66
the reproduction device 2, the display device 3 does not have to determine whether
the HDR video that has been sent from the reproduction device 2 can be displayed as
it is. Furthermore, the display device 3 itself does not have to adjust the brightness
of the HDR video.
5 [0367]
When the adjustment of the brightness of the HDR video is required, the
user of the reproduction device 2 may be allowed to set whether to perform the
adjustment of the brightness on the reproduction device 2 side or on the display
device 3 side.
10 [0368]
Alternatively, the display device 3 may notify the reproduction device 2
whether the adjustment of the brightness is performed on the reproduction device 2
side or on the display device 3 side, and in accordance with the notification, the
processing that is performed in the reproduction device 2 may be switched. For
15 example, when the display device 3 has a function of adjusting the brightness of the
HDR video, a notification is made that the adjustment of the brightness is to be
performed on the display device 3 side, and when the display device 3 has no
function of adjusting the brightness of the HDR video, a notification is made that the
adjustment of the brightness is to be performed on the reproduction device 2 side.
20 [0369]
When notified from the display device 3 that the adjustment of the
brightness is to be performed on the reproduction device 2 side, the reproduction
device 2 performs, as the decoding processing, the processing in FIG. 44 or FIG. 45.
Furthermore, when notified from the display device 3 that the adjustment of the
25 brightness is to be performed on the display device 3 side, the reproduction device 2
performs, as the decoding processing, the processing in FIG. 32 or FIG. 33.
[0370]
There are cases in which the parameters used in the adjustments are
different between the adjustment of the brightness performed by the reproduction
30 device 2 and the adjustment of the brightness performed by the display device 3. In
the above case, it is considered that, from the viewpoint of image quality, it is
67
desirable that the adjustment of the brightness is performed by the display device 3
that includes the monitor 104 and that is capable of performing adjustment that suits
the characteristic of the monitor 104 in a greater manner.
[0371]
By having the display device 3 select whether to perform 5 the adjustment of
the brightness on the reproduction device 2 side or on the display device 3 side, it
will be possible to display the HDR video with a fine image quality. It is possible
to perform the selection between performing the adjustment of the brightness on the
reproduction device 2 side or on the display device 3 side on the basis of an user
10 operation. For example, when the user instructs display of the menu screen by
operating a remote control or a button provided on a body of the display device 3, the
controller 101 of the display device 3 controls, for example, the signal processing
unit 103 such that the menu screen including items related to the configuration of the
HDR video is displayed on the monitor 104. When an item related to the
15 configuration of the HDR video is selected, a screen used for selecting whether to
perform the adjustment of the brightness on the reproduction device 2 side or on the
display device 3 side is displayed, and the user will be selecting either one. By
transmitting the information representing the selected content of the user to the
reproduction device 2 through the HDMI cable 4, the display device 3 notifies
20 whether to perform the adjustment of the brightness of the HDR video on the
reproduction device 2 side or on the display device 3 side to the reproduction device
2.
[0372]
The notification of whether to perform the adjustment of the brightness of
25 the HDR video on the reproduction device 2 side or on the display device 3 side can
be achieved by using the EDID of the HDMI.
[0373]
<8. Exemplary Application to HDMI>
[HDR EDID and HDR InfoFrame]
30 FIG. 47 is a diagram illustrating an example of a recognition on the basis of
information transmitted and received through the HDMI.
68
[0374]
As illustrated on the left side in FIG. 47, the reproduction device 2 that is a
BD player supporting processing of an HDR video with a 4K resolution reads out the
EDIDs that are stored in the memory 101A of the display device 3. A plurality of
EDIDs, such as an EDID representing the performance of the 5 monitor 104 of the
display device 3, are stored in the memory 101A of the display device 3.
[0375]
When an HDR EDID is included in the EDIDs read out from the display
device 3, the reproduction device 2 recognizes that the display device 3 is a device
10 including an HDR monitor and that an HDR video can be output to the display
device 3. The HDR EDID includes information related to the output of the HDR
video. A notification of whether to perform the adjustment of the brightness of the
HDR video on the reproduction device 2 side or on the display device 3 side is
performed using the HDR EDID.
15 [0376]
As illustrated on the right side in FIG. 47, the reproduction device 2 adds
HDR InfoFrame to the data of each frame of the HDR video output to the display
device 3. In the HDMI standard, InfoFrame is added to each frame of the video.
Information related to the specification of the video, such as information on whether
20 the video data is of an RGB data or of an YCbCr data, information representing the
aspect ratio, and the like is included in the InfoFrame of the video.
[0377]
The HDR InfoFrame is an InfoFrame including the information relating to
the specification of the HDR video. Transmission of the HDR information
25 representing the brightness characteristic of the HDR video is performed using the
HDR InfoFrame. The reproduction device 2 outputs the data of the HDR video, to
which the HDR InfoFrame has been added, to the display device 3.
[0378]
When the HDR InfoFrame is added to the video data that has been
30 transmitted from the reproduction device 2, the display device 3 recognizes that the
video data transmitted from the reproduction device 2 is data of an HDR video.
69
Subsequently, the display device 3 displays an image of the HDR video on the HDR
monitor.
[0379]
FIG. 48 is a diagram illustrating another example of a recognition on the
basis of information transmitted and received 5 through the HDMI.
[0380]
As illustrated on the left side in FIG. 48, when an HDR EDID is not
included in the EDIDs read out from the display device 3, the reproduction device 2
recognizes that the display device 3 is a device that does not include an HDR monitor.
10 In such a case, the reproduction device 2 will be outputting only the data of the STD
video to the display device 3. No HDR InfoFrame is added to the data of the STD
video that the reproduction device 2 outputs.
[0381]
On the other hand, as illustrated on the right side in FIG. 48, when no HDR
15 InfoFrame is added to the video data that has been transmitted from the reproduction
device 2, the display device 3 recognizes that the video data transmitted from the
reproduction device 2 is data of an STD video. Subsequently, the display device 3
displays an image of the STD video on the STD monitor.
[0382]
20 As described above, transmission of the HDR information from the
reproduction device 2 to the display device 3 can be performed using the InfoFrame
of the HDMI. Furthermore, the notification from the display device 3 to the
reproduction device 2 on whether to perform the adjustment of the brightness of the
HDR video on the reproduction device 2 side or on the display device 3 side can be
25 performed using the EDID of the HDMI.
[0383]
FIG. 49 is a diagram illustrating an example of the HDR EDID.
[0384]
Information representing the maximum brightness of the monitor,
30 information representing the maximum extension level, and raw/cooked flag-1 are
included in the HDR EDID. The raw/cooked flag-1 represents whether to output
70
the HDR video in a raw manner or to output the HDR video after, if needed,
adjusting the brightness of the HDR video.
[0385]
The value of the raw/cooked flag-1 being 1 represents that the HDR video is
to be output in a raw manner, in other words, it represents that the 5 display device 3 is
requesting the HDR video to be output without performing any adjustment of the
brightness on the reproduction device 2 side. When the value of the raw/cooked
flag-1 is 1, even if the dynamic range of the HDR video exceeds the display
performance of the monitor 104, the reproduction device 2 outputs the HDR video
10 without performing any adjustment of the brightness.
[0386]
For example, if provided with a function for adjusting the brightness of the
HDR video, the display device 3 sets the value of the raw/cooked flag-1 to 1.
[0387]
15 Furthermore, the value of the raw/cooked flag-1 being 0 represents that the
display device 3 is requesting the HDR video to be output after, if required,
performing adjustment of the brightness of the HDR video on the reproduction
device 2 side. When the value of the raw/cooked flag-1 is 0 and when the dynamic
range of the HDR video exceeds the display performance of the monitor 104, the
20 reproduction device 2 adjusts the brightness of the HDR video in accordance with the
display performance of the monitor 104 and outputs the HDR video on which the
adjustment has been performed.
[0388]
For example, if not provided with any function for adjusting the brightness
25 of the HDR video, the display device 3 sets the value of the raw/cooked flag-1 to 0.
[0389]
The decoding processing in FIG. 32 or FIG. 33, in which the adjustment of
the brightness is not performed on the reproduction device 2 side but is performed on
the display device 3 side, corresponds to the processing in which the value of the
30 raw/cooked flag-1 is 1. Furthermore, the decoding processing in FIG. 44 or FIG. 45,
in which the adjustment of the brightness is performed on the reproduction device 2
71
side, corresponds to the processing in which the value of the raw/cooked flag-1 is 0.
[0390]
Hereinafter, as appropriate, the output in which the reproduction device 2
outputs the HDR video in a raw manner is referred to as a raw output. Furthermore,
the output after the reproduction device 2 has, if required, performed 5 adjustment of
the brightness of the HDR video is referred to as a cooked output.
[0391]
FIG. 50 is a diagram illustrating an example of the HDR InfoFrame.
[0392]
10 The HDR InfoFrame includes ref_screen_luminance_white,
extended_range_white_level, nominal_black_level_code_value,
nominal_white_level_code_value, extended_white_level_code_value and
raw/cooked flag-2 that are parameters of the HDR information.
[0393]
15 Furthermore, the HDR InfoFrame includes raw/cooked flag-2, as well.
The raw/cooked flag-2 represents whether the HDR video that is output is a raw
HDR video on which no adjustment of the brightness has been performed or is an
HDR video on which the adjustment of the brightness has been performed.
[0394]
20 The value of the raw/cooked flag-2 being 1 represents that the HDR video
that is output is a raw HDR video on which no adjustment of the brightness has been
performed on the reproduction device 2 side. For example, when the value of the
raw/cooked flag-1 included in the HDR EDID is 1, the reproduction device 2 adds
the HDR InfoFrame in which the value of the raw/cooked flag-2 is set to 1 to the data
25 of the HDR video and outputs the data of the HDR video.
[0395]
Furthermore, the value of the raw/cooked flag-2 being 0 represents that the
HDR video that is output is an HDR video on which the adjustment of the brightness
has been performed. For example, when the value of the raw/cooked flag-1
30 included in the HDR EDID is 0 and the dynamic range of the HDR video exceeds the
display performance of the monitor 104, the reproduction device 2 performs
72
adjustment of the brightness and sets the value of the raw/cooked flag-2 to 0. The
reproduction device 2 adds the HDR InfoFrame in which the value of the raw/cooked
flag-2 is set to 0 to the data of the HDR video on which adjustment of the brightness
has been performed and outputs the data of the HDR video.
5 [0396]
In the decoding processing in FIG. 32 or FIG. 33 in which the adjustment of
the brightness is not performed on the reproduction device 2 side, the value of the
raw/cooked flag-2 of the HDR InfoFrame is set to 1. Furthermore, in the decoding
processing in FIG. 44 or FIG. 45 in which the adjustment of the brightness is, in some
10 cases, performed on the reproduction device 2 side, the value of the raw/cooked flag-
2 of the HDR InfoFrame may, in some cases, be set to 0.
[0397]
[Processing of reproduction device 2 and display device 3]
Herein, processing of the reproduction device 2 and the display device 3 in
15 which the HDR EDID and the HDR InfoFrame are used will be described.
[0398]
Referring first to the flowchart in FIG. 51, processing of the display device 3
that sets the HDR EDID will be described.
[0399]
20 In step S211, the controller 101 of the display device 3 sets the value of the
raw/cooked flag-1 to 1 or 0, and stores, in the memory 101A, the HDR EDID that
includes the information representing the maximum brightness of the monitor, the
information representing the maximum extension level, and the raw/cooked flag-1.
[0400]
25 In step S212, in accordance with the request from the reproduction device 2,
the HDMI communication unit 102 reads out a plurality of EDIDs including the
HDR EDID from the memory 101A and transmits the plurality of EDIDs to the
reproduction device 2.
[0401]
30 Referring next to the flowchart in FIG. 52, the reproduction processing of
the reproduction device 2 will be described next. For example, the processing in
73
FIG. 52 is started after the processing in FIG. 51 has been performed in the display
device 3.
[0402]
In step S221, the controller 51 controls the disc drive 52 and reads out the
PlayList and the Clip Information that are Data Base information 5 from the optical
disc 11. Furthermore, on the basis of the information included in the PlayList, the
controller 51 specifies the HEVC stream to be reproduced and controls the disc drive
52 to read out the AV stream including the specified HEVC stream from the optical
disc 11.
10 [0403]
In step S222, the controller 51 refers to the HDR_flag and the mode_flag
included in the Clip Information. In the present example, the HDR_flag is set with
a value that represents that recording of the HDR video as a master is being
performed.
15 [0404]
In step S223, the controller 51 controls the HDMI communication unit 58
and reads out the EDIDs from the display device 3. A request to read out the
EDIDs is made to the HDMI communication unit 102 of the reproduction device 2
from the HDMI communication unit 58, and the plurality of EDIDs that have been
20 transmitted in response to the request are acquired by the HDMI communication unit
58.
[0405]
In step S224, the controller 51 determines whether an HDR EDID is
included in the EDIDs that have been read out from the display device 3.
25 [0406]
When it is determined in step S224 that an HDR EDID is included, the
controller 51 recognizes that an HDR video can be output to the display device 3 and
in step S225, stores the information representing the display performance of the
monitor 104 in the register 53A. For example, the controller 51 stores, in the
30 PSR25, information representing the maximum brightness of the monitor and the
information representing the maximum extension level that are included in the HDR
74
EDID and that serve as information representing the brightness specification of the
monitor. Furthermore, the controller 51 sets a value representing that the monitor
104 is capable of displaying an HDR video in the HDR_display_capability_flag of
the PSR25.
5 [0407]
In step S226, the controller 51 determines whether a raw output is requested
from the display device 3 on the basis of the raw/cooked flag-1 included in the HDR
EDID. In the case of the example described above, when the value of the
raw/cooked flag-1 is 1, the controller 51 determines that a raw output is requested,
10 and when 0, determines that a cooked output is requested.
[0408]
When it is determined in step S226 that the raw output is requested, in step
S227, the controller 51 performs HDR/raw output processing that is processing that
performs a raw output of the HDR video.
15 [0409]
When it is determined in step S226 that the raw output is not requested, in
step S228, the controller 51 performs HDR/cooked output processing that is
processing that performs a cooked output of the HDR video.
[0410]
20 On the other hand, when it is determined in step S224 that the HDR EDID is
not included, in step S229, the controller 51 performs STD output processing that is
processing that performs output of an STD video. The output destination of the
STD video with the STD output processing will be a display device that is different
from the display device 3 and that does not include an HDR monitor.
25 [0411]
After the video data is output in step S227, S228, or S229, the process is
ended.
[0412]
Referring next to the flowchart in FIG. 53, the HDR/raw output processing
30 performed in step S227 in FIG. 52 will be described.
[0413]
75
In step S241, the parameter extraction unit 71 of the decoding processing
unit 56 extracts HDR information and tone mapping definition information from the
SEI of the HEVC stream. The parameter extraction unit 71 outputs the coded data
of the HEVC included in the HEVC stream to the HEVC decoder 72.
5 [0414]
In step S242, the HEVC decoder 72 decodes the coded data of the HEVC.
When the recording mode is mode-i, the data of the HDR video obtained by
decoding the coded data is supplied to the HDR video output unit 75A.
Furthermore, when the recording mode is mode-ii, the data of the STD video
10 obtained by decoding the coded data is supplied to the STD-HDR conversion unit 74.
[0415]
In step S243, the controller 51 determines whether the recording mode is
mode-i on the basis of the value of the mode_flag.
[0416]
15 When it is determined that the recording mode is mode-ii in step S243, in
step S244, the STD-HDR conversion unit 74 converts the STD video supplied from
the HEVC decoder 72 to an HDR video on the basis of the tone mapping definition
information for STD-HDR conversion supplied from the parameter extraction unit 71.
When it is determined in step S243 that the recording mode is mode-i, the processing
20 of step S244 is skipped.
[0417]
In step S245, the HDR video output unit 75A sets the raw/cooked flag-2 to a
value of 1 that represents that the HDR video is a raw HDR video in which no
adjustment of the brightness has been performed. Furthermore, the HDR video
25 output unit 75A generates an HDR InfoFrame that includes each parameter of the
HDR information, which has been extracted by the parameter extraction unit 71, and
the raw/cooked flag-2.
[0418]
In step S246, the HDR video output unit 75A adds the HDR InfoFrame to
30 the data of each frame of the HDR video and outputs the data to the display device 3.
[0419]
76
In step S247, the controller 51 determines whether the reproduction is to be
ended and when it is determined that the reproduction is not to be ended, the process
returns to step S241 and the above processing is executed repeatedly. When it is
determined in step S247 that the reproduction is to be ended, the process returns to
step S227 in FIG. 52 and the processing thereafter 5 is performed.
[0420]
Referring next to the flowchart in FIG. 54, the HDR/cooked output
processing performed in step S228 in FIG. 52 will be described.
[0421]
10 In step S261, the parameter extraction unit 71 of the decoding processing
unit 56 extracts HDR information and tone mapping definition information from the
SEI of the HEVC stream. The parameter extraction unit 71 outputs the coded data
of the HEVC included in the HEVC stream to the HEVC decoder 72.
[0422]
15 In step S262, the HEVC decoder 72 decodes the coded data of the HEVC.
When the recording mode is mode-i, the data of the HDR video obtained by
decoding the coded data is supplied to the HDR video output unit 75A.
Furthermore, when the recording mode is mode-ii, the data of the STD video
obtained by decoding the coded data is supplied to the STD-HDR conversion unit 74.
20 [0423]
In step S263, the controller 51 determines whether the recording mode is
mode-i on the basis of the value of the mode_flag.
[0424]
When it is determined that the recording mode is mode-ii in step S263, in
25 step S264, the STD-HDR conversion unit 74 converts the STD video supplied from
the HEVC decoder 72 to an HDR video on the basis of the tone mapping definition
information for STD-HDR conversion supplied from the parameter extraction unit 71.
When it is determined in step S263 that the recording mode is mode-i, the processing
of step S264 is skipped.
30 [0425]
In step S265, the controller 51 compares the brightness characteristic of the
77
HDR video represented by the HDR information and the performance of the monitor
104 represented by the information included in the HDR EDID with each other and
determines whether the HDR video can be displayed on the monitor 104 as it is.
[0426]
When it is determined in step S265 that the HDR video 5 cannot be displayed
as it is, in step S266, the brightness adjustment unit 111 of the HDR video output unit
75A adjusts the brightness of the HDR video in accordance with the display
performance of the monitor 104.
[0427]
10 In step S267, the rewriting unit 112 performs rewriting of the HDR
information on the basis of the result of the adjustment of the brightness. When it is
determined in step S265 that the HDR video can be displayed as it is, the processing
of steps S266 and S267 is skipped.
[0428]
15 In step S268, the HDR video output unit 75A sets a predetermined value to
the raw/cooked flag-2 and generates an HDR InfoFrame including each parameter of
the HDR information.
[0429]
For example, when the brightness of the HDR video is not adjusted, the
20 HDR video output unit 75A sets the value to 1 that represents the above to the
raw/cooked flag-2 and generates the HDR InfoFrame including the raw/cooked flag-
2 and each parameter of the HDR information that has been extracted by the
parameter extraction unit 71.
[0430]
25 On the other hand, when the brightness of the HDR video is adjusted, the
HDR video output unit 75A sets the value to 0 that represents the above to the
raw/cooked flag-2 and generates the HDR InfoFrame including the raw/cooked flag-
2 and each parameter of the HDR information on which rewriting has been
performed.
30 [0431]
In step S269, the HDR video output unit 75A adds the HDR InfoFrame to
78
the data of each frame of the HDR video and outputs the data to the display device 3.
[0432]
In step S270, the controller 51 determines whether the reproduction is to be
ended and when it is determined that the reproduction is not to be ended, the process
returns to step S261 and the above processing is executed repeatedly. 5 When it is
determined in step S270 that the reproduction is to be ended, the process returns to
step S228 in FIG. 52 and the processing thereafter is performed.
[0433]
Referring next to the flowchart in FIG. 55, the STD output processing
10 performed in step S229 in FIG. 52 will be described.
[0434]
As described above, the processing in FIG. 55 is processing in which the
video data is output to the display device that is different from the display device 3
and that does not include an HDR monitor.
15 [0435]
In step S281, the parameter extraction unit 71 of the decoding processing
unit 56 extracts HDR information and tone mapping definition information from the
SEI of the HEVC stream. The parameter extraction unit 71 outputs the coded data
of the HEVC included in the HEVC stream to the HEVC decoder 72.
20 [0436]
In step S282, the HEVC decoder 72 decodes the coded data of the HEVC.
When the recording mode is mode-i, the data of the HDR video obtained by
decoding the coded data is supplied to the HDR-STD conversion unit 73.
Furthermore, when the recording mode is mode-ii, the data of the STD video
25 obtained by decoding the coded data is supplied to the STD video output unit 75B.
[0437]
In step S283, the controller 51 determines whether the recording mode is
mode-i on the basis of the value of the mode_flag.
[0438]
30 When it is determined that the recording mode is mode-i in step S283, in
step S284, the HDR-STD conversion unit 73 converts the HDR video supplied from
79
the HEVC decoder 72 to an STD video on the basis of the tone mapping definition
information for HDR-STD conversion supplied from the parameter extraction unit 71.
When it is determined in step S283 that the recording mode is mode-ii, the
processing of step S284 is skipped.
5 [0439]
In step S285, the STD video output unit 75B outputs the STD video
supplied from the HEVC decoder 72 or the STD video supplied from the HDR-STD
conversion unit 73.
[0440]
10 In step S286, the controller 51 determines whether the reproduction is to be
ended and when it is determined that the reproduction is not to be ended, the process
returns to step S281 and the above processing is executed repeatedly. When it is
determined in step S286 that the reproduction is to be ended, the process returns to
step S229 in FIG. 52 and the processing thereafter is performed.
15 [0441]
Referring next to the flowchart in FIG. 56, display processing of the display
device 3 will be described.
[0442]
HDR InfoFrame is added to the video data transmitted by the reproduction
20 device 2 to the display device 3 including an HDR monitor. On the basis of the
HDR InfoFrame, the controller 101 of the display device 3 recognizes that the video
data transmitted from the reproduction device 2 is data of an HDR video.
[0443]
In step S301, the HDMI communication unit 102 of the display device 3
25 receives the data of the HDR video transmitted from the reproduction device 2.
HDR InfoFrame is added to the data of each frame of the HDR video.
[0444]
In step S302, on the basis of the raw/cooked flag-2 included in the HDR
InfoFrame, the controller 101 determines whether the data of the HDR video is data
30 on which raw output has been performed.
[0445]
80
When 1 is set as the value of the raw/cooked flag-2, the controller 101
determines that the data of the HDR video is data on which raw output has been
performed. Furthermore, when 0 is set as the value of the raw/cooked flag-2, the
controller 101 determines that the data of the HDR video is data on which cooked
output has 5 been performed.
[0446]
When it is determined in step S302 that the data of the HDR video is data on
which raw output has been performed, in step S303, the signal processing unit 103
refers to the HDR information included in the HDR InfoFrame. When the dynamic
10 range of the HDR video exceeds the display performance of the monitor 104, the
signal processing unit 103 adjusts the brightness of the HDR video as appropriate
and displays, on the monitor 104, the image of the HDR video on which adjustment
has been performed.
[0447]
15 On the other hand, when it is determined in step S302 that the data of the
HDR video is data on which cooked output has been performed, in step S304, the
signal processing unit 103 displays the image of the HDR video on the monitor 104
in accordance with the HDR information included in the InfoFrame.
[0448]
20 After the image of the HDR video has been displayed in step S303 or in step
S304, in step S305, the controller 101 determines whether the display of the HDR
video is to be ended and when it is determined not to end the display, processing
from step S301 and after is repeated. When determination is made to end the
display in step S305, the controller 101 ends the processing.
25 [0449]
With the above-described sequential processing, the reproduction device 2 is
capable of transmitting HDR information to the display device 3 by using the
InfoFrame of the HDMI. Furthermore, by using the EDID of the HDMI, the
display device 3 is capable of requesting on which side, that is, the reproduction
30 device 2 side or the display device 3 side, the adjustment of the brightness of the
HDR video is to be performed.
81
[0450]
<9. Other Modifications>
Although the HDR information is added when transmitting the data of the
HDR video from the reproduction device 2 to the display device 3, transmission may
be performed without the addition of 5 the HDR information.
[0451]
Furthermore, a description has been given mainly of a case in which the
reproduction device 2 is a BD player; however, a portable terminal may be equipped
with the functions described above included in the reproduction device 2. In such a
10 case, the portable terminal will be having the role as the reproduction device 2.
[0452]
Furthermore, while the content that the reproduction device 2 reproduces is
content that is recorded in a removable media, the above-described technology is
applicable to a case in which the content distributed through a network is reproduced.
15 In such a case, the reproduction device 2 receives content that has been transmitted
from a server that is connected to a network such as the Internet and reproduces the
content such that an HDR video is output to the display device 3.
[0453]
[Exemplary configuration of the computer]
20 The sequential processing described above may be implemented by
hardware or may be implemented by software. When implementing the sequential
processing by software, a program constituting the software is installed from a
program recording medium to a computer built into a dedicated hardware, a generaluse
personal computer, or the like.
25 [0454]
FIG. 57 is a block diagram illustrating an exemplary hardware configuration
of a computer that executes the sequential processing described above with a
program.
[0455]
30 A CPU 501, a ROM 502, and a RAM 503 are interconnected with a bus 504.
[0456]
82
Furthermore, an input/output interface 505 is connected to the bus 504. An
input unit 506 including a keyboard and a mouse and an output unit 507 including a
loudspeaker are connected to the input/output interface 505. Furthermore, a storage
unit 508 including a hard disk or a nonvolatile memory, a communication unit 509
including a network interface, and a drive 510 that drives the removable 5 media 511
are connected to the input/output interface 505.
[0457]
In the computer configured in the above manner, the sequential processing
described above is performed by, for example, the CPU 501 loading the program
10 stored in the storage unit 508 onto the RAM 503 through the input/output interface
505 and the bus 504 and executing the program.
[0458]
The program executed by the CPU 501 is provided by recording the
program in a removable media 511 for example, or through a wired or wireless
15 transmission medium, such as a local area network, the Internet, digital broadcast, or
the like, and is installed in the storage unit 508.
[0459]
Note that the program executed by the computer may be a program in which
the processing is performed in time sequence in the order described in the present
20 description or may be program in which the processing is performed in a parallel
manner or at a required timing such as when called.
[0460]
The embodiment of the present technology is not limited to the abovedescribed
embodiment and various modifications can be made without departing
25 from the scope of the present technology.
[0461]
Note that in the present description, a system refers to an assembly of a
plurality of components (a device, a module (parts), and the like) regardless of
whether all of the components are in the same housing or not. Accordingly, a
30 plurality of devices that are housed in different housings and that are connected to
each other through a network, and a single device in which a plurality of modules are
83
housed in a single housing are both a system.
[0462]
[Exemplary combination of configurations]
The present technology can be configured in the following manner as well.
5 [0463]
(1)
A reproduction device, including:
a readout unit configured to read out, from a recording medium that has
recorded coded data of an extended video that is a video having a second brightness
10 range that is wider than a first brightness range, brightness characteristic information
that represents a brightness characteristic of the extended video, and brightness
conversion definition information used when performing a brightness conversion of
the extended video to a standard video that is a video having the first brightness
range, the coded data, the brightness characteristic information, and the brightness
15 conversion definition information;
a decoding unit configured to decode the coded data;
a conversion unit configured to convert the extended video obtained by
decoding the coded data to the standard video on a basis of the brightness conversion
definition information; and
20 an output unit configured to output data of the extended video and the
brightness characteristic information to a display device that is capable of displaying
the extended video and configured to output data of the standard video to a display
device that is not capable of displaying the extended video.
[0464]
25 (2)
The reproduction device according to (1),
wherein the brightness characteristic information and the brightness
conversion definition information are inserted, as auxiliary information of the coded
data, in a stream including the coded data and are recorded in the recording medium.
30 [0465]
(3)
84
The reproduction device according to (2),
wherein the coded data is coded data of an HEVC, and the brightness
characteristic information and the brightness conversion definition information are
each an SEI of an HEVC stream.
5 [0466]
(4)
The reproduction device according to (3),
wherein the brightness conversion definition information is first Tone
mapping information in which either one of values 0, 2, and 3 is set as a value of a
10 tone_map_model_id, and
wherein the brightness characteristic information is second Tone mapping
information in which 4 is set as the value of the tone_map_model_id.
[0467]
(5)
15 The reproduction device according to (4),
wherein the tone_map_model_id of the first Tone mapping information and
the tone_map_model_id of the second Tone mapping information are each set with a
same value representing a recording mode of the recording medium.
[0468]
20 (6)
The reproduction device according to any of (1) to (5),
wherein information related to reproduction of the coded data, the
information including a flag representing whether a recording of the extended video
as a master is being performed, is further recorded in the recording medium, and
25 wherein when the flag represents that the recording of the extended video as
the master is being performed, the decoding unit decodes the coded data.
[0469]
(7)
The reproduction device according to (6),
30 wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a Clip Information file serving as the
85
information related to the reproduction.
[0470]
(8)
The reproduction device according to (6),
wherein the recording medium is 5 a Blu-ray Disc, and
wherein the flag is included in a PlayList file serving as the information
related to the reproduction.
[0471]
(9)
10 A reproduction method including:
a step of reading out, from a recording medium that has recorded coded data
of an extended video that is a video having a second brightness range that is wider
than a first brightness range, brightness characteristic information that represents a
brightness characteristic of the extended video, and brightness conversion definition
15 information used when performing a brightness conversion of the extended video to
a standard video that is a video having the first brightness range, the coded data, the
brightness characteristic information, and the brightness conversion definition
information;
a step of decoding the coded data;
20 a step of converting the extended video obtained by decoding the coded data
to the standard video on a basis of the brightness conversion definition information;
a step of outputting data of the extended video and the brightness
characteristic information to a display device that is capable of displaying the
extended video; and
25 a step of outputting data of the standard video to a display device that is not
capable of displaying the extended video.
[0472]
(10)
A recording medium,
30 wherein
coded data of an extended video that is a video having a second
86
brightness range that is wider than a first brightness range,
brightness characteristic information that represents a brightness
characteristic of the extended video, and
brightness conversion definition information used when performing
a brightness conversion of the extended video to a standard video 5 that is a video
having the first brightness range
are recorded, and
wherein a reproduction device that reproduces the recording medium
executes processing of
10 reading out the coded data, the brightness characteristic
information, and the brightness conversion definition information from the recording
medium,
decoding the coded data,
converting the extended video obtained by decoding the coded data
15 to the standard video on a basis of the brightness conversion definition information,
outputting data of the extended video and the brightness
characteristic information to a display device that is capable of displaying the
extended video, and
outputting data of the standard video to a display device that is not
20 capable of displaying the extended video.
[0473]
(11)
A reproduction device, including:
a readout unit configured to read out, from a recording medium that has
25 recorded coded data of a standard video that is obtained by performing a brightness
conversion of an extended video that is a video having a second brightness range that
is wider than a first brightness range, the standard video being a video having the
first brightness range, brightness characteristic information that represents a
brightness characteristic of the extended video, and brightness conversion definition
30 information used when performing the brightness conversion of the standard video to
the extended video, the coded data, the brightness characteristic information, and the
87
brightness conversion definition information;
a decoding unit configured to decode the coded data;
a conversion unit configured to convert the standard video obtained by
decoding the coded data to the extended video on a basis of the brightness
conversion definition 5 information; and
an output unit configured to output data of the extended video and the
brightness characteristic information to a display device that is capable of displaying
the extended video and configured to output data of the standard video to a display
device that is not capable of displaying the extended video.
10 [0474]
(12)
The reproduction device according to (11),
wherein the brightness characteristic information and the brightness
conversion definition information are inserted, as auxiliary information of the coded
15 data, in a stream including the coded data and are recorded in the recording medium.
[0475]
(13)
The reproduction device according to (12),
wherein the coded data is coded data of an HEVC, and the brightness
20 characteristic information and the brightness conversion definition information are
each an SEI of an HEVC stream.
[0476]
(14)
The reproduction device according to (13),
25 wherein the brightness conversion definition information is first Tone
mapping information in which either one of values 0, 2, and 3 is set as a value of a
tone_map_model_id, and
wherein the brightness characteristic information is second Tone mapping
information in which 4 is set as the value of the tone_map_model_id.
30 [0477]
(15)
88
The reproduction device according to (14),
wherein the tone_map_model_id of the first Tone mapping information and
the tone_map_model_id of the second Tone mapping information are each set with a
same value representing a recording mode of the recording medium.
5 [0478]
(16)
The reproduction device according to any of (11) to (15),
wherein information related to reproduction of the coded data, the
information including a flag representing whether a recording of the extended video
10 as a master is being performed, is further recorded in the recording medium, and
wherein when the flag represents that the recording of the extended video as
the master is being performed, the decoding unit decodes the coded data.
[0479]
(17)
15 The reproduction device according to (16),
wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a Clip Information file serving as the
information related to the reproduction.
[0480]
20 (18)
The reproduction device according to (16),
wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a PlayList file serving as the information
related to the reproduction.
25 [0481]
(19)
A reproduction method including:
a step of reading out, from a recording medium that has recorded coded data
of a standard video that is obtained by performing a brightness conversion of an
30 extended video that is a video having a second brightness range that is wider than a
first brightness range, the standard video being a video having the first brightness
89
range, brightness characteristic information that indicates a brightness characteristic
of the extended video, and brightness conversion definition information used when
performing the brightness conversion of the standard video to the extended video, the
coded data, the brightness characteristic information, and the brightness conversion
5 definition information;
a step of decoding the coded data;
a step of converting the standard video obtained by decoding the coded data
to the extended video on a basis of the brightness conversion definition information;
a step of outputting data of the extended video and the brightness
10 characteristic information to a display device that is capable of displaying the
extended video; and
a step of outputting data of the standard video to a display device that is not
capable of displaying the extended video.
[0482]
15 (20)
A recording medium,
wherein
coded data of a standard video that is obtained by performing a
brightness conversion of an extended video that is a video having a second brightness
20 range that is wider than a first brightness range, the standard video being a video
having the first brightness range,
brightness characteristic information that represents a brightness
characteristic of the extended video, and
brightness conversion definition information used when performing
25 the brightness conversion of the standard video to the extended video,
are recorded, and
wherein a reproduction device that reproduces the recording medium
executes processing of
reading out the coded data, the brightness characteristic
30 information, and the brightness conversion definition information from the recording
medium,
90
decoding the coded data,
converting the standard video obtained by decoding the coded data
to the extended video on a basis of the brightness conversion definition information,
outputting data of the extended video and the brightness
characteristic information to a display device that is capable 5 of displaying the
extended video, and
outputting data of the standard video to a display device that is not
capable of displaying the extended video.
10 Reference Signs List
[0483]
1 recording device
2 reproduction device
3 display device
15 11 optical disc
21 controller
21A Data Base information generation unit
22 coding processing unit
23 disc drive
20 31 HDR information generation unit
32 HEVC encoder
33 HDR-STD conversion unit
34 definition information generation unit
35 HEVC stream generation unit
25 51 controller
52 disc drive
53 memory
56 decoding processing unit
58 HDMI communication unit
30 71 parameter extraction unit
72 HEVC decoder
91
73 HDR-STD conversion unit
74 STD-HDR conversion unit
75 output unit
92
CLAIMS
Claim 1
A reproduction device, comprising:
a readout unit configured to read out, from a recording medium that has
recorded coded data of an extended video that is a video having a 5 second brightness
range that is wider than a first brightness range, brightness characteristic information
that represents a brightness characteristic of the extended video, and brightness
conversion definition information used when performing a brightness conversion of
the extended video to a standard video that is a video having the first brightness
10 range, the coded data, the brightness characteristic information, and the brightness
conversion definition information;
a decoding unit configured to decode the coded data;
a conversion unit configured to convert the extended video obtained by
decoding the coded data to the standard video on a basis of the brightness conversion
15 definition information; and
an output unit configured to output data of the extended video and the
brightness characteristic information to a display device that is capable of displaying
the extended video and configured to output data of the standard video to a display
device that is not capable of displaying the extended video.
20
Claim 2
The reproduction device according to claim 1,
wherein the brightness characteristic information and the brightness
conversion definition information are inserted, as auxiliary information of the coded
25 data, in a stream including the coded data and are recorded in the recording medium.
Claim 3
The reproduction device according to claim 2,
wherein the coded data is coded data of an HEVC, and the brightness
30 characteristic information and the brightness conversion definition information are
each an SEI of an HEVC stream.
93
Claim 4
The reproduction device according to claim 3,
wherein the brightness conversion definition information is first Tone
mapping information in which either one of values 0, 2, and 3 is 5 set as a value of a
tone_map_model_id, and
wherein the brightness characteristic information is second Tone mapping
information in which 4 is set as the value of the tone_map_model_id.
10 Claim 5
The reproduction device according to claim 4,
wherein the tone_map_model_id of the first Tone mapping information and
the tone_map_model_id of the second Tone mapping information are each set with a
same value representing a recording mode of the recording medium.
15
Claim 6
The reproduction device according to claim 1,
wherein information related to reproduction of the coded data, the
information including a flag representing whether a recording of the extended video
20 as a master is being performed, is further recorded in the recording medium, and
wherein when the flag represents that the recording of the extended video as
the master is being performed, the decoding unit decodes the coded data.
Claim 7
25 The reproduction device according to claim 6,
wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a Clip Information file serving as the
information related to the reproduction.
30 Claim 8
The reproduction device according to claim 6,
94
wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a PlayList file serving as the information
related to the reproduction.
5 Claim 9
A reproduction method comprising:
a step of reading out, from a recording medium that has recorded coded data
of an extended video that is a video having a second brightness range that is wider
than a first brightness range, brightness characteristic information that represents a
10 brightness characteristic of the extended video, and brightness conversion definition
information used when performing a brightness conversion of the extended video to
a standard video that is a video having the first brightness range, the coded data, the
brightness characteristic information, and the brightness conversion definition
information;
15 a step of decoding the coded data;
a step of converting the extended video obtained by decoding the coded data
to the standard video on a basis of the brightness conversion definition information;
a step of outputting data of the extended video and the brightness
characteristic information to a display device that is capable of displaying the
20 extended video; and
a step of outputting data of the standard video to a display device that is not
capable of displaying the extended video.
Claim 10
25 A recording medium,
wherein
coded data of an extended video that is a video having a second
brightness range that is wider than a first brightness range,
brightness characteristic information that represents a brightness
30 characteristic of the extended video, and
brightness conversion definition information used when performing
95
a brightness conversion of the extended video to a standard video that is a video
having the first brightness range
are recorded, and
wherein a reproduction device that reproduces the recording medium
executes 5 processing of
reading out the coded data, the brightness characteristic
information, and the brightness conversion definition information from the recording
medium,
decoding the coded data,
10 converting the extended video obtained by decoding the coded data
to the standard video on a basis of the brightness conversion definition information,
outputting data of the extended video and the brightness
characteristic information to a display device that is capable of displaying the
extended video, and
15 outputting data of the standard video to a display device that is not
capable of displaying the extended video.
Claim 11
A reproduction device, comprising:
20 a readout unit configured to read out, from a recording medium that has
recorded coded data of a standard video that is obtained by performing a brightness
conversion of an extended video that is a video having a second brightness range that
is wider than a first brightness range, the standard video being a video having the
first brightness range, brightness characteristic information that represents a
25 brightness characteristic of the extended video, and brightness conversion definition
information used when performing the brightness conversion of the standard video to
the extended video, the coded data, the brightness characteristic information, and the
brightness conversion definition information;
a decoding unit configured to decode the coded data;
30 a conversion unit configured to convert the standard video obtained by
decoding the coded data to the extended video on a basis of the brightness
96
conversion definition information; and
an output unit configured to output data of the extended video and the
brightness characteristic information to a display device that is capable of displaying
the extended video and configured to output data of the standard video to a display
device that is not capable of displaying the 5 extended video.
Claim 12
The reproduction device according to claim 11,
wherein the brightness characteristic information and the brightness
10 conversion definition information are inserted, as auxiliary information of the coded
data, in a stream including the coded data and are recorded in the recording medium.
Claim 13
The reproduction device according to claim 12,
15 wherein the coded data is coded data of an HEVC, and the brightness
characteristic information and the brightness conversion definition information are
each an SEI of an HEVC stream.
Claim 14
20 The reproduction device according to claim 13,
wherein the brightness conversion definition information is first Tone
mapping information in which either one of values 0, 2, and 3 is set as a value of a
tone_map_model_id, and
wherein the brightness characteristic information is second Tone mapping
25 information in which 4 is set as the value of the tone_map_model_id.
Claim 15
The reproduction device according to claim 14,
wherein the tone_map_model_id of the first Tone mapping information and
30 the tone_map_model_id of the second Tone mapping information are each set with a
same value representing a recording mode of the recording medium.
97
Claim 16
The reproduction device according to claim 11,
wherein information related to reproduction of the coded data, the
information including a flag representing whether a recording of 5 the extended video
as a master is being performed, is further recorded in the recording medium, and
wherein when the flag represents that the recording of the extended video as
the master is being performed, the decoding unit decodes the coded data.
10 Claim 17
The reproduction device according to claim 16,
wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a Clip Information file serving as the
information related to the reproduction.
15
Claim 18
The reproduction device according to claim 16,
wherein the recording medium is a Blu-ray Disc, and
wherein the flag is included in a PlayList file serving as the information
20 related to the reproduction.
Claim 19
A reproduction method comprising:
a step of reading out, from a recording medium that has recorded coded data
25 of a standard video that is obtained by performing a brightness conversion of an
extended video that is a video having a second brightness range that is wider than a
first brightness range, the standard video being a video having the first brightness
range, brightness characteristic information that indicates a brightness characteristic
of the extended video, and brightness conversion definition information used when
30 performing the brightness conversion of the standard video to the extended video, the
coded data, the brightness characteristic information, and the brightness conversion
98
definition information;
a step of decoding the coded data;
a step of converting the standard video obtained by decoding the coded data
to the extended video on a basis of the brightness conversion definition information;
a step of outputting data of the extended video 5 and the brightness
characteristic information to a display device that is capable of displaying the
extended video; and
a step of outputting data of the standard video to a display device that is not
capable of displaying the extended video.
10
Claim 20
A recording medium,
wherein
coded data of a standard video that is obtained by performing a
15 brightness conversion of an extended video that is a video having a second brightness
range that is wider than a first brightness range, the standard video being a video
having the first brightness range,
brightness characteristic information that represents a brightness
characteristic of the extended video, and
20 brightness conversion definition information used when performing
the brightness conversion of the standard video to the extended video,
are recorded, and
wherein a reproduction device that reproduces the recording medium
executes processing of
25 reading out the coded data, the brightness characteristic
information, and the brightness conversion definition information from the recording
medium,
decoding the coded data,
converting the standard video obtained by decoding the coded data
30 to the extended video on a basis of the brightness conversion definition information,
outputting data of the extended video and the brightness
99
characteristic information to a display device that is capable of displaying the
extended video, and
outputting data of the standard video to a display device that is not
capable of displaying the extended video.