FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
“RECEPTION DEVICE, METHOD FOR CONTROLLING
SAME, DISTRIBUTION DEVICE, DISTRIBUTION
METHOD, PROGRAM, AND DISTRIBUTION SYSTEM”
SONY CORPORATION, of 1-7-1, Konan, Minato-ku, Tokyo
108-0075, Japan
The following specification particularly describes the invention and the manner in
which it is to be performed.
2
Description
Title of Invention
RECEIVING DEVICE AND METHOD OF CONTROLLING THE SAME, DISTRIBUTION DEVICE AND DISTRIBUTION METHOD, PROGRAM, ANDDISTRIBUTION SYSTEM
Technical Field
[0001]
10 The present technology relates to a receiving device and a method of
controlling the receiving device, a distribution device and a distribution method, a
program, and a distribution system, and particularly to a receiving device and a
method of controlling the receiving device, a distribution device and a distribution
method, a program, and a distribution system that allow display of fragmented text
15 information to be continued.
Background Art
[0002]
With the proliferation of the Internet in recent years, various services related
20 to Internet streaming are provided such as IPTV (Internet Protocol TeleVision) for
distributing videos, for example, by using IP (Internet Protocol). As a move toward
standardization in Internet streaming, methods applied to VOD (Video On Demand)
streaming and live streaming by HTTP (HyperText Transfer Protocol) streaming are
being standardized. A MP4 file format is a highly promising format for container
25 layers.
[0003]
When subtitle data is stored as a component of a stream, a subtitle is
displayed based on a file which stores the subtitle data (for example, see Patent
Literature 1).
30 [0004]
Utilizing TTML (Timed Text Markup Language), which has been
3
standardized by W3C (World Wide Web Consortium), is becoming a standard for
displaying subtitles. The TTML of the W3C is being increasingly adopted by other
standardization organizations, and has received attention as a Timed Text-based
promising format.
5 [0005]
It is said that TTML is an XML (Extensible Markup Language) document,
and thus it takes a relatively long time for processing. Thus, when an XML
document is applied to live streaming, chunked TTML document instances, which
are continuously generated as fragments in a short time, must be processed in real
10 time, and so an idea needs to be implemented in a format or a processing system.
For this reason, at the present, it is considered that a TTML storing method for
enabling real-time processing is indispensable in DASH (Dynamic Adaptive
Streaming over HTTP) which is a prospective standard for an adaptive streaming
format and in MP4 which is the main file format for streaming.
15
Citation List
Patent Literature
[0006]
Patent Literature 1: JP 2009-301605A
20
Summary of Invention
Technical Problem
[0007]
Structurally, the TTML is divided into the following types: an initialization
25 document instance which specifies an attribute of a layout or a style, and a body
document instance which consists of character strings to be displayed. This is a
specification in the TTML and is already defined as Informative Annex.
[0008]
It is possible to combine TTML documents having those two types of
30 description into a single document for distribution. However, parsing the entire
XML documents by a receiving side for each distribution may cause the overhead of
4
a processing system to increase. It is sufficient to notify the receiving side only
once of attributes related to a display format such as a Style attribute and a Layout
attribute of the TTML at the time of rendering context initialization. The receiving
side may be notified of actual TTML text chunk (character string to be displayed)
separately subsequent to a description necessary for setting 5 a rendering context.
[0009]
However, fragmented text information separately sent in this manner cannot
be continued to be displayed when a subsequent fragment is acquired while the text
information is on display. Particularly, in the case of live broadcast, it is not known
10 beforehand that text information corresponding to which subtitle is to be displayed at
which timing, and thus the text information currently on display cannot be continued
to be displayed.
[0010]
For this reason, a technical method is needed to be established which allows
15 display of fragmented text information to be continued.
[0011]
The present technology has been made in consideration of such a situation
and allows display of fragmented text information to be continued.
20 Solution to Problem
[0012]
According to a first embodiment of the present technology, there is provided
a receiving device including a receiving unit configured to receive a stream of a
content to be distributed live, an analysis unit configured to analyze fragmented text
25 information corresponding to subtitle data included in the received stream, and a
control unit configured to control display of first text information so as to allow the
display to be continued when second text information out of the text information is
displayed based on a result of the analysis, the second text information being started
to be displayed temporally after the first text information is displayed.
30 [0013]
The text information includes a structured document that describes a content,
5
and a display definition document that defines a display format which is applied to
the structured document. A time indicating start of display of the first text
information is described in a first structured document that describes a content of the
first text information. A time indicating end of display of the first text information
and a time indicating start of display of the second text information 5 are described in a
second structured document that describes a content of the second text information.
The control unit starts display of the first text information according to the time
indicating the start of display of the first text information described in the first
structured document, and later ends display of the first text information on display
10 according to the time indicating the end of display of the first text information
described in the second structured document, based on a result of the analysis.
[0014]
The time indicating the start of display of the second text information
described in the second structured document is temporally before the time indicating
15 the end of display of the first text information, and the control unit starts display of
the second text information according to the time indicating the start of display of the
second text information described in the second structured document, based on a
result of the analysis.
[0015]
20 A time indicating end of display of the second text information is further
described in the second structured document, and the control unit ends display of the
second text information according to the time indicating the end of display of the
second text information described in the second structured document, based on a
result of the analysis.
25 [0016]
The time indicating the end of display of the second text information
described in the second structured document is temporally after the time indicating
the end of display of the first text information.
[0017]
30 The same display definition document is applied to the structured document
until a definition content of the display format is modified.
6
[0018]
The stream is data of a format which complies with a MP4 file format, and
the subtitle data complies with a timed text markup language (TTML) standard.
[0019]
A control method and a program according to a first aspect 5 of the present
technology correspond to a receiving device according to the first aspect of the
above-described present technology.
[0020]
In the receiving device, the control method, and the program according to
10 the first aspect of the present technology, a stream of a content to be distributed live
is received, fragmented text information corresponding to subtitle data included in
the received stream is analyzed, and display of first text information is controlled so
as to allow the display to be continued when second text information out of the text
information is displayed based on a result of the analysis, the second text information
15 being started to be displayed temporally after the first text information is displayed.
[0021]
According to a second embodiment of the present technology, there is
provided a distribution device including a content generation unit configured to
generate a stream of a content for live distribution, a text information acquisition unit
20 configured to acquire fragmented text information so as to allow display of first text
information to be continued when second text information is displayed as text
information corresponding to subtitle data of the content, the second text information
being started to be displayed temporally after the first text information is displayed,
and a distribution unit configured to distribute the stream of the content including the
25 subtitle data on live.
[0022]
A distribution method and a program according to a second aspect of the
present technology correspond to a distribution device according to the second aspect
of the above-described present technology.
30 [0023]
In the distribution device, the distribution method, and the program
7
according to the second aspect of the present technology, a stream of a content for
live distribution is generated, fragmented text information is acquired so as to allow
display of first text information to be continued when second text information is
displayed as text information corresponding to subtitle data of the content, the second
text information being started to be displayed temporally 5 after the first text
information is displayed, and the stream of the content including the subtitle data is
distributed live.
[0024]
According to a second embodiment of the present technology, there is
10 provided a distribution system including a distribution device and a receiving device.
The distribution device includes a content generation unit configured to generate a
stream of a content for live distribution, a text information acquisition unit
configured to acquire fragmented text information so as to allow display of first text
information to be continued when second text information is displayed as text
15 information corresponding to subtitle data of the content, the second text information
being started to be displayed temporally after the first text information is displayed,
and a distribution unit configured to distribute the stream of the content including the
subtitle data on live. The receiving device includes a receiving unit configured to
receive the stream of the content, an analysis unit configured to analyze the text
20 information fragmented corresponding to the subtitle data included in the received
stream, and a control unit configured to control display of the first text information
so as to allow the display to be continued when the second text information out of the
text information is displayed based on a result of the analysis.
[0025]
25 The distribution device and the receiving device may be each an
independent device or may be each a block included in one device.
[0026]
In a distribution system according to a third aspect of the present technology,
by the distribution system, a stream of a content for live distribution is generated,
30 fragmented text information is acquired so as to allow display of first text
information to be continued when second text information is displayed as text
8
information corresponding to subtitle data of the content, the second text information
being started to be displayed temporally after the first text information is displayed,
and the stream of the content including the subtitle data is distributed live; and by the
receiving device, the stream of the content is received, the text information
fragmented corresponding to the subtitle data included in the 5 received stream is
analyzed, and display of the first text information is controlled so as to allow the
display to be continued when the second text information out of the text information
is displayed based on a result of the analysis.
10 Advantageous Effects of Invention
[0027]
According to the first to third aspects of the present technology, display of
fragmented text information can be continued.
15 Brief Description of Drawings
[0028]
[FIG. 1] FIG. 1 is a diagram illustrating the configuration of TTML.
[FIG. 2] FIG. 2 is a diagram illustrating the configuration of a BOX in an MP4 file
format.
20 [FIG. 3] FIG. 3 is a diagram illustrating a hierarchical structure of a BOX.
[FIG. 4] FIG. 4 is a diagram illustrating streaming using the MP4 file format.
[FIG. 5] FIG. 5 is a diagram illustrating a configuration of a Movie.
[FIG. 6] FIG. 6 is a diagram illustrating a BOX structure in a Movie.
[FIG. 7] FIG. 7 is a diagram illustrating a configuration of a Non-fragment Movie.
25 [FIG. 8] FIG. 8 is a diagram illustrating a configuration of a Fragmented Movie.
[FIG. 9] FIG. 9 is a diagram illustrating a configuration example of a streaming
distribution system according to an embodiment of the present technology.
[FIG. 10] FIG. 10 is a diagram illustrating subtitles which are superimposed and
displayed on a video in time series in an IPTV client.
30 [FIG. 11] FIG. 11 is a figure illustrating a description example of an Initialization
Document Instance.
9
[FIG. 12] FIG. 12 is a figure illustrating a description example of a Body Document
Instance.
[FIG. 13] FIG. 13 is a figure illustrating a display example of a subtitle.
[FIG. 14] FIG. 14 is a figure illustrating a description example of a Body Document
5 Instance.
[FIG. 15] FIG. 15 is a figure illustrating a display example of a subtitle.
[FIG. 16] FIG. 16 is a figure illustrating a display example of a subtitle.
[FIG. 17] FIG. 17 is a figure illustrating a display example of a subtitle.
[FIG. 18] FIG. 18 is a flow chart illustrating streaming distribution processing.
10 [FIG. 19] FIG. 19 is a flow chart illustrating subtitle data insertion processing.
[FIG. 20] FIG. 20 is a flow chart illustrating content reproduction processing.
[FIG. 21] FIG. 21 is a flow chart illustrating TT decode processing.
[FIG. 22] FIG. 22 is a flow chart illustrating Body Document Instance processing.
[FIG. 23] FIG. 23 is a diagram illustrating a configuration example of a computer.
15
Description of Embodiments
[0029]
Hereinafter, an embodiment of the present technology will be described with
reference to the drawings.
20 [0030]
First, TTML will be described. The TTML is a markup language defined
by the W3C and is capable of specifying a display position (layout) of a text, timing
for display or the like.
[0031]
25 For example, information described in the TTML is transmitted from a
server and analyzed by a client, and a predetermined character string thereby can be
displayed on a display of the client at a specified time, in a specified font, and in a
specified area. Using the information described in the TTML in this manner,
subtitles can be displayed in synchronization with, for example, a video or an audio
30 in a content.
[0032]
10
The TTML includes a set of texts each of which is called a Document
Instance. The Document Instance is mainly classified into two types. One is a
Document Instance called an Initialization Document Instance, which includes a
description that specifies, for example, a color, a font, a display position or the like of
characters to be displayed as a subtitle. The other is a Document 5 Instance called a
Body Document Instance, which includes a description of a character string or the
like actually displayed as a subtitle.
[0033]
In the following description, Initialization Document Instance may be
10 abbreviated and denoted as Init Instance. Furthermore, Body Document Instance
may be abbreviated and denoted as Body Instance.
[0034]
[Configuration of TTML]
FIG. 1 is a diagram illustrating the configuration of TTML.
15 [0035]
As illustrated in FIG. 1, in an Initialization Document Instance, a rendering
context such as a color, a font, and a display position of characters to be displayed as
a subtitle is specified by an element such as a styling element and a layout element.
[0036]
20 In this example, a rendering context, s1 is defined by the description of
"" which is a layout element. For
example, a plurality of types of rendering context such as s1, s2, ... can also be
defined in one Initialization Document Instance.
[0037]
25 An element such as p-element is described in a Body Document Instance.
For example, a character string in a subtitle, and attributes such as a display start time
and a display end time are specified by the description of "

" which is
p-element.
[0038]
30 In this manner, the TTML provides a description having a hierarchical
structure including a combination of Initialization Document Instance and Body
11
Document Instance. A hierarchical structure including these instances is illustrated
in a lower left area of FIG. 1.
[0039]
For example, in a receiver which receives and displays a stream,
predetermined text information (character string) can 5 be displayed in a
predetermined time interval in a content by causing the receiver to receive and
analyze the TTML illustrated in FIG. 1. That is, the subtitle display is changed as
appropriate in a display of the receiver based on the character string and attributes
indicating a display start time, a display end time or the like which are specified by
10 the p-elements of the Body Document Instance. In the example of FIG. 1, character
string F1, character string F2 ... specified by the p-elements of the Body Document
Instance are displayed in a switching manner with the passage of time.
[0040]
The detail of TTML is disclosed, for example, in "Timed Text Markup
15 Language (TTML) 1.0" W3C Recommendation 18 November 2010.
[0041]
[Detail of MP4 File Format]
Next, a MP4 file format will be described. The MP4 file format is a file
format with a high degree of flexibility, and is defined such that an MP4 file is
20 constituted by a set of data called BOX with various sizes. BOX has various types
and can be expanded arbitrarily.
[0042]
The configuration of BOX in the MP4 file format is illustrated in FIG. 2.
In FIG. 2, the size and type (kind) of BOX are described in the areas displayed as
25 Box Size and Box Type. For example, video data, audio data, data of subtitles or
the like, which have been encoded, are stored in the area displayed as Box Data.
[0043]
In the MP4 file format, the above-described BOX is defined so as to have a
hierarchical structure. That is, as illustrated in FIG. 3, a BOX at a lower hierarchy
30 can be stored in the Box Data area of a BOX at a higher hierarchy.
[0044]
12
In the MP4 file format, the unit data of transmitted content, for example, a
decoding unit of audio data, or one frame of video data is called a Sample. A
plurality of Samples then forms a Chunk. For example, as illustrated in FIG. 4,
Chunks of audio and Chunks of video form streaming.
5 [0045]
In the MP4 file format, for example, a set of Chunks in a series of videos,
and a set of Chunks in a series of audios are each called a Track. Data which is
formed by integrating a plurality of Tracks is called a Movie.
[0046]
10 FIG. 5 is a diagram illustrating a configuration of a Movie. In the example
of FIG. 5, a Movie is formed by a video Track and an audio Track. As described
above, a Movie has a BOX structure. FIG. 6 is a diagram illustrating a BOX
structure in a Movie. In the example of FIG. 6, a Movie Metadata box and a Movie
Data box are stored in the BOX of the Movie.
15 [0047]
The Movie Metadata box is a BOX in which information related to the
storage position of each Sample stored in the Movie Data box and information
related to a reproduction time and a reproduction time interval are described. For
example, adrs = 1000 or the like is described as information related to the storage
20 position of each Sample, and Δt = 10 or the like is described as information related to
a reproduction time and a reproduction time interval. A codec parameter or the like
is described as necessary. The Movie Data box is a BOX in which each Sample is
stored. According to the specification of the MP4 file format, Movie Metadata box
is called moov and Movie Data box is called mdat.
25 [0048]
Sample1, Sample2, Sample3, ... can be reproduced at time t0, t10, t20, ... by
receiving and analyzing the Movie as illustrated in FIG. 6 with a receiver.
[0049]
The Movie is generally classified into two types. One is called a Non30
fragment Movie, which is suitable, for example, for transmission of a content such as
a movie or a drama. The other is called a Fragmented Movie, which is suitable, for
13
example, for transmission of a content such as news or a sport relay broadcast.
[0050]
FIG. 7 is a diagram illustrating the configuration of the Non-fragment Movie.
[0051]
As illustrated in FIG. 7, a BOX called a File Type (ftyp) 5 is disposed at the
head of the Non-fragment Movie. The ftyp is a BOX in which a file type,
compatibility information or the like are stored. The above-described moov and
mdat are disposed subsequent to the ftyp. As described above, in the moov, a codec
parameter, a storage position information, reproduction time information or the like
10 are described. As described above, in the mdat, Samples including a decoding unit
of audio data and one frame of video data are stored.
[0052]
In a Non-fragment Movie, the rendering context of the entire Movie is
defined by the moov. That is, in the case of content such as a movie or a drama, it
15 is known beforehand that which video, which audio, and which subtitle are to be
reproduced at which timing, and thus the rendering context of the entire Movie can
be defined before each Sample is received.
[0053]
On the other hand, in the case of live content such as news or a sport relay
20 broadcast, it is not known beforehand that which video, which audio, and which
subtitle are to be reproduced at which timing. For this reason, a Fragmented Movie
is adopted for transmission of a live content.
[0054]
FIG. 8 is a diagram illustrating a configuration of a Fragmented Movie.
25 [0055]
As illustrated in FIG. 8, similarly to the case of Non-fragment Movie, the
ftyp and moov are disposed in the Fragmented Movie, however, a plurality of BOXes
called Fragments is disposed following the ftyp and moov. A Fragment includes a
BOX called a Movie Fragment (moof) and a mdat. In the example of FIG. 8, each
30 Fragment includes a moof which is, so to speak, the header information of the
Fragment. In the moof, there are described the storage position information, the
14
reproduction time information or the like regarding the Sample in the mdat stored in
the Fragment. That is, in contrast to the case of Non-fragment Movie, the rendering
context for each Fragment is defined in each Fragment in the Fragmented Movie.
[0056]
The Movie Fragment Random Access (mfra) illustrated 5 in FIG. 8 is a BOX
which is inserted in the end of the Fragmented Movie and which stores information
for random access or the like.
[0057]
The examples illustrated in FIGS. 7 and 8 each illustrate the configuration
10 of a Movie as the MP4 file format, and for example, when internet streaming or the
like is performed, the above-described data is distributed in a predetermined
transmission format as seen from FIGS. 7 and 8. In the transmission format, for
example, the moov illustrated in FIG. 8 is inserted between Fragments and is
distributed repeatedly multiple times.
15 [0058]
On the other hand, as described above, for standardization of internet
streaming such as the IPTV, whether the MP4 file format is used as the format to be
adopted in the container layers is being discussed. When a subtitle is included as a
component of streaming, the TTML is often used and has received attention in
20 standardization of streaming.
[0059]
For example, when a subtitle is inserted in a video of live content such as
news, the character string (text information) for the subtitle cannot be determined
beforehand. For this reason, it is necessary to perform processing of inserting the
25 character string for the subtitle as needed during streaming of a broadcast. In such a
case, it is preferable, for example, for a receiver to receive a TTML Initialization
Document Instance and to analyze a rendering context, then to receive a Body
Document Instance as needed.
[0060]
30 However, fragmented pieces of text information, which are sent separately
from one Body Document Instance to another in this manner, are independent from
15
one Body Document Instance to another. Therefore, when a subsequent piece of
text information display is attempted to be made while a certain fragmented piece of
text information is displayed, the previous piece of text information display cannot
be continued. Particularly, in a live content such as news, it is not known
beforehand that which video, which audio, and which subtitle are 5 to be reproduced at
which timing, and a technical method for continuing to display currently displayed
text information has not been established.
[0061]
Thus, in the present technology, when the text information of a subtitle is
10 inserted in a content which is transmitted as a Fragmented Movie, continuous display
of the fragmented text information is made possible.
[0062]
[Streaming Distribution System]
FIG. 9 is a diagram illustrating a configuration example of a streaming
15 distribution system according to an embodiment of the present technology. The
streaming distribution system 10 illustrated in FIG. 9 includes a TT server 20, an
IPTV server 30, and an IPTV client 40.
[0063]
The IPTV server 30 is formed, for example, as a transmitter that broadcasts
20 contents via streaming, and the IPTV client 40 is formed, for example, as a receiver
that receives a broadcast via streaming. The TT server 20 is a device that generates
data related to a subtitle to be inserted in the content which is broadcast via streaming.
[0064]
The TT server 20 includes a TT fragment generation unit 21 and a sample
25 insertion unit 22.
[0065]
The TT fragment generation unit 21 generates Fragment data in which a
TTML Document Instance is stored, and supplies the Fragment data to the sample
insertion unit 22. Here, referring to FIG. 8, Fragment data, in which the TTML
30 Document Instance as described above is stored, is generated.
[0066]
16
The sample insertion unit 22 generates a TTML Document Instance. The
sample insertion unit 22 inserts the generated TTML Document Instance as a Sample
of the mdat in the Fragment data from the TT fragment generation unit 21. The
sample insertion unit 22 outputs the Fragment data to the IPTV server 30, the
Fragment data having the TTML Document Instance 5 inserted therein.
[0067]
An NTP synchronized time stamp generated by a time stamp generation unit
25 is suitably supplied to the TT fragment generation unit 21 and the sample
insertion unit 22.
10 [0068]
The IPTV server 30 includes a content sample generation unit 31, a
fragment multiplexer 32, and a fragment distribution unit 33.
[0069]
The content sample generation unit 31 encodes, for example, data of an
15 audio or a video included in a content, and generates audio data, video data or the
like. The content sample generation unit 31 generates a Sample based on those
audio data, video data or the like, and supplies the Sample to the fragment
multiplexer 32.
[0070]
20 The Fragment data from the sample insertion unit 22 of the TT server 20
and the Sample data from the content sample generation unit 31 are supplied to the
fragment multiplexer 32. The fragment multiplexer 32 generates a Fragment
having a mdat in which the Sample data from the content sample generation unit 31
is stored.
25 [0071]
The fragment multiplexer 32 multiplexes the generated Fragment data and
the Fragment data from the sample insertion unit 22. That is, the Fragment in
which audio data, video data are stored, and the Fragment in which the TTML
Document Instance is stored are multiplexed. The fragment multiplexer 32 supplies
30 the multiplexed Fragment data to the fragment distribution unit 33.
[0072]
17
The fragment distribution unit 33 distributes the multiplexed Fragment data
from the fragment multiplexer 32 via a network or the like. In this manner, the
content is distributed via streaming.
[0073]
The NTP synchronized time stamp generated by the 5 time stamp generation
unit 25 is suitably supplied to the content sample generation unit 31 and the fragment
multiplexer 32.
[0074]
The IPTV client 40 includes a time clock unit 41, a receiving unit 42, a
10 fragment demultiplexer 43, a TT decoder 44, a content decoder 45, and a display
control unit 46.
[0075]
The time clock unit 41 supplies NTP synchronized time information to each
unit of the IPTV client 40.
15 [0076]
The receiving unit 42 receives a Fragmented Movie transmitted from the
IPTV server 30 via a network, and supplies the Fragmented Movie to the fragment
demultiplexer 43.
[0077]
20 The fragment demultiplexer 43 acquires the Fragmented Movie from the
receiving unit 42 and extracts each Fragment included in the Fragmented Movie.
The fragment demultiplexer 43 analyzes the description of moov to determine
whether or not the Fragmented Movie includes a Fragment in which a TTML
Document Instance is stored.
25 [0078]
When it is determined that a Fragment in which a TTML Document
Instance is stored is included, the fragment demultiplexer 43 supplies the data of the
Fragment to the TT decoder 44. On the other hand, when it is determined that a
Fragment in which a TTML Document Instance is stored is not included, the
30 fragment demultiplexer 43 supplies the data of the Fragment to the content decoder
45.
18
[0079]
The data of the Fragment, in which the TTML Document Instance from the
fragment demultiplexer 43 is stored, is supplied to the TT decoder 44. The TT
decoder 44 decodes the data of a Sample in which the TTML Document Instance is
stored. The decoding by the TT decoder 44 primarily means syntactic 5 analysis of
TTML Document Instances.
[0080]
The TT decoder 44 analyzes the description of the moof in the Fragment to
determine the type of the TTML Document Instance stored in the Fragment. When
10 it is determined that the type of the TTML Document Instance is Initialization
Document Instance, the TT decoder 44 analyzes the description of the Initialization
Document Instance stored in the Sample of the mdat, and set a rendering context.
[0081]
After a rendering context is once set, only in the case where it is determined
15 that the Initialization Document Instance has been modified, the TT decoder 44
analyzes the description of the Initialization Document Instance stored in the Sample
of the mdat, and sets a rendering context again.
[0082]
When it is determined that the type of the TTML Document Instance is
20 Body Document Instance, the TT decoder 44 analyzes the Body Document Instance
stored in the Sample of the mdat, and generates display data of a subtitle. The
display data of the subtitle generated here along with information related to display
time is supplied to the display control unit 46.
[0083]
25 The data of the Fragment, in which the TTML Document Instance from the
fragment demultiplexer 43 is not stored, is supplied to the content decoder 45. The
content decoder 45 decodes the audio data, the video data or the like which are stored
in the Sample of the mdat, and generates video display data, audio output data or the
like. The video display data, audio output data or the like generated here along with
30 information related to display time, output time or the like are supplied to the display
control unit 46.
19
[0084]
Information from the TT decoder 44 related to the display data and display
time of the subtitle, or information related to video display data and display time and
information related to audio output data and output time from the content decoder 45
are supplied to the display 5 control unit 46.
[0085]
The display control unit 46 generates video signals for superimposing and
displaying the subtitle on the video of the content based on the information related to
display time, and supplies the video signals to a display (not illustrated) in a
10 subsequent stage. In addition, the display control unit 46 generates audio signals
for outputting the audio of the content based on the information related to the output
time, and supplies the audio signals to a speaker (not illustrated) in a subsequent
stage.
[0086]
15 The streaming distribution system 10 is formed as described above.
[0087]
[Display Example of Subtitle]
By the streaming distribution system 10 of FIG. 9, display of subtitles, for
example, as shown below can be controlled. FIG. 10 is a diagram illustrating
20 subtitles in time series which are superimposed and displayed on the video of a
content in the IPTV client 40 which receives the content distributed live as a
Fragmented Movie.
[0088]
For example, when the TTML Document Instance (Init Instance) as
25 illustrated in FIG. 11 is stored in a Fragment by the TT server 20 and is distributed
from the IPTV server 30, the data of Fragment0 distributed as a Fragmented Movie is
received by the IPTV client 40.
[0089]
FIG. 11 is an example of description of an Initialization Document Instance.
30 In the example of FIG. 11, description is written to specify the color, the font or the
like of the characters of the subtitle, and "subtitleArea1" and "subtitleArea2" are
20
described as the display position of the subtitle.
[0090]
Returning to FIG. 10, when Fragment0, in which the Sample (Sample0) in
mdat0 is stored, is acquired by the IPTV client 40, the Sample storing the
Initialization Document Instance of FIG. 11, rendering contexts such 5 as the color, the
font, and the display position of the characters of text information to be displayed as
the subtitle are specified.
[0091]
When the TTML Document Instance (Body Instance1) as illustrated in FIG.
10 12 is stored in a Fragment by the TT server 20 and is distributed from the IPTV
server 30, the data of Fragment1 distributed as a Fragmented Movie is received by
the IPTV client 40.
[0092]
FIG. 12 is an example of description of a Body Document Instance. In the
15 example of FIG. 12, the character string of "It seems a paradox, does it not,"
specified by the start tag and end tag of p-element is the character string in the
subtitle. In addition, an id attribute, a begin attribute, a region attribute are
specified as the attributes of p-element. For the id attribute, an ID for identifying
the subtitle is specified. For the begin attribute, a display start time of the subtitle is
20 specified. For the region attribute, a character string for specifying the display
position of the subtitle is specified.
[0093]
Returning to FIG. 10, when Fragment1, in which the Sample (Sample1) in
mdat1 is stored, is acquired by the IPTV client 40, the Sample storing the Body
25 Document Instance (Body Instance1) of FIG. 12, the character string in the subtitle,
specified by the description of FIG. 12 is displayed based on the rendering context
which is set according to the description of FIG. 11. That is, "0.1 s" is specified as
the begin attribute in the Body Document Instance of FIG. 12, and thus the character
string of "It seems a paradox, does it not," as illustrated in FIG. 13 is displayed by the
30 IPTV client 40 after a lapse of 0.1 second since the Body Document Instance is
acquired.
21
[0094]
In the example of FIG. 12, "subtitle1" is specified as the id attribute, and
thus the character string in the subtitle is identified by "subtitle1". Furthermore,
"subtitleArea1" is specified as the region attribute, and thus the character string in the
subtitle is displayed at the display position specified by "subtitleArea1" 5 of FIG. 11.
[0095]
Subsequently, when the TTML Document Instance (Body Instance2) as
illustrated in FIG. 14 is stored in a Fragment by the TT server 20 and is distributed
from the IPTV server 30, the data of Fragment2 distributed as a Fragmented Movie is
10 received by the IPTV client 40.
[0096]
FIG. 14 is an example of description of a Body Document Instance. In the
example of FIG. 14, the character string in the subtitle is formed by the character
string of "It seems a paradox, does it not," identified by "subtitle1" which is the id
15 attribute of the p-element in the upper row, and the character string of "that the image
formed on the Retina should be inverted ?" identified by "subtitle2" which is the id
attribute of the p-element in the lower row. For the p-element in the upper row, "3
s" is specified as the end attribute for specifying the display end time of the subtitle
and "subtitleArea1" is specified as the region attribute. In addition, for the p20
element in the lower row, "1s", "5s", "subtitleArea2" are specified as the begin
attribute, the end attribute, the region attribute, respectively.
[0097]
Returning to FIG. 10, when Fragment2, in which the Sample (Sample2) in
mdat2 is stored, is acquired by the IPTV client 40, the Sample storing the Body
25 Document Instance (Body Instance2) of FIG. 14, the character string in the subtitle,
specified by the description of FIG. 14 is displayed based on the rendering context
which is set according to the description of FIG. 11. That is, "1 s" is specified in the
Body Document Instance of FIG. 14 as the begin attribute of the character string in
the subtitle identified by "subtitle2", and thus only the character string of "It seems a
30 paradox and does it not", which is identified by subtitle1 as illustrated in FIG. 15, is
displayed by the IPTV client 40 after a lapse of 1 second since the Body Document
22
Instance is acquired.
[0098]
Subsequently, when 1 second, which is specified by the begin attribute of
"subtitle2", elapses since the Body Document Instance of FIG. 14 is acquired, "that
the image formed on the Retina should be inverted ?" of "subtitle2" 5 is displayed as
illustrated in FIG. 16 in the lower row of the character string of "It seems a paradox,
does it not" which is identified by "subtitle1". Because "subtitleArea2" is specified
as the region attribute, the character string in the subtitle of "subtitle2" is displayed at
the display position specified by "subtitleArea2" of FIG. 11.
10 [0099]
The character strings in the subtitle identified by "subtitle1" and "subtitle2"
of FIG. 16 are continued to be displayed in the upper and lower rows during the
interval from the time specified by the begin attribute of the character string in the
subtitle identified by "subtitle2" to the time specified by the end attribute of the
15 character string in the subtitle identified by "subtitle1". When 3 seconds, which is
specified by the end attribute of "subtitle1", has elapsed after the Body Document
Instance (Body Instance2) of FIG. 14 is acquired, the display of the character string
in the subtitle of "subtitle1" is erased, and only the character string in the subtitle of
"subtitle2" is on display as illustrated in FIG. 17.
20 [0100]
Returning to FIG. 10, subsequently, only the character string in the subtitle,
identified by "subtitle2" of FIG. 17 is continued to be displayed during the interval
from the time specified by the end attribute of the character string in the subtitle
identified by "subtitle1" to the time specified by the end attribute of the character
25 string in the subtitle identified by "subtitle2". When 5 seconds, which is specified
by the end attribute of "subtitle2", has elapsed after the Body Document Instance
(Body Instance2) of FIG. 14 is acquired, the display of the character string in the
subtitle of "subtitle2" is erased and the display of the subtitle is terminated.
[0101]
30 In this manner, for example, when the Body Document Instance (Body
Instance2) of FIG. 14 is acquired subsequent to the Body Document Instance (Body
23
Instance1) of FIG. 12, the begin attribute of the character string in the subtitle of
"subtitle1" is specified by Body Instance1, and the end attribute thereof is specified
by Body Instance2. Consequently, even after Body Instance2 is acquired, the
character string in the subtitle of "subtitle1" is allowed to be continued to be
5 displayed.
[0102]
[Streaming Distribution Processing]
Next, the detail of the processing performed by each device included in the
streaming distribution system 10 of FIG. 9 will be described.
10 [0103]
First, the streaming distribution processing performed by the IPTV server 30
will be described with reference to the flow chart of FIG. 18. The processing is
performed, for example, when a subtitle is inserted in a live content and is distributed
as a Fragmented Movie via a network or the like.
15 [0104]
In step S21, the IPTV server 30 acquires the data of the content. At this
point, for example, data or the like of an audio and a video included in the content
are acquired.
[0105]
20 In step S22, the content sample generation unit 31 encodes, for example, the
data of the audio and video included in the content, and generates audio data, video
data or the like. The content sample generation unit 31 then generates data of a
Sample based on those audio data and video data.
[0106]
25 In step S23, the fragment multiplexer 32 generates a Fragment which stores
the data of the Sample generated in step S22 into the mdat.
[0107]
In step S24, the TT server 20 performs subtitle data insertion processing.
Thus, data related to the subtitle is inserted in the data of a content to be distributed
30 via streaming.
[0108]
24
Here, the detail of the subtitle data insertion processing corresponding to
step S24 of FIG. 18 will be described with reference to the flow chart of FIG. 19.
[0109]
In step S41, a TTML sentence is generated.
5 [0110]
In step S42, the TT fragment generation unit 21 generates data of a
Fragment in which a TTML Document Instance is stored.
[0111]
In step S43, the sample insertion unit 22 generates a TTML Document
10 Instance based on the TTML sentence generated in step S41 and inserts the TTML
Document Instance as a Sample of the mdat in the Fragment generated in step S42.
[0112]
In step S44, the sample insertion unit 22 outputs the Fragment in which the
TTML Document Instance has been inserted by the processing in step S43.
15 Consequently, the Fragment is supplied to the fragment multiplexer 32 of the IPTV
server 30.
[0113]
An NTP synchronized time stamp generated by the time stamp generation
unit 25 is suitably supplied to the TT fragment generation unit 21 and the sample
20 insertion unit 22.
[0114]
Returning to the flow chart of FIG. 18, after the processing in step S24, in
step S25, the fragment multiplexer 32 multiplexes the Fragment generated in step
S42 of FIG. 19 and the Fragment generated in step S23. That is, here, the Fragment
25 in which audio data and video data or the like are stored, and the Fragment in which
a TTML Document Instance is stored are multiplexed.
[0115]
In step S26, the fragment multiplexer 32 generates data of a Fragment
Movie.
30 [0116]
In step S27, the fragment distribution unit 33 distributes the Fragment
25
Movie generated in step S26 via a network or the like.
[0117]
The streaming distribution processing is performed as described above.
[0118]
Next, the content reproduction processing performed 5 by the IPTV client 40
will be described with reference to the flow chart of FIG. 20.
[0119]
In step S61, the receiving unit 42 receives the Fragment Movie distributed
in step S27 of FIG. 18.
10 [0120]
In step S62, the fragment demultiplexer 43 analyzes the description of the
moov in the Fragment Movie received in step S61.
[0121]
In step S63, the fragment demultiplexer 43 extracts the Fragments included
15 in the Fragment Movie received in step S61.
[0122]
In step S64, the fragment demultiplexer 43 determines whether or not the
Fragment Movie includes a Fragment in which a TTML Document Instance is stored,
based on a result of the analysis in step S62.
20 [0123]
In step S64, when it is determined that the Fragment Movie includes a
Fragment in which a TTML Document Instance is stored, the processing proceeds to
step S65.
[0124]
25 In step S65, the fragment demultiplexer 43 checks the description of the
moof in each Fragment.
[0125]
In step S66, the fragment demultiplexer 43 determines whether or not a
TTML Document Instance is stored in the Fragment.
30 [0126]
In step S66, when it is determined that no TTML Document Instance is
26
stored in the Fragment, the processing proceeds to step S68 described below. On
the other hand, in step S66, when the fragment demultiplexer 43 determines that a
TTML Document Instance is stored in the Fragment, the processing proceeds to step
S67.
5 [0127]
In step S67, the TT decoder 44 performs TT decode processing.
[0128]
In the TT decode processing, when a result of the analysis of the description
of the moof in the Fragment indicates that the type of the TTML Document Instance
10 is an Initialization Document Instance, the description of the Initialization Document
Instance stored in the Sample of the mdat is analyzed, and a rendering context is set.
When the type of the TTML Document Instance is a Body Document Instance, the
Body Document Instance stored in the Sample of the mdat is analyzed, and display
data of a subtitle is generated. The display data of a subtitle, along with the
15 information related to display time specifying start of display and/or end of display,
is supplied to the display control unit 46.
[0129]
The detail of the TT decode processing will be described below with
reference to FIGS. 21 and 22.
20 [0130]
On the other hand, in step S64, when it is determined that the Fragment
Movie includes no Fragment in which a TTML Document Instance is stored, the
processing proceeds to step S68.
[0131]
25 In step S68, the content decoder 45 decodes the audio data, the video data or
the like stored in the Sample of the mdat.
[0132]
In step S69, the content decoder 45 outputs video display data, audio output
data or the like which have been obtained as a result of the processing in step S68.
30 The video display data, audio output data or the like generated here along with the
information related to display time, output time or the like are supplied to the display
27
control unit 46.
[0133]
In step S70, the display control unit 46 generates video signals for
superimposing and displaying the subtitle on the video of the content based on the
information related to the display time specifying start of display 5 and/or end of
display, and supplies the video signals to a display (not illustrated) in a subsequent
stage. In addition, the display control unit 46 generates audio signals for outputting
the audio of the content based on the information related to the output time, or the
like, and supplies the audio signals to a speaker (not illustrated) in a subsequent stage.
10 [0134]
That is, the video display data, the audio output data generated in step S69
of FIG. 20, and the display data of the subtitle generated in step S105 of FIG. 22
described below are synchronized, and displayed or outputted.
[0135]
15 In step S71, it is determined whether or not the Fragment Movie has ends.
For example, when the Movie Fragment Random Access (mfra) illustrated in FIG. 8
is received, it is determined that the Fragment Movie has ended. When a user
issues a command to stop the reception, it is determined that the Fragment Movie has
ended.
20 [0136]
In step S71, when it is determined that the Fragment Movie has not ended
yet, the processing returns to step S63 and the subsequent processing is repeated.
On the other hand, in step S71, when it is determined that the Fragment Movie has
ended, the content reproduction processing of FIG. 20 is terminated.
25 [0137]
The content reproduction processing is performed as described above.
[0138]
Next, the detail of the TT decode processing corresponding to step S67 of
FIG. 20 will be described with reference to the flow chart of FIG. 21.
30 [0139]
In step S81, the TT decoder 44 reads a Fragment from the fragment
28
demultiplexer 43.
[0140]
In step S82, the TT decoder 44 analyzes the description of the moof in the
Fragment, and determines whether or not the type of the TTML document instance is
an Initialization 5 Document Instance.
[0141]
In step S82, when it is determined that the type of the TTML Document
Instance is not an Initialization Document Instance, the processing proceeds to step
S83. In step S83, the TT decoder 44 removes the current Fragment. The
10 processing then returns to step S81 and the subsequent processing is repeated.
[0142]
On the other hand, in step S82, when it is determined that the type of the
TTML document instance is an Initialization Document Instance, the processing
proceeds to step S84. In step S84, the TT decoder 44 performs Initialization
15 Document Instance processing, analyzes the description of the Initialization
Document Instance stored in the Sample of the mdat, and sets a rendering context.
[0143]
When setting a rendering context is completed in step S84, the processing
proceeds to step S85. In step S85, the TT decoder 44 reads a Fragment from the
20 fragment demultiplexer 43.
[0144]
In step S86, the TT decoder 44 analyzes the description of the moof in the
Fragment, and determines whether or not the type of the TTML Document Instance
is an Initialization Document Instance.
25 [0145]
In step S86, when it is determined that the type of the TTML Document
Instance is not an Initialization Document Instance, the type has to be Body
Document Instance, and thus the processing proceeds to step S87. In step S87, the
TT decoder 44 performs Body Document Instance processing.
30 [0146]
Here, the Body Document Instance processing corresponding to step S87 of
29
FIG. 21 will be described with reference to the flow chart of FIG. 22.
[0147]
In step S101, the TT decoder 44 performs XML parser processing, and
extracts the elements included in the Body Document Instance. The TT decoder 44
performs the processing in step S102 and after sequentially for 5 each of one or a
plurality of elements which has been extracted.
[0148]
In step S102, the TT decoder 44 determines whether or not the extracted
element is a p-element. In step S102, when it is determined that the extracted
10 element is not a p-element, the processing proceeds to step S103. In step S103, the
TT decoder 44 processes elements other than p-element.
[0149]
When the processing in step S103 is completed, the processing proceeds to
step S108. In step S108, the TT decoder 44 determines whether or not the
15 processing for all elements is completed.
[0150]
In step S108, when it is determined that the processing for all elements is
not completed, the processing returns to step S102 and the determination processing
in step S102 is performed. In step S102, when it is determined that the extracted
20 element is a p-element, the processing proceeds to step S104. In step S104, the TT
decoder 44 determines whether or not a begin attribute is included in the p-element.
[0151]
In step S104, when it determined that a begin attribute is included in the pelement,
the processing proceeds to step S105. In step S105, the TT decoder 44
25 processes normal p-element.
[0152]
For example, when XML parser processing is performed on the Body
Document Instance of FIG. 12, normal processing for p-element is performed
because a begin attribute is included in the p-element, and thus display data of the
30 subtitle consisting of the character string of "It seems a paradox, does it not," is
generated. The generated display data of the subtitle, along with the information
30
related to display time specifying start of display after a lapse of 0.1 second, is
supplied to the display control unit 46.
[0153]
On the other hand, in step S104, when it is determined that a begin attribute
is not included in the p-element, the processing proceeds to step S106. 5 In step S106,
the TT decoder 44 determines whether or not the same subtitle is already displayed,
based on a result of analysis of the id attribute of the p-element.
[0154]
In step S106, when it is determined that the same subtitle is already
10 displayed, the processing proceeds to step S107. In step S107, the TT decoder 44
causes the subtitle on display to be continuously displayed.
[0155]
For example, when XML parser processing is performed on the Body
Document Instance of FIG. 14, the processing in step S107 is performed because a
15 begin attribute is not included in the p-element in the upper row, and in addition, the
subtitle having an id attribute of "subtitle1" is already displayed by the Body
Document Instance of FIG. 12. That is, the TT decoder 44 supplies the information
related to display time indicating, for example, end of display after a lapse of 3
seconds specified by an end attribute, so that the subtitle on display having an id
20 attribute of "subtitle1" is continued to be displayed.
[0156]
For example, a begin attribute is included in the p-element in the lower row
of the Body Document Instance of FIG. 14, and thus the processing in step S105 is
performed. That is, the TT decoder 44 generates display data of the subtitle
25 consisting of the character string of "subtitle2" which is "that the image formed on
the Retina should be inverted ?". The generated data of the subtitle, along with the
information related to display time specifying start of display after a lapse of 1
second and end of display after a lapse of 5 seconds, is supplied to the display control
unit 46.
30 [0157]
When the processing in step S105 or S107 is completed, the determination
31
processing in step S108 is performed. In step S108, when it is determined that the
processing for all elements has been completed, the processing returns to step S87 of
FIG. 21, and the subsequent processing is repeated.
[0158]
That is, a Fragment is read and it is determined whether 5 or not the type of
the TTML Document Instance is an Initialization Document Instance (step S86).
When it is determined by the determination processing in step S86 that the type is not
an Initialization Document Instance, the Body Document Instance processing is
performed again (step S87). On the other hand, when it is determined by the
10 determination processing in step S86 that the type is an Initialization Document
Instance, the processing proceeds to step S88.
[0159]
In step S88, the TT decoder 44 determines whether or not the definition
content of the display format of the Initialization Document Instance stored in the
15 read Fragment is different from the definition content of the rendering context
currently set.
[0160]
In step S88, when it is determined that the definition content of the display
format is different from the definition content of the rendering context, the
20 processing proceeds to step S84 and the subsequent processing is repeated. That is,
the Initialization Document Instance processing is performed again, and the
rendering context is set again (step S84). On the other hand, in step S88, when it is
determined that the definition content of the display format is the same as the
definition content of the rendering context, the processing returns to step S85 and the
25 subsequent processing is repeated. That is, in this case, the rendering context is not
set again, and a Fragment is read again from the fragment demultiplexer 43.
[0161]
In step S71 of FIG. 20, the TT decode processing of FIG. 21 is repeatedly
performed until it is determined that the Fragment Movie has ended and so the
30 content reproduction processing of FIG. 20 is completed.
[0162]
32
So far, the TT decode processing has been described with reference to FIGS.
21 and 22.
[0163]
As described above, a begin attribute is attached to a subtitle which is
described in the Body Document Instance stored in a first read Fragment, 5 and an end
attribute is attached to the same subtitle which is described in the Body Document
Instance stored in a subsequently read Fragment, thereby allowing display of the
subtitle of the first read Fragment to be continued even after the subsequent
Fragment is read.
10 [0164]
[Configuration Example of Computer to Which Present Technology is Applied]
The series of processes described above can be executed by hardware but can also be
executed by software. When the series of processes is executed by software, a
program that constructs such software is installed into a computer. Here, the
15 expression “computer” includes a computer in which dedicated hardware is
incorporated and a general-purpose personal computer or the like that is capable of
executing various functions when various programs are installed.
[0165]
FIG. 23 is a block diagram showing a hardware configuration example of a computer
20 that performs the above-described series of processing using a program.
[0166]
In the computer 100, a central processing unit (CPU) 101, a read only memory
(ROM) 102 and a random access memory (RAM) 103 are mutually connected by a
bus 104.
25 [0167]
An input/output interface 105 is also connected to the bus 104. An input unit 106,
an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are
connected to the input/output interface 105.
[0168]
30 The input unit 106 is configured from a keyboard, a mouse, a microphone or the like.
The output unit 107 is configured from a display, a speaker or the like. The storage
33
unit 108 is configured from a hard disk, a non-volatile memory or the like. The
communication unit 109 is configured from a network interface or the like. The
drive 110 drives a removable media 111 such as a magnetic disk, an optical disk, a
magneto-optical disk, a semiconductor memory or the like.
5 [0169]
In the computer 100 configured as described above, the CPU 101 loads a program
that is stored, for example, in the storage unit 108 onto the RAM 103 via the
input/output interface 105 and the bus 104, and executes the program. Thus, the
above-described series of processing is performed.
10 [0170]
Programs to be executed by the computer 100 (the CPU 101) are provided being
recorded in the removable media 111 which is a packaged media or the like. Also,
programs may be provided via a wired or wireless transmission medium, such as a
local area network, the Internet or digital satellite broadcasting.
15 [0171]
In the computer 100, by inserting the removable media 111 into the drive 110, the
program can be installed in the storage unit 108 via the input/output interface 105.
Further, the program can be received by the communication unit 109 via a wired or
wireless transmission media and installed in the storage unit 108. Moreover, the
20 program can be installed in advance in the ROM 102 or the storage unit 108.
[0172]
It should be noted that the program executed by a computer 100 may be a program
that is processed in time series according to the sequence described in this
specification or a program that is processed in parallel or at necessary timing such as
25 upon calling.
[0173]
A processing step herein for describing a program which causes the computer 100 to
perform various processing does not necessarily have to be processed
chronologically in the order described in a flow chart. It also includes processing
30 performed in parallel or individually (for example, parallel processing or processing
by an object).
34
[0174]
The program may be processed by one computer or by a plurality of computers in a
distributed manner. Further, the program may be performed after being transferred
to a remote computer.
5 [0175]
Further, in the present disclosure, a system has the meaning of a set of a plurality of
configured elements (such as an apparatus or a module (part)), and does not take into
account whether or not all the configured elements are in the same casing. Therefore,
the system may be either a plurality of apparatuses, stored in separate casings and
10 connected through a network, or a plurality of modules within a single casing.
[0176]
An embodiment of the disclosure is not limited to the embodiments described above,
and various changes and modifications may be made without departing from the
scope of the disclosure.
15 [0177]
For example, the present disclosure can adopt a configuration of cloud computing
which processes by allocating and connecting one function by a plurality of
apparatuses through a network.
[0178]
20 Further, each step described by the above mentioned flow charts can be executed by
one apparatus or by allocating a plurality of apparatuses.
[0179]
In addition, in the case where a plurality of processes is included in one step, the
plurality of processes included in this one step can be executed by one apparatus or
25 by allocating a plurality of apparatuses.
[0180]
Additionally, the present technology may also be configured as below.
[0181]
(1)
30 A receiving device including:
a receiving unit configured to receive a stream of a content to be distributed
35
live;
an analysis unit configured to analyze fragmented text information
corresponding to subtitle data included in the received stream; and
a control unit configured to control display of first text information so as to
allow the display to be continued when second text information 5 out of the text
information is displayed based on a result of the analysis, the second text information
being started to be displayed temporally after the first text information is displayed.
(2)
The receiving device according to (1),
10 wherein the text information includes a structured document that describes a
content, and a display definition document that defines a display format which is
applied to the structured document,
wherein a time indicating start of display of the first text information is
described in a first structured document that describes a content of the first text
15 information,
wherein a time indicating end of display of the first text information and a
time indicating start of display of the second text information are described in a
second structured document that describes a content of the second text information,
and
20 wherein the control unit starts display of the first text information according
to the time indicating the start of display of the first text information described in the
first structured document, and later ends display of the first text information on
display according to the time indicating the end of display of the first text
information described in the second structured document, based on a result of the
25 analysis.
(3)
The receiving device according to (2),
wherein the time indicating the start of display of the second text
information described in the second structured document is temporally before the
30 time indicating the end of display of the first text information, and
wherein the control unit starts display of the second text information
36
according to the time indicating the start of display of the second text information
described in the second structured document, based on a result of the analysis.
(4)
The receiving device according to (2) or (3),
wherein a time indicating end of display of the second 5 text information is
further described in the second structured document, and
wherein the control unit ends display of the second text information
according to the time indicating the end of display of the second text information
described in the second structured document, based on a result of the analysis.
10 (5)
The receiving device according to (4),
wherein the time indicating the end of display of the second text information
described in the second structured document is temporally after the time indicating
the end of display of the first text information.
15 (6)
The receiving device according to any one of (2) to (5),
wherein the same display definition document is applied to the structured
document until a definition content of the display format is modified.
(7)
20 The receiving device according to any one of (1) to (6),
wherein the stream is data of a format which complies with a MP4 file
format, and
the subtitle data complies with a timed text markup language (TTML)
standard.
25 (8)
A control method performed by a receiving device, the control method
including the steps of:
receiving a stream of a content to be distributed live;
analyzing fragmented text information corresponding to subtitle data
30 included in the received stream; and
controlling display of the first text information so as to allow the display to
37
be continued when second text information out of the text information is displayed
based on a result of the analysis, the second text information being started to be
displayed temporally after the first text information is displayed.
(9)
A program for causing a computer 5 to function as:
a receiving unit configured to receive a stream of a content to be distributed
live;
an analysis unit configured to analyze fragmented text information
corresponding to subtitle data included in the received stream; and
10 a control unit configured to control display of first text information so as to
allow the display to be continued when second text information out of the text
information is displayed based on a result of the analysis, the second text information
being started to be displayed temporally after the first text information is displayed.
(10)
15 A distribution device including:
a content generation unit configured to generate a stream of a content for
live distribution;
a text information acquisition unit configured to acquire fragmented text
information so as to allow display of first text information to be continued when
20 second text information is displayed as text information corresponding to subtitle
data of the content, the second text information being started to be displayed
temporally after the first text information is displayed; and
a distribution unit configured to distribute the stream of the content
including the subtitle data on live.
25 (11)
A distribution method performed by a distribution device, the distribution
method including the steps of:
generating a stream of a content for live distribution;
acquiring fragmented text information so as to allow display of first text
30 information to be continued when second text information is displayed as text
information corresponding to subtitle data of the content, the second text information
38
being started to be displayed temporally after the first text information is displayed;
and
distributing the stream of the content including the subtitle data on live.
(12)
A program for causing a computer 5 to function as:
a content generation unit configured to generate a stream of a content for
live distribution;
a text information acquisition unit configured to acquire fragmented text
information so as to allow display of first text information to be continued when
10 second text information is displayed as text information corresponding to subtitle
data of the content, the second text information being started to be displayed
temporally after the first text information is displayed; and
a distribution unit configured to distribute the stream of the content
including the subtitle data on live.
15 (13)
A distribution system including:
a distribution device; and
a receiving device,
wherein the distribution device including
20 a content generation unit configured to generate a stream of a
content for live distribution,
a text information acquisition unit configured to acquire
fragmented text information so as to allow display of first text information to be
continued when second text information is displayed as text information
25 corresponding to subtitle data of the content, the second text information being
started to be displayed temporally after the first text information is displayed, and
a distribution unit configured to distribute the stream of the content
including the subtitle data on live, and
wherein the receiving device including
30 a receiving unit configured to receive the stream of the content,
an analysis unit configured to analyze the text information
39
fragmented corresponding to the subtitle data included in the received stream, and
a control unit configured to control display of the first text
information so as to allow the display to be continued when the second text
information out of the text information is displayed based on a result of the analysis.
5
Reference Signs List
[0182]
10 streaming distribution system
20 TT server
10 21 TT fragment generation unit
22 sample insertion unit
25 time stamp generation unit
30 IPTV server
31 content sample generation unit
15 32 fragment multiplexer
33 fragment distribution unit
40 IPTV client
41 time clock unit
42 receiving unit
20 43 fragment demultiplexer
44 TT decoder
45 content decoder
46 display control unit
100 computer
25 101 CPU
40
CLAIMS
Claim 1
A receiving device comprising:
a receiving unit configured to receive a stream of a content to be distributed
5 live;
an analysis unit configured to analyze fragmented text information
corresponding to subtitle data included in the received stream; and
a control unit configured to control display of first text information so as to
allow the display to be continued when second text information out of the text
10 information is displayed based on a result of the analysis, the second text information
being started to be displayed temporally after the first text information is displayed.
Claim 2
The receiving device according to claim 1,
15 wherein the text information includes a structured document that describes a
content, and a display definition document that defines a display format which is
applied to the structured document,
wherein a time indicating start of display of the first text information is
described in a first structured document that describes a content of the first text
20 information,
wherein a time indicating end of display of the first text information and a
time indicating start of display of the second text information are described in a
second structured document that describes a content of the second text information,
and
25 wherein the control unit starts display of the first text information according
to the time indicating the start of display of the first text information described in the
first structured document, and later ends display of the first text information on
display according to the time indicating the end of display of the first text
information described in the second structured document, based on a result of the
30 analysis.
41
Claim 3
The receiving device according to claim 2,
wherein the time indicating the start of display of the second text
information described in the second structured document is temporally before the
time indicating the end of display of the first 5 text information, and
wherein the control unit starts display of the second text information
according to the time indicating the start of display of the second text information
described in the second structured document, based on a result of the analysis.
10 Claim 4
The receiving device according to claim 3,
wherein a time indicating end of display of the second text information is
further described in the second structured document, and
wherein the control unit ends display of the second text information
15 according to the time indicating the end of display of the second text information
described in the second structured document, based on a result of the analysis.
Claim 5
The receiving device according to claim 4,
20 wherein the time indicating the end of display of the second text information
described in the second structured document is temporally after the time indicating
the end of display of the first text information.
Claim 6
25 The receiving device according to claim 2,
wherein the same display definition document is applied to the structured
document until a definition content of the display format is modified.
Claim 7
30 The receiving device according to claim 1,
wherein the stream is data of a format which complies with a MP4 file
42
format, and
the subtitle data complies with a timed text markup language (TTML)
standard.
5 Claim 8
A control method performed by a receiving device, the control method
comprising the steps of:
receiving a stream of a content to be distributed live;
analyzing fragmented text information corresponding to subtitle data
10 included in the received stream; and
controlling display of the first text information so as to allow the display to
be continued when second text information out of the text information is displayed
based on a result of the analysis, the second text information being started to be
displayed temporally after the first text information is displayed.
15
Claim 9
A program for causing a computer to function as:
a receiving unit configured to receive a stream of a content to be distributed
live;
20 an analysis unit configured to analyze fragmented text information
corresponding to subtitle data included in the received stream; and
a control unit configured to control display of first text information so as to
allow the display to be continued when second text information out of the text
information is displayed based on a result of the analysis, the second text information
25 being started to be displayed temporally after the first text information is displayed.
Claim 10
A distribution device comprising:
a content generation unit configured to generate a stream of a content for
30 live distribution;
a text information acquisition unit configured to acquire fragmented text
43
information so as to allow display of first text information to be continued when
second text information is displayed as text information corresponding to subtitle
data of the content, the second text information being started to be displayed
temporally after the first text information is displayed; and
a distribution unit configured to distribute the 5 stream of the content
including the subtitle data on live.
Claim 11
A distribution method performed by a distribution device, the distribution
10 method comprising the steps of:
generating a stream of a content for live distribution;
acquiring fragmented text information so as to allow display of first text
information to be continued when second text information is displayed as text
information corresponding to subtitle data of the content, the second text information
15 being started to be displayed temporally after the first text information is displayed;
and
distributing the stream of the content including the subtitle data on live.
Claim 12
20 A program for causing a computer to function as:
a content generation unit configured to generate a stream of a content for
live distribution;
a text information acquisition unit configured to acquire fragmented text
information so as to allow display of first text information to be continued when
25 second text information is displayed as text information corresponding to subtitle
data of the content, the second text information being started to be displayed
temporally after the first text information is displayed; and
a distribution unit configured to distribute the stream of the content
including the subtitle data on live.
30
Claim 13
44
A distribution system comprising:
a distribution device; and
a receiving device,
wherein the distribution device including
a content generation unit configured to generate 5 a stream of a
content for live distribution,
a text information acquisition unit configured to acquire
fragmented text information so as to allow display of first text information to be
continued when second text information is displayed as text information
10 corresponding to subtitle data of the content, the second text information being
started to be displayed temporally after the first text information is displayed, and
a distribution unit configured to distribute the stream of the content
including the subtitle data on live, and
wherein the receiving device including
15 a receiving unit configured to receive the stream of the content,
an analysis unit configured to analyze the text information
fragmented corresponding to the subtitle data included in the received stream, and
a control unit configured to control display of the first text
information so as to allow the display to be continued when the second text
20 information out of the text information is displayed based on a result of the analysis.