FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
“RECEPTION DEVICE, INFORMATION PROCESSING
METHOD, PROGRAM, TRANSMISSION DEVICE AND
APPLICATION LINKING SYSTEM”
SONY CORPORATION, of 1-7-1, Konan, Minato-ku, Tokyo
108-0075, Japan
The following specification particularly describes the invention and the manner in
which it is to be performed.
2
DESCRIPTION
RECEPTION DEVICE, METHOD OF PROCESSING INFORMATION,
PROGRAM, TRANSMISSION DEVICE, AND APPLICATION COOPERATION
SYSTEM
5
TECHNICAL FIELD
[0001]
The present disclosure relates to a reception
device, a method of processing information, a program, a
10 transmission device, and an application cooperation
system, and especially relates to a reception device, a
method of processing information, a program, a
transmission device, and an application cooperation
system, which are suitably used when an application
15 program is executed in cooperation with playback of
content, particularly such as a television program.
BACKGROUND ART
[0002]
20 For example, consider displaying information
(performers, a story line, announcement of the next time,
and the like) related to a television (TV) program
(hereinafter, simply referred to as program) on the air,
or information (news, weather forecast, traffic
25 information, and the like) useful for viewers although
not directly related to the program, to viewers of the
program, on screens.
[0003]
To realize the above display, a command for
30 acquiring and starting a dedicated application program
(hereinafter, described as application in short) may just
3
be transmitted to TV receivers and the like in
cooperation with progress of the program. In fact,
already in Japan and Europe, the command or the
application is transmitted using a band for data
broadcasting in a TV broadcasting signal, 5 whereby the
above display is realized (for example, see Patent
Document 1).
[0004]
Meanwhile, in the United States, the band for data
10 broadcasting is not provided in the TV broadcasting
signal, and a method in place thereof has not been
established. Therefore, execution of an application in
cooperation with progress of a program has not been
realized.
15 [0005]
Note that, in the United States, there are a larger
number of households who views programs through a CATV or
an IPTV than households who directly receive TV
broadcasting waves with the TV receivers and view the
20 programs. In the CATV or the IPTV, only a video and an
audio signal of the program may sometimes be extracted
and distributed from the TV broadcasting signal, and thus
if the band for data broadcasting is provided in the TV
broadcasting signal in the United States, there is no
25 guarantee that the data broadcasting signal including
data related to an application is transmitted to
reception devices.
[0006]
Further, in recent years, not only when a program
30 on the air is viewed, but also when a recorded and played
back program, a video read from a package media such as a
4
DVD or BD, or arbitrary content such as a moving image
downloaded from the Internet is viewed, there are demands
for execution of an application in cooperation with the
program, the video, or the arbitrary content.
5
CITATION LIST
PATENT DOCUMENT
[0007]
Patent Document 1: Japanese Patent Application Laid-Open
10 No. 2006-50237
SUMMARY OF THE INVENTION
PROBLEMS TO BE SOLVED BY THE INVENTION
[0008]
15 However, execution of an application in cooperation
with arbitrary content is not apparently realized.
[0009]
Further, it is desired not only to simply cause the
application to be in cooperation with the content, but
20 also to execute an application suitable for the user who
views the content, and to present information suitable
for the user in the executed application. However, a
method that realizes the demands has not been established.
[0010]
25 The present disclosure has been made in view of the
foregoing, and enables an application suitable for a user
to be executed in cooperation with progress of arbitrary
content that is being viewed by the user.
30 SOLUTIONS TO PROBLEMS
[0011]
5
A reception device according to a first aspect of
the present disclosure includes: an extraction unit
configured to extract, from played back content,
signature data indicating a characteristic of the
content; a profile generation unit configured 5 to generate
user profile data; a query generation unit configured to
generate a query including at least the signature data
and the user profile data, to transmit the generated
query to a transmission device, and to receive a response
10 matched with the user profile data in the transmission
device, and returned from the transmission device
according to the query; and an application execution unit
configured to acquire and execute an application in
cooperation with playback of the content based on the
15 received response.
[0012]
The generation unit generates the user profile data
including a demographic attribute of a user.
[0013]
20 The query generation unit generates the query
including at least the signature data and the user
profile data, transmits the generated query to the
transmission device, receives the response matched with
the user profile data in the transmission device, and
25 returned from the transmission device according to the
query, every time the signature data is extracted in the
extraction unit.
[0014]
The profile generation unit further generates the
30 user profile data including at least one of a
specification of the reception device, a congestion state
6
of a communication network, and natural environment
information.
[0015]
The reception device is built in a playback device
that plays back content, and a content 5 supply unit
configured to supply all pieces of content to be played
back by the playback device to the extraction unit is
further included.
[0016]
10 A method of processing information of a reception
device according to the first aspect of the present
disclosure includes the steps of: by the reception device,
extracting, from played back content, signature data
indicating a characteristic of the content; generating
15 user profile data; generating a query including at least
the signature data and the user profile data,
transmitting the generated query to a transmission device,
and receiving a response matched with the user profile
data in the transmission device, and returned from the
20 transmission device according to the query; and acquiring
and executing an application in cooperation with playback
of the content based on the received response.
[0017]
A program according to the first aspect of the
25 present disclosure causes a computer to function as: an
extraction unit configured to extract, from played back
content, signature data indicating a characteristic of
the content; a profile generation unit configured to
generate user profile data; a query generation unit
30 configured to generate a query including at least the
signature data and the user profile data, to transmit the
7
generated query to a transmission device, and to receive
a response matched with the user profile data in the
transmission device, and returned from the transmission
device according to the query; and an application
execution unit configured to acquire 5 and execute an
application in cooperation with playback of the content
based on the received response.
[0018]
According to the first aspect of the present
10 disclosure, from played back content, signature data that
indicates a characteristic of the content is extracted,
user profile data is generated, a query including at
least the signature data and the user profile data is
generated and transmitted to a transmission device, a
15 response matched with the user profile data in the
transmission device and returned from the transmission
device according to the query is received. Then, an
application is acquired and executed in cooperation with
playback of the content based on the received response.
20 [0019]
A transmission device according to a second aspect
of the present disclosure includes: a database indicating
a corresponding relationship among signature data
indicating a characteristic of content extracted from the
25 content, a content identifier indicating the content of
an extraction source, and related metadata including an
application identifier indicating an application to be
executed in cooperation with the content; a response
generation unit configured to identify content of an
30 extraction source of signature data included in a query
transmitted from a reception device by reference to the
8
database, to generate a response including related
metadata including the application identifier indicating
an application to be executed in cooperation with the
identified content, and to return the generated response
to the reception device; and a matching 5 unit configured
to match the related metadata included in the response
before a return with the user profile data included in
the query.
[0020]
10 The matching unit matches the related metadata
included in the response before a return with a
demographic attribute of a user of the reception device
included in the user profile data.
[0021]
15 According to the second aspect of the present
disclosure, by reference to a database that indicates a
corresponding relationship among signature data
indicating a characteristic of content extracted from the
content, a content identifier indicating the content of
20 an extraction source, and related metadata including an
application identifier indicating an application to be
executed in cooperation with the content, content of an
extraction source of signature data included in a query
transmitted from a reception device is identified, a
25 response including related metadata including the
application identifier indicating an application to be
executed in cooperation with the identified content is
generated and returned to the reception device. Note
that the related metadata included in the response before
30 a return is matched with user profile data included in
the query.
9
[0022]
An application cooperation system according to a
third aspect of the present disclosure made of a
transmission device and a reception device of content,
the system includes: the reception device 5 including an
extraction unit configured to extract, from played back
content, signature data indicating a characteristic of
the content; a profile generation unit configured to
generate user profile data; a query generation unit
10 configured to generate a query including at least the
signature data and the user profile data, to transmit the
generated query to a transmission device, and to receive
a response matched with the user profile data in the
transmission device, and returned from the transmission
15 device according to the query; and an application
execution unit configured to acquire and execute an
application in cooperation with playback of the content
based on the received response, and the transmission
device including a database indicating a corresponding
20 relationship among signature data indicating a
characteristic of content extracted from the content, a
content identifier indicating the content of an
extraction source, and related metadata including an
application identifier indicating an application to be
25 executed in cooperation with the content; a response
generation unit configured to identify content of an
extraction source of signature data included in a query
transmitted from a reception device by reference to the
database, to generate a response including related
30 metadata including the application identifier indicating
an application to be executed in cooperation with the
10
identified content, and to return the generated response
to the reception device; and a matching unit configured
to match the related metadata included in the response
before a return with the user profile data included in
5 the query.
[0023]
According to the third aspect of the present
disclosure, by a reception device, from played back
content, signature data indicating a characteristic of
10 the content is extracted, a query including at least the
signature data and user profile data is generated and
transmitted to a transmission device, a response matched
with the user profile data in the transmission device,
and returned from the transmission device according to
15 the query is received, and an application is acquired and
executed in cooperation with playback of the content
based on the received response. Meanwhile, by the
transmission device, by reference to a database that
indicates a corresponding relationship among signature
20 data indicating a characteristic of content extracted
from the content, a content identifier indicating the
content of an extraction source, and related metadata
including an application identifier indicating an
application to be executed in cooperation with the
25 content, content of an extraction source of signature
data included in a query transmitted from a reception
device is identified, a response including related
metadata including the application identifier indicating
an application to be executed in cooperation with the
30 identified content is generated and returned to the
reception device. Note that the related metadata
11
included in the response before a return is matched with
the user profile data included in the query.
EFFECTS OF THE INVENTION
5 [0024]
According to the first aspect of the present
disclosure, an application suitable for the user can be
executed in cooperation with progress of content being
viewed.
10 [0025]
According to the second aspect of the present
disclosure, content now being viewed is identified by a
reception device, and an application suitable for the
user can be supplied in cooperation with progress of the
15 content.
[0026]
According to the third aspect of the present
disclosure, content now being viewed is identified by a
reception device, and an application suitable for the
20 user can be supplied from a broadcasting device to the
reception device in cooperation with progress of the
content.
BRIEF DESCRIPTION OF DRAWINGS
25 [0027]
Fig. 1 is a block diagram illustrating a
configuration example of an application cooperation
system that is an embodiment of the present disclosure.
Fig. 2 is a block diagram illustrating a
30 configuration example of an ACR server.
Fig. 3 is a diagram illustrating a data structure
12
of ACR reference data.
Fig. 4 is a diagram illustrating a data structure
of an ACR query.
Figs. 5A and 5B are diagrams illustrating data
structures of 5 an ACR response.
Fig. 6 is a flowchart for describing an operation
of an application cooperation system.
Fig. 7 is a block diagram illustrating a
configuration example of a computer.
10
MODE FOR CARRYING OUT THE INVENTION
[0028]
Hereinafter, favorable embodiments (hereinafter,
referred to embodiments) for implementing the present
15 disclosure will be described in detail with reference to
the drawings.
[0029]
[Configuration Example of Application Cooperation System]
Fig. 1 illustrates a configuration example of an
20 application cooperation system as an embodiment of the
present disclosure.
[0030]
This application cooperation system 10 identifies
content viewed by a user using a screen of a TV receiver
25 as a monitor, executes an application suitable for the
user in cooperation with progress of the content, and
presents information suitable for the user with the
application now being executed.
[0031]
30 Here, the content is not limited to a program now
on the air, which is received by the TV receiver. For
13
example, all kinds of AV content, such as a program
recorded and played back by a video recorder, a video
such as a movie played back from a package medium by a
multimedia player, and a moving image downloaded through
the Internet, are included. Further, 5 a commercial
message (hereinafter, referred to CM) inserted between
programs or in the middle of a program is also included
in the content.
[0032]
10 For identification of the content, automatic
content recognition (ACR) that identifies the content by
comparing signature data (a feature amount) periodically
extracted from the content now being viewed, and
signature data of content registered in a database in
15 advance, is used.
[0033]
The application cooperation system 10 is configured
from a transmission device 20, and a plurality of
reception devices 30 connected with the transmission
20 device 20 through a broadcasting network 11 and a
bidirectional communication network 12. The broadcasting
network 11 indicates a TV broadcasting network, a CATV
network, an IPTV network, and the like. The
bidirectional communication network 12 indicates an IP
25 communication network represented by the Internet.
[0034]
Each of the reception devices 30 is arranged in a
user house in a state of being built in a TV receiver or
the like.
30 [0035]
[Description of Transmission Device 20]
14
The transmission device 20 is configured from a
content server 21, an application server 22, an ACR
server 23, and a profile matching server 24.
[0036]
The content server 21 broadcasts 5 content such as a
program or a CM through the broadcasting network 11.
Further, the content server 21 supplies broadcasted
content and corresponding metadata to the ACR server 23.
The metadata includes an identifier that indicates an
10 application to be executed in cooperation with progress
of the content, an acquisition destination thereof, data
to be used in the application, and the like. Note that
the signature data that indicates characteristics of the
content may be supplied to the ACR server 23, instead of
15 supplying the content.
[0037]
The application server 22 supplies the application
and the data to be used in the application through the
bidirectional communication network 12 in response to a
20 request from the reception device 30.
[0038]
The ACR server 23 holds, in a database, ACR
reference data in which the signature data, which is
extracted from each of various types of content that can
25 be viewed at the reception device 30 side, at a
predetermined sampling period, is associated with a
content identifier, an application identifier, and the
like. The ACR server 23 generates and returns an ACR
response in response to an ACR query transmitted from the
30 reception device 30 based on the database of the ACR
reference data.
15
[0039]
The profile matching server 24 performs matching
and filtering of related metadata to be stored in the ACR
response based on user profile data of the reception
device 30 included in the ACR query when 5 the ACR server
23 generates the ACR response according to the ACR query.
[0040]
Note that the content server 21, the application
server 22, the ACR server 23, and the profile matching
10 server 24 that configure the transmission device 30 may
be centrally arranged in one place, or may be arranged in
a distributed manner. Further, the content server 21,
the application server 22, the ACR server 23, and the
profile matching server 24 may be appropriately combined.
15 Further, a plurality of the ACR servers 23 and the
profile matching servers 24 may exist.
[0041]
[Description of Reception Device 30]
The reception device 30 includes a content renderer
20 31, an ACR client 32, a user interface 33, a profile
manager 34, and an application manager 35.
[0042]
The content renderer 31 acquires and branches all
pieces of content displayed on a display of the TV
25 receiver where the reception device 30 is built in, and
supplies the content to the ACR client 32. That is, the
content renderer 31 acquires and branches not only the
content broadcasted from the content server 21 but also
content input through various input terminals (HDMI
30 (registered trademark) terminal, and the like) of the TV
receiver, and supplies the content to the ACR client 32.
16
[0043]
The ACR client 32 extracts, at a predetermined
sampling period, the signature data that indicates
characteristics of the content from the content input
from the renderer 31. Here, as a method 5 of extracting
the signature data, an extraction method of the ACR
server 23 of the transmission device 20 (described below)
is used.
[0044]
10 Further, the ACR client 32 generates the ACR query
that includes the extracted signature data and user
profile data, and transmits the ACR query to the ACR
server 23 of the transmission device 20 through the
bidirectional communication network 12. Further, the ACR
15 client 32 receives and holds the ACR response returned
from the ACR server 23 according to the transmitted ACR
query. Further, the ACR client 32 analyzes the held ACR
response, and causes the application manager 35 to
execute an application corresponding to the content now
20 being viewed in cooperation with progress of the content.
[0045]
The user interface 33 receives an input operation
of profile data of the user himself/herself, a selection
operation of content to be played back, an operation to
25 the executed application, and the like.
[0046]
The profile manager 34 generates the user profile
data based on information input using the user interface
33, an operation history, and the like, and outputs the
30 user profile data to the ACR client 32.
[0047]
17
The generated user profile data can include items,
such as a demographic attribute of the user (the age,
gender, occupation, academic background, residential area,
mail address, hobby, preference, language, family size,
and viewing tendency of content), a specification 5 of the
reception device 30 (a type of available CODEC and the
like), a congestion state of the bidirectional
communication network 12, natural environment information
(weather, temperature, humidity, and the like).
10 [0048]
The application manager 35 acquires the application
corresponding to the content now being viewed from the
application server 22 through the bidirectional
communication network 12 and executes the application,
15 according to control from the ACR client 32. The
application executed in the application manager 35
acquires related metadata corresponding to the
application now being executed from the ACR client 32
using a related metadata acquisition application program
20 interface (API).
[0049]
[Detailed Configuration Example of ACR Server 23]
Fig. 2 illustrates a detailed configuration example
of the ACR server 23.
25 [0050]
The ACR server 23 is configured from a content
acquisition unit 41, a reference signature extraction
unit 42, an ACR database 43, and an ACR response
generation unit 44.
30 [0051]
The content acquisition unit 41 acquires, from the
18
content server 21, the content that is scheduled to
broadcast and metadata of the content by the content
server 21 through the broadcasting network 11, and
supplies the acquired content to the reference signature
extraction unit 42. Further, the content 5 acquisition
unit 41 acquires various pieces of content that can be
viewed at the reception device 30 side and metadata of
the content from an outside, and supplies the acquired
content to the reference signature extraction unit 42.
10 [0052]
The reference signature extraction unit 42 extracts,
at a predetermined sampling period using a predetermined
extraction method, the signature data that indicates
characteristics of the content from the content supplied
15 from the content acquisition unit 41, and outputs the
extracted signature data to the ACR database 43. As the
extraction method of the signature data, an existing
arbitrary method can be applied. For example, a
watermark embedded in the content in advance may be
20 extracted and employed as the signature data. A finger
print may be calculated and employed as the signature
data.
[0053]
By use of the finger print as the signature data,
25 even if a resolution, an aspect ratio, a bit rate, and an
encoding format of the content are converted, the same
signature data can be obtained before and after the
conversion. Therefore, identification accuracy of when
identification of the content is performed based on the
30 signature data can be increased.
[0054]
19
Note that, when there is a plurality of the ACR
servers 23, the extraction methods of the signature data
in the reference signature extraction units 42 are not
necessarily unified. An arbitrary extraction method can
be employed in each of the 5 ACR servers 23.
[0055]
The ACR database 43 generates and stores the ACR
reference data in which each signature data input from
the reference signature extraction unit 42 is associated
10 with the content identifier that indicates the content of
an extraction source of the signature data, and the like.
Accordingly, the signature data extracted from the
content is stored in the database. A data structure of
the ACR reference data will be described below with
15 reference to Fig. 3.
[0056]
The ACR response generation unit 44 identifies the
content of the extraction source of the signature data
included in the ACR query transmitted from the ACR client
20 32 by reference to the ACR database 43. Further, the ACR
response generation unit 44 generates the ACR response
that includes the content identifier, the related
metadata, and the like as an identification result.
Further, the ACR response generation unit 44 performs
25 matching and filtering of the related metadata stored in
the ACR response, according to the control of the profile
matching server 24, and transmits a result to the
reception device 30. A data structure of the ACR
response will be described below with reference to Figs.
30 5A and 5B.
[0057]
20
[Data Structure of ACR Reference Data]
Fig. 3 illustrates a data structure of the ACR
reference data stored in the ACR database 43 of the ACR
server 23.
5 [0058]
In ACR reference data 50, a content identifier 52,
a playback time 53, and related metadata 54 are
associated with signature data 51.
[0059]
10 The signature data 51 is extracted from the content
in the reference signature extraction unit 42. The
content identifier 52 is information for identifying the
content of the extraction source of the signature data 51.
The playback time 53 indicates progress timing of the
15 content of when the signature data 51 is extracted from
the content indicated by the content identifier 52, and
is expressed by an elapsed time from a head of the
content.
[0060]
20 The related metadata 54 includes an application
identifier that indicates an application to be executed
in cooperation with the progress timing of content, the
progress timing being indicated by a playback time 83,
and the content being indicated by a content identifier
25 82, information that indicates an acquisition destination
(the application server 22) of the application identifier,
various data to be used by the executed application.
[0061]
Note that the related metadata 54 may have
30 different content according to the progress timing of
content indicated by the playback time 53.
21
[0062]
[Data Structure of ACR Query]
Fig. 4 illustrates a data structure of the ACR
query generated in the ACR client 32.
5 [0063]
An ACR query 60 includes an ACR query identifier 61,
an extraction method identifier 62, a service identifier
63, signature data 64, a local time stamp 65, user
profile data 66, a transmission source address 67, and a
10 signature 68.
[0064]
The ACR query identifier 61 is information for
uniquely identifying the ACR query 60. The extraction
method identifier 62 is information for identifying the
15 extraction method used when the signature data 64 is
extracted. The service identifier 63 is information for
selecting the ACR server 23, to which the ACR query 60 is
transmitted and from which the ACR response is obtained,
when there is a plurality of the ACR servers 23.
20 [0065]
The signature data 64 is extracted from the content
in the ACR client 32. The local time stamp 65 indicates
timing at which the signature data 64 is extracted from
the content, and is expressed by a time indicated by a
25 local system clock of the reception device 30.
[0066]
The user profile data 66 is generated in the
profile manager 34. The transmission source address 67
is an address in the bidirectional communication network
30 12 of the ACR client 32 that transmits the ACR query 60,
and is used as information that indicates a return
22
destination of the ACR response generated in the ACR
server 23 according to the ACR query 60. The signature
68 suppresses falsification of the ACR query 60. Note
that the entire ACR query 60 may be encrypted and
5 transmitted.
[0067]
[Data Structure of ACR Response]
Figs. 5A and 5B illustrate data structures of the
ACR response generated in the ACR response generation
10 unit 44 of the ACR server 23.
[0068]
Note that Fig. 5A illustrates a data structure of
the ACR response of when the content of the extraction
source of the signature data 64 included in the ACR query
15 60 has been able to be identified, that is, when the
content now being viewed has been able to be identified
in the reception device 30. Fig. 5B illustrates a data
structure of the ACR response of when the content has not
been able to be identified.
20 [0069]
An ACR response 70 (Fig. 5A) of when the content
now being viewed has been able to be identified in the
reception device 30 includes an ACR query identifier 71,
an extraction method identifier 72, a service identifier
25 73, a content identifier 74, a playback time 75, a local
time stamp 76, related metadata 77, an transmission
source address 78, and a signature 79.
[0070]
Meanwhile, the ACR response 70 (Fig. 5B) of when
30 the content now being viewed has not been able to be
identified in the reception device 30 includes the ACR
23
query identifier 71, the service identifier 73, the
transmission source address 78, the signature 79, and an
identification failure flag 80.
[0071]
The ACR query identifier 71, the 5 extraction method
identifier 72, the service identifier 73, and the local
time stamp 76 are used for identifying the ACR query 60
that is a trigger with which the ACR response 70 is
generated, and are described citing the ACR query
10 identifier 61, the extraction method identifier 62, the
service identifier 63, and the local time stamp 65 of the
corresponding ACR query 60.
[0072]
The content identifier 74, playback time 75, and
15 the related metadata 77 indicate an identification result,
and are described citing the content identifier 52, the
playback time 53, and the related metadata 54 of the
corresponding ACR reference data 50.
[0073]
20 The transmission source address 78 is an address on
the bidirectional communication network 12, of the ACR
server 23 that transmits the ACR response 70. The
signature 79 suppresses falsification of the ACR response
70. Note that the falsification may be prevented by
25 encrypting and transmitting of the entire ACR response 70.
[0074]
The identification failure flag 80 is a flag that
indicates the content of the extraction source of the
signature data 64 included in the ACR query 60 from the
30 ACR client 32 has not been able to be identified in the
ACR server 23, that is, the content now being viewed has
24
not been able to be identified in the reception device 30.
[0075]
[Operation by Application Cooperation System 10]
Next, an operation of the application cooperation
system 10 5 will be described.
[0076]
Fig. 6 is a flowchart for describing an operation
of the application cooperation system 10.
[0077]
10 In step S11, the transmission device 20 supplies
the content to be subsequently transmitted and the relate
metadata thereof to the ACR server 23, as preprocessing
of starting transmission of the content through the
broadcasting network 11. The ACR server 23 generates the
15 ACR reference data using the supplied content and the
related metadata, and registers the ACR reference data in
the ACR database.
[0078]
As described above, after the ACR reference data
20 corresponding to the content to be broadcasted is stored
in the database, steps S12 to S15 described below are
repeated.
[0079]
In step S12, the transmission device 20 starts
25 transmission of the content through the broadcasting
network 11.
[0080]
Meanwhile, in the reception device 30, the profile
manager 34 generates the user profile data and supplies
30 the user profile data to the ACR client 32 as
preprocessing of receiving and playing back of the
25
content. Note that, among the items included in the user
profile data, items that are dynamically changed, such as
the congestion state of the bidirectional communication
network 12 and the natural environment information, are
subsequently updated, 5 as needed.
[0081]
In the reception device 30, while the content is
played back and viewed, steps S22 to S25 described below
are repeated. Note that the content may not be the
10 content transmitted by the content server 12.
[0082]
In step S22, the content renderer 31 acquires and
branches the content now being viewed, and outputs the
content to the ACR client 32. In step S23, the ACR
15 client 32 extracts, at a predetermined sampling period,
the signature data from the content now being viewed
input from the content renderer 31.
[0083]
In step S24, the ACR client 32 generates the ACR
20 query 60 including the signature data and the user
profile data, and transmits the ACR query 60 to the ACR
server 23, every time extracting the signature data.
[0084]
In step S13, in the ACR server 23 that has received
25 the ACR query 60 from the ACR client 32, the ACR response
generation unit 44 refers to the ACR database 43, and
identifies the content corresponding to the signature
data 64 included in the received ACR query 60.
[0085]
30 In step S14, the ACR response generation unit 44
generates the ACR response 70 according to an
26
identification result of the content. At this time, the
ACR response generation unit 44 performs matching and
filtering of the related metadata 77 to be included in
the ACR response 70 based on the user profile data 66
included in the ACR query 60. In 5 step S15, the ACR
response generation unit 44 transmits the generated ACR
response 70 to the ACR client 32.
[0086]
In step S25, the ACR client 32 that has received
10 the ACR response 70 from the ACR server 23 analyzes the
related metadata 77 included in the ACR response 70, and
cause the application manager 35 to acquire and execute
the application to be executed in cooperation with the
content now being viewed.
15 [0087]
Note that the related metadata 77 included in the
received ACR response 70 has already been subjected to
the matching and filtering in the ACR server 23 based on
the user profile data. However, the matching and
20 filtering may be further performed in the ACR client 32
based on the user profile data.
[0088]
The application manager 35 acquires and executes
the application from the application server 22. The
25 application executed in the application manager 35
acquires the related metadata 77 from the ACR response 70
held by the ACR client 32 using the related metadata
acquisition API.
[0089]
30 The processing from steps S12 to S15 and from steps
S22 to S25 described above is repeatedly executed while
27
the content is viewed. Accordingly, the operation of the
application suitable for the user and in cooperation with
the progress of the content now being viewed becomes
possible.
5 [0090]
To be specific, for example, when there is a scene
of feeding a pet as details of certain content, if it is
revealed that the user of the reception device 30 has a
cat according to the user profile data, link information
10 such as a commercial banner of a pet food for cat, a
purchase site, and the like can be displayed in the scene
with an application to be executed in cooperation with
the content.
[0091]
15 Further, for example, when it has been revealed
that the language of the user of the reception device 30
is Spanish according to the user profile data, and when
the content such as a program or a CM is being viewed
with a language other than Spanish, a Spanish subtitle
20 can be displayed or a Spanish commentary can be output
with an application to be executed in cooperation with
the content.
[0092]
Further, for example, when a viewing region of the
25 user of the reception device 30 has been revealed
according to the user profile data, information specific
to the viewing region can be presented to the user with
an application to be executed in cooperation with the
content.
30 [0093]
Note that the above-described specific examples can
28
be executed by existing technologies. However, to
actually execute the examples, a plurality of times of
transactions is required between the reception side and
the transmission side for narrowing down the information
to be presented to the user, and the information 5 required
by the user cannot be promptly presented.
[0094]
However, in the present embodiment, the user
profile data 66 is transmitted by being included in the
10 ACR query 60 for requesting identification of the content.
Therefore, the matching and filtering can be performed so
that the related metadata 77 becomes suitable for the
user of the reception device 70, at the stage where the
ACR response 70 is generated. Therefore, the information
15 suitable for the user can be promptly presented to the
user.
[0095]
Incidentally, each of the transmission device 20
and the reception device 30 that execute the above20
described series of processing can not only be configured
from hardware but also realized by execution of software
by a computer. The computer includes a computer
incorporated in dedicated hardware, a general-purpose
computer capable of executing various functions by being
25 installed various programs, and the like.
[0096]
Fig. 7 is a block diagram illustrating a
configuration example of hardware of the above-described
computer.
30 [0097]
In a computer 100, a central processing unit (CPU)
29
101, a read only memory (ROM) 102, and a random access
memory (RAM) 103 are mutually connected by a bus 104.
[0098]
An input/output interface 105 is connected to the
bus 104. An input unit 106, an 5 output unit 107, a
storage unit 108, a communication unit 109, and a drive
110 are connected to the input/output interface 105.
[0099]
The input unit 106 is made of a key board, a mouse,
10 a microphone, and the like. The output unit 107 is made
of a display, a speaker, and the like. The storage unit
108 is made of a hard disk, a non-volatile memory, and
the like. The communication unit 109 is made of a
network interface, and the like. The drive 110 drives a
15 removable medium 111 such as a magnetic disk, an optical
disk, a magneto-optical disk, or a semiconductor memory.
[0100]
In the computer 100 configured as described above,
the CPU 101 loads the program stored in the storage unit
20 108 through the input/output interface 105 and the bus
104 to the RAM 103, and executes the program, thereby to
perform the above-described series of processing.
[0101]
The program executed by the computer 100 (CPU 101)
25 can be recorded on the removable medium 111 as a package
medium and can be provided. Further, the program can be
provided through a wired or wireless transmission medium,
such as local area network, the Internet or digital
satellite broadcasting.
30 [0102]
In the computer 100, the program can be installed
30
to the storage unit 108 through the input/output
interface 105 by mounting the removable medium 211 to the
drive 210. Further, the program can be received by the
communication unit 109 and installed to the storage unit
108 through a wired or wireless transmission 5 medium.
Alternatively, the program can be installed in the ROM
102 or the storage unit 108 in advance.
[0103]
Note that the program executed by the computer 100
10 may be a program, processing of which is performed in
time series along the order described in this
specification, or may be a program, processing of which
is performed in parallel or at necessary timing such as
when called.
15 [0104]
Note that an embodiment of the present disclosure
is not limited to the above-described embodiments, and
various changes can be made without departing from the
gist of the present disclosure.
20
REFERENCE SIGNS LIST
[0105]
10 Application cooperation system
11 Broadcasting network
25 12 Bidirectional communication network
20 Transmission device
21 Content server
22 Application server
23 ACR server
30 24 Profile matching server
30 Reception device
31
31 Content renderer
32 ACR client
33 User interface
34 Profile manager
35 Application 5 manager
41 Content acquisition unit
42 Reference data extraction unit
43 ACR database
44 ACR response generation unit
10 50 ACR reference data
60 ACR query
66 User profile data
70 ACR response
100 Computer
15 101 CPU
32
CLAIMS
1. A reception device comprising:
an extraction unit configured to extract, from
played back content, signature 5 data indicating a
characteristic of the content;
a profile generation unit configured to generate
user profile data;
a query generation unit configured to generate a
10 query including at least the signature data and the user
profile data, to transmit the generated query to a
transmission device, and to receive a response matched
with the user profile data in the transmission device,
and returned from the transmission device according to
15 the query; and
an application execution unit configured to acquire
and execute an application in cooperation with playback
of the content based on the received response.
20 2. The reception device according to claim 1, wherein
the generation unit generates the user profile data
including a demographic attribute of a user.
3. The reception device according to claim 2, wherein
25 the query generation unit generates the query including
at least the signature data and the user profile data,
transmits the generated query to the transmission device,
receives the response matched with the user profile data
in the transmission device, and returned from the
30 transmission device according to the query, every time
the signature data is extracted in the extraction unit.
33
4. The reception device according to claim 2, wherein
the profile generation unit further generates the user
profile data including at least one of a specification of
the reception device, a congestion 5 state of a
communication network, and natural environment
information.
5. The reception device according to claim 2, wherein
10 the reception device is built in a playback device that
plays back content, and
a content supply unit configured to supply all
pieces of content to be played back by the playback
device to the extraction unit is further included.
15
6. A method of processing information of a reception
device, comprising the steps of:
by the reception device,
extracting, from played back content, signature
20 data indicating a characteristic of the content;
generating user profile data;
generating a query including at least the signature
data and the user profile data, transmitting the
generated query to a transmission device, and receiving a
25 response matched with the user profile data in the
transmission device, and returned from the transmission
device according to the query; and
acquiring and executing an application in
cooperation with playback of the content based on the
30 received response.
34
7. A program for causing a computer to function as:
an extraction unit configured to extract, from
played back content, signature data indicating a
characteristic of the content;
a profile generation unit configured 5 to generate
user profile data;
a query generation unit configured to generate a
query including at least the signature data and the user
profile data, to transmit the generated query to a
10 transmission device, and to receive a response matched
with the user profile data in the transmission device,
and returned from the transmission device according to
the query; and
an application execution unit configured to acquire
15 and execute an application in cooperation with playback
of the content based on the received response.
8. A transmission device comprising:
a database indicating a corresponding relationship
20 among signature data indicating a characteristic of
content extracted from the content, a content identifier
indicating the content of an extraction source, and
related metadata including an application identifier
indicating an application to be executed in cooperation
25 with the content;
a response generation unit configured to identify
content of an extraction source of signature data
included in a query transmitted from a reception device
by reference to the database, to generate a response
30 including related metadata including the application
identifier indicating an application to be executed in
35
cooperation with the identified content, and to return
the generated response to the reception device; and
a matching unit configured to match the related
metadata included in the response before a return with
the user profile data included 5 in the query.
9. The transmission device according to claim 8,
wherein the matching unit matches the related metadata
included in the response before a return with a
10 demographic attribute of a user of the reception device
included in the user profile data.
10. An application cooperation system made of a
transmission device and a reception device of content,
15 the system comprising:
the reception device including
an extraction unit configured to extract, from
played back content, signature data indicating a
characteristic of the content;
20 a profile generation unit configured to generate
user profile data;
a query generation unit configured to generate a
query including at least the signature data and the user
profile data, to transmit the generated query to a
25 transmission device, and to receive a response matched
with the user profile data in the transmission device,
and returned from the transmission device according to
the query; and
an application execution unit configured to acquire
30 and execute an application in cooperation with playback
of the content based on the received response, and
36
the transmission device including
a database indicating a corresponding relationship
among signature data indicating a characteristic of
content extracted from the content, a content identifier
indicating the content of an extraction 5 source, and
related metadata including an application identifier
indicating an application to be executed in cooperation
with the content;
a response generation unit configured to identify
10. content of an extraction source of signature data
included in a query transmitted from a reception device
by reference to the database, to generate a response
including related metadata including the application
identifier indicating an application to be executed in
cooperation with the identified content, and to return
the generated response to the reception device; and
a matching unit configured to match the related
metadata included in the response before a return with
the user profile data included in the query.