Description
Title of Invention
INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING
5 METHOD, AND PROGRAM
Techiical Field
[OOOI]
The present invention relates to an information processing device, an
10 information processing method, and a program.
Background Art
[0002]
In recent years, techniques for specifying a person shown in a captured
15 image have been developed. For example, a technique is disclosed in which a facial
region shown in a captured image is checked against a face image prepared in
advance and a person shown in tlie captured image is specified on tlie basis of the
checking result (for example, see Patent Literature 1). According to the technique,
a door is opened/closed in the case where the specifying of the person has been
20 succeeded, and hence, enhanced security can be achieved.
[0003]
The technique for specifying a person shown in a captured image is applied
not only for enhancing security, but is also applied to various scenes.
25 Citation List
Patent Literature
[0004]
Patent Literature 1 : JP 2009-3659A
30 Summary of Invention
Technical Probleni
[OOOS]
Howevel; there is a demand for easily finding a state of a subject sliown in a
captured image. For exanlple, convenience for a user enhances if the user can
easily find the change in the state of tlie subject in a network service shown in the
5 captured image. Accordingly, it is desired to achieve a technique for easily finding
the change in the state of the subject in the network service shown in the captured
image.
Solution to Problem
10 [0006]
According to the present disclosure, there is provided an inforlllation
processing dewice including an image acquisitioti unit configured to acquire a
captured image, a change detection unit configured to detect a change in a state of a
subject it1 a network service recognized from the captured image, and a depiction
15 change unit configured to change a depiction of the subject shown in the captured
image in a case where the change detection unit detects tlie change in the state.
[0007]
According to the present disclosure, there is provided an information
processing method including acquiring a captured image, detecting a change in a
20 state of a subject in a network service recognized from the captured image, and
changing a depiction of the subject sliown in the captured image in a case where tlie
change in the state is detected.
[OOOS]
According to the present disclosure, there is provided a program for causing
25 a coniputer to fi~nction as an information processing device including an itnage
acquisitioli unit configured to acquire a captured image, a change detection unit
configured to detect a change in a state of a subject in a network service recognized
fro111 tlie captured image, and a depiction change unit configured to change a
depiction of tlie subject show11 in tlie captured image in a case where the change
30 detection unit detects the change in tlie state.
Advantageous Effects of Invention
[0009]
According to the present disclosure as described above, the change in state
of the subject in the network service shown in the captured image can be easily found.
5
Brief Description of Drawings
[OO 101
[FIG. 11 FIG. 1 is a diagratn illustrating a brief overview in accordance with a present
embodiment.
10 [FIG. 21 FIG. 2 is a diagram illustrating a configuration of an information processing
system in accordance with the present embodiment.
[FIG. 31 FIG. 3 is a block diagratn illustrating a functional configuration of an
information processing device in accordance with the embodiment.
[FIG. 41 FIG. 4 is a diagram illustrating a brief ove~view of a user specification
15 function of an infornlation processing device.
[FIG. 51 FIG. 5 is a diagram illustrating a display exatnple of a portable terminal
when the user specification fails.
[FIG. 61 FIG. 6 is a diagratn illustrating a display exatnple of a portable terminal
when the nser specification succeeds.
20 [FIG. 71 FIG. 7 is a diagram illustrating a display example of a portable terminal
when the user specification fails.
[FIG. 81 FIG. 8 is a diagram illustrating a display example of a portable terminal
when the user specification fails.
[FIG. 91 FIG. 9 is a diagratn illustrating a display example of a portable terminal
25 when the user specification fails.
[FIG. 101 FIG. 10 is a diagratn illustrating a brief overview of a conlposition decision
function of the information processing device.
[FIG. 111 FIG. 11 is a diagram illustrating a display image at the time of setting a first
mode.
30 [FIG. 121 FIG. 12 is a diagratn illustrating a display image at the time of setting a
second mode.
[FIG. 131 FIG. 13 is a diagram illustratiag a variation of a technique of determining a
display image.
[FIG. 141 FIG. 14 is a diagram illustrating an example of the determined display
image.
5 [FIG. 151 FIG. 15 is a flowchart illustrating a flow of composition decision operations
of the information processing device.
[FIG. 161 FIG. 16 is a diagram illustrating an example of a depiction change function
of the information processing device.
[FIG. 171 FIG. 17 is a diagram illustrating another example of a depiction change
10 function of the inforn~ationp rocessing device.
[FIG. 181 FIG. 18 is a diagram illustrating another example of a depiction change
function of the information processing device.
[FIG. 191 FIG. 19 is a diagram illustrating another example of a depiction change
function of the information processing device.
15 [FIG. 201 FIG. 20 is a diagram illustrating another example of a depiction change
function of the information processing device.
[FIG. 211 FIG. 21 is a diagram illustrating another example of a depiction change
fi~nctiono f the infornlation processing device.
[FIG. 221 FIG. 22 is a diagram illustrating another example of a depiction change
20 function of the information processing device.
[FIG. 231 FIG. 23 is a flowchart iliustrating a flow of depiction change operations of
the infor~nationp rocessing device.
Description of Embodiments
25 [0011]
Hereinafter, preferred einbodime~lts of the present disclosure will be
described in detail with reference to the appended drawings. Note that, in this
specification and the appended drawings, structural elements that have substantially
the same function and structure are denoted with the same reference ilumerals, and
30 repeated explanation of these structural elements is omitted.
[a0121
Further, in this specification and the drawings, each of a plurality of
structural elements having substa~ltially the same function is distinguished by
affixing a different letter to the same reference numeral in some cases. However,
when there is no particular necessity to distinguish between stmctural elements
having substantially the same function, they are denoted by the same reference
5 numeral.
[0013]
First, "Description of Embodiments" will be described in accordance with
the order listed below.
1. User specification function
10 2. Composition decision function
3. Depiction change function
4. Conclusion
[0014]
Functions of the information processing device according to the present
15 etnbodi~nenta re broadly classified into a user specification function, a con~position
specification finlction, and a depiction change function. First, before describing
each of the functions, a condition that is a premise of each function will be described.
[OOl 51
FIG. 1 is a diagram illustrating a brief overview of the present etnbodiment.
20 As shown in FIG. 1, a user U having a portable terminal 20 is present in a real space.
The user U may be present anywhere in the reai space. In addition, a fi~nction of
displaying an image is installed in the portable tertninal 20, and it is possible for the
user U to view a screen displayed by the pol-table terminal 20. The user U is
captured by an imaging device 30 provided to be separate from the portable terminal
25 20. A position in which the imaging device 30 is to be provided is not particularly
limited. For example, the imaging device may be provided in a building such as in
a monitoring camera, or tnay be provided in a mobile object such as a vehicle. In
addition, a kind of the imaging device 30 is not particularly limited, but may be an
infrared camera or the like, for example.
30 [0016]
FIG. 2 is a diagram illustrating a configuration of an infortnation processing
system in accordance with the present embodiment. As shown in FIG. 2, the
infor~nation processing system 1 includes an information processing device 10, a
portable temiinal 20, and an iniaging device 30. Altl~ough the information
processing device 10 and the portable terminal 20 are connected via a network 40 in
FIG. 2, the number of the portable terminal 20 connected to the network 40 may not
5 be one. For example, a plurality of the portable terminals 20 may be present, and
each of the portable ternii~ials2 0 may be contiected to the network 40.
[0017]
In addition, as shown in FIG. 2, the information processing device 10 is
connected to the imaging device 30. Although one imaging device 30 is connected
10 to the infor~nationp rocessi~igd evice 10 in the example shown in FIG. 2, the number
of the imaging device 30 may not be one. For example, a plurality of the imaging
devices 30 may be present, and each of the imaging devices 30 may be comiected to
the information processing device 10.
[0018]
15 In addition, although the information processing device 10 is configured to
be separate from the pol-table terminal 20 and the imaging device 30 in the example
shown in FIG. 2, the information processing device may be embedded in the portable
terminal 20, or may be embedded in the imaging device 30. A captured image
captured by the imaging device 30 is provided to the portable terminal 20 via the
20 information processing device 10, and it is possible for the portable terminal 20 to
display tlie captured image. The information processing device 10 may use the
captured image provided from the imaging device 30 to exert the user specification
function, the composition decision function, and the depiction change function.
[00 191
25 FIG. 3 is a block diagram illustrating functional configuration of the
information processing device 10 in accordance with the present embodiment. As
shown in FIG. 3, the information processing device 10 includes a processing control
unit 100, a display control unit 160, and a storage unit 50. In addition, the
processing control unit 100 has an image acquisition unit 111, a parameter
30 acquisition unit 112, a candidate extraction unit 113, a specification unit 114, and an
authentication unit 115. The image acquisition unit 111, the parameter acquisition
unit 112, the candidate extraction unit 113, the specification unit 114, and the
authentication unit 115 are blocks mainly associated with the user specification
function of the inforniation processing device 10.
[0020]
In addition, the processing co~itrol unit 100 has a recognition unit 121, a
5 co~ldition decision unit 122, an information addition unit 123, a mode setting unit
124, a composition decision unit 125, and an image determination unit 126. The
processi~ig colltrol unit 100 is, and the recognition unit 121, the condition decision
unit 122, the infor~nation addition unit 123, the mode setting unit 124, the
conlposition decision unit 125, and the image determination unit 126 are blocks
10 mainly associated with the composition decision function of tlie infoxmation
processing device 10.
[0021]
In addition, the processi~igc ontrol unit 100 has a change detection ~~il1i3t1
and a depiction change unit 132. The change detection unit 131 and the depiction
15 change unit 132 are blocks mainly associated with the depiction change function of
the information processing device 10.
100221
The processing control unit 100 and tlie display control unit 160 correspond
to processors such as a CPU (Central Processing Unit) or a DSP (Digital Signal
20 Processor). The processing control unit 100 and the display control unit 160 exert
various functions of tlie processing control unit 100 and the display controi unit 160
by executing a program stored in the storage unit 50 or another storage medium.
100231
The storage unit 50 uses a storage medium sucll as a semiconductor memory
25 or a hard disk to store programs and data for processes to be carried out by the
processing control unit 100 and the display control unit 160. For example, the
storage unit 50 stores a feature arnount dictionary used to recognize an object.
Further, the storagc unit 50 may store a recognition result that is generated as a result
of the object recognition. Altl~ough the storage unit 50 is configured to be
30 embedded in the infor~nationp rocessing device 10 in the example shown in FIG. 3,
the storage unit 50 may be configured to be separate from the i~lfornlationp rocessing
device 10.
[0024]
Premises of the respective functions have been described. Hereinafter,
each of the fi~nctionsw ill be described in order.
[0025]
5 < 1. User specification function>
First, the user specification filnction of the information processing device 10
will be described. FIG. 4 is a diagram illustrating a brief ove~view of the nser
specification function of the information processing device 10. The itnage
acquisition unit 11 1 first acquires a captured image captured by the imaging device
10 30. In the example shown in FIG. 4, as an example of the captured image, a
captured itnage Inlg in which a real space shown in FIG. 1 is captured is acquired by
the image acquisition unit 111. The captured image acquired by the image
acquisition unit 111 is controlled to be displayed in the portable terminal 20 by the
display control unit 160.
15 [0026]
According to the user specification function, a user is specified fiom a
subject shown in the captured image acquired by the image acquisition unit 111.
The purpose of the user specification is not particularly limited. However, it is
assumed herein that a network service is provided by the infornlation processing
20 device 10 and the user specification is carried out so as to allow the user U to log into
the network service via the portable terminai 20.
[0027]
In addition, the kind of the network service is not particularly limited.
Howevel; a service allowing a user to write a message or to read the message written
25 by the user or another user using a portable terminal it1 which logging into the
network service is con~pletedi s assumed herein. Altl~oughth e timing for specifying
the user is not particularly limited, a timing at wl~ich an operation for the nser to
request the user specification is performed on the portable terminal 20 may be used.
The operation for requesting the user specification may be an operation for request to
30 log into the network service.
[0028]
In order to specify the user frolorn the subject shown in the captured itnage,
the parameter acquisition unit 112 acquires parameters associated with the user to be
specified. Altliough the timing for the paralneter acquisition unit 112 to acquire the
parameters is not particularly limited, for example, the parameters may be acquired
in advance from the portable terminal 20 of the usel; or may be acquired from the
5 portable terminal 20 when the user is specified.
[0029]
The kind of the parameter to be acquired by the parameter acquisition unit
112 is not pal-titularly limited. For exa~nple, as shown in FIG. 4, the parameter
acquisition unit 112 may acquire a face image of the user as the parameter PI, and
10 may acquire sensor data representing a movement of the user as the parameter P2.
A device capturing the face image of the user is not particularly limited. For
example, the face image of the user may be a face image captured by the poltable
terminal 20, or may be a face image captured by another device.
[0030]
15 In addition, a sensor detecting the movement of the user is not particularly
limited. The sensor detecting the movement of the user may be an acceleration
sensol; a sensor receiving GPS signals, and a sensor receiving radio waves
transmitted from a Wi-Fi base station. In addition, the sensor detecting the
movement of the user may be embedded in the portable terminal 20, and may be
20 mounted on a body of the user.
[003 11
Before the user is specified by the specification unit 114, a candidate for the
user may be specified by the candidate extraction unit 113 (step Sll). For example,
when coordinates on the captured image displayed in the portable terminal 20 by the
25 user operation input to the portable tenninal 20 (e.g., a toucll operation of the touch
panel) are designated, the parameter acquisition unit 112 acquires the coordinates,
and the candidate extraction unit 113 may specify a subject selected by the
coordinates (e.g., the subject present on the coordinates) as the candidate for tlie user.
By specifying the candidate for tlie usel; a load necessary to specify the user is
30 reduced.
[0032]
The specification unit 114 tries to specify the user frotn the captured image
based on the parameter acquired by the parameter acquisition unit 112 (step S12).
For example, when the face image of the user is acquired as the parameter PI by the
parameter acquisition u11it 112, the specification unit 114 may specify the subject
extracted based on checking of a facial region of the subject shown in the captured
5 image acquired by the image acquisition unit 11 1 against the face image as the user.
For example, the specificatio~l unit 114 may specify the subject having the face
image of the user and the facial region of the similarity exceeding a threshold value
as the user.
[0033]
10 In addition, for example, when sensor data representing the movement of
the user is acquired as the parameter P2 by the parameter acquisition unit 112, the
specification unit 114 may specify the subject extracted based on a checking of the
movement of the subject detected from the captured image acquired by the image
acquisition unit 111 against tlie setisor data as the user. For example, the
15 specification unit 114 may specify the subject in wl~ichth e movement of the user in
the captured image and tlie sensor data of the similarity exceeding a threshold value
are detected as the user. In addition, when the candidate for the user is specified,
the specification unit 114 may specify the user based on the parameter from the
candidate for the usee
20 [0034]
As a result of the specification unit 114 t~yi~iintgo specify the usel; it is also
assumed that the user is not specified. For example, a case in wliich the similarity
does not exceed the tl~reshold value correspo~ids to the situation assumed above.
Accordingly, when the user is not specified by the specification unit 114, tlie display
25 control unit 160 controls the portable terminal 20 to display illfornlation indicating
the movement of tlie user necessary to specify the user in the portable terminal 20.
In accordance with the control of the display control unit 160, the information
indicating the movement of tlie user is displayed in tlie portable tertilirial 20 (step
S13).
30 [0035]
FIG. 5 is a diagram illustratitlg a display example of the portable terminal 20
when the user specification fails. For example, when the user is not specified by the
specification unit 114, the display control unit 160 may control the portable terminal
20 such that the infornlation promnpting the user to turn his or her face toward the
imaging device is displayed in the portable terminal 20. In FIG. 5, the example in
which the imaging device 30 is assumed to be a rnonitoriilg camera and the display
5 control unit 160 controls the portable terminal 20 such that a message MI indicating
"Please turn your face toward the ~llo~litori~calmg era" is displayed in the portable
terminal 20 is shown.
[0036]
A description will be made with reference back to FIG. 4. When the user is
10 specified by the specification unit 114, before the flow proceeds to step S15, the
authentication unit 115 may perform the authentication process on the portable
terminal 20 specified by the specification unit 114 (step S14). 111 particular, for
exa~liplea, s shown in FIG, 4, when a password is input by a user operation input to
the portable ternlinal 20, the authentication unit 115 may determine success and
15 failure by determining u~hether the input password nlatches a password that is
registered in advance. When the authentication is successful, the flow proceeds to
step S15. When the authentication fails, the authentication process may be
perfornled again instead of proceeding to step S15.
[0037]
20 When the flow proceeds to step S15, for example, logging into the network
service is conlpleted (step S15) and the display co~ltroul nit 160 controls the portable
terminal 20 such that the captured image and the additional information are displayed
by the portable terminal 20. In accordance with tlie control of tlie display control
unit 160, the captured image and the additional infornlation are displayed in the
25 portable terminal 20 (step S16). Although the additional infornlation is not
particularly limited, for exanlple, the additional i~lfor~liationni ay be a message
written by the user hiniselflherself or another user.
LO0381
FIG. 6 is a diagratn illustrating a display exanlple of the portable temiinal20
30 when the user specification is successful. For exatnple, when tlie user is specified
by the specification unit 114, the display control unit 160 controls the portable
terlnilial20 such that the captured image arid the additional information are displayed.
An example in which the display control unit 160 controls the portable terminal 20
such that a message written by another user is displayed as the additional information
is shown in FIG. 6.
[0039]
5 In addition, the information prompting the user to turn his or her face
toward the imaging device is not limited to the example shown in FIG. 5. FIG. 7 is
a diagram illustrating a display example of the portable terminal 20 when the user
specification fails. The display control unit 160 may control the portable terminal
20 such that information indicating the movement of the user necessary to specify the
10 user is displayed in the portable terminal 20 based on a position of the candidate for
the user extracted by the candidate extraction unit 113 and a position of the imaging
device 30 that is set in advance.
[0040]
For example, as shown in FIG. 7, the display control unit 160 may control
15 the portable terminal 20 such that the portable terminal 20 displays a straight line in a
direction that the candidate for the user faces and a straight line in a direction in
which the imaging device 30 is present using the position of the candidate for the
user as a reference. In addition, as shown in FIG. 7, the display control unit 160
may control the portable terminal 20 such that an arrow representing a rotational
20 direction fro111 the straight line in the direction that the candidate for the user faces to
the straight line in the direction in which the imaging device 30 is present is
displayed in the portable tenninal 20. In addition, as shown in FIG. 7, the display
control unit 160 may control the portable terminal 20 such that a message M2 of
"Turn Left" is displayed as the message representing the rotational direction that the
25 user has seen in the portable terminal 20.
[0041]
In addition, when the user is not specified by the specification unit 114, a
technique of specifying the user may be switched. FIG. 8 is a diagram illustrating a
display example of the poltable ternlinal20 when the user specification fails. When
30 the user is not specified by the specification unit 114, the display control unit 160
may control the portable tenninal 20 such that information indicating that the user is
specified by another tecln~ique is displayed in the portable terminal 20. For
example, the display control unit 160 may control the portable terminal 20 such that
a message M3 of "a teclniique of specifying the user is switched" is displayed as the
information indicating that the user is specified by another technique in the portable
terlninal 20. The specification unit 114 may specify the subject extracted by
5 another specification technique as the user.
[0042]
For example, the specification unit 114 tries to specify the subject extracted
based on checking of the face region of the subject sllown in the captured image
against the face image of the user as the user. In this case, when the user is not
10 specified, the specification unit 114 may try to specify the subject extracted based on
checking of the movement of the subject detected by the captured image against
sensor data as the user. 111 addition, the user specification may be tried in reverse
order.
[0043]
15 In addition, when the user is not specified by the specification unit 114, the
user may be prompted to cause a difference between movements of another subject
sllown in the captured image and the user to be clear. Accordingly, when a subject
moving out of the defined nonnal range is detected from the captured image, it is
possible for the specification unit 114 to specify the subject as the user.
20 [0044]
FIG. 9 is a diagram illustrating a display example of the portable terminal 20
when the user specification is failed. For example, w11en the user is not specified by
the specification uuit 114, the display control unit 160 may control the pol-table
tern~iaal 20 such that information prompting the user to move the portable terminal
25 20 is displayed as inforn~ationin dicating the movement of the user necessary to
specify the user in the portable terminal 20. For example, as shown in FIG. 9, the
display control unit 160 may control the portable terminal 20 such that a message M4
of "Please move your portable terminal" is displayed as the information prompting
the user to move the portable terlninal 20 in the portable terminal 20.
30 [0045]
As described above, according to the user specification function of the
infornlation processing device 10, user specification is tried from the captured image
based on the parameter associated with the user of the portable terminal, and the
display control unit 160 controls the portable terminal 20 such that inforniation
indicating the movement of the user necessary to specify the user is displayed in the
portable terminal 20 when the user is not specified. Therefore, the user is expected
5 to be easily specified from the captnred image.
[0046]
<2. Colnposition decision fnnction>
Next, the composition decision function of the information processing
device 10 will be described. FIG. 10 is a diagram illustrating a brief overview of
10 the composition decision function of the inforniation processing device 10. As
described above, when the capture image is captured by the imaging device 30, the
captured image is displayed in the portable tenninal20 of the user. It is possible for
the user to view the captured image displayed in the portable terminal 20. A scene
in which the user moves toward the destination while viewing the captured image is
15 assumed herein. Decision on a preferred conlposition as the captured image viewed
by the user will be described.
[0047]
First, inforniation indicating the destination of the user is assunled. The
information indicating the destination of tl~eu ser may be input by the user operation
20 input to the portable terminal 20, and may be set by an application run by the
portable terminal 20. For example, tlie infonnation indicating the destination of the
user is depicted at a position in the real space. The infornlation indicating the
destination of tlie user is acquired by the i~lfornlation processing device 10. The
composition decision unit 125 decides the cotnposition based on the inforlnation
25 indicating the destination of the user and the recognition result of the user based on
the captnred image acquired by the image acquisition unit 111. The conlposition is
a diagram illustrating an ideal position of a11 object in the image (or an ideal direction
of the object).
[0048]
30 The recognition result of the user includes at least the user position in the
real space and the travelling direction of the user. For example, the recognition
result of the user is acquired by the recognition lullit 121. In other words, the
recognition unit 121 obtains the recognition result by recognizing the user based on
the captured image. I11 the example showti it1 FIG. 10, the user position in the real
space is denoted as Pu, the travelling direction of the user is denoted as V1, and the
direction of tlie destination of the user using the user position Pu as a reference is
5 denoted as V2.
[0049]
For example, when the user positioli is recognized as the ~recognitioar esult,
the colnpositioll decision unit 125 tnay decide the co~npositionb ased on the direction
of the destination of the user using the user position as a reference. For example, in
10 the example sliowli in FIG. 10, tlie compositioli decision unit 125 may decide the
composition based on the direction V2 of the destination of the user using the user
position Pu as the reference. For example, when the comnposition is decided based
on V2, the con~positiond ecision unit 125 may decide tlie image in which a region in
the direction V2 using the user position Pu as the reference is included to be larger
15 than a region in a direction opposite to the direction V2 using tlie user positiori Pu as
the reference as the composition. An exatnple of the conlposition as decided above
is shown as K2 in FIG. 10. The point C2 indicates a middle point of the
composition K2.
[0050]
20 I11 addition, for example, when the travelling direction of the user is
recognized as the recognition result, the con~positioa decision unit 125 may decide
the composition based on the travelling direction of the user. For example, in the
exan~ple sl~o\vn in FIG. 10, the composition decision unit 125 rnay decide the
composition based on the travelling direction V1 of the user, For example, when
25 tlie composition is decided based on V1, the conlposition decision unit 125 may
decide the image in which a region in the direction V1 using the user positioli Pu as
the reference is included to be larger than a region in a direction opposite to tlie
direction V1 using the user position Pu as tlie reference as the comnposition. A11
exatnple of the colnposition as decided above is shown as K1 in FIG, 10. The point
30 C1 indicates a nliddle poilit of tlle composition Kl.
[0051]
The colnposition decision unit 125 tiiay uniformly decide the compositioli
based 011 the travelling direction V1 of tlie usel; may uniformly decide the
composition based on the direction V2 of the destination of the user using the user
position Pu as the reference, or may selectively use ally of the decision techniques
~nentioned above. In other words, when a mode in which the composition is
5 decided based on the travelling direction V1 of the user is a first mode and a mode in
which the composition is decided based on the direction V2 of the destination of the
user using the user position Pu as the reference is a second mode, the mode setting
unit 124 may set any of these two modes. I11 this case, the composition decision
unit 125 may decide the composition in accordance with1 the mode set by the mode
10 setting unit 124. The mode may be set based on the user operatioti input to tlie
portable terminal 20, or may be set by an application run by the portable terniillal20.
[0052]
The i~ilaged etermination unit 126 determines the display image based on
the coniposition decided by the cotnposition decision unit 125. For example, the
15 image determination unit 126 may determine an image in conformity with the
composition decided by the composition decisio~iu nit 125 as the display image, or
may (leternline an itnage closest to the compositio~l decided by the con~position
decision unit 125 witl~nth e selectable range as the display image. The display
control unit 160 controls the portable terminal 20 such that the display image
20 deter~nined by the image determination unit 126 is displayed in the portable terminal
20.
[0053]
FIG. 11 is a diagram illustrating a display image at the ti~neo f setting the
first inode. For example, when the captured image Img is acquired as shown in FIG.
25 10 and the first ~uode is set by the ~iiode setting unit 124, the con~position K1 is
decided based on the travelling direction V1 of the user. In this case, for example,
as shown in FIG. 11, the image determination unit 126 may determine an image in
conforn~ity with the composition K1 as the display image Dl. In addition, the
co~npositio~dle cision unit 125 may decide the conlposition in which the user is
30 presetit in the middle. As show~lit 1 FIG. 11, the compositio~li n which the user is
present at a position spaced a predeternlined distance dl from the ~niddle may be
decided.
[0054]
In addition, a current capturing condition may be decided. In other words,
the condition decision unit 122 tilay decide whether or not the condition for capturing
the user is prepared, and the inforlnation addition unit 123 may add information
5 indicating that the condition is not prepared to the display image when the condition
decision unit 122 decides that the condition is not prepared. For example, when a
region capable of being captured is decided by the condition decision unit 122, the
information addition unit 123 may add an object indicating a boundary of the region
capable of being captured to the display image.
10 [0055]
In addition, when the boundary of the region capable of being captured in
the travelling direction V1 of the user using the user position Pu as tlie reference is
decided by the condition decision unit 122, the inforlnation addition unit 123 may
add an object indicating the boundary of the region capable of being captured to the
15 display image. Since the boundary of the region capable of being captured in the
travelling direction V1 of the user using the user position Pu as the reference has
been decided in FIG. 11, the object indicatilig the boundary of the region capable of
being captured is added to the display image Dl as Al. Alternatively, when the
condition decision unit 122 decides that a distance between the user position Pu and
20 the boundary of the region capable of being captured is shorter than a threshold, the
information addition unit 123 may add tlie object indicating the boundary of the
region capable of being captured to the display image.
[0056]
In addition, when the condition decision unit 122 decides that the brightness
25 of the captured image is less than a threshold, the infor~nationa ddition unit 123 may
add an object indicating deterioration of the capturing co~iditionto the display image.
Although prompting the user to change the travelling direction is possible by virtue
of such a process, the information provided to the user is not limited to the added
object. For example, the information addition unit 123 may control the portable
30 terlninal 20 to vibrate, and may control the portable terniinal 20 to generate an alarm
tone.
[0057]
FIG. 12 is a diagram illustrating a display image at tlie time of setting the
second mode. For example, when the captured image 11ng is acquired as shown in
FIG. 10 and the second mode is set by the mode setting unit 124, the composition K2
is decided based on the direction V2 of the destination of the user using the user
5 position Pu as the reference. In this case, for example, as shown in FIG. 12, the
image determination unit 126 may determine an image in conformity with the
composition K2 as the display image D2. In addition, although the cornposition
decision unit 125 decides the co~ilpositionin which the user is present in the middle,
the composition decision unit may decide the composition in which the user is
10 present at a position spaced a predetermined distance d2 fiom the middle as shown in
FIG. 12.
[0058]
So far, the image determination unit 126 has used the technique of
determining the display image by cutting out a portion of the captured image
15 captured by the imaging device 30 based on the composition decided by the
composition decision unit 125. When the imaging device 30 is one fixed camera,
only the technique mentioned above is employed. However, when the imaging
device 30 is a direction adjustable camera or an angle-of-view adjustable camera, or
when the imaging device 30 is provided in a plural number, other techniques may be
20 employed.
[0059]
In this case, the fixcd camera means a camera in which tlie capturing
direction or the angle of view is not adjustable. The direction adjustable camera
means a movable camera, and may be a camera having a pan fi~nctiono r a camera
25 having a tilt function. The angle-of-view adjustable camera means a camera
capable of changing the angle of view. FIG. 13 is a diagram illustrating a variation
of a technique of determining the display image. As sl~ownin FIG. 13, when the
capturing camera 30 is tlie fixed camera, the image determination unit 126 enlploys
the technique of determining the region selected &om the captured image as the
30 display image.
[0060]
In addition, as shown in FIG. 13, when the i~llaging device 30 is the
direction adjustable camera, the image determination unit 126 determines the
capturing direction of the imaging device 30 that provides the captured image, and
determines the captured image captured in the determined capturing direction as the
display image. For example, the image determination unit 126 determines the
5 capturing direction of the imaging device 30 based on the conlposition decided by
the composition decision unit 125. In particular, the image deternlination unit 126
may determine the direction ia which an image closest to the composition decided by
the composition decision unit 125 can be captured as the capturing direction of the
imaging device 30.
10 [0061]
In addition, as shown in FIG. 13, when the imaging device 30 is the angleof-
view adjustable camera, the image determination unit 126 deternlines the angle of
view of the imaging device 30 that provides the captured image, and determines the
captured image captured at the determined angle of view as the display image. For
15 example, the image determination unit 126 determines the angle of view of the
imaging device 30 based on the co~nposition decided by the composition decision
unit 125. In paiticulal; the image determination unit 126 may determine the angle
of view at whicl~ an image closest to the co~npositio~del cided by the conlposition
decision unit 125 can be captured as the angle of view of the imaging device 30.
20 [0062]
In addition, as shown ia FIG. 13, when captured images provided fro111 the
respective imaging devices 30 are acquired by the image acquisition unit 111, the
image deternlination unit 126 determines the captured image selected from the
captured inlages provided from the respective imaging devices 30 as the display
25 image. For example, the image determination unit 126 determines the captured
image selected from the captured images provided from the respective imaging
devices 30 as the display image based on the composition decided by the
composition decision unit 125. I11 particular, the image determination unit 126 may
select the captured image closest to the composition decided by the co~npositio~l
30 decision unit 125 from the captured images provided from the respective i~naging
devices 30, and lnay determine the selected captured image as the display image.
[0063]
In addition, in tlie example described above, the image closest to tlie
co~nposition decided by the composition decision unit 125 is used as the display
image. However, when only an image having a difference exceeding a threshold
between the image and tlie composition is acquired, the display image may not be
5 determined. In this case, it is also assumed that it is difficult for the image
determination unit 126 to determine the display image based on the composition
decided by the con~position decision unit 125. Accordingly, in such a case, the
image deternlination unit 126 may determine the display image based on detection
data other than the composition.
10 [0064]
The detection data is not particularly limited. For example, it is possible
for the image determination unit 126 to determine an image in which a position
closest to the user position specified by the specification unit 114 based on the sensor
data is captured as the display image. In addition, the image determination unit 126
15 may deternline an image having the srnallest number of persons shown in the image
as the display image, or niay determine an image having the smallest density of
persons shown in the image as the display image. Further, the image deternlination
unit 126 may determine an image in which the largest range is captured as the
display image, or tnay determine the captured image that is most frequently used as
20 the display image.
[0065]
In addition, when the inlaging device 30 is not present or the like, it is also
assumed that the captured image is not acquired by the image acquisition unit 111.
In such a case, the image determination unit 126 tnay determine an image according
25 to information indicating the destination of the user and the user position detected
based on data other than the captured image as the display image.
[0066]
For example, when position infornlation of the user is acquired based 011 tlie
signal received by a sensor receiving GPS signals, the image determination unit 126
30 may use the position infornlation and infornlation indicating the destination of the
user to search an image from a web page or the like. The image may be a plotted
map, or may be a captured photograph. In addition, when plural images are
acquired by searching, tlie image determination unit 126 may determine a new image
generated by synthesizing a plurality of images as the display image.
[0067]
FIG. 14 is a diagram illustrating an example of the determined display iniage.
5 As shown in FIG. 14, the display control unit 160 may add an object Objl indicating
a distance fi.0111 the user position Pu as a reference to the destination of the usel; an
object Obj2 indicating an estimated time of arriving in the destination and a distance
to the destination, and so forth, to the display image D2.
[0068]
10 In addition, as shown in FIG. 14, the display control unit 160 may add an
object Obj3 indicating a bearing, an object Obj4 indicating a direction of the
destination of the user using the user position Pu as the reference, and so forth, to the
display image D2. In addition, as sl~ownin FIG. 14, the display control unit 160
may add an object Obj5 indicating a direction of the destination of the user using the
15 user position Pu as the reference to the user position Pu and may add an object Obj6
indicating the user position Pu to a position of the user in the display image D2.
[0069]
Next, a flow of the composition decision operation of the infornlation
processing device 10 will be described. FIG. 15 is a flowchart illustrating the flow
20 of tlie con~positiond ecision operation of the information processing device 10. As
shown in FIG. 15, when the captured image is not acquired by the image acquisition
unit 11 1 ("No" in step S21), the recognition unit 121 recognizes the user fro111 data
other than the captured image (step S22), and the flow proceeds to step S26.
[0070]
25 On the other hand, when the captured itnage is acquired by the image
acquisition unit 111 ("Yes" in step S21), the recognition unit 121 recognizes the user
fiom the captured image (step S23), and the condition decision unit 122 decides
whether or not a condition for capturing is prepared (step S24). When the condition
decision unit 122 decides that the condition for capturing is prepared ("Yes" in step
30 S24), the flow proceeds to step S26. On the other hand, when the condition
decision unit 122 decides that tlie condition for capturing is not prepared ("No" in
step S24), the infornlation addition unit 123 adds information indicating that the
condition is not prepared to the captured image (step S25), and the flow proceeds to
step S26.
[007 11
When the flow proceeds to step S26, the mode setting unit 124 sets any one
5 of the first mode and the second mode (step S26), and the composition decision unit
125 decides the composition in accordance with the mode set by the mode setting
unit 124 based on the recognition result of the recognition unit 121 (step S27). The
image determination unit 126 then tries to determine the display image based on the
composition decided by the composition decision unit 125 (step S28).
10 [0072]
In this case, when the display image is deter~nined by the image
determination unit 126 ("Yes" in step S29), the flow proceeds to step S31. On the
other hand, when the display image is not determined by the image determination
unit 126 ("No" in step S29), the image determination unit 126 determines the display
16 image based on detection data other than the composition (step S30), and the flow
proceeds to step S3 1. The display control unit 160 controls the portable terminal 20
such that the display image determined by the image determination unit 126 is
displayed in the portable terminal 20 (step S31), and the flow is finished.
[0073]
20 As described above, according to the comnposition decision function of the
inforn~ationp rocessing device 10, the colnposition is decided based on inforruation
indicating the destination of the user and the recognitioll result of the user based on
the captured image. I11 addition, the display image is deternlined based on tlie
determined composition. In accordance with such control, the display image having
25 higller convenience is expected to be determined for the usee
[0074]
<3. Depiction change function>
Next, the depiction change fi~actioao f the informatioa processing device 10
will be described. As described above, it is assu~lted that the information
30 processing device 10 provides a aetwork service and the network service is provided
to the portable terminal 20 w11en the user U logs into the network service via the
portable terminal 20.
[0075]
Logging into the network service is not limited to the user U, and may be
performed by another user. In other words, there is a possibility that a person
sliown in the captured image (hereinafter, also referred to as a subject) enjoy the
5 network service. Hereinafter, a finiction of easily finding the change in state of the
subject in the network service show11 in the captured image will be described. In
addition, the subject shown in the captured image may be recognized by the
recognition unit 121 using the satlie technique as the technique specified by the usel:
[0076]
10 The change detection unit 131 detects the change in state of the subject in
the network service recognized from the captured image acquired by the image
acquisition unit 111. The state in the network service is not particularly limited.
For example, tlie state may be information indicating whether or not the portable
terminal of the subject logs into the network service. In other words, when the
15 change detection uuit 13 1 detects that the portable ternlitla1 of the subject has logged
into the network service, the depiction change unit 132 may change the depiction of
the subject shown in the captured image.
[0077]
In addition, the state in the network service may be i~lformationi ndicating
20 whether or not a specific process is carried out while being logged into the ~ietwork
service. In other words, when the change detection unit 131 detects that the
movement of the portable tellninal of the subject in the network service satisfies a
predetermined condition, the depiction change unit 132 may change tlie depiction of
the subject shown in the captured image. The predetermined condition is not
25 particularly limited. For example, tlie predetermined corldition may be a condition
that a message was written, and may be a condition that the message was written
within a predetermined time.
[0078]
When the change in state is detected by the change detection unit 131, the
30 depiction change unit 132 changes tlie depiction of the subject shown in the captured
image. A region of the subject sliown in the captured image may be figured out in
any way by the depiction change unit 132. For exatnl>le, when a difference between
the captured image in which the subject is 11ot shown and the captured image in
which the subject is shown occurs, the differential region therebetween may be found
as the region of the subject. In addition, a nlethod of changing the depiction of the
subject is not particularly limited.
5 [0079]
Further, when the user is specified by the specification unit 114, the
depiction change unit 132 may change the depiction of the user by emphasizing the
user shown in the captured image. I11 addition, a nlethod of emphasizing the user is
not particularly limited. The display control unit 160 corttrols the portable terminal
10 20 such that the display image that may be obtained by causing the depiction change
unit 132 to change the depiction is displayed in the portable ternlinal 20.
[0080]
Techniques of emphasizing the user will be described with reference to
drawings. FIG. 16 is a diagram illustrating an example of the depiction change
15 function of the information processing device 10. As shown in FIG. 16, the
depiction change unit 132 may emphasize the user U by decreasing the definition of
subjects other than the user U in the captured image.
[0081]
FIG. 17 is a diagram illustrating another example of the depiction change
20 function of the information processing device 10. As shown in FIG. 17, the
depiction cliange unit 132 may emphasize the user U by emphasizing an outline L1
of the user U in the captured image. For example, the user U may be enlphasized
by nlaking the outline Ll of the user U thick in the captured image.
[0082]
25 FIG. 18 is a diagram illustrating another exatnple of the depiction change
function of the information processing device 10. As shown in FIG. 18, the
depiction change unit 132 may emphasize the user U by changing the pixel value of
subjects other than the user U in the captured inlage. For exalnple, the user U may
be emphasized by decreasing the brigllttless of subjects other than the user U in the
30 captured image.
[0083]
FIG. 19 is a diagram illustrating another example of the depiction change
fi~nction of tlie information processirig device 10. As shown in FIG. 19, the
depiction change unit 132 may emphasize tlie user U such that the user U is zoo~iied
in on and displayed in the captured image. In addition, as shown in FIG. 19, the
depiction change unit 132 rimy zoom out and display the user U after the zoom-in
5 display is carried out.
[0084]
FIG. 20 is a diagram illustrating another example of tlie depiction change
function of the information processing device 10. The depiction change unit 132
may elliphasize the user by displaying an object at a position of the user or a position
10 near the user in the captured image. The range of surrounding the user niay be
defined in advance. In the example shown in FIG. 20, the depiction change unit 132
emphasizes the user U by adding objects Obj8 and Obj9 to the position around the
user in the captured image.
[0085]
15 In addition, the degree of enipliasizing the user U may be constant, or may
be clia~igedd epending on the situation. For example, the depiction change unit 132
may change tlie degree of emphasizing the user in accordance with the size of tlie
user in the captured image. FIG. 21 is a diagram illustrating another example of the
depiction change fiulction of the information processing device 10. For example,
20 tlie depiction change unit 132 may increase the degree of emnphasizing tlie user to the
same extent to which the size of the user in the captured image decreases.
[0086]
In the example shown in FIG. 21, as the position of the user U is farther
from the imaging device 30, the size of the user U in the captured image is slnalle~
25 Therefore, the depiction change unit 132 increases the degree of emphasizing the
user U having a small size by making tlie outlille LO of tlie user U having the s~iiall
size thicker than the outline L1 of the user U having a large size. In this way, it is
easier to find tlie user in the captured image by increasing the degree of emphasizing
the user to the same extent to which the size of the user in the captured image
30 decreases.
[0087]
In additioa, the user U may be hidden behind other objects in the captured
image. For example, wlien a portioti of the user or the entire user is hidden and
shown by other objects in the captured image, the depiction change unit 132 may
cliange tlie technique of emphasizing the user. FIG. 22 is a diagram illustrating
another exa~ilple of the depiction change functio~i of tlie information processing
5 device 10. As shown in FIG. 22, a portion of the user U is hidden by other subjects
in the captured image. The depiction cliange unit 132 thus changes the technique of
emphasizing the user U by adding the object Obj 10 to a position around the user U in
the captured image. The rauge of surrounding tlie user U may be defined in
advance.
10 [OOSS]
Next, a flow of depiction change operations of the information processing
device 10 will be described. FIG. 23 is a flowchart illustrating the flow of the
depiction change operations of the infor~nationp rocessing device 10. As shown in
FIG. 23, when the captured image is not acquired by the image acquisition unit 111
15 ("No" in step S41), the flow is finislied. On the other hand, when the captured
image is acquired by tlie image acquisition unit 111 ("Yes" in step S41), the subject
is recognized from the captured image by the recognition unit 121 (step S42). The
change detection unit 131 then decides whether or not the change in state of tlie
subject in the network service is detected (step S43).
20 [0089]
When the change in state of the subject. in tlie network service is not
detected by the cliange detection unit 131 ("No" in step S43), the flow is finished,
On the other hand, when tie cliange in state of the subject in the network service is
detected by tlie cliange detection unit 131 ("Yes" in step S43), the depiction change
25 uuit 132 changes the depiction of the subject (step S44). The display control unit
160 controls display of the display image that may be obtained by tlie depiction
change unit 132 that changes the depiction (step S45), arld the flow is finished.
[0090]
As described above, according to the depiction cliange function of the
30 inforrnation processing device 10, the change in state of tlie subject in the network
service recognized from the captured i~iiage is detected. In addition, when the
cliange in state is detected, the depiction of the subject shown in the captured image
is changed. According to such control, the change in state of the subject in the
network service shown in the captured image is expected to be easily found.
[0091]
<4. Conclusion>
5 As described above, according to the user specification function of the
information processing device 10 of the present embodiment, the information
processing device 10 including the image acquisition unit 11 1 that acquires the
captured image, the paralneter acquisition unit 112 that acquires the paralneter
associated with the user of the portable termiaal 20, the specification unit 114 that
10 specifies the user fro111 the captured image based on the parameter, and the display
control unit 160 that control the portable terminal such that information indicating
the movement of the user necessary to specify the user is displayed in the portable
terminal 20 when the user is not specified by the specification unit 114 is provided.
lo0921
15 According to the corlfiguration described above, when the user is not
specified by the specification unit 114, the information indicating the movement of
the user necessary to specify the user is displayed by the portable terminal 20, and
the user who has viewed the information can move so as to specify the user from the
captured image. Accordingly, the user is expected to be easily specified from the
20 captured image.
100931
In addition, according to the co~nposition decision function of the
infom~ation processing device 10 of the present embodiment, the iuformation
processing device 10 including the image acquisition unit 111 that acquires the
25 captured image, the compositior~ decision unit 125 that decides the composition
based on inforn~ationin dicating the destination of the user and the recognition result
of the user based on the captured image, and the i~naged etertllination unit 126 that
deterlnines the display image based on the co~llpositio~del cided by the conlposition
decision unit 125 is provided.
30 [0094]
According to s ~ ~ac hco nfiguration, the co~llpositioni s decided based on the
i~lfor~llatioinnd icating the destination of the user and the recog~litiollr esult of the
user based on the captured image, and the display image is determined based on the
composition. For example, the composition is decided based on infonnation
indicating the user position and information indicating the destination by the
cornposition decision unit 125. Accordingly, the display itnage having higher
5 convenience is expected to be deter~ninedf or the user.
[0095]
In addition, according to the depiction change function of the information
processing device 10 of the present embodiment, the inforniation processing device
10 including the image acquisition unit 111 that acquires the captured image, the
10 change detection unit 131 that detects the change in state of the subject in the
network service recognized from the captured image, and tlie depiction change unit
132 that changes the depiction of the subject shown in the captured image when the
change in state is detected by the change detection unit 13 1 is provided.
[0096]
15 According to such a configuration, wlieti the change in state of the subject in
the network service is detected, the depiction of the subject shown in the captured
image is changed. It is possible for the user who has viewed the captured image to
easily find the cl~aangei n state of the subject in the network service from the captured
image.
20 [0097]
It should be understood by those skillcd in thc art that various modifications,
con~binations, sub-combinations and alterations may occur depending on design
requirements and other factors insofar as they are within the scope of the appended
claims or the equivalents thereof.
25 [0098]
In addition, for example, an exaniple in which the infornlation processing
device 10 includes all of the processing control unit 100 and the display control unit
160 has been described. However, a device other than tlie infortnation processi~ig
device 10 niay have a portion of the blocks or the entire blocks. For exaniple, a
30 server may have a poltion of the processing control unit 100 and tlie display control
unit 160 and the portable terminal 20 may have the remaining portion. In this way,
the technique of the present disclosure call also be applied to cloud cornputing.
LO0991
In addition, it is not necessary for each step in operations of the inforniation
processing device 10 of the present specification to be processed in a time series in
the order described in the flowchart. For example, each step in the operatio~iso f the
5 information processing device 10 may be processed in an order different from the
order described in the flowchart, or may be processed in parallel.
[Ol 001
I11 addition, it is possible to create a computer program causing hardware
such as a CPU, a ROM, and a RAM embedded in the information processing device
10 10 to exert the same function as the configuration of the information processing
device 10 described above. In addition, a storage medium in which the colnputer
program is stored is also provided.
[OlOl]
Additionally, the present teclu~ologym ay also be configured as below.
15 (1)
An information processing device including:
an image acquisition unit configured to acquire a captured image;
a change detection unit configured to detect a change in a state of a subject
in a network service recognized from tlie captured image; and
20 a depiction change unit configured to change a depiction of the subject
sl~owi~ni tlie captured image in a case where the change detection unit detects the
change in tlie state.
(2)
Tlle infonilation processing device according to (I), further including
25 a specification unit configured to specify a user of a portable terniinal from
the captured image,
wherein tlie depiction change unit changes tlie depiction of the user by
emphasizing the user shown in tlie captured image.
(3)
30 Tlie information processing device according to (2), further including
a display control unit configured to perform coritrol in a manner that a
display image obtained by the depiction being changed by the depiction change unit
is displayed in the portable terminal.
(4)
The information processing device according to any one of ( 1 ) to (3),
5 wherein, in a case where the change detection unit detects that a portable
terminal of the subject logs into the network service, the depiction change unit
changes the depiction of the subject shown in the captured image.
(5)
The information processing device according to any one of (1) to (3),
10 wherein, in a case where the change detection unit detects that a movement
of a portable terminal of the subject in the network service satisfies a predetermined
condition, the depiction change unit changes the depiction of the subject shown in
the captured image.
(6)
15 The information processing device according to (2) or (3),
wherein the depiction change unit changes a degree of emphasizing the user
in accordance with a size of the user in the captured image.
(7)
The infomlation processing device according to (6),
20 wherein the depiction change unit increases the degree of emphasizing the
user as the size of the user in the captured image decreases.
(8)
The infor~nationpr ocessing device according to (2)o r (3),
wherein, in a case where a portion of the user or an entirety of the user is
25 hidden and shoown by another object in the captured image, the depiction change unit
changes a teclulique ofe ~npliasizingth e user.
(9)
The information processing device according to (2) or (3),
wherein the depiction change unit emphasizes the user by decreasing
30 definition of a subject other than the user in the captured image.
(10)
Tlie information processing device according to (2) or (3),
~vl~eretilnie depiction change unit emphasizes tlie user by enlpliasizing an
outline of the user in the captured image.
(11)
5 The information processing device according to (2) or (3),
wherein the depiction change unit emphasizes the user by changing a pixel
value of a subject other than the user in the captured image.
(12)
Tlie information processing device according to (2) or (3),
10 wherein the depiction change unit eniphasizes the user by carrying out a
zootn in display of tlie user in the captured image.
(13)
The infomiation processing device according to (2) or (3),
wherein the depiction change unit elnpliasizes the user by adding an object
15 at a position of the user or a position around the user in the captured image.
(14)
An infor~natiopnr ocessing method including:
acquiring a captured image;
detecting a change in a state of a subject in a network service recognized
20 from the captured iniage; and
chauging a depiction of the subject shown in tlie captured image in a case
where the change in the state is detected.
(15)
A program for causing a computer to futlction as a11 information processing
25 device including:
an iniage acquisition unit configured to acquire a captured image;
a change detection unit configured to detect a change in a state of a subject
in a network service recognized from the captured image; and
a depiction cliange unit collfigured to change a depiction of the subject
30 shown in the captured image i11 a case where the change detection unit detects the
cliange in the state.
Reference Signs List
[O 1021
information processing system
infornlation processing device
portable terminal
imaging device
network
storage unit
processing control unit
ilnage acquisition unit
parameter acquisition unit
candidate extraction unit
specification unit
authentication unit
recognition unit
condition decision unit
information addition unit
node setting unit
composition decision unit
ilnage determination unit
change detection unit
depiction change unit
display control unit
CLAIMS
Claim 1
An infor~nationp rocessing device comprising:
an image acquisition unit configured to acquire a captured image;
5 a change detection unit configured to detect a change in a state of a subject
in a network service recognized from the captured image; and
a depiction change unit configured to change a depiction of the subject
shown in the captured image in a case where the change detection unit detects the
change in the state.
10
Claim 2
The infor~nationp rocessing device according to claini 1, further comprising
a specification unit configured to specify a user of a portable terminal from
the captured image,
15 wherein the depiction change unit changes the depiction of the user by
etnphasizing the user shown in the captured image.
Claim 3
The information processi~lgd evice according to claini 2, further comprising
20 a display control unit configured to perform control in a ~nanner that a
display image obtained by the depiction being changed by the depiction change unit
is displayed in the portable ternlinal.
Claim 4
25 The infonnation processing device according to claim 1,
wherein, in a case bvlvhere the change detection unit detects that a portable
terminal of the subject logs into the network service, tlie depiction change unit
changes the depiction of the subject shown in the captured image.
30 Claim 5
The infonnation processing device according to claim 1,
wherein, in a case where tlie change detection unit detects that a movement
of a portable terminal of the subject in the network service satisfies a predetermined
condition, the depiction change unit changes the depiction of the subject shown in
the captured image.
5
Claim 6
The inforniation processing device according to claim 2,
wherein the depiction change unit changes a degree of emphasizing the user
in accordance with a size of the user in tlie captured image.
10
Claim 7
The infomiation processing device according to claim 6,
wherein the depiction change unit increases the degree of emphasizing the
user as the size of the user in the captured image decreases.
15
Claim 8
The information processing device according to claim 2,
wherein, in a case where a portion of the user or an entirety of tlie user is
hidden and sho~vnb y another object in tlie captured image, the depiction change unit
20 changes a technique of emphasizing the user.
Claim 9
The inforniation processing device according to claim 2,
wherein the depiction change lullit elnphasizes the user by decreasing
25 definition of a subject other than the user in the captured image.
Claim 10
The infornlation processing device according to claim 2,
wherein the depiction change unit etnphasizes the user by etnpliasizing an
30 outline of the user in the captured image.
Claim 11
The information processing device according to claim 2,
wherein the depiction change unit emphasizes the user by changing a pixel
value of a subject other than the user in the captured image.
5
Claim 12
The information processillg device according to claim 2,
wherein the depiction change unit emphasizes the user by carrying out a
zoom in display of the user in the captured image.
10
Claim 13
The information processing device according to claim 2,
wherein the depiction change unit emphasizes tlie user by adding an object
at a position of the user or a position around the user in the captured image.
15
Claim 14
An information processing method comprising:
acquiring a captured image;
detecting a change in a state of a subject in a network service recognized
20 fiom tlie captured image; and
changing a depiction of the subject sho~vni n the captured image in a case
wliere the change in the state is detected.
Claim 15
25 A program for causing a conlputer to function as an information processing
device including:
an image acquisition unit collfigured to acquire a captured i~nage;
a change detection unit collfigured to detect a change in a state of a subject
in a network service recognized from the captured image; and
30 a depiction change unit configured to change a depiction of the subject
shown in the captured image in a case where tlie change detection unit detects the change in the state.