Description
Title of Invention: INFORMATION PROCESSING TERMINAL,
INFORMATION PROCESSING METHOD, AND PROGRAM
Technical Field
[0001] The present technology relates to information processing terminals, information
processing methods, and programs and, more particularly, to an information processing
terminal, an information processing method, and a program capable of naturally sup
pressing camera shake with a target object being arranged at a certain position on an
image.
Background Art
[0002] Many digital still cameras have a hand shake alert function installed therein. The
hand shake alert function is to detect hand shake of a user and display an alert if the
hand shake is too large to cause motion blur of an object.
[0003] The hand shake alert is put out, for example, in a mode in which an icon is displayed
while the user is watching a captured image to determine the composition. The hand
shake alert icon is displayed at a certain position, such as a corner, of the captured
image along with an indicator or a numerical value indicating the amount of camera
shake.
Citation List
Patent Literature
[0004] PTL 1: Japanese Unexamined Patent Application Publication No. 2008-22300
Summary of Invention
Technical Problem
[0005] With the hand shake alert described above, it is necessary for the user to take his/her
eyes from an object on the captured image in order to confirm the amount of camera
shake and, thus, it is difficult for the user to confirm the amount of camera shake while
determining the composition.
[0006] In addition, only the amount of camera shake can be confirmed from the icon and the
user is not capable of determining which direction the user moves his/her hands to
suppress the camera shake.
[0007] The present technology is provided under such situations in order to naturally
suppress the camera shake, for example, with a target object being arranged at a certain
position on an image.
Solution to Problem
[0008] An information processing terminal of an aspect of the present technology includes
an imaging unit that takes an image; a display unit that displays the taken image; a
measuring unit that measures a motion occurring in the terminal itself; and a display
control unit that displays an indicator composed of a plurality of components arranged
in a nested structure on the image and varies a position and a size of each component
in accordance with the motion.
[0009] The display control unit may be caused to vary the positions of the components in ac
cordance with the motion in the directions of two axes that are defined on a face of the
display unit and that are orthogonal to each other and to vary the sizes of the
components in accordance with the motion in the direction of an axis orthogonal to the
two axes.
[0010] The display control unit may be caused to move at least one of the plurality of
components in a direction opposite to the direction of the motion.
[001 1] The display control unit may be caused to move the inner components by an amount
larger than that of the outer components.
[0012] The display control unit may be caused to move the outermost component, among
the plurality of components, in the same direction as the direction of the motion.
[0013] The respective components may be arranged such that the center positions of the
components coincide with each other when no motion occurs. In this case, the display
control unit may be caused to vary the positions of the respective components with
respect to the center position.
[0014] The display control unit may be caused to vary at least one of the plurality of
components so as to be decreased in size if the motion in a user direction along the axis
orthogonal to the two axes is measured and so as to be increased in size if the motion
in a direction opposite to the user direction is measured.
[0015] When the motion in the user direction is measured, the display control unit may be
caused to make the amounts of variation of the outer components larger than the
amounts of variation of the inner components to vary the components so as to be
decreased in size.
[0016] When the motion in the direction opposite to the user direction is measured, the
display control unit may be caused to make the amounts of variation of the inner
components larger than the amounts of variation of the outer components to vary the
components so as to be increased in size.
[0017] The display control unit may be caused to fix the size of the outermost component,
among the plurality of components.
[0018] When no motion occurs, the respective components may be arranged such that the
outer components and the inner components are spaced at regular intervals. In this
case, the display control unit may be caused to vary the sizes of the respective
components with respect to the sizes when the outer components and the inner
components are spaced at regular intervals.
[0019] When no motion occurs, the respective components may be arranged so as to have
the same size. In this case, the display control unit may be caused to vary the sizes of
the respective components with respect to the same size.
[0020] When the motion is not measured, the display control unit may be caused to perform
a process of clearing the display of the indicator.
[0021] In an aspect of the present technology, an image is taken, the taken image is
displayed, and a motion occurring in the terminal itself is measured. In addition, a
process is performed in which an indicator composed of a plurality of components
arranged in a nested structure is displayed on the image and a position and a size of
each component are varied in accordance with the motion.
Advantageous Effects of Invention
[0022] According to the present technology, it is possible to naturally suppress camera
shake, for example, with a target object being arranged at a certain position on an
image.
Brief Description of Drawings
[0023] [fig. l]Fig. 1 is a diagram showing an example of the configuration of a front face of an
information processing terminal.
[fig.2]Fig. 2 is a diagram showing an example of the configuration of a rear face of the
information processing terminal.
[fig.3]Fig. 3 is a diagram for describing measurement directions of acceleration.
[fig.4]Fig. 4 is a diagram showing an example of the structure of a screen of a display
unit.
[fig.5]Fig. 5 is a diagram showing an example of how an indicator is displayed
[fig.6]Fig. 6 is a diagram showing a structure of the indicator.
[fig.7]Fig. 7 is a diagram showing another example of how the indicator is displayed.
[fig.8]Fig. 8 is a diagram showing an example of how the indicator is varied.
[fig.9]Fig. 9 is a diagram showing another example of how the indicator is varied
[fig. 10] Fig. 10 includes diagrams showing examples of how the indicator is varied
when accelerations in an X-axis direction are detected.
[fig. 1l]Fig. 1 1 includes diagrams showing examples of how the indicator is varied
when accelerations in a Y-axis direction are detected.
[fig. 12] Fig. 12 is a diagram showing an example of how the indicator is varied when
an acceleration in a Z-axis direction is detected.
[fig.l3]Fig. 13 is a diagram showing another example of how the indicator is varied
when an acceleration in the Z-axis direction is detected.
[fig. 14] Fig. 14 is a diagram showing another example of how the indicator is varied
when an acceleration in the Z-axis direction is detected.
[fig.l5]Fig. 15 is a diagram showing an example of how the indicator is varied when
an acceleration in the Z-axis direction is detected.
[fig. 16] Fig. 16 is a diagram showing an example of the hardware configuration of the
information processing terminal.
[fig.l7]Fig. 17 is a block diagram showing an example of the functional configuration
of a control unit.
[fig.l8]Fig. 18 is a flow chart describing a process of displaying the indicator
performed by the information processing terminal.
[fig. 19] Fig. 19 is a diagram showing an exemplary structure of a screen in the display
unit.
[fig.20]Fig. 20 is a diagram for describing a specific example of the process.
[fig.21]Fig. 2 1 is another diagram for describing the specific example of the process.
[fig.22]Fig. 22 is a block diagram showing an example of the configuration of a
computer.
Description of Embodiments
[0024]
Fig. 1 is a diagram showing an example of the external view of an information
processing terminal according to an embodiment of the present technology.
[0025] An information processing terminal 1 is a mobile terminal, such as a so-called
smartphone, having a casing of a size which a user is capable of carrying with one
hand. A display unit 11 composed of, for example, a liquid crystal display (LCD) is
provided on a front face 1A of the casing of the information processing terminal 1. A
layered touch panel is provided in the display unit 11 and the user is capable of
performing various operations by directly touching, for example, a button displayed on
the display unit 11 with his/her finger.
[0026] A camera 12 is provided in a rear face IB of the casing of the information processing
terminal 1, as shown in Fig. 2. An image (captured image) captured by the camera 12
is displayed in real time in the display unit 11.
[0027] A user interface (UI) function is installed in the information processing terminal 1
having the above external configuration. An indicator for allowing camera shake to be
suppressed with a target object being arranged at a certain position, such as the center
of a screen, is displayed with the UI function. The target object is selected from
various objects including the face of a person, a building, and a two-dimensional
maker, an image of which the user is to take.
[0028] As described below, the display of the indicator is varied with the direction and the
magnitude of a motion occurring in the information processing terminal 1 due to the
camera shake or the like. The motion occurring in the information processing terminal
I is represented by, for example, an acceleration measured by an acceleration sensor
incorporated in the information processing terminal 1.
[0029] Fig. 3 is a diagram for describing measurement directions of the acceleration. The ac
celerations in an X-axis direction, a Y-axis direction, and a Z-axis direction shown in
Fig. 3 are detected in the information processing terminal 1.
[0030] The X axis is an axis in a direction that passes through the center of the display unit
I I and that is orthogonal to the longitudinal direction of the casing. The Y axis is an
axis that passes through the center of the display unit 11 and that is parallel to the lon
gitudinal direction of the casing. The X axis and the Y axis are axes that are defined on
the face of the display unit 11 and that are orthogonal to each other. The Z axis is an
axis that is orthogonal to the two axes of the X axis and the Y axis and that passes
through the center of the display unit 11.
[0031] The right direction toward the display unit 11 is a +X direction, the left direction
toward the display unit 11 is a -X direction, the upper direction toward the display unit
11 is a +Y direction, and the lower direction toward the display unit 11 is a -Y
direction. The direction from the rear face IB side toward the front face 1A side is a
+Z direction and the direction from the front face 1A side toward the rear face IB side
is a -Z direction. The +Z direction with respect to the information processing terminal
1 is the direction where the user is located.
[0032]
The display of the indicator is premised on the following two mentalities of persons.
[0033] 1. Persons normally adjust the imaging range of the camera 12 so that a target object
is arranged at the center of a captured image when they point the camera 12 at the
target object. In particular, this point stands out when the target object is a twodimensional
marker or the like in order to cause the information processing terminal 1
to recognize the two-dimensional marker.
[0034] 2. Persons attempt to correct distortion if the indicator is displayed in the distorted
manner.
[0035] Fig. 4 is a diagram showing an example of the structure of a screen displayed in the
display unit 11 when the camera 12 is used in the imaging.
[0036] The screen in Fig. 4 is displayed instead of a menu screen, for example, when ac
tivation of a camera application, which is an application having the imaging function,
is instructed on the menu screen displayed in the display unit 11.
[0037] As shown in Fig. 4, the screen of the camera application includes an image display
area 2 1 and an icon display area 22. The image display area 21, which is formed in
substantially the entire display unit 11, is an area where a captured image captured by
the camera 12 is displayed. The icon display area 22, which is a band-shaped area
formed along the lower side of the display unit 11, is an area where various icons are
displayed in a line.
[0038] After the camera application is activated, the user watches the captured image
displayed in the image display area 2 1 to adjust the imaging range. The captured image
is not shown in Fig. 4. The same applies to the other drawings showing examples of
display of screens.
[0039] When an acceleration higher than or equal to a certain value is detected, for example,
during the adjustment of the imaging range, the indicator is displayed on the captured
image in the image display area 21.
[0040] Fig. 5 is a diagram showing an example of how the indicator is displayed.
[0041] As shown in Fig. 5, a circle 3 1 is displayed in the image display area 21. The center
position of the circle 3 1 is at the center of the image display area 2 1 and the circle 3 1
has a substantially full circular shape with a radius of a length slightly shorter than the
distance between the center of the image display area 2 1 and the long sides thereof.
Part of the right side of the circle 31 is cut out. A horizontal line 32 that horizontally
extends from an end of a curved line forming the circle 31 intersects with a vertical
line 33 that is orthogonal to the horizontal line 32 at the center of the image display
area 21.
[0042] The circle 31, the horizontal line 32, and the vertical line 33 are fixedly displayed.
The user is capable of adjusting the imaging range of the camera 12 so that a target
object is arranged at the center of the image display area 2 1 with respect to the circle
31, the horizontal line 32, and the vertical line 33.
[0043] L-shaped guides 4 1 to 44 the interior angles of which are toward the center of the
image display area 2 1 are displayed at an upper left corner, a lower left corner, a lower
right corner, and an upper right corner, respectively, of the image display area 21.
While a certain acceleration is detected and the indicator is displayed, the guides 4 1 to
44 are fixedly displayed at the four corners of the image display area 21. When no ac
celeration is detected because, for example, the camera shake is corrected, the guides
4 1 to 44 are moved and displayed so as to converge at the center of the image display
area 2 1 and disappear along with the indicator 51.
[0044] An indicator 5 1 is displayed near the center of the image display area 21. The
indicator 51 disappears when no acceleration is detected because, for example, the
camera shake is corrected.
[0045] Fig. 6 is a diagram showing an example of the structure of the indicator 51.
[0046] The indicator 51 has four rings: a ring A, a ring B, a ring C, and a ring D having
different sizes as the components. The indicator 5 1 is composed of the four rings: the
ring A, the ring B, the ring C, and the ring D that are arranged in ascending order of
size in a nested structure.
[0047] The ring A has a substantially circular shape but the arc of the ring A is cut out at a
position Al, which is a position on the circumference composing the ring A. Thin-line
arcs are drawn at positions A2 and A3, which are also positions on the circumference,
so as to connect thick-line arcs sandwiching the positions A2 and A3. The positions
Al, A2, and A3 are spaced at regular intervals. The shapes of the rings B and C are
similar to the shape of the ring A.
[0048] The ring D has an arc shape of a length of about 3/4 of the full circle. A thin-line arc
is drawn at a position Dl, which is a position on the circumference composing the ring
D, so as to connect thick-line arcs sandwiching the position Dl.
[0049] The default positions (the positions when no acceleration is detected) of the rings A
to D are positions arranged in a concentric manner, as shown on the left side in Fig. 6.
The center positions of the rings A to D coincide with each other at the default
positions. In addition, in the default sizes of the rings A to D arranged in a concentric
circle, the spaces between the ring D and the ring C, between the ring C and the ring B,
and between the ring B and the ring A, that is, the spaces between the outer rings and
the inner rings are substantially equal to each other.
[0050] Furthermore, the shapes of the rings A to D are not limited to the ones shown in Fig.
6 and each ring may be composed of a simple circle. The rings A to D are hereinafter
appropriately shown as simple circles.
[0051] The positions and the sizes of the rings A to D having the above shapes are
separately varied with the magnitude and the direction of the acceleration detected by
the acceleration sensor, as in a manner shown in Fig. 7.
[0052] In the example in Fig. 7, the ring D slightly moves leftward and the ring C slightly
moves rightward with respect to the center of the image display area 21. The ring B
further moves rightward, compared with the ring C, and the ring A further moves
rightward, compared with the ring B. In addition, the ring D is kept at the same size as
that in Fig. 5. The rings A to C are slightly increased in size, compared with the sizes
thereof in Fig. 5.
[0053] When the indicator 5 1 is displayed in the manner shown in Fig. 7, the user has the
mentality to slightly move the ring D rightward and move the rings A, B, and C
leftward to return the rings A to D to the concentric positions. The user also has the
mentality to return the sizes of the rings A, B, and C to the default sizes. Adjusting the
imaging range of the camera 12 in accordance with these mentalities leads to ar
rangement of the target object at the center of the image display area 2 1 and attempt to
suppression of the camera shake.
[0054]
Fig. 8 is a diagram for describing how the indicator 51 is varied when an acceleration
in at least one of the X-axis direction and the Y-axis direction is detected. The intersection
between the X axis and the Y axis in Fig. 8 is positioned at the center
position of the image display area 21.
[0055] When an acceleration in at least one of the X-axis direction and the Y-axis direction
is detected, the rings A to C moves in a direction opposite to the acceleration direction
without changing the sizes (while keeping the default sizes). As for the amounts of
movement of the rings A to C, the amounts of movement of the inner smaller rings are
larger than the amounts of movement of the outer larger rings. The ring A moves by an
amount larger than that of the ring B and the ring B moves by an amount larger than
that of the ring C. The outermost ring D moves a bit in the same direction as the ac
celeration direction without changing the size.
[0056] The above movement creates an image of a motion of a spring that exists such that
the upper face of the spring coincides with the face of the display unit 11 when the
upper face of the spring is fixed with slight ranges of motion in the X and Y directions
and the opposite face (the lower face) of the spring is pulled in a direction opposite to
the direction in which the acceleration occurs. The ring A corresponding to the lower
face of the spring moves by the largest amount in the direction opposite to the direction
in which the acceleration occurs and the ring D corresponding to the upper face of the
spring slightly moves in the direction in which the acceleration occurs. In addition, the
rings B and C correspond to intermediate faces of the spring, viewed from the lon
gitudinal direction. The ring B closer to the lower face moves by an amount larger than
that of the ring C and the rings B and C move in the direction opposite to the direction
in which the acceleration occurs.
[0057] The indicator 5 1 in Fig. 8 indicates a state when accelerations in the -X direction and
the -Y direction are detected.
[0058] Fig. 9 is a diagram for describing how the indicator 5 1 is varied when an acceleration
in the Z-axis direction is detected. The intersection between the X axis, the Y axis, and
the Z axis in Fig. 9 is positioned at the center position of the image display area 21.
[0059] When an acceleration in the Z-axis direction is detected, the rings A to C are
increased in size if the acceleration direction is the -Z direction and are decreased in
size if the acceleration direction is the +Z direction without changing the positions
(while keeping the default positions). As for the amounts of variation in size of the
rings A to C when an acceleration in the -Z direction is detected, the amounts of
variation in size of the inner smaller rings are larger than the amounts of variation in
size of the outer larger rings. In this example, the inner rings are not made larger than
the outer rings although the amounts of variation of the inner rings are larger than the
amounts of variation of the outer rings. The position and the size of the ring D are
fixed to the default position and size. The size of the ring D may be slightly varied.
[0060] The above variation in size creates an image of a motion of a spring that exists such
that the upper face of the spring coincides with the face of the display unit 11 when the
upper face of the spring is fixed with slight ranges of motion in the X and Y directions
and the opposite face of the spring is pushed toward the upper face side if the ac
celeration direction is the -Z direction and is pulled if the acceleration direction is the
+Z direction.
[0061] The indicator 5 1 in Fig. 9 indicates a state when an acceleration in the -Z direction is
detected.
[0062] How the indicator 5 1 is varied when an acceleration occurs in each of the X-axis, the
Y-axis, and the Z-axis directions will be further described.
[0063] Figs. 10A and 10B are diagrams showing examples of how the indicator is varied
when accelerations in the X-axis direction are detected.
[0064] The indicator 5 1 in Fig. 10A indicates a state when an acceleration Accl in the -X
direction is detected, as shown by a void arrow #1.
[0065] In this case, the center position of the ring A moves to a position represented by x l in
the +X direction, which is a direction opposite to the direction in which the ac
celeration Accl is detected. The center position of the ring B moves to a position rep
resented by x2 in the +X direction, and the center position of the ring C moves to a
position represented by x3 in the +X direction. A relationship xl>x2>x3 is established
between xl, x2, and x3. Since no acceleration is detected in the Z-axis direction, the
sizes of the rings A to C are not varied.
[0066] In addition, the center position of the ring D moves to a position represented by -x4
in the -X direction, which is the same direction as that in which the acceleration Accl
is detected.
[0067] The indicator 5 1 in Fig. 10B indicates a state when an acceleration Acc2 in the -X
direction is detected, as shown by a void arrow #2. The acceleration Acc2 is smaller
than the acceleration Accl.
[0068] In this case, the center position of the ring A moves to a position represented by x l 1
in the +X direction, which is a direction opposite to the direction in which the ac
celeration Acc2 is detected. The center position of the ring B moves to a position rep
resented by x 12 in the +X direction, and the center position of the ring C moves to a
position represented by xl3 in the +X direction. A relationship x l 1>c12>c13 is e s
tablished between xll, xl2, and xl3, and relationships xlly2>y3 is established
between yl, y2, and y3. Since no acceleration is detected in the Z-axis direction, the
sizes of the rings A to C are not varied.
[0074] In addition, the center position of the ring D moves to a position represented by -y4
in the -Y direction, which is the same direction as that in which the acceleration Accl
is detected.
[0075] The indicator 5 1 in Fig. 1IB indicates a state when the acceleration Acc2 in the -Y
direction is detected, as shown by a void arrow #12. The acceleration Acc2 is smaller
than the acceleration Accl.
[0076] In this case, the center position of the ring A moves to a position represented by y l 1
in the +Y direction, which is a direction opposite to the direction in which the ac
celeration Acc2 is detected. The center position of the ring B moves to a position rep
resented by y 12 in the +Y direction, and the center position of the ring C moves to a
position represented by yl3 in the +Y direction. A relationship y l I>yl2>yl3 is e s
tablished between yll, yl2, and yl3, and relationships yll
Fig. 16 is a diagram showing an example of the hardware configuration of the in
formation processing terminal 1.
[0104] The information processing terminal 1 includes the display unit 11, the camera 12, a
control unit 71, an acceleration sensor 72, a memory 73, and a communication unit 74.
[0105] The control unit 7 1 executes programs stored in, for example, the memory 73 to
control the operation of the entire information processing terminal 1. For example,
when an acceleration higher than or equal to a threshold value is measured by the ac
celeration sensor 72, the control unit 71 displays the indicator 51 on a captured image
displayed in the display unit 11 and controls the display of the indicator 51 in the
manner described above.
[0106] The acceleration sensor 72 measures accelerations occurring in the X-axis direction,
the Y-axis direction, and the X-axis direction and outputs sensor data indicating the
measured values to the control unit 71.
[0107] The memory 73 is, for example, a flash memory and stores the programs executed by
the control unit 71. The communication unit 74 communicates with an external
apparatus under the control of the control unit 71.
[0108] Fig. 17 is a block diagram showing an example of the functional configuration of the
control unit 71.
[0109] At least part of the functional blocks shown in Fig. 17 is realized by the control unit
7 1 in Fig. 16 that executes certain programs. In the control unit 71, a sensor data
acquirer 81, a calculator 82, and a display controller 83 are realized.
[01 10] The sensor data acquirer 8 1 acquires the sensor data output from the acceleration
sensor 72 and outputs information about the acceleration occurring in the information
processing terminal 1 to the calculator 82.
[0111] The calculator 82 calculates the display position and the size of each ring composing
the indicator 51 on the basis of the information supplied from the sensor data acquirer
81.
[0112] For example, when an acceleration in at least one of the X-axis direction and the Yaxis
direction is detected, the calculator 82 calculates positions shifted in a direction
opposite to the acceleration direction by amounts corresponding to the magnitude of
the acceleration as the display positions of the rings A to C. In addition, the calculator
82 calculates a position shifted in the same direction as the acceleration direction by an
amount corresponding to the magnitude of the acceleration as the display position of
the ring D.
[0113] When an acceleration in the -Z direction is detected, the calculator 82 calculates the
sizes increased by the amounts of variation corresponding to the acceleration as the
sizes of the rings A to C. In addition, when an acceleration in the +Z direction is
detected, the calculator 82 calculates the sizes decreased by the amounts of variation
corresponding to the acceleration as the sizes of the rings A to C.
[01 14] When both of an acceleration in at least one of the X-axis direction and the Y-axis
direction and an acceleration in the Z-axis direction are detected, the sizes of the rings
A to C are calculated, in addition to the calculation of the positions of the rings A to D.
The calculator 82 outputs information about the positions and the sizes of the re
spective rings obtained by the calculation to the display controller 83.
[0115] The display controller 83 identifies the positions and the sizes of the respective rings
composing the indicator 51 on the basis of the information supplied from the calculator
82 and displays the indicator on a captured image displayed in the image display area
21.
[01 16]
A process of displaying the indicator performed by the information processing
terminal 1 will now be described with reference to a flow chart in Fig. 18.
[01 17] The process in Fig. 18 is performed each time the acceleration sensor 72 measures an
acceleration during activation of the camera application. Upon activation of the camera
application, a captured image captured by the camera 12 is displayed in the image
display area 2 1 on the display unit 11.
[0118] In Step SI, the sensor data acquirer 8 1 acquires a measured value by the acceleration
sensor 72.
[0119] In Step S2, the calculator 82 obtains the difference between the current measured
value and the previous measured value, which are acquired by the sensor data acquirer
81.
[0120] In Step S3, the calculator 82 stores the obtained difference of the acceleration.
[0121] In Step S4, the calculator 82 determines whether a motion occurring in the in
formation processing terminal 1 is larger than a threshold value on the basis of the
difference obtained in Step S2.
[0122] If the calculator 82 determines in Step S4 that the motion occurring in the in
formation processing terminal 1 is larger than the threshold value, in Step S5, the
calculator 82 calculates the position and the size of each ring composing the indicator
51 in the above manner in accordance with the accelerations in the X-axis direction,
the Y-axis direction, and the Z-axis direction.
[0123] In Step S6, the display controller 83 displays the indicator 5 1 composed of the rings
having the positions and the sizes obtained by the calculator 82 on the captured image.
[0124] In contrast, if it is determined in Step S4 that the motion occurring in the information
processing terminal 1 is not larger than the threshold value, in Step S7, the display
controller 83 clears the display of the indicator 5 1 when the indicator 5 1 has been
displayed. When the indicator 51 has not been displayed, the display of the captured
image is continued.
[0125] After the indicator 5 1 is displayed in Step S6 or after the display of the indicator 5 1
is cleared in Step S7, the process is terminated. The above process is repeated each
time an acceleration is detected.
[0126] The information processing terminal 1 is capable of causing the user to have the
mentality to arrange a target object at the center of the image display area 2 1 with the
camera shake suppressed by displaying the indicator on the captured image in the
above manner. The user is capable of adjusting the imaging range of the camera 12 in
accordance with the display of the indicator 5 1 to intuitively arrange the target object
at the center of the image display area 2 1 with the camera shake suppressed.
[0127]
A specific example of the process to realize the display of the indicator described
above will now be described. As shown in Fig. 19, it is assumed that the image display
area 2 1 horizontally has 320 pixels and vertically has 426 pixels. The center of the
image display area 2 1 is represented by x= 160th pixel and y=213th pixel with respect
to one pixel at the upper left corner.
[0128] Fig. 20 and Fig. 2 1 are diagrams for describing the flow of the process. The flow of
the process shown in Fig. 20 and Fig. 2 1 is basically the same as the flow of the
process described above with reference to Fig. 18.
[0129] Accelerations in the X direction, the Y direction, and the X direction, which are
newly measured, are denoted by currentAccX, currentAccY, and currentAccZ. Accel
erations in the X direction, the Y direction, and the X direction, which have been
previously measured, are denoted by previousAccX, previousAccY, and previousAccZ.
[0130] In this case, the calculator 82 calculates accX, accY, and accZ in accordance with the
following equations (1) to (3), as shown in the first to third lines in Fig. 20. In each
equation, factor denotes a certain value.
accX = (currentAccX * factor) + (previousAccX * (1.0 - factor)) (1)
accY = (currentAccY * factor) + (previousAccY * (1.0 - factor)) (2)
accZ = (currentAccZ * factor) + (previousAccZ * (1.0 - factor)) (3)
[0131] In addition, the calculator 82 calculates diffX, diffY, and diffZ in accordance with
the following equations (4) to (6), as shown in the fourth to sixth lines in Fig. 20.
diffX = accX - previousAccX (4)
diffY = accY - previousAccY (5)
diffZ = accZ - previousAccZ (6)
[0132] The calculation in the equations (1) to (6) corresponds to the processing in Step S2 in
Fig. 18.
[0133] The calculator 82 stores diffX, diffY, and diffZ obtained by the equations (4) to (6)
as previsouAccX, previsouAccY, and previsouAccZ, respectively, as shown in the
seventh to ninth lines in Fig. 20. Storing previsouAccX, previsouAccY, and pre
visouAccZ corresponds to the processing in Step S3 in Fig. 18. PrevisouAccX, pre
visouAccY, and previsouAccZ stored here are used in the calculation when a next acceleration
is acquired.
[0134] The calculator 82 calculates deltaX, deltaY, and deltaZ in accordance with the
following equations (7) to (9), as shown in the tenth to twelfth lines in Fig. 20. For
example, weight is equal to -650.
deltaX = diffX * weight (7)
deltaY = diffY * weight (8)
deltaZ = diffZ * weight (9)
[0135] The calculator 82 performs calculation in the following equation (10), as shown in
the thirteenth line in Fig. 20, to determine whether the obtained value is smaller than a
threshold value. The threshold value is set to, for example, 40.0.
deltaX * deltaX + deltaY * deltaY + deltaZ * deltaZ
(10)
[0136] The processing in which the calculation in the equations (7) to (10) is performed and
the value obtained by the equation (10) is compared with the threshold value cor
responds to the processing in Step S4 in Fig. 18. If the value obtained by the equation
(10) is smaller than the threshold value, the display of the indicator disappears, as
shown in the fourteenth line in Fig. 20. If the value obtained by the equation (10) is
larger than the threshold value, the display of the indicator is started, as shown in the
sixteenth line in Fig. 20.
[0137] When the value obtained by the equation (10) is larger than the threshold value, the
processing in which each ring (Focus) of the indicator 5 1 is drawn in accordance with
the values of deltaX, deltaY, and deltaZ is performed, as shown in the first line in Fig.
21.
[0138] "MoveFocusA(deltaX, deltaY)" in the second line in Fig. 2 1 represents the
processing in which the position of the ring A is moved in accordance with the values
of deltaX and deltaY, and "resizeFocusA(deltaZ)" in the third line represents the
processing in which the size of the ring A is varied in accordance with the value of
deltaZ. "MoveFocusB(deltaX, deltaY)" in the fourth line represents the processing in
which the position of the ring B is moved in accordance with the values of deltaX and
deltaY, and "resizeFocusB (deltaZ)" in the fifth line represents the processing in which
the size of the ring B is varied in accordance with the value of deltaZ.
"MoveFocusC(deltaX, deltaY)" in the sixth line represents the processing in which the
position of the ring C is moved in accordance with the values of deltaX and deltaY,
and "resizeFocusC(deltaZ)" in the seventh line represents the processing in which the
size of the ring C is varied in accordance with the value of deltaZ.
"MoveFocusD(deltaX, deltaY)" in the eighth line represents the processing in which
the position of the ring D is moved in accordance with the values of deltaX and deltaY.
[0139] The processing in the second and subsequent lines in Fig. 2 1 corresponds to the
processing in Steps S5 and S6 in Fig. 18.
[0140] The tenth to fourteenth lines represent the processing of "moveFoxusA(deltaX,
deltaY)." The X coordinate of the center of the ring A is obtained by the following
equation (11), and the y coordinate of the center of the ring A is obtained by the
following equation (12).
x = 160.0 + deltaX*1.4 (11)
y = 213.0 + deltaY* 1.4 (12)
[0141] The coefficient 1.4 by which deltaX is multiplied in the equation (11) and the co
efficient 1.4 by which deltaY is multiplied in the equation (12) are larger than coef
ficients used in equations to obtain the positions of the rings B, C, and D other than the
ring A. As a result, the display of the indicator 51 in which the amounts of movement
of the inner smaller rings are made large is realized, as described above.
[0142] The fifteenth to seventeenth lines represent the processing of "resizeFoxusA(
deltaZ)." The size of the ring A is obtained by the following equation (13).
The equation (13) represents calculation in which deltaZ is applied to a certain
function f and the result of the application is multiplied by the coefficient 1.4.
focusA.resizeTo( 1.4*f(deltaZ) (13)
[0143] The eighteenth to twenty-second lines represent the processing of
"moveFoxusB(deltaX, deltaY)." The X coordinate of the center of the ring B is
obtained by the following equation (14), and the y coordinate of the center of the ring
B is obtained by the following equation (15).
x = 160.0 + deltaX*1.0 (14)
y = 213.0 + deltaY* 1.0 (15)
[0144] The twenty-third to twenty-fifth lines represent the processing of "resizeFoxusB(
deltaZ)." The size of the ring B is obtained by the following equation (16).
focusB.resizeTo(1.0*f(deltaZ)) (16)
[0145] The twenty-sixth to thirty lines represent the processing of "moveFoxusC(deltaX,
deltaY)." The X coordinate of the center of the ring C is obtained by the following
equation (17), and the y coordinate of the center of the ring C is obtained by the
following equation (18).
x = 160.0 + deltaX*0.6 (17)
y = 213.0 + deltaY*0.6 (18)
[0146] The thirty-first to thirty-third lines represent the processing of "resizeFoxusC(
deltaZ)." The size of the ring C is obtained by the following equation (19).
focusC.resizeTo(0.6*f(deltaZ)) (19)
[0147] The thirty-fourth to thirty-eighth lines represent the processing of
"moveFoxusD(deltaX, deltaY)." The X coordinate of the center of the ring D is
obtained by the following equation (20), and the y coordinate of the center of the ring
D is obtained by the following equation (21).
x = 160.0 - deltaX*0.4 (20)
y = 213.0 - deltaY*0.4 (21)
[0148] In the equation (20), the value resulting from multiplication of deltaX by the co
efficient 0.4 is subtracted from the x coordinate 160.0 of the center of the image
display area 21. In addition, in the equation (21), the value resulting from multi
plication of deltaY by the coefficient 0.4 is subtracted from the y coordinate 213.0 of
the center of the image display area 21. As a result, the display of the indicator 5 1 in
which only the ring D is slightly moved in the same direction as the acceleration
direction is realized, as described above.
[0149]
Although the components of the indicator 51 have the circular shapes in the above
description, the indicator 51 may have components having other shapes including
linear shapes, such as triangles or quadrangles, or curved shapes.
[0150] In addition, although the reference position of the indicator 5 1 coincides with the
center of the image display area 2 1 and the position of each ring is varied with respect
to the center of the image display area 21, the indicator 5 1 may be displayed by using
another position in the image display area 2 1 as the reference position. The user may
select an arbitrary position as the reference position of the indicator 51. Alternatively,
the face of a person appearing in the captured image may be recognized and the
indicator 51 may be displayed by using the position of the face of the person as the
reference position.
[0151]
The series of processing described above may be performed by hardware or by
software. When the series of processing is performed by software, the programs
composing the software are installed from a program recording medium into a
computer incorporated in dedicated hardware, a general-purpose personal computer, or
the like.
[0152] Fig. 22 is a block diagram showing an example of the hardware configuration of a
computer that performs the series of processing described above with programs.
[0153] A central processing unit (CPU) 101, a read only memory (ROM) 102, and a random
access memory (RAM) 103 are connected to each other via a bus 104.
[0154] An input-output interface 105 is also connected to the bus 104. An input unit 106
including, for example, a keyboard and/or a mouse and an output unit 107 including,
for example, a display and/or a speaker are connected to the input-output interface 105.
In addition, a storage unit 108, which is, for example, a hard disk or a non-volatile
memory, a communication unit 109, which is, for example, a network interface, and a
drive 110 driving a removable medium 111 are connected to the input-output interface
105.
[0155] In the computer configured in the above manner, the CPU 101 loads programs, for
example, stored in the storage unit 108 into the RAM 103 via the input-output interface
105 and the bus 104 and executes the programs to perform the series of processing
described above.
[0156] The programs to be executed by the CPU 101 is, for example, stored in the
removable medium 111 or supplied via a wired or wireless transmission medium, such
as a local area network, the Internet, or digital broadcasting to be installed in the
storage unit 108.
[0157] For information, the programs to be executed by the computer may be programs that
perform the processing in time series in the order described in this description or may
be programs that perform the processing in parallel or at required timing, such as in
response to invocation.
[0158] The embodiments of the present technology are not limited to the embodiments
described above and various modifications may be made without departing from the
spirit and scope of the present technology.
[0159] For example, the present technology may have a cloud computing configuration in
which one function is shared between multiple apparatuses via a network and the
multiple apparatuses process the function in conjunction with each other.
[0160] In addition, each step described in the above flow chart may be shared between and
executed by multiple apparatuses, instead of being executed by one apparatus.
[0161] Furthermore, when one step includes multiple processings, the multiple processings
included in the one step may be shared between executed by multiple apparatuses,
instead of being executed by one apparatus.
[0162]
The present technology may also adopt the following configurations.
[0163] (1)
An information processing terminal includes
an imaging unit that takes an image;
a display unit that displays the taken image;
a measuring unit that measures a motion occurring in the terminal itself; and
a display control unit that displays an indicator composed of a plurality of
components arranged in a nested structure on the image and varies a position and a size
of each component in accordance with the motion.
[0164] (2)
The information processing terminal described in (1),
wherein the display control unit varies the positions of the components in accordance
with the motion in the directions of two axes that are defined on a face of the display
unit and that are orthogonal to each other and varies the sizes of the components in ac
cordance with the motion in the direction of an axis orthogonal to the two axes.
[0165] (3)
The information processing terminal described in (2),
wherein the display control unit moves at least one of the plurality of components in
a direction opposite to the direction of the motion.
[0166] (4)
The information processing terminal described in (2) or (3),
wherein the display control unit moves the inner components by an amount larger
than that of the outer components.
[0167] (5)
The information processing terminal described in any of (2) to (4),
wherein the display control unit moves the outermost component, among the
plurality of components, in the same direction as the direction of the motion.
[0168] (6)
The information processing terminal described in any of (2) to (5),
wherein the respective components are arranged such that the center positions of the
components coincide with each other when no motion occurs, and
wherein the display control unit varies the positions of the respective components
with respect to the center position.
[0169] (7)
The information processing terminal described in any of (2) to (6),
wherein the display control unit varies at least one of the plurality of components so
as to be decreased in size if the motion in a user direction along the axis orthogonal to
the two axes is measured and so as to be increased in size if the motion in a direction
opposite to the user direction is measured.
[0170] (8)
The information processing terminal described in (7),
wherein, when the motion in the user direction is measured, the display control unit
makes the amounts of variation of the outer components larger than the amounts of
variation of the inner components to vary the components so as to be decreased in size.
[0171] (9)
The information processing terminal described in (7) or (8),
wherein, when the motion in the direction opposite to the user direction is measured,
the display control unit makes the amounts of variation of the inner components larger
than the amounts of variation of the outer components to vary the components so as to
be increased in size.
[0172] (10)
The information processing terminal described in any of (7) to (9),
wherein the display control unit fixes the size of the outermost component, among the
plurality of components.
[0173] (11)
The information processing terminal described in any of (7) to (10),
wherein, when no motion occurs, the respective components are arranged such that
the outer components and the inner components are spaced at regular intervals, and
wherein the display control unit varies the sizes of the respective components with
respect to the sizes when the outer components and the inner components are spaced at
regular intervals.
[0174] (12)
The information processing terminal described in any of (7) to (10),
wherein, when no motion occurs, the respective components are arranged so as to
have the same size, and
wherein the display control unit varies the sizes of the respective components with
respect to the same size.
[0175] (13)
The information processing terminal described in any of (1) to (12),
wherein, when the motion is not measured, the display control unit clears the display
of the indicator.
[0176] (14)
An information processing method includes the steps of:
taking an image;
displaying the taken image;
measuring a motion occurring in the terminal itself; and
displaying an indicator composed of a plurality of components arranged in a nested
structure on the image and varying a position and a size of each component in ac
cordance with the motion.
[0177] (15)
A program causes a computer to execute a process including the steps of:
taking an image;
displaying the taken image;
measuring a motion occurring in the terminal itself; and
displaying an indicator composed of a plurality of components arranged in a nested
structure on the image and varying a position and a size of each component in ac
cordance with the motion.
Reference Signs List
I information processing terminal
I I display unit
12 camera
1 control unit
2 acceleration sensor
3 memory
4 communication unit
81 sensor data acquirer
82 calculator
83 display controller

PCT7JP2012/007650
Claims
1. An information processing terminal comprising:
an imaging unit that takes an image;
a display unit that displays the taken image;
a measuring unit that measures a motion occurring in the terminal
itself; and
a display control unit that displays an indicator composed of a plurality
of components arranged in a nested structure on the image and varies a
position and a size of each component in accordance with the motion.
2. The information processing terminal according to Claim 1,
wherein the display control unit varies the positions of the components
in accordance with the motion in the directions of two axes that are
defined on a face of the display unit and that are orthogonal to each
other and varies the sizes of the components in accordance with the
motion in the direction of an axis orthogonal to the two axes.
3. The information processing terminal according to Claim 2,
wherein the display control unit moves at least one of the plurality of
components in a direction opposite to the direction of the motion.
4. The information processing terminal according to Claim 3,
wherein the display control unit moves the inner components by an
amount larger than that of the outer components.
5. The information processing terminal according to Claim 2,
wherein the display control unit moves the outermost component,
among the plurality of components, in the same direction as the
direction of the motion.
6. The information processing terminal according to Claim 2,
wherein the respective components are arranged such that the center
positions of the components coincide with each other when no motion
occurs, and
wherein the display control unit varies the positions of the respective
components with respect to the center position.
7. The information processing terminal according to Claim 2,
wherein the display control unit varies at least one of the plurality of
components so as to be decreased in size if the motion in a user
direction along the axis orthogonal to the two axes is measured and so
as to be increased in size if the motion in a direction opposite to the
user direction is measured.
PCT7JP2012/007650
8. The information processing terminal according to Claim 7,
wherein, when the motion in the user direction is measured, the display
control unit makes the amounts of variation of the outer components
larger than the amounts of variation of the inner components to vary the
components so as to be decreased in size.
9. The information processing terminal according to Claim 7,
wherein, when the motion in the direction opposite to the user direction
is measured, the display control unit makes the amounts of variation of
the inner components larger than the amounts of variation of the outer
components to vary the components so as to be increased in size.
10. The information processing terminal according to Claim 7,
wherein the display control unit fixes the size of the outermost
component, among the plurality of components.
11. The information processing terminal according to Claim 7,
wherein, when no motion occurs, the respective components are
arranged such that the outer components and the inner components are
spaced at regular intervals, and
wherein the display control unit varies the sizes of the respective
components with respect to the sizes when the outer components and
the inner components are spaced at regular intervals.
12. The information processing terminal according to Claim 7,
wherein, when no motion occurs, the respective components are
arranged so as to have the same size, and
wherein the display control unit varies the sizes of the respective
components with respect to the same size.
13. The information processing terminal according to Claim 1,
wherein, when the motion is not measured, the display control unit
clears the display of the indicator.
14. An information processing method comprising the steps of:
taking an image;
displaying the taken image;
measuring a motion occurring in the terminal itself; and
displaying an indicator composed of a plurality of components arranged
in a nested structure on the image and varying a position and a size of
each component in accordance with the motion.
15. A program causing a computer to execute a process including the steps
of:
taking an image;
PCT/JP2012/007650
displaying the taken image;
measuring a motion occurring in the terminal itself; and
displaying an indicator composed of a plurality of components arranged
in a nested structure on the image and varying a position and a size of
each component in accordance with the motion.