FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
“OPERATION DEVICE, AND INFORMATION
PROCESSING METHOD AND INFORMATION
PROCESSING DEVICE THEREFOR”
SONY CORPORATION, of 1-7-1, Konan, Minato-ku, Tokyo
108-0075, Japan
The following specification particularly describes the invention and the manner in
which it is to be performed.
2
DESCRIPTION
OPERATION APPARATUS, INFORMATION PROCESSING METHOD
THEREFOR, AND INFORMATION PROCESSING APPARATUS
5 Technical Field
[0001] The present technology relates to an
operation apparatus that remotely operates an
information processing apparatus such as a television
receiver, to an information processing method therefor,
10 and to an information processing apparatus being a
control target of the operation apparatus.
Background Art
[0002] As a wireless operation terminal that
remotely controls an information processing apparatus
15 such as a television receiver, an infrared remote
controller utilizing an infrared communication has been
a mainstream. However, the infrared remote controller
has a high directivity of an infrared ray, and hence it
has been necessary to direct the remote controller, a
20 light-emitting unit of an infrared ray, to a controltarget
apparatus. However, the directivity of a radio
wave is relatively low, and hence, in recent years, a
radio frequency (RF) remote controller utilizing a
high-frequency radio wave has been developed and is
25 becoming a mainstream. Further, attempts to standardize
the RF remote controller are conducted by
3
organizations.
[0003] For example, in accordance with near field
communication standard IEEE (registered trademark)
(institute of electrical and electronic engineers)
802.15.4, ZigBee (registered trademark) 5 is standardized
as specifications for a network layer, a security
layer, and an application layer, which correspond to
upper layer of IEEE (registered trademark) 802.15.4. In
addition, based on IEEE (registered trademark)
10 802.15.4, RF remote control standard ZigBee (registered
trademark) RF4CE (radio frequency for consumer
electronics) is standardized by trade organizations.
[0004] For example, Patent Document 1 discloses a
technique relating to an operation terminal that
15 controls an information processing apparatus such as a
television receiver using an RF wireless signal such as
RF4CE. Further, Patent Document 2 describes a remote
control apparatus including a casing formed of a sixsided
rectangular parallelepiped, which has two main
20 surfaces in which operation keys are provided. This
remote control apparatus detects which of the two main
surfaces is on the front side and invalidates an
operation key of the main surface on the back side.
[0005] Patent Document 1: Japanese Patent
25 Application Laid-open No. 2011-034294
Patent Document 2: Japanese Patent
4
Application Laid-open No. HEI 6-89634
Summary of Invention
Problem to be solved by the Invention
[0006] By the way, in recent years, information
processing apparatuses have 5 become remarkably
multifunctional. For example, there is a television
receiver or the like that is connected to the Internet
to be capable of using various services on the
Internet. Therefore, also in an operation apparatus for
10 remotely controlling such a multifunctional information
processing apparatus, necessities for a pointing device
such as a touch pad and a keyboard are increased.
However, an installation space is required because the
pointing device and the keyboard needs a certain
15 surface size, which contributes to an increase in size
of the operation apparatus. In view of this, the
provision of the keyboard, the touch pad, and the like
in two surfaces of the operation apparatus that are
opposed in front and back directions is under
20 consideration. In the case where such a configuration
is employed, various improvements for improving the
operability are expected.
[0007] In view of the above-mentioned circumstances,
it is an object of the present technology to provide an
25 operation apparatus capable of achieving an improvement
in operability, an information processing method for
5
the operation apparatus, and an information processing
apparatus.
Means for solving the Problem
[0008] In order to solve the above-mentioned
problems, an operation apparatus 5 being an aspect
according to the present technology includes: a casing
including two surfaces opposed in front and back
directions as a first surface and a second surface; a
first operation input unit that is provided in the
10 first surface and includes a detector that performs a
detection of an operation of a user with respect to a
predetermined coordinate detection space on the first
surface; a second operation input unit provided in the
second surface; a determination unit that determines an
15 attitude of the casing when an operation of the user
with respect to the coordinate detection space of the
detector is performed from a side of the second
surface; and a converter that converts, when the
attitude is determined, information detected by the
20 detector into information of a coordinate system of the
coordinate detection space seen through from the side
of the second surface.
[0009] The detector may detect coordinates specified
by the user with respect to the coordinate detection
25 space, and the converter may perform a conversion by
calculation formulae
6
X’ = -Y
Y’ = -X
where coordinates detected by the detector are denoted
by (X, Y), detection coordinates in a coordinate system
of the coordinate detection space seen 5 through from the
side of the second surface are denoted by (X’, Y’), a
length of the coordinate detection space in a Y-axis
direction is denoted by , and a length of the
coordinate detection space in an X-axis direction is
10 denoted by .
[0010] In the above-mentioned operation apparatus,
the first operation input unit may include one or more
key operation units together with the detector, and the
operation apparatus may further include a control unit
15 that puts a detection of an operation of the key
operation unit in a stop state when the attitude is
determined.
[0011] The control unit may put the determination of
the attitude in the stop state when information is
20 output from the detector.
The control unit may put the determination of the
attitude in the stop state when the second operation
input unit is operated.
[0012] The operation apparatus according to the
25 present technology may further include an imaging unit
that is capable of capturing an image of a front side
7
of either one of the first surface and the second
surface, and the determination unit may determine the
attitude based on the image captured by the imaging
unit.
[0013] The converter may perform 5 a conversion by
calculation formulae
X’ = -X
Y’ = Y
where detection coordinates obtained in a coordinate
10 system of the coordinate detector are denoted by (X,
Y), detection coordinates in a coordinate system of the
coordinate detection space seen through from the side
of the second surface are denoted by (X’, Y’), a length
of a detection space of the coordinate detector in the
15 Y-axis direction is denoted by .
[0014] The detector may detect movement information
according to an operation of the user with respect to
the coordinate detection space, and the converter may
perform a conversion by calculation formulae
20 x’ = -y
y’ = -x
where the movement information detected by a coordinate
system of the coordinate detector is denoted by (x, y)
and movement information in the coordinate system of
25 the coordinate detection space seen through from the
side of the second surface is denoted by (x’, y’).
8
[0015] The detector may detect movement information
according to an operation of the user with respect to
the coordinate detection space, and the converter may
perform a conversion by calculation formulae
5 x’ = -x
y’ = y
where movement information obtained in the coordinate
system of the coordinate detector is denoted by (x, y)
and the movement information of the coordinate system
10 of the coordinate detection space seen through from the
side of the second surface is denoted by (x’, y’).
[0016] An information processing method for an
operation apparatus being another aspect according to
the present technology includes: determining an
15 attitude of a casing including a first surface in which
a first operation input unit is provided and a second
surface in which a second operation input unit is
provided, the first operation input unit including a
detector that performs a detection of an operation of a
20 user with respect to a predetermined coordinate
detection space, the second surface being opposed to
the first surface in front and back directions, the
attitude of the casing being an attitude when an
operation of the user with respect to the coordinate
25 detection space of the detector is performed from a
side of the second surface; and converting, when the
9
attitude is determined, information detected by the
detector into information of a coordinate system of the
coordinate detection space seen through from the side
of the second surface.
[0017] An information processing 5 apparatus being
another aspect according to the present technology
includes: for an operation apparatus including a casing
including two surfaces opposed in front and back
directions as a first surface and a second surface, a
10 first operation input unit that is provided in the
first surface and includes a detector that performs a
detection of an operation of a user with respect to a
predetermined coordinate detection space on the first
surface, and a second operation input unit provided in
15 the second surface, a determination unit that
determines an attitude of the casing when an operation
of the user with respect to the coordinate detection
space of the detector is performed from a side of the
second surface; and a converter that converts, when the
20 attitude is determined, information detected by the
detector into information of a coordinate system of the
coordinate detection space seen through from the side
of the second surface.
Effect of the Invention
25 [0018] As described above, according to the present
technology, it is possible to provide an operation
10
apparatus having high operability.
Brief Description of Drawings
[0019] [Fig. 1] A block diagram showing a
configuration of an information processing system of a
first embodiment according to the present 5 technology.
[Fig. 2] A view showing a hardware
configuration of an information processing apparatus of
Fig. 1.
[Fig. 3] An outer appearance view on a side
10 of a remote-controller surface of the operation
apparatus of Fig. 1.
[Fig. 4] An outer appearance view on a side
of a keyboard surface of the operation apparatus of
Fig. 1.
15 [Fig. 5] A block diagram showing a hardware
configuration of the operation apparatus of Fig. 1.
[Fig. 6] A view showing a touch pad operation
attitude of the operation apparatus of Fig. 1.
[Fig. 7] A view showing a keyboard operation
20 attitude of the operation apparatus of Fig. 1.
[Fig. 8] A view showing a state when the
keyboard surface of the operation apparatus of Fig. 1
is directed to the user and a touch pad placed in a
back surface thereof is operated in such an attitude.
25 [Fig. 9] A view for explaining a coordinate
system of the touch pad of the operation apparatus of
11
Fig. 1.
[Fig. 10] A view for explaining a coordinate
system of the coordinate detection space of the touch
pad seen through from a side of the keyboard surface in
the operation apparatus 5 of Fig. 1.
[Fig. 11] A view showing a second touch pad
operation attitude of an operation apparatus according
to Modified example 1.
[Fig. 12] A view showing a touch pad
10 operation attitude of the operation apparatus according
to Modified example 1.
[Fig. 13] A view for explaining an attitude
detection method by an operation apparatus according to
Modified Example 4.
15 [Fig. 14] Another view for explaining the
attitude detection method by the operation apparatus
according to Modified Example 4.
[Fig. 15] A view for explaining an operation
apparatus according to Modified Example 5.
20 Mode(s) for Carrying Out the Invention
[0020] Hereinafter, an embodiment according to the
present technology will be described with reference to
the drawings.
This embodiment relates to an operation apparatus
25 that remotely operates an information processing
apparatus such as a television receiver, a game
12
console, a recorder, and a personal computer through a
transmission channel such as a cable transmission
signal, an Ir signal, an RF signal, and a wireless LAN.
[0021] In recent years, information processing
apparatuses have become remarkably multifunctional. 5 For
example, there is a television receiver or the like
that is connected to the Internet to be capable of
using various services on the Internet. In view of
this, there has also been introduced a remote operation
10 apparatus installing a QWERTY keyboard including a
normal key arrangement employed in, for example, a
keyboard for a personal computer, a touch pad, and the
like. Further, in the case where the QWERTY keyboard,
the touch pad, and the like are placed in a single
15 surface as viewed from the user, the surface size of
the operation apparatus increases, which leads to an
increase in size of the operation apparatus. In view of
this, the provision of the QWERTY keyboard and the
pointing device such as the touch pad in two surfaces
20 of the operation apparatus that are opposed in front
and back directions is under consideration.
[0022] In the case where the QWERTY keyboard, the
touch pad, and the like are placed in the two surfaces
of the operation apparatus that are opposed in the
25 front and back directions, as an operation mode of the
touch pad and the like, a mode of operating the touch
13
pad and the like with the surface in which the QWERTY
keyboard is placed being directed to the user is
assumed. When the touch pad in the back surface is
operated with the surface in which the QWERTY keyboard
is placed being directed to the user, 5 it is necessary
for the user to perform an operation while being aware
of viewing a coordinate system of the touch pad from
the back side and it is difficult to perform an
intuitive operation. Thus, the operability is
10 significantly lowered.
[0023] The operation apparatus according to this
embodiment includes a built-in detector such as an
acceleration sensor necessary for detecting the
attitude. This operation apparatus detects the attitude
15 based on a detection value of the detector and
determines which of the surfaces, a first surface in
which the touch pad is placed and a second surface in
which the QWERTY keyboard is placed, faces the user and
determines the vertical and horizontal attitude
20 orientation of the operation apparatus. Based on the
determination result, the operation apparatus converts
information of the coordinates and the like detected by
the touch pad into information of a coordinate system
of a coordinate detection space of the touch pad seen
25 through from a side of the second surface depending on
needs.
14
[0024] Hereinafter, an operation apparatus according
to this embodiment will be described in detail.

Fig. 1 is a block diagram showing a configuration
of an information processing 5 system in a first
embodiment according to the present technology. As
shown in the figure, an information processing system
100 in this embodiment includes an information
processing apparatus 200 being an operation target and
10 an operation apparatus 300 that remotely operates the
information processing apparatus 200. The information
processing apparatus 200 may be any apparatus as long
as it has a hardware configuration of a basic computer,
for example, a television receiver, a personal
15 computer, a recorder, a player, a game machine, or the
like. Alternatively, the information processing
apparatus 200 may be an apparatus that is connected to
a network such as the Internet to enable viewing of a
web page and the like to be performed.
20 [0025] [Configuration of Information Processing
Apparatus 200]
Fig. 2 is a view showing a hardware configuration
of the information processing apparatus 200.
In this embodiment, a case where a television
25 receiver is used as the information processing
apparatus 200 will be described.
15
[0026] The information processing apparatus 200
includes a central processing unit (CPU) 201, a bus
202, a memory 203, storage 204, a network I/F 206, and
a wireless communication unit 207. The information
processing apparatus 200 further includes 5 an antenna
209, a tuner 210, a descrambler 211, a demultiplexer
212, an audio decoder 213, a video decoder 214, an
audio processing circuit 215, a speaker 216, a GUI
superposition unit 217, a video processing circuit 218,
10 and a display 219.
[0027] In the information processing apparatus 200,
the CPU 201 executes various types of processing
according to programs stored in the memory 203 or the
storage 204 connected via the bus 202.
15 [0028] The wireless communication unit 207 performs
a wireless bi-directional signal communication with the
operation apparatus 300. Examples of the wireless
communication system include an infrared (IR) system,
an RF system such as radio frequency for consumer
20 electronics (RF4CE) being an international standard of
an RF remote controller for a home electric appliance,
and a wireless LAN compatible for IEEE 802.11b standard
or the like.
[0029] The antenna 209 receives a digital broadcast
25 signal or the like and inputs it into the tuner 210.
[0030] The tuner 210 extracts a broadcast signal of
16
a predetermined channel from the digital broadcast
signal. The tuner 210 outputs a transport stream of the
predetermined channel that is obtained by subjecting
the extracted broadcast signal to decoding processing,
to the 5 descrambler 211.
[0031] The descrambler 211 uses a release key that
is in advance stored in a predetermined IC card (not
shown) mounted on the information processing apparatus
200, to release the scramble of the transport stream
10 input from the tuner 210. The descrambler 211 outputs
the transport stream whose scramble has been released
to the demultiplexer 212.
[0032] The demultiplexer 212 demultiplexes audio
data and video data from the transport stream whose
15 scramble has been released, the transport stream being
input from the descrambler 211. The demultiplexer 212
outputs the demultiplexed audio data to the audio
decoder 213, and outputs the demultiplexed video data
to the video decoder 214.
20 [0033] The audio decoder 213 decodes the audio data
input from the demultiplexer 212, and outputs the
obtained audio data to the audio processing circuit
215.
The audio processing circuit 215 subjects the
25 audio data input from the audio decoder 213 to
digital/analog (D/A) conversion, amplification
17
processing, or the like, and outputs the obtained audio
signal to the speaker 216.
[0034] The video decoder 214 decodes the video data
input from the demultiplexer 212 and outputs the
obtained video data to the graphical 5 user interface
(GUI) superposition unit 217.
[0035] The GUI superposition unit 217 superposes
graphic data such as on screen display (OSD) on the
video data input from the video decoder 214 and outputs
10 it to the video processing circuit 218.
[0036] The video processing circuit 218 subjects the
video data input from the GUI superposition unit 217 to
predetermined image processing, digital/analog (D/A)
conversion, or the like, and outputs the obtained video
15 signal to the display 219.
[0037] Further, the CPU 201 is capable of receiving
digital broadcasting based on an operation signal
relating to recording from the operation apparatus 300
or information for programmed recording that is set in
20 the memory 203, obtaining a transport stream of a
predetermined channel, and storing this as video-audio
data of a program in the storage 204.
[0038] In this manner, the information processing
apparatus 200 is capable of receiving digital
25 broadcasting and outputting that program through the
display 219 and the speaker 216 in a viewable state or
18
recording it in the storage 204. Further, the CPU 201
is also capable of accessing the Internet through the
network I/F 206 or displaying an obtained web page on
the display 219.
[0039] [Configuration of Operation 5 Apparatus 300]
Next, a configuration of the operation apparatus
300 will be described.
Fig. 3 is an outer appearance view on a side of a
remote-controller surface of the operation apparatus
10 300. Fig. 4 is an outer appearance view on a side of a
keyboard surface of the operation apparatus 300.
[0040] As shown in Figs. 3 and 4, the operation
apparatus 300 includes two rectangular surfaces opposed
in front and back directions as main surfaces 31 and
15 32, and a casing 33 having a rectangular parallelepiped
shape with a total of six surfaces, the surfaces having
a sufficiently smaller size in an axis direction (depth
direction) than the size of the main surfaces 31 and 32
in two axis directions, the axis direction (depth
20 direction) being orthogonal to those two axes. Both of
the two main surfaces opposed in the front and back
directions are operation surfaces for the user.
Specifically, in the one main surface 31 (also referred
to as “remote-controller surface 31”), a touch pad 34
25 and keys of cursor keys 35 and the like are provided as
a first operation input unit. The touch pad 34 is
19
located in an almost center area of the one main
surface 31. That is because the operation of the touch
pad 34 becomes a blind operation for the user upon
operation in a keyboard operation attitude (to be
described later). A certain degree of 5 blind operability
of the touch pad 34 can be ensured by causing the
center of the remote-controller surface 31 to
correspond or almost correspond to a center coordinate
of the touch pad 34. In the other main surface 32 (also
10 referred to as “keyboard surface 32”) in an opposed
relationship to the remote-controller surface 31 of the
casing 33 in the front and back directions, a keyboard
38 such as a QWERTY keyboard is provided as a second
operation input unit. Out of four surfaces
15 (hereinafter, each referred to as “side surface”) other
than the remote-controller surface 31 and the keyboard
surface 32 of the casing 33, in at least one side
surface 36, a plurality of frequently used keys 37 of
volume control, channel selection, or the like are, for
20 example, provided.
[0041] Fig. 5 is a block diagram showing a hardware
configuration of the operation apparatus 300.
The operation apparatus 300 includes a control
unit 301, a wireless communication unit 302, the touch
25 pad 34, an acceleration sensor 304, a remotecontroller-
surface key matrix 305, a side-surface key
20
matrix 306, and a keyboard-surface key matrix 307.
[0042] The control unit 301 performs an entire
control of the blocks constituting the operation
apparatus 300, controls various types of arithmetic
processing and a data communication between 5 the blocks.
[0043] The wireless communication unit 302 performs
a wireless bi-directional signal communication with the
information processing apparatus 200. Examples of the
wireless communication system include an infrared (IR)
10 system, an RF system such as radio frequency for
consumer electronics (RF4CE) being an international
standard of an RF remote controller for a home electric
appliance, and a wireless LAN compatible for IEEE
802.11b standard.
15 [0044] The touch pad 34 is a device that detects
coordinates of a position touched by the user. The
touch pad 34 is constituted of, for example, a touch
sensor of a capacitive system, a resistive film system,
or the like.
20 [0045] The acceleration sensor 304 is a sensor that
detects an acceleration in three axis (X-axis, Y-axis,
and Z-axis) directions. A detection signal of the
acceleration sensor 304 is supplied to the control unit
301 and processed as information for detecting the
25 attitude of the operation apparatus 300. Note that a
means for detecting the attitude of the operation
21
apparatus 300 includes, in addition to the acceleration
sensor 304, a gyro sensor or the like that detects an
angle with respect to a direction of gravitational
force. In addition, there is, for example, a method of
detecting the attitude of the operation 5 apparatus 300
in such a manner that a camera (not shown) captures an
image of a periphery as viewed from the operation
apparatus 300 and the control unit 301 in the operation
apparatus 300, the CPU 201 in the information
10 processing apparatus 200, or the like analyses the
captured image.
[0046] The remote-controller-surface key matrix 305
detects an operation with respect to a key of the
cursor keys 35 and the like provided to the remote15
controller surface 31 and notifies the control unit 301
of it.
The side-surface key matrix 306 detects an
operation with respect to the keys 37 provided in the
side surface 36 of the casing 33 and notifies the
20 control unit 301 of it.
The keyboard-surface 32 key matrix 307 detects an
operation with respect to the keyboard 38 and notifies
the control unit 301 of it.
[0047]
25 Next, an operation of the operation apparatus 300
according to this embodiment will be described.
22
[0048] The control unit 301 of the operation
apparatus 300 performs the following control based on a
conversion program of touch pad detection information
incorporated in advance.
[0049] The control unit 301 5 of the operation
apparatus 300 determines an operation attitude of the
operation apparatus 300 based on a detection result
obtained by the acceleration sensor 304 (determination
unit).
10 [0050] The attitude when the operation apparatus 300
according to this embodiment is operated includes at
least two basic attitudes as follows.
1. The attitude in a vertical direction with the
remote-controller surface 31 being directed to the user
15 (hereinafter, referred to as ”touch pad operation
attitude”) (see Fig. 6).
2. The attitude in a horizontal direction with the
keyboard surface 32 being directed to the user (see
Fig. 7) (hereinafter, referred to as ”keyboard
20 operation attitude”). The use in the horizontal
direction is because the key arrangement of the
keyboard 38 such as the QWERTY keyboard is long in the
horizontal direction. The user performs key inputs with
fingers of the both hands holding the both end portions
25 of the operation apparatus 300 with the both hands.
Further, when the operation in this attitude is
23
performed, as shown in Fig. 8, the user can also
perform an operation of the touch pad 34 sliding the
fingers to a back side (remote-controller surface 31
side).
[0051] Based on a detection result 5 obtained by the
acceleration sensor 304, a method of determining the
operation attitude of the operation apparatus 300
includes, for example, the following.
1. The control unit 301 determines, based on the
10 output of the acceleration sensor 304, which of the
remote-controller surface 31 and the keyboard surface
32 is more directed in the direction of gravitational
force. The control unit 301 determines that it is in
the keyboard operation attitude if the remote15
controller surface 31 is more directed in the direction
of gravitational force, and determines that it is in
the touch pad operation attitude if the keyboard
surface 32 is more directed in the direction of
gravitational force.
20 2. It is determined that which of the longitudinal
direction and the short direction of the operation
apparatus 300 is more directed in the direction of
gravitational force. The control unit 301 determines
that it is in the touch pad operation attitude if the
25 longitudinal direction of the operation apparatus 300
is more directed in the direction of gravitational
24
force, and determines that it is in the keyboard
operation attitude if the short direction is more
directed in the direction of gravitational force.
3. The two determination methods above are both
used. That is, if the control unit 301 5 determines that
the remote-controller surface 31 is more directed in
the direction of gravitational force and the short
direction is more directed in the direction of
gravitational force, the control unit 301 determines
10 that it is in the keyboard operation attitude. Further,
if the control unit 301 determines that the keyboard
surface 32 is more directed in the direction of
gravitational force and the longitudinal direction is
more directed in the direction of gravitational force,
15 the control unit 301 determines that it is in the touch
pad operation attitude. In Other cases, the control
unit 301 ignores them.
[0052] When the control unit 301 determines the
touch pad operation attitude, the control unit 301
20 keeps the output information of the touch pad 34 valid.
Here, the coordinate system of the coordinate detection
space of the touch pad 34 is, as shown in Fig. 9, one
with the left- and right-hand directions being the Xaxis
direction and the upper and lower directions being
25 the Y-axis direction assuming that a point c at a lower
left end of the touch pad 34 being reference
25
coordinates (X = 0, Y = 0).
[0053] In contrast, as shown in Fig. 10, if it is in
the keyboard operation attitude, the coordinate system
of the coordinate detection space of the touch pad 34
and a coordinate system of a coordinate 5 detection space
34S of the touch pad 34 seen through from the keyboard
surface 32 are in a mirror symmetrical and 180-degrees
rotational symmetrical relationship. Therefore, if it
is determined that it is in the keyboard operation
10 attitude, the control unit 301 converts coordinates (X,
Y) detected by the touch pad 34 into coordinates (X’,
Y’) of the coordinate system of the coordinate
detection space 34S of the touch pad 34 seen through
from the keyboard surface 32 by the following
15 calculation (converter).
[0054] X’ = -Y
Y’ = -X
Where  denotes a length of the touch pad 34 in
the Y-axis direction and  denotes a length of the
20 touch pad 34 in the X-axis direction.
Note that, here, it is assumed that the touch pad
34 has an identical length in the X-axis direction and
the Y-axis direction. In contrast, if the length in the
X-axis direction is different from that in the Y-axis
25 direction (if coordinate detection space of touch pad
34 is rectangular), upon the above-mentioned
26
conversion, the values of Y and X employed in those
calculation formula only need to be adjusted by scale
conversion, center correction, both of them, or the
like depending on an aspect ratio.
[0055] By converting the coordinates 5 detected with
respect to the operation of the touch pad 34 in the
keyboard operation attitude into the coordinates of the
coordinate system of the coordinate detection space 34S
of the touch pad 34 seen through from the keyboard
10 surface 32 in this manner, the operation of the touch
pad 34 in the keyboard operation attitude can be
performed according to a user’s sense of the coordinate
system.
[0056] By the way, if the operation input units are
15 provided in the back and front of the casing 33 as
described above, there is a possibility in that the key
and the like of the operation input unit in the back as
viewed from the user are erroneously operated.
Therefore, in the operation apparatus 300 according to
20 this embodiment, the control unit 301 performs a
control to put the operation input unit provided in the
back surface as viewed from the user in a stop state
depending on the operation attitude determined based on
the output of the acceleration sensor 304. For example,
25 if it is determined that it is in the keyboard
operation attitude, the control unit 301 performs a
27
control to put a detection with respect to an operation
of the key such as the cursor keys 35 provided in the
remote-controller surface 31 in the stop state. This
makes it possible to prevent an erroneous operation of
the operation input unit provided in 5 the back surface
as viewed from the user.
[0057]
Next, a modified example of the above-mentioned
embodiment will be described.
10 An operation apparatus 300A according to this
modified example is different from the above-mentioned
embodiment in the two basic attitudes upon operation.
1a. The attitude in the lateral direction with the
remote-controller surface 31 being directed to the user
15 (hereinafter, referred to as ”second touch pad
operation attitude”) (see Fig. 11).
2b. The attitude in the lateral direction with the
keyboard surface 32 being directed to the user (see
Fig. 12) (hereinafter, referred to as ”keyboard
20 operation attitude”). This keyboard operation attitude
is the same as that of the above-mentioned embodiment.
[0058] As shown in Fig. 11, if it is determined that
it is in the second touch pad operation attitude, the
control unit 301 keeps the output information of the
25 touch pad 34 valid. In contrast, as shown in Fig. 12,
if it is in the keyboard operation attitude, the
28
coordinate system of the touch pad 34 and the
coordinate system of the coordinate detection space 34S
of the touch pad 34 seen through from the keyboard
surface 32 are in a mirror symmetrical relationship.
Therefore, if it is determined 5 that it is in the
keyboard operation attitude, the control unit 301 of
the operation apparatus 300A converts the coordinates
(X, Y) detected by the touch pad 34 into the
coordinates (X’, Y’) of the coordinate system of the
10 coordinate detection space 34S of the touch pad 34 seen
through from the keyboard surface 32 by the following
calculation.
[0059] X’ = -X
Y’ = Y
15 Where  denotes a length of the touch pad 34 in
the Y-axis direction.
[0060] Note that, in this Modified example 1, based
on a detection result obtained by the acceleration
sensor 304, the operation attitude of the operation
20 apparatus 300A is determined, for example, in the
following manner.
1. The control unit 301 determines which of the
remote-controller surface 31 and the keyboard surface
32 is more directed in the direction of gravitational
25 force based on the output of the acceleration sensor
304. The control unit 301 determines that it is in the
29
keyboard operation attitude if it is determined that
the remote-controller surface 31 is more directed in
the direction of gravitational force, and determines
that it is in the touch pad operation attitude if it is
determined that the keyboard 5 surface 32 is more
directed in the direction of gravitational force.
[0061] By converting the coordinates of the
coordinate system of the touch pad 34 detected with
respect to the operation of the touch pad 34 in the
10 keyboard operation attitude into the coordinates of the
coordinate system of the coordinate detection space 34S
of the touch pad 34 seen through from the keyboard
surface 32 in this manner, the operation of the touch
pad 34 in the keyboard operation attitude can be
15 performed according to a user’s sense of the coordinate
system.
[0062]
Next, Modified Example 2 of the above-mentioned
embodiment will be described.
20 In the above, the case where the coordinates
detected by the touch pad 34 are subjected to the
conversion processing has been described.
[0063] In this Modified Example 2, not the
coordinates but the movement information (movement
25 amount and movement direction), more specifically, a
difference between the coordinates between two points
30
of detection elements such as the fingers moving per
unit time is set as a conversion processing target.
[0064] In this case, calculation formulae for
converting movement information (x, y) detected by the
touch pad 34 into movement information 5 (x’, y’) in the
coordinate system of the coordinate detection space 34S
of the touch pad 34 seen through from the keyboard
surface 32 are as follows.
Assuming that the attitude in the vertical
10 direction with the remote-controller surface 31 being
directed to the user and the attitude in the horizontal
direction with the keyboard surface 32 being directed
to the user are basic attitudes upon operation,
x’ = -y
15 y’ = -x
[0065] Further, assuming that the attitude in the
horizontal direction with the remote-controller surface
31 being directed to the user and the attitude in the
horizontal direction with the keyboard surface 32 being
20 directed to the user are basic attitudes upon
operation,
x’ = -x
y’ = y
Note that, here, it is assumed that the touch pad
25 34 has an identical length in the X-axis direction and
the Y-axis direction. In contrast, if the length in the
31
X-axis direction is different from that in the Y-axis
direction (coordinate detection space of touch pad 34
is rectangular), upon the above-mentioned conversion,
the values of Y and X employed in those calculation
formula only need to be adjusted by 5 scale conversion,
center correction, both of them, or the like depending
on an aspect ratio.
[0066]
Controls of the conversion of the coordinates, the
10 stop of the key detection, and the like according to
the above-mentioned embodiment and modified examples
may be performed not by the control unit 301 of the
operation apparatus 300 but by the CPU 201 (Fig. 2) of
the information processing apparatus 200 being a
15 control target of the operation apparatus 300. In the
case where the operation apparatus 300 and the
information processing apparatus 200 are capable of
performing a relatively high speed wireless
communication, for example, an RF signal, a wireless
20 LAN, and the like, a control by the CPU 201 of the
information processing apparatus 200 also can obtain a
real-time property sufficient in practice.
[0067]
In the above-mentioned embodiment, the attitude of
25 the operation apparatus 300 is determined using the
acceleration sensor 304. However, based on an image
32
captured by a camera provided to the operation
apparatus 300, the attitude of the operation apparatus
300 may be determined.
[0068] Figs. 13 and 14 are views each showing a
state in which an attitude of an operation 5 apparatus
300B is determined based on an image captured by a
camera provided to the operation apparatus 300B.
In the operation apparatus 300B, a lens 41 of the
camera is provided to either one of the remote10
controller surface 31 and the keyboard surface 32. In
the illustrated example, the lens 41 of the camera is
provided on a side of the remote-controller surface.
[0069] The control unit 301 of the operation
apparatus 300B recognizes a user 51 by, for example,
15 pattern matching of an image of the face of the user 51
that is captured by the camera. If the recognized user
51 matches a user registered in advance, the control
unit 301 determines that the operation apparatus 300B
is in an attitude in which the remote-controller
20 surface 31 is directed to the user 51 (see Fig. 13). In
contrast, if the registered face of the user is not
recognized, the control unit 301 determines that the
operation apparatus 300B is in an attitude in which the
keyboard surface 32 is directed to the user 51 (see
25 Fig. 14).
[0070] Further, by combining the determination of
33
the attitude by the camera with a determination result
of the horizontal/vertical attitude of the operation
apparatus 300B by the acceleration sensor 304, it is
also possible to set it as a final determination result
of the attitude of the operation 5 apparatus 300B.
[0071] This makes it possible to accurately
determine the attitude of the operation apparatus 300B.
For example, the operation apparatus 300B may be
operated at a position lower than the height of the
10 eyes of the user 51 or may be operated at a position
higher than the height of the eyes of the user 51.
According to the method of Modified Example 3, the
touch pad operation attitude and the keyboard operation
attitude can be accurately determined in both the
15 states.
[0072]
In the state in which the detection element such
as the finger is detected in the touch pad 34, the
determination of the touch pad operation attitude and
20 the keyboard operation attitude based on the captured
image of the camera or the output of the acceleration
sensor 304 may be invalidated.
[0073] Fig. 15 is a view showing a state of this
control.
25 When an attitude of an operation apparatus 300C is
changed from the touch pad operation attitude (State 1)
34
to an attitude in which the remote-controller surface
31 is more directed in the direction of gravitational
force (State 2), the control unit 301 determines, based
on the output of the acceleration sensor 304, that the
attitude of the operation apparatus 300C 5 changes to the
keyboard operation attitude. At this time, if the
finger or the like is in contact with the touch pad 34
(State 3), that is, if information is output from the
touch pad 34, the control unit 301 invalidates the
10 determination of the touch pad operation attitude and
the keyboard operation attitude based on the captured
image of the camera and the output of the acceleration
sensor 304. With this, the control is performed
assuming that the attitude of the operation apparatus
15 300C remains in the touch pad operation attitude.
[0074] With this, by the change of the attitude that
occurs upon input operation in the remote-controller
surface 31, it is possible to prevent the detection of
the operation of the key present in the remote20
controller surface 31 from being stopped despite the
intention of the user.
[0075] In a similar principle, in a state in which
depression of the key of the keyboard 38 is detected in
the keyboard operation attitude, the determination of
25 the touch pad operation attitude and the keyboard
operation attitude based on the captured image obtained
35
by the camera and the output of the acceleration sensor
304 may be invalidated.
[0076] In addition, as long as the operation button
of the remote-controller surface is operated at a
frequency higher than a predetermined 5 value determined
in view of the frequency upon a normal operation, the
determination of the touch pad operation attitude and
the keyboard operation attitude based on the output of
the acceleration sensor 304 may be invalidated and the
10 control in the touch pad operation attitude may be
performed.
[0077] Similarly, as long as the key of the keyboard
38 is operated at a frequency higher than a
predetermined value determined in view of the frequency
15 upon a normal operation, the determination of the touch
pad operation attitude and the keyboard operation
attitude based on the output of the acceleration sensor
304 may be invalidated and the control in the keyboard
operation attitude may be performed.
20 [0078] Note that the present technology may also
take the following configurations.
(1) An operation apparatus, including:
a casing including two surfaces opposed in front
and back directions as a first surface and a second
25 surface;
a first operation input unit that is provided in
36
the first surface and includes a detector that performs
a detection of an operation of a user with respect to a
predetermined coordinate detection space on the first
surface;
a second operation input unit 5 provided in the
second surface;
a determination unit that determines an attitude
of the casing when an operation of the user with
respect to the coordinate detection space of the
10 detector is performed from a side of the second
surface; and
a converter that converts, when the attitude is
determined, information detected by the detector into
information of a coordinate system of the coordinate
15 detection space seen through from the side of the
second surface.
(2) The operation apparatus according to (1), in which
the detector detects coordinates specified by the
user with respect to the coordinate detection space,
20 and
the converter performs a conversion by calculation
formulae
X’ = -Y
Y’ = -X
25 where coordinates detected by the detector are denoted
by (X, Y), detection coordinates in a coordinate system
37
of the coordinate detection space seen through from the
side of the second surface are denoted by (X’, Y’), a
length of the coordinate detection space in a Y-axis
direction is denoted by , and a length of the
coordinate detection space in an X-5 axis direction is
denoted by .
(3) The operation apparatus according to (1) or (2),
in which
the first operation input unit includes one or
10 more key operation units together with the detector,
further including a control unit that puts a
detection of an operation of the key operation unit in
a stop state when the attitude is determined.
(4) The operation apparatus according to any one of
15 (1) to (3), in which
the control unit puts the determination of the
attitude in the stop state when information is output
from the detector.
(5) The operation apparatus according to any one of
20 (1) to (4), in which
the control unit puts the determination of the
attitude in the stop state when the second operation
input unit is operated.
(6) The operation apparatus according to any one of
25 (1) to (4), in which
the determination unit includes an imaging unit
38
that is capable of capturing an image of a front side
of either one of the first surface and the second
surface, and
the control unit determines the attitude together
with the image captured by 5 the imaging unit.
(7) The operation apparatus according to (1), in which
the detector detects coordinates specified by the
user with respect to the coordinate detection space,
and
10 the converter performs a conversion by calculation
formulae
X’ = -X
Y’ = Y
where detection coordinates obtained in a coordinate
15 system of the coordinate detector are denoted by (X,
Y), detection coordinates in the coordinate system of
the space seen through from the side of the second
surface are denoted by (X’, Y’), and a length of a
detection space of the coordinate detector in a Y-axis
20 direction is denoted by .
(8) The operation apparatus according to (7), in which
the first operation input unit includes one or
more key operation units together with the detector,
further including a control unit that puts a
25 detection of an operation of the key operation unit in
a stop state when the attitude is determined.
39
(9) The operation apparatus according to (7) or (8),
in which
the determination unit puts the determination of
the attitude in the stop state when information is
output 5 from the detector.
(10) The operation apparatus according to any one of
(7) to (9), in which
the control unit puts the determination of the
attitude in the stop state when the second operation
10 input unit is operated.
(11) The operation apparatus according to any one of
(7) to (10), in which
the determination unit includes an imaging unit
that is capable of capturing an image of a front side
15 of either one of the first surface and the second
surface, and
the control unit determines the attitude together
with the image captured by the imaging unit.
(12) The operation apparatus according to (1), in which
20 the detector detects movement information
according to an operation of the user with respect to
the coordinate detection space, and
the converter performs a conversion by calculation
formulae
25 x’ = -x
y’ = y
40
where the movement information detected by the
coordinate detector is denoted by (x, y) and movement
information in the coordinate system of the coordinate
detection space seen through from the side of the
second surface is denoted 5 by (x’, y’).
(13) The operation apparatus according to (12), in
which
the first operation input unit includes one or
more key operation units together with the detector,
10 further including a control unit that puts a
detection of an operation of the key operation unit in
a stop state when the attitude is determined.
(14) The operation apparatus according to (12) or (13),
in which
15 the determination unit puts the determination of
the attitude in the stop state when information is
output from the detector.
(15) The operation apparatus according to any one of
(12) to (14), in which
20 the control unit puts the determination of the
attitude in the stop state when the second operation
input unit is operated.
(16) The operation apparatus according to any one of
(12) to (15), in which
25 the determination unit includes an imaging unit
that is capable of capturing an image of a front side
41
of either one of the first surface and the second
surface, and
the control unit determines the attitude together
with the image captured by the imaging unit.
(17) The operation apparatus according 5 to (1), in which
the detector detects movement information
according to an operation of the user with respect to
the coordinate detection space, and
the converter performs a conversion by calculation
10 formulae
x’ = -x
y’ = y
where movement information obtained in the coordinate
system of the coordinate detector is denoted by (x, y)
15 and movement information of the coordinate system of
the coordinate detection space seen through from the
side of the second surface is denoted by (x’, y’).
(18) The operation apparatus according to (17), in
which
20 the first operation input unit includes one or
more key operation units together with the detector,
further including a control unit that puts a
detection of an operation of the key operation unit in
a stop state when the attitude is determined.
25 (19) The operation apparatus according to (17) or (18),
in which
42
the determination unit puts the determination of
the attitude in the stop state when information is
output from the detector.
(20) The operation apparatus according to any one of
(17) 5 or (19), in which
the control unit puts the determination of the
attitude in the stop state when the second operation
input unit is operated.
(21) The operation apparatus according to any one of
10 (17) to (20), in which
the determination unit includes an imaging unit
that is capable of capturing an image of a front side
of either one of the first surface and the second
surface, and
15 the control unit determines the attitude together
with the image captured by the imaging unit.
[0079] Note that the present technology is not
limited to the above-mentioned embodiment and may be
variously modified within a range of the technical
20 concept of the present technology.
Description of Symbols
[0080] 31 remote-controller surface
32 keyboard surface
33 casing
25 34 touch pad
34S coordinate detection space
43
35 cursor key
38 keyboard
100 information processing system
200 information processing apparatus
5 201 CPU
300 operation apparatus
301 control unit
304 acceleration sensor
305 remote-controller-surface key matrix
10 306 side-surface key matrix
307 keyboard-surface key matrix
44
Claims
[1] An operation apparatus, comprising:
a casing including two surfaces opposed in front
and back directions as a first surface and a second
5 surface;
a first operation input unit that is provided in
the first surface and includes a detector that performs
a detection of an operation of a user with respect to a
predetermined coordinate detection space on the first
10 surface;
a second operation input unit provided in the
second surface;
a determination unit that determines an attitude
of the casing when an operation of the user with
15 respect to the coordinate detection space of the
detector is performed from a side of the second
surface; and
a converter that converts, when the attitude is
determined, information detected by the detector into
20 information of a coordinate system of the coordinate
detection space seen through from the side of the
second surface.
[2] The operation apparatus according to claim 1,
wherein
25 the detector detects coordinates specified by the
user with respect to the coordinate detection space,
45
and
the converter performs a conversion by calculation
formulae
X’ = -Y
5 Y’ = -X
where coordinates detected by the detector are denoted
by (X, Y), detection coordinates in a coordinate system
of the coordinate detection space seen through from the
side of the second surface are denoted by (X’, Y’), a
10 length of the coordinate detection space in a Y-axis
direction is denoted by , and a length of the
coordinate detection space in an X-axis direction is
denoted by .
[3] The operation apparatus according to claim 2,
15 wherein
the first operation input unit includes one or
more key operation units together with the detector,
further comprising a control unit that puts a
detection of an operation of the key operation unit in
20 a stop state when the attitude is determined.
[4] The operation apparatus according to claim 3,
wherein
the control unit puts the determination of the
attitude in the stop state when information is output
25 from the detector.
[5] The operation apparatus according to claim 4,
46
wherein
the control unit puts the determination of the
attitude in the stop state when the second operation
input unit is operated.
[6] The operation apparatus according 5 to claim 5,
further comprising an imaging unit that is capable of
capturing an image of a front side of either one of the
first surface and the second surface, in which
the determination unit determines the attitude
10 based on the image captured by the imaging unit.
[7] The operation apparatus according to claim 1,
wherein
the detector detects coordinates specified by the
user with respect to the coordinate detection space,
15 and
the converter performs a conversion by calculation
formulae
X’ = -X
Y’ = Y
20 where detection coordinates obtained in a coordinate
system of the coordinate detector are denoted by (X,
Y), detection coordinates in the coordinate system of
the space seen through from the side of the second
surface are denoted by (X’, Y’), and a length of a
25 detection space of the coordinate detector in a Y-axis
direction is denoted by .
47
[8] The operation apparatus according to claim 1,
wherein
the detector detects movement information
according to an operation of the user with respect to
the coordinate detection 5 space, and
the converter performs a conversion by calculation
formulae
x’ = -y
y’ = -x
10 where the movement information detected by the
coordinate detector is denoted by (x, y) and movement
information in the coordinate system of the coordinate
detection space seen through from the side of the
second surface is denoted by (x’, y’).
15 [9] The operation apparatus according to claim 1,
wherein
the detector detects movement information
according to an operation of the user with respect to
the coordinate detection space, and
20 the converter performs a conversion by calculation
formulae
x’ = -x
y’ = y
where movement information obtained in the coordinate
25 system of the coordinate detector is denoted by (x, y)
and the movement information of the coordinate system
48
of the coordinate detection space seen through from the
side of the second surface is denoted by (x’, y’).
[10] An information processing method for an operation
apparatus, comprising:
determining an attitude of a 5 casing including a
first surface in which a first operation input unit is
provided and a second surface in which a second
operation input unit is provided, the first operation
input unit including a detector that performs a
10 detection of an operation of a user with respect to a
predetermined coordinate detection space, the second
surface being opposed to the first surface in front and
back directions, the attitude of the casing being an
attitude when an operation of the user with respect to
15 the coordinate detection space of the detector is
performed from a side of the second surface; and
converting, when the attitude is determined,
information detected by the detector into information
of a coordinate system of the coordinate detection
20 space seen through from the side of the second surface.
[11] An information processing apparatus, comprising:
a casing including two surfaces opposed in front
and back directions as a first surface and a second
surface;
25 a first operation input unit that is provided in
the first surface and includes a detector that performs
49
a detection of an operation of a user with respect to a
predetermined coordinate detection space on the first
surface;
a second operation input unit provided in the
5 second surface;
a determination unit that determines an attitude
of the casing when an operation of the user with
respect to the coordinate detection space of the
detector is performed from a side of the second
10 surface; and
a converter that converts, when the attitude is
determined, information detected by the detector into
information of a coordinate system of the coordinate
detection space seen through from the side of the
15 second surface.