INFORMATION PROCESSIHG APPARATUS,INFORMATION PROCESSING METHOD AND PROGRAM

The present technique relates to an
information processing apparatus including a touch
sensor, and an information processing method and a
program for the information processing apparatus.
Background Art
. [0002] From the past, information processing
apparatuses with each of which a user is capable of
performing an input operation on a screen using•a
writing tool such as a stylus (hereinafter, referred to
as pen-input) via a touch panel or a' touch pad are put .
to practical use (see, for example, Patent Document 1).
The pen input is realized by detecting a position of a
pen and displaying an image on a display apparatus
based on detection data.
[0003] Patent Document 1: Japanese Patent
Application Laid-open No. 2012-168993
Summary of Invention
Problem to be solved by the Invention
[0004] The pen input technique of the related art as
described above is specialized in•displaying input
results of letters and line arts in real time. However,
if the information processing apparatus can stably and
accurate
SP352714WO00
ly detect not" only a position of the pen on the
screen but also a pressing force of the pen, it becomes
possible to record more specific features at a time of
a pen input of each user, such as a writing pressure
and a brushwork, in addition to a handwriting. The
feature lata can then be used in various applications.
[0005] . In view of the circumstances as' described
above, t^e present technique aims at providing an
information processing apparatus capable of recording,
for each user, specific features at a time of an input
using a writing tool and utilizing them, and an
information processing method and a program for the
information processing apparatus.
Means for solving the Problem
[000 6] To attain the object described above,
according to an embodiment of the present technique,
there is provided an information processing apparatus
including a sensor, a storage section, and a controller.
The sensar includes an input surface for accepting an
input operation of'a user using a writing tool and is
capable of detecting^ coordinates of a position at which
the input operation is made and a weight applied to the
position. The controller is capable of causing the
storage section to store, at predetermined time
intervals, coordinate"" data indicating the detected
coordinates and weight data indicating the weight in
association with identification information of the user,
and reading out the stored coordinate data and weight
data from the storage section in association with the
identification information.
3
SP352714WO00
0007] With this structure, since the information
processihg apparatus can detect not only the coordinate
data at bhe time an input operation is made to the
sensor using the writing tool but also the weight data,
specific features obtained at the time the input
operation is made using the writing tool can be
recorded for each user and utilized. Here/ examples of
the writing tool include various tools with which a
writing operation can be made irrespective of the shape
or the u
brush.
[0008]
movement
of the c
se of inks, such as a stylus, a pen, and an ink
The controller may be capable of calculating
velocity data indicating a "movement velocity
Dordinates from the coordinate data stored at
the predetermined time intervals
0009] Accordingly, by also calculating the movement
velocity data in addition to the coordinate data and
the weight data, the information processing apparatus'
can more specifically record the features at the time
the input operation, is made and utilize them,
0010] The'controller may be capable of calculating
weight change data indicating a temporal change of the
• weight f|rom the weight data stored at the predetermined
time intervals.
00111 Accordingly, by also calculating the weight
change dhta in addition to the coordinate data and the
weight d|ata, the information processing apparatus can
more specifically record the features at the time the
input operation is made and utilize them.
[0012] The controller may be capable of comparing
the coordinates and the weight detected from an input
SP352714WO00
operation made using the writing tool after the
coordinate data, and the weight data are stored, with -
the stor2d coordinate data and weight data and judging
whether there is a difference.
[0013] Accordingly, the information processing
apparatujs can judge a difference in the features of
input operations made by different users based on the
coordinate data and the weight data
[0014]
authenti
whether there is a difference and outputting an
authenti
[0015]
apparatu
on the d
data.
[0016]
further
controll
section
The controller may be capable of
mating the user based on the judgment on
ation result.
Accordingly, the information processing
3 can perform individual authentications based
ifference in the coordinate data and the weight
The information processing apparatus may
include a display section. In this case, the
ar may be capable of controlling the display
to display, based on the input operation, an
image showing a trajectory from a start to an end of
the input operation using only the coordinate data out
of the CDordinate data and the weight data.
[0017] Accordingly, while both the coordinate data
and the weight data are used in the authentication
processing in the information processing apparatus, by
not ref1 acting the weight data onto an image as a
result of the input operation of the user, it can be
made difficult for a copier to copy input operations of
other users including weights.
[0018] The information processing apparatus may
SP352714WO00
5
further [include an output section. In this case, the.
controller may be capable of controlling the output
section to output information indicating the judged
differen
[00191
ce.
Accordingly, the information pr'ocessing
apparatuSs can notify the user of a difference in the
operation inputs based on the difference in the
coordinate data and the weight data.
[0020] The information processing.apparatus may
further include a display section. In this case, the
controllsr may be capable of controlling the display
section bo display, based on the stored coordinate' data
and weight data, a first image that shows1 a trajectory
from a start to an end of the input operation of the
user.
[0021 Accordingly, other,users that have performed
operation inputs after the coordinate data and the
weight d ata are stored can reference the trajectory of
the' operation input of the user for which the
coordina te data and the weight data are stored as their
own examples, for example
[0022]
the disp
the writ
The sensor may be capable of detecting, after
Lay of the image, coordinate data and weight
data fro:n an input operation made by another.user using
ing tool. In this case, the controller may be
capable of controlling the display section to display,
based on the detected coordinate data and weight data,
a second image that shows a trajectory from a start to
an end of the input operation of the another user while
superimposing the second image on the first image.- The
controller may also be capable of comparing the stored
coordinate data and weight data with the coordinate
data and
SP352714WO00
the weight data detected from the input
operation of the another user, and controlling the
display section to display information indicating a
difference between the first image and the second image
[00.23] Accordingly, by displaying the first image
based on the stored coordinate data and weight data and
notifying the user of the difference between the first
image and the second image drawn by another user, the
information processing apparatus can assist technical
improvements in pen writing, calligraphy,\ painting, and
the like.
[0024] The controller may change a line width or
shading of the first image and the second image
according to the stored weight data and the weight data
detected from the input operation.of the another user.
[0025] Accordingly, the information processing
apparatus can express specific features such as a
writing pressure of each user by the line width or
shading in the first image and the second image.to more
specifically notify the difference between the images.
[0026] The sensor may be capable of detecting, when
a hand of the user touches the input surface at a time
the user makes the input operation using the writing
tool, coordinates of the contact position and a weight
applied to the contact position. In this case, the
controller may cause the storage section to store
coordinate data indicating the detected coordinates of
the contact position and weight data indicating the
weight applied to the contact position in association
with the coordinate data and the weight data, that have
SP352714WO00
7
been detected from the input operation, and the
identification information.
[0027] . Accordingly, by recording not only the
features of the user in the input operation of the user
5 using th3 writing tool but also a feature related to
? how a hand of the user is placed during the input
operation, the information processing apparatus can
more specifically record the features of the user.
[0028] The information processing apparatus may
10 further include a communication section. : In this case,
. the controller may control the communication section to
transmit the stored coordinate data and weight data to
another Information processing apparatus. The another
informatIon processing apparatus may display an image
15 that shows a trajectory from a start to -an end of the
input operation of the user, based on the transmitted
•coordinate data and weight data.
'i [0029] Accordingly, the information processing
apparatus can reproduce the input operation of the user
20 ' using ths writing tool in other information processing
apparatuses.
[0030] According to another embodiment of the
present technique, there is provided an information
• processing method including: detecting, by a sensor
25. including an input surface for accepting an input
operation of a user using a writing tool, coordinates
of a posItion at which the input operation is made and
a weight applied to the position; storing, by a storage
section, at predetermined time intervals, coordinate
30 data indicating the detected coordinates and weight
data indicating the weight in association with
identifi
the st'or
storage
informat
[0031]
present
causes a
detectio
includin
SP352714WO00
8
ation information of the user; and reading out
d.'coordinate data and weight data from the
section in association with the identification
ion.
According to another embodiment of the
technigue, there is provided a program that
i information processing apparatus to execute a
a step, a storage step, and a reading step. The
detection step includes detecting, by a sensor
3 an input surface for accepting an input
operation of a user using a writing tool, coordinates
of a position at which the input operation is made and
a weight applied to the position. The storage step
includes storing, by a storage section, at
predetermined time intervals, coordinate data
indicating the detected coordinates and weight data
indicating the weight in association with
identifi nation information of the user, The reading
step includes reading out the stored coordinate data
and weigrrt data from the storage section in association
with the identification information.
Effect of the Invention
[0032] As described above, according to the present
techniqua, specific features obtained at a time an
input is made using a writing tool can be recorded for
each user and utilized.
Brief Description of Drawings
SP352714WO00
[0033]
appearan
[Fig. 1] A -diagram showing an outer
:e of a tablet computer according to a first
embodiment of the present technique
Fig. 2]
tablet computer.
[Fig. 3]
input apparatus included in the tablet computer.
Figs. 4
A block diagram showing a structure of the
A schematic cross-sectional diagram of an
] Diagrams for explaining calculation
processing of coordinate data, weight data, movement
velocity data, and temporal weight change data by the
tablet cpmputer
[Fig. 5] A flowchart showing a flow of individual
authentication processing by the tablet -computer
[Fig. 6] A diagram for explaining examples of pen
operations made by different users and processing of
comparing them in the first embodiment of the present
technique
[Fig. 7] A diagram for explaining processing of
discriminating a copier of a pen operation of a certain
user in the first embodiment of the present technique.
[Fig. 8] A diagram showing a picture drawing operation
of a certain user and reproduction processing based on
recording data of the drawing operation according to a
second embodiment of the present technique
A diagram showing a reproduction example of
ing operation that uses various types of
j data in the second embodiment of the present
[Fig. .9]
the draw
recordin
technique
[Fig. 10
tablet c
] A diagram showing a flow of operations of the
Dmputer at a time of executing a picture or
calligraphy learning application in the second
10
SP352714WO00
embodiment of the present technique
[Fig. 11] A diagram showing a flow of processing of the
picture or calligraphy learning application.
Modes for Carrying Out the Invention
[0034] Hereinafter, embodiments of the present
technique will be described with reference to the
drawings
0035]
First, a first embodiment of the present technique
will be described. In this embodiment, the present
technique is applied to a tablet computer. The tablet
computer is used in a system that requires an
authentication by a signature for settlements in shops
and websites, various procedures in banks, and the like,
for example. The tablet computer may be possessed by a
user or ay a shop or the like.
[0036] [Structure of tablet computer]
Fig. 1 is a diagram showing an outer appearance of
a tablet computer 100 (hereinafter, simply referred to
as tablet 100) of this embodiment. Fig. 2 is a block
diagram showing a structure of the tablet 100.
0037] As shown in Fig. 1, the tablet 100 includes
an input apparatus 150 that accepts an input operation
made using a writing tool such as a stylus S
Ihereina
0038]
fter, also referred to as pen operation).
The input apparatus 150 has a structure in
which a sensor 1 to be described later and a display 6
that displays letters and images based on pen
opefations are integrated. When a pen operation is made
on an input screen of the display 6, an image I is
displayed on the display 6 along a trajectory T of a
[0039
Unit) 3,
display
SP352714WO00
11
tip end position of the stylus S.
As shown in Fig. 2, the tablet 100 includes
the sensor 1, a sensor IC 2, -a CPU (Central Processing
a memory 4, a graphic driver 5, and the
6. As described above/ the input apparatus 150
is constituted of the sensor 1 and the display 6. The
specific
obtained
(hereina
from the
interval
the CPU
[0041]'
the sens
structure of the input apparatus 150 will be
describes later
[0040] The sensor IC 2 receives sensor, data detected
by the sensor"! at predetermined time intervals and
calculates coordinate data and weight data of the
stylus S based on the sensor data. The sensor IC also
calculates data indicating a movement velocity of the
coordinates of the stylus S from the coordinate data
at the predetermined time intervals and
calculates data indicating a temporal weight change
Iter, also referred to as weight change data)
weight data obtained at the predetermined time
s. The calculated pieces of data are output to
3.
The CPU 3 writes the sensing data output from
Dr IC 2 in the memory 4 and reads out the
written data from the memory 4 as appropriate. At this
time, the data is recorded in association with a user
that has made the pen operation. Then, the CPU 3
determines a data display method for the display 6
based on
or read
driver 5
T0042T
the sensing data output from the sensor IC 2
3ut from the_ memory 4 and instructs the graphic
to display.
The memory 4 stores the sensing data as input
operation data of each user. The memory 4 also stores
SP352714WO00
12
other data such as programs requisite for accepting a
pen operation, reproducing pen operation data, and the
like.
[0043
trajecto
The graphic, driver 5 generates an image
corresponding to a pen operation (image showing
ry of stylus S, etc.) based on the display
instruction from the CPU 3 and outputs it to the
display 6 for display.
[0044] Although not shown, the tablet 100 may also
include a commu-nication section for communicating with
other information processing apparatuses in a wireless
or wired manner.
[0045] [Structure 'of input apparatus]
Next, the structure of the input apparatus 150
will be
sectiona
described. Fig. 3 is a schematic cross-
L diagram of the input apparatus 150. As shown
display
that det
in the figure, the input apparatus 150 includes the
6 that accepts pen operations and the sensor 1
cts user operations. The input apparatus 150
is structured as a flexible touch panel display, for
example,
sensor 1
and is incorporated into the tablet 100. The
and the display 6 are each formed as a plate
extending in a direction vertical to a Z axis.
0046] The display 6 includes a first surface 110
and a sebond surface 120 on the other side of the first;
surface fL10. The display 6 has both a function as an
input operation section and a function as a display
i
section in the input apparatus .150. Specifically, the
display 6 causes the first surface 110 to function as
an input operation surface and a display surface and
displays an image corresponding to a user operation
0047
SP352714WO00
13
upwardly in the Z-axis direction from the first surface
110. Displayed on the first surface 110' are letters
written oy a user or an image drawn by a user using the
stylus S, an image corresponding to a keyboard, a GUI
(Graphical User Interface), and the like.
The specific structure of the display 6 is
not limited in particular. For example, as the display
6, a so-called 'electronic paper, an organic EL (Electro
Luminescence) panel, an inorganic EL panel, a liquid
crystal panel, or the like may be used. The thickness
of the display 6 is not limited in particular and is,
for example, about 0.1 mm to 1 mm.
0048] The sensor 1 includes a metal film (first
conductive layer) 12, a conductive layer (second
conductive layer) 50, an electrode substrate 20, a
first supporting body 30, and a second supporting body
40. The sensor 1 is arranged on the•second surface 120
side of the display 6.
[0049]
structur
film 12.
of secon
of first
while be
The metal film 12 has a deformable sheet-like
e. The conductive layer 50 opposes the metal
The electrode substrate 2 0 includes a
plurality of first electrode lines 210 and a plurality
i electrode lines 220 that oppose the plurality
electrode lines 210.and intersect the
plurality of first electrode lines 210, is arranged
inq deformable between 'the metal film 12 and
the conductive layer 50, and is capable of statically
detecting a distance change with respect to each of the
metal film 12 and the conductive layer 50. The first
supporting body 30 includes a plurality of first
structures 310 that' connect the metal film 12 and the
14
SP352714WO00
electrode substrate 20 and first spatial sections 330
formed a:nong the plurality of first structures 310. The
second supporting body 40 includes a plurality of
second structures 410 that are each provided between
the plurality of adjacent first structures 310 and
connect the conductive layer 50 and the electrode
substrate 20 and second spatial sections 430 formed
among the plurality of -second structures 410.
[0050]

Claims
[1] An [Information processing apparatus, comprising:
a s snsor that includes an input surface for
accepting an input operation of a user using a writing
tool and is capable of detecting coordinates of a
position at which the input operation is made and a
weight applied to the position;
a storage section; and
a controller capable of causing the storage
section to store, at predetermined time intervals,
coordina te data indicating the detected coordinates and
weight data indicating the weight in association with
identifi
the stored coordinate data and weight data from the
storage
informat
[2] The
claim 1,
whe
movement
of the c
section in association with the identification
ion.
information processing apparatus according to
rein the controller is capable of calculating
velocity data indicating a movement velocity
Dordinates from the coordinate data stored at
[3] The
claim 1,
.whe
weight c
:ation information of the user, and reading out
the predetermined time intervals.
information processing apparatus according to
rein the controller is capable of calculatint
lange data indicating a temporal change of the
weight from the weight data stored at the predetermined
time intervals
[4] The information processing apparatus according to
claim 1,
wherein the controller is capable of comparing the
coordinates and the weight detected from an input
operation made using the writing tool after the
coordinate data and the weight data are stored, with '
the stored coordinate data and weight data and judging
whether bhere is a difference.
. [5] The information processing apparatus according to
claim 4,
wherein the controller is capable of
authenticating the user based on the judgment on
whether there is a difference and outputting an
authentication result.
[6] The information processing apparatus according to
claim 5, further comprising
a display section,
wherein the controller is capable of controlling
the display section to display, based on the input
.operation, an image showing a trajectory from a start
to an end of the input operation using only the
coordinate data out of the coordinate data and the
. weight data.
[7] The information processing apparatus according to
claim 4, further comprising
an output section,
wherein the controller is capable of1 controlling
the output section to output information indicating the
judged difference.
[8] The information processing apparatus according to
claim 1, further comprising
a display section,
wherein the controller is capable of controlling
the display section'to display, based on the stored
coordinate data and weight data, a first image that
shows a trajectory.from a start to an end of the input
operatioh of the user.
[9] The information processing apparatus according to
claim 8,
wherein the sensor is capable of detecting, after
the display of the image, coordinate data and weight
data from an. input operation made by another user using
the writing tool, and
wherein the controller is capable of
controlling the display section to display,
based on the detected coordinate data and weight data,
a second image that shows a trajectory f.rom a start to
an end of the input operation of the another user while
i
superimppsing the second image on the first image,
comparing the stored coordinate data and
weight data with the coordinate data and the weight
data detected from the input operation of the another
user, and
controlling the display section to display
information indicating a difference between the first
i the second image
information processing apparatus: according to
image an
[10] The
claim 9,
whe rein the controller changes a line width or
shading of the first image and the second image
j to the stored weight data and the weight data
from the input operation of the another user,
information processing apparatus; according to
accordin
detected
[11] The
claim 1,
wherein the sensor is capable of detecting, when a'
hand of the user touches thetinput surface at a time
the user makes the input operation using the writing
tool, coordinates of the contact position and a weight
applied to the contact position, and
wherein the controller causes the storage section,
to store coordinate data indicating the detected
coordinates of the contact position and weight data
indicating the 'weight applied to the contact position
.•in association with the coordinate data and the weight
''data, that have been detected from the input operation,
and the [identification information
[12] The information processing apparatus according to
claim 1, further comprising
a communication section,
wherein the controller controls the communication
section to transmit the stored coordinate data and
weight data to another information processing apparatus',
and
apparatu
whejrein the another information- processing
3 displays an image that shows a trajectory
from a s tart to an end of the input operation of the
user based on the transmitted 'coordinate data and
weight data.
[13] An information processing method, comprising
deflecting, by a sensor including an input surface
for accepting an input operation of a user using a
writing tcJj'ol, coordinates of a position at which the
input operation is made and a weight applied to the
position;
storing/ by a storage section, at predetermined
time intervals, coordinate data indicating the detected
La.it"
and
coordin
associat
user;
rea
data frotn
identifi
[14] A p
apparatu
det
for acce
writing
input op
position
sto
time int
coordinafc
associat
user; an
rea
data fr
identifi
es and weight data indicating the weight in
ion with identification information of the
iing out the stored coordinate data and weight
the storage section in association with the
atiofi information.
rogram that causes an information; processing
3 to execute the' steps of:
acting, by a sensor including an input surface
Dting an input operation of a user using a
tool, coordinates of a position at which the
ration is made and a weight applied to the
ring, by a storage section, at predetermined
rvals, coordinate data indicating the detected
es and weight data indicating the weight in
ion with identification information of the
d
ding out the stored coordinate data and weight
he storage section in association with the .
ation information.