Technical field
[0001]
　The present invention relates to a system for evaluating the writing ability of a user, especially an educated and studying child.
Background technology
[0002]
　A system for measuring handwriting, which is a locus of movement of the brush tip of a writing instrument during a writing act, is known (see Patent Documents 1 to 3 below). This type of system is mainly used in offices and the like for converting written characters and drawn figures into digital data and importing them into information processing terminals such as smartphones and personal computers.
[0003]
　In addition, a timekeeping device (stopwatch) that can be attached to a writing instrument and measures the time during which a child or the like is writing or studying using the writing instrument is also existing (see Patent Document 4 below).
[0004]
　By the way, recently, in the education of children, etc., the focus is on developing the ability to write. In particular, the ability to execute without being conscious of writing letters, which is located between writing or writing and writing, and the ability to be the basis of thinking equivalent to multiplication tables of arithmetic are emphasized here. This is called "writing power". If you have a high ability to write, you can write while thinking and think while writing. In addition, improvement in writing ability is expected to lead to improvement in reading comprehension. Therefore, through daily study and training, children's brains can be thought of by being able to write what they want to write as letters from a state where they are distracted by writing letters (the cognitive load of writing work is heavy). It is required to evolve into a state where you can concentrate (the cognitive load of writing work is light).
Prior art literature
Patent documents
[0005]
Patent Document 1: Japanese Patent Application Laid-Open No. 2016-024504
Patent Document 2: Japanese Patent Application Laid-Open No. 2004-274518
Patent Document 3: Japanese Patent Application Laid-Open No. 2004-029915
Patent Document 4: Patent Document 5176046
Outline of the invention
Problems to be solved by the invention
[0006]
　An object of the present invention is to accurately visualize the writing ability of a user who uses a writing tool in a writing act.
Means to solve problems
[0007]
　In the present invention, a detection unit that detects the amount of writing in a writing act using a writing instrument and the speed of writing in the same writing act, and information according to the amount of writing in the writing act detected through the detection unit can be obtained by the user. A writing action evaluation system including an information output unit that outputs in a manner appealing to the eyes or hearing and outputs information according to the speed of writing in the writing action in a manner appealing to the user's eyes or hearing is configured. did.
[0008]
　Increasing the amount of writing means getting used to writing and improving the achievement of learning and training. On the other hand, faster writing and faster writing suggests that the ability to write is improved and that students can concentrate on studying and other tasks that involve writing. The present invention focuses on this point, and by outputting information according to not only the amount of writing but also the speed of writing and presenting it to the user, it is possible to convey to the user how much ability to write at present. At the same time, it makes it possible for the user to be aware of the speed of writing.
[0009]
　The information output unit responds to the speed of writing detected through the detection unit during the writing operation, provided that the writing amount in the writing operation detected via the detection unit reaches a predetermined threshold value. Output different information.
[0010]
　The writing action evaluation system according to the present invention is typically an information processing terminal provided with the information output unit capable of exchanging data between a writing tool side device provided with the detection unit attached to the writing tool and the writing tool side device. And as an element. Then, the writing instrument side device stores the writing amount in the writing action and the writing speed in the writing action acquired by the detection unit, and the stored writing amount and the writing speed are processed into the information processing. The information processing terminal transmits the information to the information processing terminal in a situation where it can communicate with the terminal, and the information processing terminal that receives the information processing outputs the information based on the amount of writing and the speed of writing in the information output unit.
[0011]
　If the detection unit has an acceleration sensor that measures the acceleration of the movement of the tip of the writing instrument, the acceleration sensor can be used to simplify both the amount of writing in the writing act and the speed of writing in the same writing act. Can be calculated and obtained.
[0012]
　The writing instrument side device used for constructing the writing action evaluation system according to the present invention detects the writing amount in the writing action using the writing instrument and the writing speed of the writing instrument in the writing action, and also detects the detected writing action. And a detection unit that stores the writing speed, and a transmission that transmits the writing amount and writing speed detected and stored by the detection unit to the information processing terminal in a situation where it can communicate with the information processing terminal. It has a part.
[0013]
　It is preferable that the writing instrument side device is removable from the writing instrument used for the writing act.
[0014]
　In the program used to configure the writing act evaluation system according to the present invention, the information processing terminal is transmitted from the writing instrument side device attached to the writing instrument, and the writing amount in the writing act using the writing instrument and the writing act in the writing instrument. The receiving unit that receives the writing speed and the information corresponding to the writing amount received by the receiving unit are output in a manner that appeals to the user's visual or auditory sense, and also according to the writing speed received by the receiving unit. It functions as an information output unit that outputs the information in a manner that appeals to the user's eyes or hearing.
Effect of the invention
[0015]
　According to the present invention, it is possible to accurately visualize the writing ability of a user in a writing act.
A brief description of the drawing
[0016]
FIG. 1 is a perspective view showing a writing instrument side device and an information processing terminal, which are elements of the writing action evaluation system according to the embodiment of the present invention.
[Fig. 2] Fig. 2 is a diagram showing hardware resources provided in the writing instrument side device of the same embodiment.
[Fig. 3] Functional block diagram of the writing action evaluation system of the same embodiment.
FIG. 4 is a diagram showing hardware resources included in the information processing terminal of the same embodiment.
FIG. 5 is a flow chart showing an example of a procedure of processing executed by the writing instrument side device of the same embodiment in order to acquire data related to the writing action.
FIG. 6 is a diagram showing an operation performed by a user as an execution start condition for sending and receiving data related to a writing action from the writing instrument side device of the same embodiment to the information processing terminal.
FIG. 7 is a flow chart showing an example of a procedure of processing executed by the writing instrument side device and the information processing terminal of the same embodiment in order to send and receive data related to the writing action.
FIG. 8 is a diagram showing an example in which the information processing terminal of the same embodiment outputs different information depending on the amount of writing and the speed of writing.
[Fig. 9] Fig. 9 is a diagram showing an example in which the information processing terminal of the same embodiment outputs different information depending on the writing speed.
Mode for carrying out the invention
[0017]
　An embodiment of the present invention will be described with reference to the drawings. As shown in FIG. 1, the writing action evaluation system in the present embodiment includes a writing instrument side device 1 attached to the writing instrument 0 used for the writing action, and an information processing terminal 2 capable of communicating with the writing instrument side device 1. It is the main component. The writing instrument side device 1 plays a role of acquiring quantified data related to the writing action using the writing instrument 0, for example, the writing amount and the writing speed in the writing action. The information processing terminal 2 receives the data related to the writing action acquired by the writing tool side device 1 from the writing tool side device 1, and outputs the information corresponding to the data in a manner appealing to the user's sight or hearing.
[0018]
　The writing instrument side device 1 can be retrofitted to a ready-made writing instrument 0 such as a pencil, a mechanical pencil, a ballpoint pen, or the like. Therefore, the housing of the writing tool side device 1 is provided with a holding portion 11 for holding the writing tool 0. The holding portion 11 is, for example, an insertion hole through which the writing tool 0 can be inserted and held, but is like a clip or a clamp that holds the writing tool 0 in its mouth or fits on the outer circumference of the writing tool 0. It doesn't matter. The housing of the writing tool side device 1 may have a gripping portion 12 that is gripped by the fingers of a user who performs a writing act using the writing tool 0. In the present embodiment, the writing tool side device 1 can be attached to and detached from the writing tool 0, and the writing tool side device 1 can be commonly used for a number of writing tools 0. However, it does not prevent the writing tool side device 1 from being integrated with the writing tool 0 and being inseparable from the writing tool 0, or being built in the writing tool 0.
[0019]
　As shown in FIG. 2, the writing instrument side device 1 is a microcomputer system including hardware resources such as a processor 1a, a main memory 1b, an auxiliary storage device 1c, an acceleration sensor 1d, a communication interface 1e, and a battery 1f. The auxiliary storage device 1c is, for example, a flash memory. The acceleration sensor 1d has, for example, the function of a three-axis acceleration sensor that measures acceleration along each of the three directions of the X-axis, the Y-axis, and the Z-axis that are orthogonal to each other, and the θ-direction around the X-axis and the Y-axis. It is a so-called 6-axis acceleration sensor or 9-axis acceleration sensor that also has the function of a 3-axis rotation angular velocity sensor (gyro sensor) that measures the angular velocity along each rotation direction in the φ direction and the Ψ direction around the Z axis. .. The acceleration sensor 1d can detect the acceleration of the movement of the writing tool 0 (the tip of the brush), and can calculate the speed of the movement of the writing tool 0 through the time integration of the acceleration or the time-series integration of the repeatedly measured acceleration, and the time integration of the speed. Alternatively, the displacement amount of the motion of the writing tool 0 can be calculated through the time-series integration of the speed calculated repeatedly. Incidentally, the nine-axis accelerometer also has the function of a three-axis geomagnetic sensor (electronic compass) for knowing the north, south, east, and west directions, but the function of this geomagnetic sensor is not always necessary.
[0020]
　The communication interface 1e is a device for performing data communication between the writing tool side device 1 and an external information processing terminal 2, and is, for example, Bluetooth (registered trademark), wireless LAN (Local Area Network), or mobile phone network. , A wireless transceiver for carrying out wireless communication via a WiMAX (Worldwide Internet Access) network or the like, or an RFID (Radio Frequency Identification) card or chip. The battery 1f supplies the electric power required for the hardware resources. In addition, instead of the battery 1f, or together with the battery 1f, a power generation device that generates power by using the movement (vibration) applied to the writing tool side device 1 or the body temperature of the user who grips the grip portion 12 to supply or charge the power It is also conceivable to mount it on the writing instrument side device 1.
[0021]
　In the writing instrument side device 1, the program to be executed by the processor 1a is stored in the auxiliary storage device 1c, and when the program is executed, the program is read from the auxiliary storage device 1c into the main memory 1b and decoded by the processor 1a. Will be done. The writing tool side device 1 operates the above hardware resources according to a program, and exerts functions as a detection unit 101 and a transmission unit 102 shown in FIG.
[0022]
　The information processing terminal 2 is, for example, a general-purpose mobile phone terminal, particularly a smartphone, a personal computer, a video game machine, or the like. As shown in FIG. 4, the information processing terminal 2 includes a processor 2a, a main memory 2b, an auxiliary storage device 2c, a video codec 2d, an audio codec 2e, a communication interface 2f, an input device 2g, a display 2h, an audio output device 2i, and a battery. It is equipped with hardware resources such as 2j, which are controlled by a controller (system controller, I / O controller, etc.) 2k and operate in cooperation with each other. The auxiliary storage device 2c is a flash memory, a hard disk drive, an optical disk drive, or the like. The video codec 2d is a GPU (Graphics Processing Unit) that generates a screen to be displayed based on a drawing instruction received from the processor 2a and sends the screen signal to the display 2h, and temporarily transmits screen and image data. The element is a video memory or the like to be stored. The audio codec 2e decodes the encoded voice data and outputs the voice from the voice output device 2i. The video codec 2d and the audio codec 2e can each be implemented as software instead of hardware.
[0023]
　The communication interface 2f is a device for the information processing terminal 2 to perform data communication with an external device or a computer including a writing tool side device 1, for example, Bluetooth (registered trademark), a wireless LAN, or a mobile phone network. , A wireless transceiver for performing wireless communication via a WiMAX network or the like, or an RFID card reader. The input device 2g is a touch panel (which may be superimposed on the display 2h) operated by the user, a push button, a mouse, a keyboard, or the like, or a voice input device in which the user inputs a command by voice. .. The battery 2j supplies the power required for the hardware resources.
[0024]
　In the information processing terminal 2, the program to be executed by the processor 2a is stored in the auxiliary storage device 2c, and when the program is executed, the program is read from the auxiliary storage device 2c into the main memory 2b and decoded by the processor 2a. Will be done. The information processing terminal 2 operates the above hardware resources according to a program, and exerts functions as a receiving unit 201 and an information output unit 202 shown in FIG.
[0025]
　Hereinafter, the functions of each part of this system will be described in detail. The detection unit 101 of the writing tool side device 1 uses the acceleration sensor 1d to acquire quantified data regarding the writing action by the user using the writing tool 0. Then, the data is stored and held in a required storage area of ​​the main memory 1b or the auxiliary storage device 1c.
[0026]
　In the present embodiment, the data related to the writing act includes the writing amount in the writing act of the user and the writing speed in the writing act. The writing amount indicates the amount of writing by the user. More specifically, it is an integrated value of the time when the writing act is performed, an integrated value of the displacement amount which is the distance moved by the writing instrument 0 in the writing act, the number of strokes written or the number of characters written. It can be said that as the amount of writing increases, the user becomes accustomed to writing, or the degree of achievement of learning and training increases. The writing speed indicates the speed of writing in the writing action, the number of strokes and the number of characters written by the user within a certain period of time. More specifically, it is the angular velocity or speed of movement of the writing instrument 0 during the writing act. It can be said that the faster the writing, that is, the faster the writing, the higher the user's writing ability, and the more he can concentrate on studying and other tasks involving writing.
[0027]
　The information processing terminal 2 is not involved in the collection of data related to the writing action by the writing tool side device 1, and the existence of the information processing terminal 2 and the communication between the writing tool side device 1 and the information processing terminal 2 are not required.
[0028]
　FIG. 5 shows a procedure for processing for acquiring data related to the writing action in the detection unit 101 of the writing tool side device 1. The detection unit 101 of the writing instrument side device 1 uses the acceleration sensor 1d to accelerate the three axes [X, Y,] every predetermined time, for example, every frame (one frame is 1/30 second or 1/60 second). Z] and the angular velocity of rotation around the three axes [θ, φ, Ψ] are known (step S1). The writing tool side device 1 is fixed to the writing tool 0 used by the user, and the acceleration and the angular velocity measured by the acceleration sensor 1d suggest the acceleration and the angular velocity of the movement of the writing tool 0 (the brush tip). At this time, a predetermined axis of the acceleration sensor 1d, for example, the Z axis, is set in advance so as to be parallel or substantially parallel to the axial direction of the writing tool 0, in other words, the extending direction of the writing tool 0.
[0029]
　The acceleration and angular velocity acquired in step S1 may be raw values ​​output by the acceleration sensor 1d, or calculated values ​​obtained by calculation based on the output values ​​of the acceleration sensor 1d, that is, the output of the acceleration sensor 1d. It may be a value calculated by substituting the raw value to be used into a predetermined function formula. For example, when the Z axis of the acceleration sensor 1d is aligned with the extending direction of the axis of the writing instrument 0, the writing surface (the surface of the paper or the like to be written) on which writing is performed in the writing act using the writing instrument 0 It is assumed that the Z-axis is substantially orthogonal to each other and the tip of the writing instrument 0 is displaced in the X-axis direction and the Y-axis direction during writing. However, it is not guaranteed that the Z-axis and the writing surface are always orthogonal to each other, and it is naturally possible that the Z-axis is inclined with respect to the writing surface. Therefore, in order to accurately know the acceleration, velocity, or displacement amount of the movement of the brush tip on the writing surface, the inclination of the Z-axis with respect to the writing surface, that is, the horizontal plane is detected based on the gravity acting on the acceleration sensor 1d. It is necessary to convert the raw output value [X, Y, Z] of the acceleration sensor 1d into the acceleration value [X', Y', Z'] after tilt correction. If the angle of the Z-axis, which is the axis of the writing tool 0, with respect to the writing surface is constant during writing, the acceleration value [X', Y'] after tilt correction is the acceleration of the movement of the writing tip on the writing surface, that is, Is the acceleration along the biaxial directions parallel to the writing surface and orthogonal to each other. In addition, the acceleration value along the Z'axis direction is 0 unless the writing tip approaches or separates from the writing surface (the Z'axis direction is a direction orthogonal to the writing surface. Of course, unless writing is done once. It is natural that the brush tip is displaced in the Z'direction).
[0030]
　However, since the angle of the axis of the writing tool 0 can change during the writing action, the angle change, that is, the rotation is detected by using the function of the acceleration sensor 1d as an angular velocity sensor, and the acceleration value after tilt correction [X]. By further applying a rotation matrix to', Y', Z'] that cancels the rotation of the writing tool 0, it is possible to calculate the acceleration of the movement of the brush tip on the writing surface more accurately.
[0031]
　However, the demand for accuracy of data related to writing is not always significantly high. Moreover, the actual writing surface is not always horizontal, and the top plate is slightly tilted like a desk in a university lecture room, or the writing surface is vertically facing like when writing on a whiteboard. It is also possible. Therefore, it is not essential to apply the above correction to the output value of the acceleration sensor 1d.
[0032]
　The acceleration and the angular velocity acquired in step S1 may be obtained by applying some sort of filtering process to the raw values ​​output by the acceleration sensor 1d. When the output value of the accelerometer 1d fluctuates or pulsates frequently, the moving average of the output value of the accelerometer 1d is calculated, or the output value of the accelerometer 1d is low-pass filtered to obtain the fluctuation or pulsation. It is possible to obtain a suppressed appropriate acceleration and angular velocity.
[0033]
　Next, the detection unit 101 sets a predetermined number of consecutive frames, for example, ten frames as one period, and for each period, the absolute value of the acceleration of each frame included in the period (for example, √ (X 2 + Y 2 )). or √ (X ' 2 + Y' 2 )) of the combined (ten sum of the absolute value of the acceleration) is calculated. Then, on condition that the total value exceeds the determination threshold value (step S2), the period is counted as the "writing time" in which the user is writing (step S4). Otherwise, the period is counted as "time not written" when the user is not writing (step S5).
[0034]
　However, even if the sum of the absolute values ​​of the accelerations of each frame in a certain period exceeds the judgment threshold value, it cannot be immediately determined that the period is the "writing time". This is because the acceleration of the movement of the writing tool 0 detected by the acceleration sensor 1d may increase due to a factor other than the writing action. When the user is a child or the like, it is not difficult to imagine playing by shaking, turning, or rolling the writing tool 0. Therefore, even if the determination result in step S2 is true, the detection unit 101 detects the absolute value of the motion acceleration or the angular velocity of the writing tool 0 detected via the acceleration sensor 1d in the period or the frame included in the period. When is equal to or greater than or exceeds the predetermined upper limit (step S3), it is considered that the large exercise is not due to the writing action, and the period is counted as the "non-writing time" when the user is not writing. (Step S5).
[0035]
　The value of the acceleration or the angular velocity referred to in step S3 (compared with the upper limit value) may be the raw output value of the acceleration sensor 1d, or a calculated value obtained by calculation based on the output value of the acceleration sensor 1d. In particular, the value may be a value subjected to the above-mentioned correction, filtering, or the like. Further, it is also arbitrary to refer to the acceleration in any of the X-axis, Y-axis, and Z-axis directions, and to refer to the angular velocity in any of the θ-direction, φ-direction, and Ψ-direction rotation directions. When the Z axis of the acceleration sensor 1d is aligned with the extending direction of the axis of the writing tool 0, the absolute value of the acceleration in the Z axis direction becomes excessive when the user swings the writing tool 0 up and down, and when the writing tool 0 is shaken left and right. It is expected that the absolute value of acceleration in the X-axis or Y-axis direction will become excessive. Further, it is expected that the absolute value of the angular velocity in the θ direction or the φ direction becomes excessive when the user turns the writing tool 0, and the absolute value of the angular velocity in the Ψ direction becomes excessive when the writing tool 0 is rolled around the axis. The detection unit 101 has upper limit values ​​corresponding to the absolute values ​​of the X-axis direction acceleration, the Y-axis direction acceleration, the Z-axis direction acceleration, the θ-direction angular velocity, the φ-direction angular velocity, and the Ψ-direction angular velocity measured in each frame in the target period. If any of the above values ​​is equal to or greater than the upper limit, the period is counted as "time not written". Alternatively, the sum of the absolute values ​​of the X-axis direction acceleration of each frame included in the period (the sum of ten absolute values), the sum of the absolute values ​​of the Y-axis direction acceleration, and the sum of the absolute values ​​of the Z-axis direction acceleration. Compare the total value of the absolute value of the θ direction angular velocity, the absolute value of the φ direction angular velocity, and the absolute value of the Ψ direction angular velocity with the corresponding upper limit values, and either of them is equal to or higher than the upper limit value. If it exceeds, the period may be counted as "time not written". The upper limit value may be set individually for each axial direction or rotation direction, may be the same value in the three axial directions, or may be the same value in all rotation directions.
[0036]
　Alternatively, in step S3, the average value, median value, maximum value, etc. of the movement speed (absolute value) or displacement amount (absolute value) of the writing instrument 0 during the target period is compared with the predetermined upper limit value. When the former is greater than or equal to the latter or greater than the latter, the period may be counted as "time not being written" when the user is not writing. The speed or displacement of the movement of the writing instrument 0 during the period can be calculated based on the acceleration and / or the angular velocity detected via the acceleration sensor 1d during the period.
[0037]
　The number of periods of "writing time" counted through steps S1 to S5 corresponds to the writing amount of the writing act performed by the user using the writing instrument 0. Then, the total value of the counted "writing time" period number and the "non-writing time" period number is the total amount of time the user was holding the writing instrument 0, including the time other than the writing act. Corresponds to the length of. The detection unit 101 of the writing instrument side device 1 stores at least the number of periods of "writing time" corresponding to the writing amount in the main memory 1b or the auxiliary storage device 1c. In addition, the number of periods of "time not written" and / or the total value of the number of periods of "time written" and the number of periods of "time not written" are stored in the main memory 1b or the auxiliary storage device 1c. Remember.
[0038]
　In addition, the detection unit 101, for each period was determined as "write The times", the absolute value of the acceleration of each frame included in the period (e.g., √ (x 2 + y 2 ) or √ (X ' 2 + Y ' 2 )) The sum of (the sum of the absolute values ​​of ten accelerations) is evaluated in stages, for example, in five stages (step S6). That is, it is determined in which range of the five rank divisions the sum of the absolute values ​​of the accelerations exceeding the determination threshold value in step S3 is located. This means that the speed of brush strokes in the period is evaluated on a five-point scale. Then, the frequency of occurrence of the five-stage evaluation is counted (step S7). For example, if the sum of the absolute values ​​of the accelerations of a certain period is within the range of C rank, the value of the frequency of occurrence of C rank is incremented by 1.
[0039]
　The frequency of occurrence of each rank counted through steps S6 and S7 suggests the speed of writing in the writing action performed by the user using the writing instrument 0. The detection unit 101 of the writing instrument side device 1 displays a histogram of the occurrence frequency of each rank, that is, the occurrence frequency of A rank, the occurrence frequency of B rank, ..., Each value of the occurrence frequency of E rank in the main memory 1b or auxiliary. Store in the storage device 1c. Assuming that the number of periods counted in the "writing time" is 500, the total value of the A rank occurrence frequency, the B rank occurrence frequency, ..., And the E rank occurrence frequency is 500. When evaluating the writing speed of the user, the rank with the highest frequency of occurrence, or the frequency of occurrence of each rank and the score value of the rank (for example, 5 for A rank, 4 for B rank, ..., E rank) Then, the average value or median value of the product of 1) and the sum of all ranks can be used as an index for the evaluation.
[0040]
　By repeatedly executing the above steps S1 to S7, the detection unit 101 acquires data related to the writing action using the user's writing instrument 0, that is, the writing amount and the writing speed in the writing action, and obtains the main memory 1b or the writing speed. The memory is stored in the auxiliary storage device 1c. Obtain the output value of the acceleration sensor 1d obtained during the period determined as "time not written" in steps S2 or S3, and the writing amount and writing speed calculated based on the output value as data related to the writing action. (That is, it is not counted as "writing time" and is not subject to a five-point evaluation of writing speed. The "non-writing time" count corresponds to data related to writing activity, not writing amount. Do not), do not remember this.
[0041]
　The detection unit 101 may calculate and store the integrated value of the displacement amount of the writing instrument 0 in the period determined as "writing time" as the writing amount in the writing action. In addition, the detection unit 101 determines that the writing speed in the writing action is the average value or the median value of the movement speed of the writing tool 0 during the period, which is determined as "writing time", and "writing time". The integrated value of the displacement of the writing tool 0 in the period determined to be, divided by the number of periods of "writing time" (after all, the displacement of the writing tip per unit time), or any of them is stepped. The frequency of occurrence of each rank at the time of evaluation may be calculated and stored in memory.
[0042]
　The transmission unit 102 of the writing instrument side device 1 uses the communication interface 1e to detect data related to the user's writing action using the writing instrument 0, which is detected by the detection unit 101 and stored in the main memory 1b or the auxiliary storage device 1c. Is transmitted to the information processing terminal 2. The receiving unit 201 of the information processing terminal 2 uses the communication interface 2f to receive data related to the writing action transmitted from the writing tool side device 1 and stores it in the main memory 2b or the auxiliary storage device 2c. Store and retain in the area.
[0043]
　In the present embodiment, as shown in FIG. 6, the user can use the end portion of the writing tool 0 attached to the writing tool side device 1 (either the front end portion having the brush tip or the rear end portion on the opposite side to the brush tip). , An operation of tilting from above to downward toward the information processing terminal 2 (operation of changing the writing tool 0 from a lying position (closer to horizontal) to a standing position of writing tool 0 (closer to vertical)). Data between the writing tool side device 1 and the information processing terminal 2 triggered by an operation as if the water stored in the writing tool 0 was poured into the information processing terminal 2 from the end of the writing tool 0. Start giving and receiving. In this operation, the writing amount of the writing act performed by the user using the writing instrument 0 is regarded as a certain energy or power, and the energy or power accumulated in the writing instrument 0 by the user through the writing act is poured into the information processing terminal 2. It imitates the action.
[0044]
　FIG. 7 shows a procedure for processing for transmitting and receiving data related to writing by the transmitting unit 102 of the writing tool side device 1 and the receiving unit 201 of the information processing terminal 2. After the preparation for the pre-stage of data transmission / reception is completed (step S8), the transmission unit 102 of the writing tool side device 1 rotates around the three axes of the writing tool 0 via the acceleration sensor 1d at predetermined time intervals, that is, every frame. Know the angular velocity of rotation [θ, φ, Ψ] (step S9).
[0045]
　The branch determination in step S8 becomes true when, for example, the user operates a predetermined button or switch mounted on the writing instrument side device 1 itself. Alternatively, the user performs a specific operation via the input device 2g of the information processing terminal 2, and a signal or information indicating that effect is transmitted from the information processing terminal 2 to the writing tool side device 1, and this is transmitted to the writing tool side device 1. Is true when is received. As a matter of course, the operation of pointing the end of the writing instrument 0 downward is also performed during writing. Therefore, the purpose of step S8 is to prevent the transmission of data from the writing instrument side device 1 to the information processing terminal 2 from being started during writing even though the user does not intend to do so.
[0046]
　The angular velocity acquired in step S9 may be a raw value output by the acceleration sensor 1d, or may be a raw value output by the acceleration sensor 1d subjected to some filtering.
[0047]
　Then, the transmission unit 102 of the writing tool side device 1 sets the time series of the angular velocity [θ, φ, Ψ] of the rotation of the writing tool 0 detected by the acceleration sensor 1d at predetermined time intervals as Euler angles or quaternions (quaternions). It is transmitted to the information processing terminal 2 in an arbitrary numerical format such as quaternion (step S10).
[0048]
　The receiving unit 201 of the information processing terminal 2 receives the time series of the angular velocity of the rotation of the writing tool 0 at predetermined time intervals brought from the writing tool side device 1 (step S11). Then, based on this, it is determined whether or not the user has performed an operation of tilting the end portion of the writing tool 0 toward the information processing terminal 2 (step S12). When it is determined that the user has performed an operation of tilting the end portion of the writing tool 0 toward the information processing terminal 2, a signal or information indicating that fact is transmitted to the writing tool side device 1 (step S13).
[0049]
　The transmission unit 102 of the writing instrument side device 1 stores and holds the data stored in the main memory 1b or the auxiliary storage device 1c on condition that the above signal or information brought from the information processing terminal 2 is received (step S14). The transmission to the information processing terminal 2 is started to be executed (step S15).
[0050]
　In steps S10 to S14 described above, the information processing terminal 2 determines and confirms that the user has manually tilted the end of the writing instrument 0 toward the information processing terminal 2. However, in the writing tool side device 1, it is determined whether or not such an operation has been performed based on the time series of the angular velocity of the rotation of the writing tool 0 at predetermined time intervals, and the data is provided on condition that the operation is performed. The transmission to the information processing terminal 2 of the above (step S15) may be executed. If the writing tool side device 1 determines the presence or absence of the operation, the steps S10 to S14 can be omitted.
[0051]
　The data transmitted by the writing instrument side device 1 to the information processing terminal 2 in step S15 is data related to the user's writing action, the number of periods of "writing time" indicating the writing amount, and the writing speed. The frequency of occurrence of each rank of the five-grade evaluation shown, and the number of periods of "time not written" and / or the total value of the number of periods of "time written" and the number of periods of "time not written" including.
[0052]
　The receiving unit 201 of the information processing terminal 2 receives the data provided by the writing instrument side device 1 (step S16), and stores this in the main memory 2b or the auxiliary storage device 2c. At this time, in the information processing terminal 2, the newly received "writing time" is added to the number of "writing time" periods received in the past and stored in the main memory 2b or the auxiliary storage device 2c. The number of periods may be added. In addition, the histogram of the occurrence frequency of each rank newly received this time may be added to the histogram of the occurrence frequency of each rank of the five-step evaluation of the writing speed received and stored in the past. In addition, the number of periods of "time not written" or the number of periods of "time written" and the number of periods of "time not written" that have been received and stored in the past have been added to the total value. The number of periods of "time not written" or the total value of the number of periods of "time written" and the number of periods of "time not written" may be added to.
[0053]
　The transmission / reception of data in steps S15 and S16 may be completed as quickly as possible, but the larger the value of the data stored and held in the writing instrument side device 1, or the larger the amount of data, the more data transmission / reception. It is also possible to give an effect that takes a long time to complete. More specifically, the length of time that the transmitting unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2 keep the end of the writing instrument 0 tilted toward the information processing terminal 2. Data transmission / reception is completed on the condition that the value exceeds the threshold value, and the threshold value is set larger (longer) as the number of periods of "writing time" stored and held by the writing instrument side device 1 increases. Alternatively, the higher the frequency of occurrence of each rank of the five-step evaluation of the writing speed stored in the writing instrument side device 1, the larger the setting. That is, the more energy or power the user has stored in the writing tool 0 through the writing act, the longer it takes to flow all the energy or power into the information processing terminal 2.
[0054]
　Until the transmission / reception of data is completed, that is, while the user keeps tilting the end of the writing tool 0 toward the information processing terminal 2 (the length of time that keeps that state reaches the threshold value). As a function of the receiving unit 201 of the information processing terminal 2), information for making the user aware that the transmission / reception processing is in progress, in other words, for the user to recognize that the state should still be maintained. It is also preferable to output in a manner that appeals to the user's sight or hearing. For example, during transmission / reception, a moving image in which water is poured may be displayed on the screen of the display 2h, or a sound effect such as the sound of water being poured may be output from the audio output device 2i. May be good.
[0055]
　Further, when the transmission / reception of data is not completed immediately in this way, the data value to be stored in the main memory 1b or the auxiliary storage device 1c of the writing instrument side device 1 during the transmission / reception, particularly "writing". Data stored in the main memory 2b or auxiliary storage device 2c of the information processing terminal 2 while gradually changing (gradually decreasing) the value of the occurrence frequency of each rank of the five-stage evaluation of the number of periods of "time" and the speed of writing. It is also possible to process the value, especially the number of periods of "writing time" and the value of the frequency of occurrence of each rank of the five-level evaluation of the writing speed so as to gradually change (increase gradually).
[0056]
　When the user stops maintaining the state before the length of time that the user keeps the end of the writing tool 0 tilted toward the information processing terminal 2 exceeds the threshold value, the data transmission / reception itself That is, the data stored in each of the writing instrument side device 1 and the information processing terminal 2 may be set to the data before the start of transmission / reception (or restored to the data before transmission / reception). Alternatively, if the process of gradually changing the data value stored in each of the writing instrument side device 1 and the information processing terminal 2 is being performed during transmission / reception, the time when the user stops maintaining the above state. The data value in the above may be stored and held in the writing tool side device 1 and the information processing terminal 2. To determine whether or not the user keeps the end of the writing tool 0 tilted toward the information processing terminal 2 during transmission / reception, the user sets the end of the writing tool 0 at the information processing terminal 2 as a condition for starting transmission / reception. By the same procedure as determining whether or not the operation of tilting toward is performed, the information processing terminal 2 executes the operation and then notifies (transmits) the determination result from the information processing terminal 2 to the stationery side device 1. It may be judged by the writing instrument side device 1 itself.
[0057]
　After the transmission / reception of data (steps S15 and S16) between the writing tool side device 1 and the information processing terminal 2 is completed, the writing tool side device 1 has stored and held the data in the main memory 1b or the auxiliary storage device 1c until then. Erase the transmitted data from the main memory 1b or the auxiliary storage device 1c, in other words, the number of periods of "writing time", the number of periods of "not writing time", and the speed of writing. The frequency of occurrence of each rank of evaluation is reset to 0 (step S17).
[0058]
　The transmitting unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2 cut off communication between the two in a period other than when transmitting and receiving the data in steps S8 to S17 described above, that is, wirelessly directed to each other. It stops sending signals and thus suppresses power consumption.
[0059]
　The information output unit 202 of the information processing terminal 2 receives information from the writing instrument side device 1 and stores it in the main memory 2b or the auxiliary storage device 2c according to the data related to the writing action performed by the user using the writing instrument 0. , Output in a manner that appeals to the user's sight or hearing.
[0060]
　For example, as shown in FIG. 8, based on (cumulative value) of the writing amount in the writing action performed by the user so far, as information visually indicating the writing amount, the tree 21 that grows greatly as the writing amount increases. Such an image is generated or selected and displayed on the screen of the display 2h. At this time, different voice information such as tone color, melody, and loudness may be generated or selected according to the amount of writing performed by the user, and may be output from the voice output device 2i.
[0061]
　It can be said that the amount of writing is the result of the user's study or training so far, and by presenting this to the user in a timely manner, the writing act using the writing instrument 0 is given a game-like property, especially for children and the like. Motivate users to study voluntarily.
[0062]
　In addition, as shown in FIGS. 8 and 9, the information output unit 202 of the information processing terminal 2 is a histogram of the speed of writing in the writing actions performed by the user so far (the occurrence frequency of each rank of the five-stage evaluation). ) As information that visually indicates the writing speed, an image in which different kinds of fruits 22 grow on the tree 21 is generated or selected according to the writing speed, and displayed on the screen of the display 2h. Let me. For example, when the writing speed is lower than a certain low rank or a certain low value, the cherry 22 is fruitful as shown in FIG. 9 (a), and the writing speed is a certain high rank or a certain high value. If it is higher than that, the banana 22 will be produced as shown in FIG. 9 (c), and if the writing speed is in between, the apple 22 will be produced as shown in FIG. 9 (b). , Such as. At this time, different voice information such as tone color, melody, and loudness may be generated or selected according to the writing speed of the writing action performed by the user, and may be output from the voice output device 2i. As mentioned above, the speed of writing in the user's past writing activities is the most frequently occurring rank among the occurrence frequencies of each rank on a five-point scale, the occurrence frequency of each rank, and the score value of that rank. It can be evaluated from the average value or median value of the product of and the sum of all ranks. If the frequency of D rank is the highest, the user's writing speed is slightly slower than medium, and it can be evaluated that there is room for growth or improvement. If the frequency of A rank is the highest, it can be evaluated. It can be evaluated that the user's writing has become considerably faster and the writing ability has increased. If the average value or median value of the product of the rank occurrence frequency and the rank score value is referred to, it can be evaluated that the higher the value, the faster the user writes.
[0063]
　The fact that the information processing terminal 2 presents not only the amount of writing by the user so far but also the speed of writing in the writing action leads to making the user such as a child aware of the speed of writing, and the ability to write. It is expected to contribute to the cultivation of. You can write 15 to 20 characters per minute in the lower grades of elementary school, 20 to 25 characters per minute in the middle grades, and 25 to 30 characters per minute in the upper grades. Speed ​​will be one of the goals. If you have the ability to constantly write thirty characters per minute with decent characters, that is the writing ability of an adult who has no shortage of writing, when trying to write notes, memos, diaries, postcards, letters, etc. The brush will move soon.
[0064]
　In the present embodiment, the writing amount in the writing action using the writing instrument 0, the detection unit 101 for detecting the writing speed in the writing action, and the writing amount in the writing action detected through the detection unit 101 are supported. A writing act including an information output unit 202 that outputs information in a manner appealing to the user's eyes or hearing and outputs information different depending on the writing speed in the same writing act in a manner appealing to the user's eyes or hearing. The evaluation system was configured. According to the present embodiment, both the amount of writing in the writing action of the user and the speed of writing can be output and presented to the user. As a result, it becomes possible to accurately visualize and evaluate the degree of achievement of the user's learning through the writing act and the degree of improvement of the user's writing ability.
[0065]
　The information output unit 202 has a writing speed detected through the detection unit 101 during the writing action, provided that the writing amount of the writing action detected through the detection unit 101 has reached a predetermined threshold value. Output different information according to. According to the example shown in FIG. 8, the fruit 22 displaying the writing speed does not grow to a certain size of the tree 21 that grows according to the writing amount, that is, the tree 21 grows to that size. Unless the amount of writing stored in the information processing terminal 2 increases to the amount required for the information processing terminal 2, that is, the threshold value, it will not be fruitful. The same applies to the output of voice information according to the speed of writing.
[0066]
　The writing action evaluation system of the present embodiment is an information processing terminal provided with the information output unit 202 capable of exchanging data between the writing instrument side device 1 provided with the detection unit 101 attached to the writing instrument 0 and the writing instrument side device 1. With 2 as an element, the writing instrument side device 1 stores the writing amount of the writing action acquired by the detection unit 101 and the writing speed in the writing action, and the memorized writing amount and writing speed are stored. Is transmitted to the information processing terminal 2 in a situation where it can communicate with the information processing terminal 2, and the information processing terminal 2 that receives this is based on the writing amount and the writing speed in the information output unit 202. The above information is output. In the present embodiment, the writing instrument side device 1 calculates and stores in advance a value suggesting the writing speed, that is, a histogram of the occurrence frequency of the five-step evaluation, and the writing instrument side device 1 and the information processing terminal 2 Send and receive when communication is possible. Therefore, during the writing act, the acceleration, speed, displacement amount, position coordinates, etc. of the writing tip of the writing tool 0 are continuously transmitted from the writing tool side device 1 to the information processing terminal 2 continuously and continuously for a long time.

There is no need. That is, power saving can be realized by appropriately limiting the communication opportunity between the writing tool side device 1 and the information processing terminal 2. Furthermore, data related to the writing act can be collected without the need for the information processing terminal 2 (even if the information processing terminal 2 is absent), and the existence of the information processing terminal 2 does not interfere with the writing act. ..
[0067]
　The detection unit 101 has an acceleration sensor 1d that measures the acceleration of the movement of the tip of the writing tool 0, and the acceleration sensor 1d is used to easily write the amount of writing and the speed of writing in the writing. Can be calculated and obtained.
[0068]
　Further, in the present embodiment, the writing instrument side device 1 attached to the writing instrument 0 used for the writing act and the information processing terminal 2 capable of exchanging data between the writing instrument side device 1 are used as elements. 1 is a condition that the detection unit 101 that acquires and stores quantified data regarding the writing action using the writing instrument 0 and the operation of tilting the end portion of the writing instrument 0 toward the information processing terminal 2 are performed. The information processing terminal 2 is provided with a transmission unit 102 that transmits the data acquired and stored by the detection unit 101 to the information processing terminal 2, and the information processing terminal 2 receives the data transmitted from the writing instrument side device 1. A transmission / reception system including a reception unit 201 is configured. According to this embodiment, when exchanging data between the writing tool side device 1 and the information processing terminal 2, it is possible to provide an experience of linking the writing tool 0 and the application program on the information processing terminal 2, which is interesting. The game quality is improved.
[0069]
　The information processing terminal 2 includes an information output unit 202 that outputs information in a manner that appeals to the user's vision or hearing according to the data received by the reception unit 201.
[0070]
　The transmitting unit 102 and the receiving unit 201 complete transmission / reception on condition that the length of time in which the end of the writing tool 0 is kept tilted toward the information processing terminal 2 exceeds a threshold value. The threshold value varies depending on the size of the value of the data acquired and stored by the detection unit 101 or the amount of the data. As a result, the time for the user to tilt the writing instrument 0 toward the information processing terminal 2 changes according to the writing amount data stored in the writing instrument 0, and the more energy or power stored in the writing instrument 0, the more energy or power is stored in the writing instrument 0. It is possible to provide the user with a virtual experience that it takes time to flow all the energy or power into the information processing terminal 2.
[0071]
　The transmitting unit 102 and the receiving unit 201 cut off communication between the two during a period other than when the data is transmitted and received to reduce power consumption.
[0072]
　Further, in the present embodiment, the output value of the sensor 1d that is attached to the writing tool 0 and measures the acceleration, speed, or displacement of the movement of the writing tool 0 or the calculated value obtained by calculating based on the output value is the data related to the writing action. The detection unit 101 includes the detection unit 101 to be acquired as When, the writing instrument side device 1 is configured so that the output value or the calculated value exceeding or exceeding the upper limit value is not acquired as the data related to the writing action. According to the present embodiment, the movement of the writing instrument 0 caused by the writing act and the movement of the writing instrument 0 caused by the act other than the writing act can be separated without separately mounting the sensors and switches other than the sensor 1d. Can be identified. Then, it is possible to effectively prevent an error from being mixed in the data related to the writing action acquired via the sensor 1d.
[0073]
　The sensor 1d measures the acceleration, velocity, or displacement of the movement of the writing instrument 0 along the direction of at least one of the three axes that are immovably set with respect to the writing instrument 0 and are orthogonal to each other. When the output value of the sensor 1d or the calculated value calculated based on the output value exceeds or exceeds a predetermined upper limit value, the unit 101 has an output value equal to or higher than or exceeds the upper limit value. Do not acquire the calculated value as data related to writing.
[0074]
　The sensor 1d measures the acceleration, velocity, or displacement of the rotational movement of the writing tool 0 about at least one of the three axes that are immovably set with respect to the writing tool 0 and are orthogonal to each other. When the output value of the sensor 1d or the calculated value calculated based on the output value exceeds or exceeds a predetermined upper limit value, the unit 101 has an output value that is equal to or greater than or exceeds the upper limit value. Do not acquire the calculated value as data related to writing.
[0075]
　The sensor 1d has the functions of a three-axis acceleration sensor and a three-axis gyro sensor.
[0076]
　The detection unit 101 acquires both the writing amount of the writing act and the writing speed in the writing act as data related to the writing act.
[0077]
　The present invention is not limited to the embodiments described in detail above. The specific configuration of each part, the processing procedure, and the like can be variously modified without departing from the spirit of the present invention.
Code description
[0078]
　0 ... Writing tool
　1 ... Writing tool side device
　1d ... Accelerometer
　101 ... Detection unit
　102 ... Transmission unit
　2 ... Information processing terminal
　201 ... Reception unit
　202 ... Information output unit
　21 ... Information (tree) that differs depending on the amount of writing in the writing action
　22 … Information (fruit) that differs depending on the speed of writing in the writing act
The scope of the claims
[Claim 1]
A detection unit that detects the amount of writing in a writing act using a writing instrument and the speed of writing in the same writing act, and
information according to the amount of writing in the writing act detected through the detection unit can be visually or audibly transmitted to the user.
A writing action evaluation system including an information output unit that outputs in an appealing manner and outputs information according to the speed of writing in the same writing action in a manner that appeals to the user's eyes or hearing .
[Claim 2]
The information output unit responds to the speed of writing detected through the detection unit during the writing operation, provided that the writing amount in the writing operation detected through the detection unit reaches a predetermined threshold value. The writing act evaluation system according to claim 1, which outputs information.
[Claim 3]
The writing instrument side device attached to the writing instrument and having the detection unit and the information processing terminal provided with the information output unit capable of exchanging data between the
writing instrument side devices are elements, and the writing instrument side device is the detection unit. The amount of writing in the acquired writing act and the speed of writing in the same writing act are memorized, and the memorized amount of writing and the speed of writing are directed to the information processing terminal in a situation where communication with the information processing terminal is possible. The writing action evaluation system according to claim 1 or 2, wherein the information processing terminal that receives the information processing outputs the information based on the writing amount and the writing speed in the information output unit.
[Claim 4]
Claims 1 and 2 that the detection unit has an acceleration sensor that measures the acceleration of the movement of the writing tip of the writing tool, and uses the acceleration sensor to acquire the writing amount in the writing act and the writing speed in the writing act. Or the writing act evaluation system described in 3.
[Claim 5]
It is used to construct the writing act evaluation system according to claim 1, 2, 3 or 4
, and detects the amount of writing in the writing act using the writing instrument and the writing speed of the writing instrument in the writing act. At the same time, the
information processing is performed under the condition that the detection unit that stores the detected writing action and the writing speed and the writing amount and the writing speed that the detection unit detects and stores can communicate with the information processing terminal. A
writing instrument side device including a transmitter for transmitting to a terminal .
[Claim 6]
The writing instrument side device according to claim 5, which is removable from the writing instrument used for writing.
[Claim 7]
A writing act using a writing instrument , which is used to configure the writing act evaluation system according to claim 1, 2, 3 or 4 , and is transmitted from a writing instrument side device attached to a writing instrument to an
information processing terminal.
The receiving unit that receives the writing amount and the writing speed in the writing act, and the
receiving unit outputs information according to the writing amount received by the receiving unit in a manner that appeals to the user's visual or auditory sense.
A program that functions as an information output unit that outputs information according to the writing speed received in the user in a manner that appeals to the user's eyes or hearing .
[Claim 8]
A set of the writing instrument side device according to claim 5 or 6 and the program according to claim 7.