1. An image processing apparatus comprising: a display image generation unit that generates a display image; a display unit that displays the display image so as to be superimposed on a user's field of vision5 ; an imaging unit that generates a captured image so as to include the user's field of vision; and a recognition unit that analyzes the captured image, and specifies an identification code included in the captured 10 image, wherein the display image generation unit generates the display image having emphasis information displayed at a position corresponding to the specified identification code in the user's field of vision.

2. The image processing apparatus according to claim 1, wherein the recognition unit performs a process of recognition on the specified identification code, and the display image generation unit generates the display 5 image in which a recognized identification code and an unrecognized identification code are distinguishable from each other.

3. The image processing apparatus according to claim 1 or 2, wherein in a case where a plurality of identification codes 58 are included in the captured image, the recognition unit specifies the plurality of identification codes, and the display image generation unit generates the displa5 y image having the emphasis information displayed at a position corresponding to each of the plurality of specified identification codes in the user's field of vision.

4. An image processing apparatus comprising: a display image generation unit that generates a display image; a display unit that displays the display image so as 5 to be superimposed on a user's field of vision; an imaging unit that generates a captured image so as to include the user's field of vision; and a recognition unit that analyzes the captured image, specifies an identification code included in the captured 10 image, and performs a process of recognition on the specified identification code, wherein the display image generation unit generates the display image having emphasis information displayed at a position corresponding to a recognized identification code 15 or a position corresponding to an unrecognized identification code in the user's field of vision.

5. The image processing apparatus according to claim 4, wherein in a case where a plurality of identification codes is included in the captured image, the recognition unit 59 specifies the plurality of identification codes, and performs a process of recognition on the respectiv5 e identification codes, and the display image generation unit generates the display image having the emphasis information displayed at a position corresponding to each of a plurality of recognized 10 identification codes or a position corresponding to each of a plurality of unrecognized identification codes in the user's field of vision.

6. The image processing apparatus according to any one of claims 1 to 5, further comprising an input receiving unit that receives a start instruction input from a user, wherein the imaging unit starts to generate the captured 5 image in accordance with the start instruction input, the recognition unit starts to analyze the captured image in accordance with the generation of the captured image, the display image generation unit starts to generate 10 the display image in accordance with generation of a result of the analysis of the captured image, and the display unit starts to display the display image in accordance with the generation of the display image.

7. The image processing apparatus according to any one of claims 1 to 6, wherein the display unit includes a transmission-type display, and displays the display image 60 on the transmission-type display.

8. The image processing apparatus according to any one of claims 1 to 7, wherein the display unit includes a head mounted display, and displays the display image on the head mounted display.

9. An image processing method executed by a computer, the method comprising: a display image generation step of generating a display image; a display step of displaying the display image so a5 s to be superimposed on a user's field of vision; an imaging step of generating a captured image so as to include the user's field of vision; and a recognition step of analyzing the captured image and 10 specifying an identification code included in the captured image, wherein the display image generation step includes generating the display image having emphasis information displayed at a position corresponding to the specified 15 identification code in the user's field of vision.

11. An image processing method executed by a computer, the method comprising: a display image generation step of generating a display image; 5 a display step of displaying the display image so as to be superimposed on a user's field of vision; an imaging step of generating a captured image so as to include the user's field of vision; and a recognition step of analyzing the captured image, 10 specifying an identification code included in the captured image, and performing a process of recognition on the specified identification code, wherein the display image generation step includes generating the display image having emphasis information 15 displayed at a position corresponding to a recognized identification code or a position corresponding to an 62 unrecognized identification code in the user's field of vision.

TECHNICAL FIELD
[0001]
The present invention relates to an image processing
apparatus, an image processing method, and a program.
10 BACKGROUND ART
[0002]
Techniques associated with Patent Documents 1 and 2 are
disclosed.
[0003]
15 Patent Document 1 discloses a product processing
apparatus including a head mounted display, an imaging
apparatus, an image processing unit, a product information
acquisition unit, and an information display unit.
[0004]
20 The head mounted display includes a holding member
formed in the shape of a spectacle frame. The holding member
holds a light-transmissive member that makes it possible to
visually observe code information attached to a product. A
portion of the light-transmissive member allows display of
25 a monitor.
[0005]
The imaging apparatus captures an image of at least the
3
code information attached to a product. The image
processing unit displays image data acquired by image
capture performed by the imaging apparatus on a portion of
the light-transmissive member allowing display of a monitor.
In addition, the image processing unit performs imag5 e
processing on the image data and deciphers a product code
included in the code information.
[0006]
The product information acquisition unit acquires
10 information of a product on the basis of the product code
deciphered by the image processing unit. The information
display unit displays at least the information of a product
acquired by the product information acquisition unit on a
monitor display unit of the head mounted display.
15 [0007]
Patent Document 2 discloses a reading apparatus in
which, in a case where plural bar codes are included in a
captured image, a recognition process is performed using
each of these bar codes as a processing object.
20 RELATED DOCUMENTS
PATENT DOCUMENTS
[0008]
[Patent Document 1] Japanese Unexamined Patent
Publication No. 2009-93489
25 [Patent Document 2] Japanese Unexamined Patent
Publication No. 9-114913
4
SUMMARY OF THE INVENTION
TECHNICAL PROBLEM
[0009]
In a technique disclosed in Patent Document 1, when the
image data is monitor-displayed on a portion of th5 e
light-transmissive member, a user's field of vision includes
(1) an image which is monitor-displayed on a portion of the
light-transmissive member, and (2) the view in front of a
user which is seen through another portion of the
10 light-transmissive member. A product included in the image
obtained by capturing an image in the forward direction of
a user, and product information obtained by reading the code
information attached to the product are displayed on the
image of (1).
15 [0010]
In a case where only one product is present in front
of a user, the user can associate the product present within
the view of (2) with the product and the product information
displayed within the image of (1). However, in a case where
20 plural products are present in front of the user, the user
is not able to determine which of the plural products present
within the view of (2) the product and the product
information displayed within the image of (1) correspond to.
A technique disclosed in Patent Document 2 is not able to
25 solve the problem.
[0011]
An object of the present invention is to provide, in
5
an apparatus that analyzes a captured image potentially
including identification codes and provides the result to
a user, a technique for allowing the user to easily recognize
which identification code the provided analysis result
corresponds to5 .
SOLUTION TO PROBLEM
[0012]
According to the present invention, there is provided
an image processing apparatus including: a display image
10 generation unit that generates a display image; a display
unit that displays the display image so as to be superimposed
on a user's field of vision; an imaging unit that generates
a captured image so as to include the user's field of vision;
and a recognition unit that analyzes the captured image, and
15 specifies an identification code included in the captured
image, wherein the display image generation unit generates
the display image having emphasis information displayed at
a position corresponding to the specified identification
code in the user's field of vision.
20 [0013]
In addition, according to the present invention, there
is provided an image processing method executed by a computer,
the method including: a display image generation step of
generating a display image; a display step of displaying the
25 display image so as to be superimposed on a user's field of
vision; an imaging step of generating a captured image so
as to include the user's field of vision; and a recognition
6
step of analyzing the captured image and specifying an
identification code included in the captured image, wherein
the display image generation step includes generating the
display image having emphasis information displayed at a
position corresponding to the specified identification cod5 e
in the user's field of vision.
[0014]
In addition, according to the present invention, there
is provided a program causing a computer to function as: a
10 display image generation unit that generates a display
image; a display unit that displays the display image so as
to be superimposed on a user's field of vision; an imaging
unit that generates a captured image so as to include the
user's field of vision; and a recognition unit that analyzes
15 the captured image, and specifies an identification code
included in the captured image, wherein the display image
generation unit is caused to generate the display image
having emphasis information displayed at a position
corresponding to the specified identification code in the
20 user's field of vision.
[0015]
In addition, according to the present invention, there
is provided an image processing method executed by a computer,
the method including: a display image generation step of
25 generating a display image; a display step of displaying the
display image so as to be superimposed on a user's field of
vision; an imaging step of generating a captured image so
7
as to include the user's field of vision; and a recognition
step of analyzing the captured image, specifying an
identification code included in the captured image, and
performing a process of recognition on the specified
identification code, wherein the display image generatio5 n
step includes generating the display image having emphasis
information displayed at a position corresponding to the
recognized identification code or a position corresponding
to the unrecognized identification code in the user's field
10 of vision.
[0016]
In addition, according to the present invention, there
is provided a program causing a computer to function as: a
display image generation unit that generates a display
15 image; a display unit that displays the display image so as
to be superimposed on a user's field of vision; an imaging
unit that generates a captured image so as to include the
user's field of vision; and a recognition unit that analyzes
the captured image, specifies an identification code
20 included in the captured image, and performs a process of
recognition on the specified identification code, wherein
the display image generation unit is caused to generate the
display image having emphasis information displayed at a
position corresponding to the recognized identification
25 code or a position corresponding to the unrecognized
identification code in the user's field of vision.
ADVANTAGEOUS EFFECTS OF INVENTION
8
[0017]
According to the present invention, in an apparatus
that analyzes a captured image potentially including
identification codes, and provides the result to a user, it
is possible for the user to easily recognize 5 which
identification code the provided analysis result
corresponds to.
BRIEF DESCRIPTION OF THE DRAWINGS
10 [0018]
The above and other objects, features, and advantages
will be made clearer from preferred exemplary embodiments
described below, and the following accompanying drawings.
[0019]
15 FIG. 1 is a diagram conceptually illustrating an
example of a hardware configuration of an apparatus of the
present exemplary embodiment.
FIG. 2 is an example of a functional block diagram of
an image processing apparatus of the present exemplary
20 embodiment.
FIG. 3 is a diagram illustrating an application example
of the image processing apparatus of the present exemplary
embodiment.
FIG. 4 is a diagram illustrating an advantageous effect
25 of display performed by the image processing apparatus of
the present exemplary embodiment.
FIG. 5 is a flow diagram illustrating an example of a
9
flow of processes of the image processing apparatus of the
present exemplary embodiment.
FIG. 6 is a diagram illustrating an advantageous effect
of display performed by the image processing apparatus of
the present exemplary embodiment5 .
FIG. 7 is a flow diagram illustrating an example of a
flow of processes of the image processing apparatus of the
present exemplary embodiment.
FIG. 8 is a diagram illustrating an advantageous effect
10 of display performed by the image processing apparatus of
the present exemplary embodiment.
FIG. 9 is a diagram illustrating an advantageous effect
of display performed by the image processing apparatus of
the present exemplary embodiment.
15 FIG. 10 is an example of a functional block diagram of
the image processing apparatus of the present exemplary
embodiment.
FIG. 11 is a diagram illustrating an advantageous
effect of display performed by the image processing
20 apparatus of the present exemplary embodiment.
DESCRIPTION OF EXEMPLARY EMBODIMENTS
[0020]
First, an example of a hardware configuration of an
25 apparatus of the present exemplary embodiment will be
described. Each unit included in the apparatus of the
present exemplary embodiment is constituted by any
10
combination of hardware and software based on a central
processing unit (CPU), a memory, a program loaded into the
memory, a storage unit (which can also store a program
downloaded from a recording medium such as a compact disc
(CD), a server on the Internet, or the like, in addition t5 o
a program stored from a step of shipping an apparatus in
advance) such as a hard disk having the program stored
thereon, and an interface for network connection of any
computer. It will be understood by those skilled in the art
10 that constitution methods and apparatuses thereof may be
modified in various ways.
[0021]
FIG. 1 is a diagram conceptually illustrating an
example of a hardware configuration of the apparatus of the
15 present exemplary embodiment. As shown in the drawing, the
apparatus of the present exemplary embodiment includes, for
example, a CPU 1A, a random access memory (RAM) 2A, a read
only memory (ROM) 3A, a display control unit 4A, a display
5A, an operation receiving unit 6A, an operating unit 7A,
20 a communication unit 8A, an auxiliary storage apparatus 9A,
a camera 10A, and the like which are connected to each other
through a bus 11A. Note that although not shown in the
drawing, the apparatus may include other elements such as
an input and output interface connected to an external device
25 in a wired manner, a microphone, and a speaker, in addition
thereto.
[0022]
11
The CPU 1A controls the entire computer of the apparatus
together with each element. The ROM 3A includes an area for
storing programs for operating the computer, various
application programs, various setting data used when these
programs operate, and the like. The RAM 2A includes an area5 ,
such as a work area in order for programs to operate, in which
data is temporarily stored. The auxiliary storage
apparatus 9A is, for example, a hard disc drive (HDD), and
can store high-capacity data.
10 [0023]
The display 5A is, for example, a transmission-type
display (transparent display) constituted by a
light-transmissive member. That is, the view beyond the
display 5A is seen through the display. In a case where a
15 display image is displayed on such a display 5A, the display
image is superimposed before the view beyond the display 5A
in the field of vision of a user who observes the display
5A. It should be noted that the display 5A may be a head
mounted display. In this case, a transmission-type display
20 is provided at a lens portion of goggles or spectacles.
[0024]
The display control unit 4A performs various screen
displays by reading out data stored in a video RAM (VRAM),
performing a predetermined process on the read-out data, and
25 then sending the data to the display 5A. The operation
receiving unit 6A receives various operations through the
operating unit 7A. The operating unit 7A includes an
12
operation key, an operation button, a switch, a jog dial,
and the like. Note that the operation receiving unit 6A may
receive a predetermined gesture, performed in front of the
camera 10A, as a predetermined operation.
[00255 ]
The communication unit 8A is connected to a network such
as the Internet or a local area network (LAN) in a wired and/or
wireless manner, and communicates with other electronic
apparatuses.
10 [0026]
Hereinafter, the exemplary embodiments will be
described. Note that each functional block diagram which
is used in the description of the following exemplary
embodiments represents a function-based block rather than
15 a hardware-based configuration. In the drawings, each
apparatus is described to be constituted by one apparatus,
but its constitution unit is not limited thereto. That is,
the respective apparatuses may be physically separated, and
may be logically separated. Note that the same components
20 are denoted by the same reference numerals and signs, and
thus the description thereof will not be repeated.
[0027]

First, the outline of the present exemplary embodiment
25 will be described. An image processing apparatus of the
present exemplary embodiment analyzes an image captured so
as to include a user's field of vision, and retrieves a
13
predetermined identification code represented by a figure
or the like. In a case where an identification code is
specified within the captured image, the image processing
apparatus notifies a user of the specified identification
code5 .
[0028]
A transmission-type display is used in a notification
unit of the present exemplary embodiment. The
transmission-type display is located in front of a user, and
10 is configured to allow a predetermined image to be displayed
so as to be superimposed on the user's field of vision. In
such a case, in the user's field of vision, the predetermined
image displayed on the transmission-type display is
superimposed on the view in front of the user. In the user's
15 field of vision, the image processing apparatus displays a
display image, having emphasis information (for example,
predetermined mark) displayed at a position corresponding
to the specified identification code, on the
transmission-type display.
20 [0029]
According to such an image processing apparatus, it is
possible for a user to easily recognize an identification
code specified by the image processing apparatus, on the
basis of information within the field of vision, that is,
25 a correspondence relation between emphasis information and
an identification mark present within the field of vision.
[0030]
14
Next, the configuration of an image processing
apparatus 10 of the present exemplary embodiment will be
described in detail. FIG. 2 shows an example of a functional
block diagram of the image processing apparatus 10 of the
present exemplary embodiment. As shown in the drawing, 5 the
image processing apparatus 10 includes a display image
generation unit 11, a display unit 12, an imaging unit 13,
and a recognition unit 14.
[0031]
10 The display unit 12 displays a display image so as to
be superimposed on a user's field of vision. Specifically,
the display unit 12 displays a display image so as to be
superimposed on the view in front of a user which is present
in a user's field of vision. The display unit 12 includes
15 a transmission-type display. The display unit 12 displays
a display image on the transmission-type display located in
front of a user. With such a configuration, in a user's
field of vision, the display image is superimposed on the
view in front of the user which is present in the user's field
20 of vision.
[0032]
The transmission-type display may be a wearable
apparatus worn by a user, for example, a head mounted display.
An example is schematically shown in FIG. 3. FIG. 3 shows
25 a spectacles-type head mounted display. A lens portion 20
is constituted by a transmission-type display.
[0033]
15
Referring back to FIG. 2, the display image generation
unit 11 generates a display image. Though described in
detail below, the result of image analysis performed by the
recognition unit 14 is input to the display image generation
unit 11. The display image generation unit 11 generates 5 a
display image on the basis of the result. The display image
generated by the display image generation unit 11 is input
to the display unit 12. The display unit 12 displays the
display image so as to be superimposed on a user's field of
10 vision.
[0034]
In a case of the example of FIG. 3, the display image
generation unit 11 may be constituted by, for example, a
computer located within a processing apparatus 22.
15 Communication between the display image generation unit 11
and the display unit 12 is realized by any communication
standard in a wired and/or wireless manner.
[0035]
Referring back to FIG. 2, the imaging unit 13 generates
20 a captured image so as to include a user's field of vision.
The imaging unit 13 (camera) is configured to capture an
image of in the forward direction of a user (facing direction
of a user). For example, the imaging unit 13 is configured
such that its lens faces in the forward direction of a user.
25 In addition, the imaging unit 13 is configured to have the
direction of the lens changed in accordance with a change
in the direction of a user's face.
16
[0036]
For example, a camera is installed on an object worn
on the head of a user in a predetermined direction, thereby
allowing the configuration as described above to be realized.
In a case of the example of FIG. 3, a camera 21 is installe5 d
onto a head mounted display worn on a user's face. The
camera 21 is installed so as to capture an image in the forward
direction of a user (facing direction of a user). In a case
of this example, when the direction of a user's face changes,
10 the direction of the lens of the camera 21 also changes so
as to face the same direction in accordance therewith.
[0037]
Referring back to FIG. 2, the recognition unit 14
analyzes an image captured by the imaging unit 13, and
15 specifies identification codes included in (appearing in)
the captured image. In a case where plural identification
codes are present in the captured image, the recognition unit
14 can specify the plural identification codes. In a case
of the example of FIG. 3, the recognition unit 14 may be
20 constituted by, for example, a computer located within the
processing apparatus 22. Communication between the imaging
unit 13 and the recognition unit 14 is realized by any
communication standard in a wired and/or wireless manner.
[0038]
25 An identification code represented by a figure or the
like is attached to each object to be tested. For example,
a one-dimensional code such as a bar code or a
17
two-dimensional code such as a QR code (Registered
Trademark) is attached to the test object. An
identification code represented by a figure or the like is
included in the image obtained by capturing such a test
object. The recognition unit 14 holds, in advance, th5 e
feature of the outer appearance of the identification code
represented by a figure or the like. The recognition unit
14 specifies a place in which the feature is shown up within
the captured image.
10 [0039]
The outer appearances of the identification codes have
peculiarities according to respective standards. The
identification codes have respective different outer
appearances in their details while satisfying the
15 requirements of standards, and thus are distinguishable from
each other. In this manner, a common feature and features
different from each other are present in the outer
appearances of plural identification codes. A feature used
in a process of specifying identification codes included in
20 the captured image may be set to a feature common to plural
identification codes.
[0040]
The recognition unit 14 inputs the analysis result of
the captured image, that is, information indicating a
25 position within the captured image of each determined
identification code to the display image generation unit 11.
[0041]
18
The display image generation unit 11 generates a
display image on the basis of the information which is input
from the recognition unit 14. Specifically, the display
image generation unit 11 generates a display image having
emphasis information displayed at a position correspondin5 g
to a specified identification code in a user's field of
vision. In a case where the recognition unit 14 has
specified plural identification codes, the display image
generation unit 11 generates a display image having the
10 emphasis information displayed at a position corresponding
to each of the plural identification codes.
[0042]
In a case where the display unit 12 displays a display
image, the display image is superimposed on the view in front
15 of a user, in the user's field of vision. An identification
code which is actually present in front and emphasis
information which is displayed as a display image are
included in the user's field of vision. The "position
corresponding to a specified identification code" at which
20 emphasis information is displayed includes every position
at which a user can intuitively recognize that the specified
identification code and the emphasis information correspond
to each other, on the basis of the information within the
field of vision. For example, within the field of vision,
25 display may be performed at a position where the
identification code and the emphasis information are
superimposed on each other, and display may be performed so
19
that the emphasis information is located around the
identification code.
[0043]
The emphasis information may be able to be emphasized
within a user's field of vision, and can be constituted by5 ,
for example, arrows, other figures, signs, characters,
numbers, marks, photos, and the like.
[0044]
The display image generation unit 11 holds, in advance,
10 a conversion rule (such as, for example, a conversion
expression constituted by a matrix or the like) for
converting coordinates within an image captured by the
imaging unit 13 into coordinates within a display image
displayed on a transmission-type display. In a case where
15 information indicating a position within the captured image
of each specified identification code is acquired from the
recognition unit 14, the position of each identification
code is converted into the coordinates within a display image
in accordance with the conversion rule. The display image
20 generation unit 11 generates a display image having emphasis
information disposed at a position corresponding to the
coordinates after conversion.
[0045]
The conversion rule may be generated on the basis of
25 parameters such as the direction of the lens or the
distortion of the lens of the imaging unit 13 (camera), the
direction of a transmission-type display (lens portion 20
20
of a head mounted display), a relative positional
relationship between the imaging unit 13 and the
transmission-type display, or a relative positional
relationship between the transmission-type display and a
user's eyes. In a case of the head mounted display show5 n
in FIG. 3, these parameters are determined in advance.
Therefore, the conversion rule can be created in advance,
and be held in the display image generation unit 11. Note
that a unit that converts the coordinates within a captured
10 image into the coordinates within a display image can be
realized according to the related art, and thus a detailed
description thereof herein will not be given.
[0046]
Here, reference will be made to FIGS. 3 and 4 to describe
15 an example of a display image which is generated by the
display image generation unit 11 and display of a display
image which is performed by the display unit 12.
[0047]
FIG. 4(1) shows a user's field of vision through a
20 see-through-type display in a state where a display image
is not displayed. This corresponds to the user's field of
vision of FIG. 3. A work table and four test objects placed
on the work table are present in the user's field of vision.
An identification code (bar code) A represented by a figure
25 or the like is attached to each of the four test objects.
[0048]
FIG. 4(2) is a display image generated by the display
21
image generation unit 11. In the example, figures having
a rectangular shape are displayed as emphasis information
B. In the display image, portions other than portions in
which the emphasis information B is displayed are
transparent. The display image is displayed on th5 e
see-through-type display, that is, the lens portion 20 of
FIG. 3.
[0049]
FIG. 4(3) shows a user's field of vision through the
10 see-through-type display in a state where the display image
is displayed. The display image (FIG. 4(2)) is superimposed
on the view in front of a user (FIG. 4(1)). The emphasis
information B is present at a position corresponding to the
identification code A.
15 [0050]
A user can intuitively recognize that the
identification codes A of all the four test objects present
in front are specified by the image processing apparatus 10,
on the basis of the field of vision as shown in FIG. 4(3).
20 [0051]
Note that, as described above, the position
corresponding to the identification code A at which the
emphasis information B is displayed may be a position
enabling a user to intuitively recognize the emphasis
25 information B and the identification code A corresponding
to each other. As shown in FIG. 4(3), the emphasis
information B may contain the identification code A, and the
22
emphasis information B may be superimposed on the
identification code A. In addition, the emphasis
information B may be located around the identification code
A. Besides, the emphasis information B may emphatically
display a test object to which the identification code A 5 is
attached, in addition to emphasis display of the
identification code A (see FIG. 11). These premises are the
same as those in all the following exemplary embodiments.
In addition, these premises for the emphasis information B
10 are also the same as those in emphasis information C which
will be described in a second exemplary embodiment.
[0052]
Next, an example of a flow of processes of the image
processing apparatus 10 of the present exemplary embodiment
15 will be described with reference to the flow diagram of FIG.
5.
[0053]
In a case where the imaging unit 13 captures an image
in the forward direction of a user (facing direction of a
20 user), and generates a captured image so as to include the
user's field of vision (S10), the recognition unit 14
analyzes the captured image, and performs a process of
specifying an identification code represented by a figure
or the like (S11). In a case where an identification code
25 is not present within the captured image (No of S12), the
process proceeds to S15.
[0054]
23
In a case where an identification code is present within
the captured image (Yes of S12), the recognition unit 14
inputs information indicating a position within the captured
image of each determined identification code to the display
image generation unit 11. The display image generation uni5 t
11 generates a display image having the emphasis information
displayed at a position corresponding to the specified
identification code in the user's field of vision, on the
basis of the information (S13). The display unit 12
10 displays the display image generated in S13 so as to be
superimposed on the user's field of vision (S14).
Thereafter, the process proceeds to S15.
[0055]
In S15, it is determined whether an instruction for
15 terminating the process is inputted. In a case where the
instruction is not inputted (No of S15), the process return
to S10, and the same process is repeated by acquiring the
next captured image. On the other hand, in a case where the
instruction is inputted (Yes of S15), the process is
20 terminated.
[0056]
The image processing apparatus 10 of the present
exemplary embodiment described above can display the display
image so as to be superimposed on the user's field of vision,
25 using the see-through-type display. In such a case, the
display image displayed on the transmission-type display is
superimposed on the view in front of a user, in the user's
24
field of vision. In a case where the image processing
apparatus 10 captures an image in the forward direction of
a user (facing direction of a user), and specifies
identification codes within the captured image generated so
as to include the user's field of vision, the apparatus ca5 n
generate a display image having the emphasis information
displayed at a position corresponding to the specified
identification code, and display the generated image on the
see-through-type display.
10 [0057]
According to such an image processing apparatus 10, it
is possible to emphatically display the specified
identification code in the user's field of vision in which
the view in front of the user and the display image are
15 superimposed on each other. Therefore, it is possible for
a user to intuitively recognize an identification code
specified by the image processing apparatus 10 from
information within his or her field of vision.
[0058]
20 In addition, in a case where plural identification
codes are present within the captured image, the image
processing apparatus 10 of the present exemplary embodiment
can specify these identification codes, and perform a
recognition process on the respective identification codes.
25 It is possible to emphatically display each specified
identification code. In this manner, according to the
present exemplary embodiment in which plural identification
25
codes can be collectively processed, work efficiency is
improved. In addition, in a case of the present exemplary
embodiment, even in a case where plural identification codes
are present in front of a user, it is possible for the user
to intuitively recognize which identification code th5 e
analysis result of the image processing apparatus 10
corresponds to.
[0059]
In this manner, according to the image processing
10 apparatus 10 of the present exemplary embodiment, in an
apparatus that analyzes a captured image potentially
including identification codes, and provides the result to
a user, it is possible for the user to easily recognize which
identification code the provided analysis result
15 corresponds to.
[0060]

An image processing apparatus 10 of the present
exemplary embodiment is different from that of first
20 exemplary embodiment, in that recognition results for the
specified identification codes are displayed in a
distinguishable mannerｎ. Other configurations are the
same as those of the first exemplary embodiment.
[0061]
25 FIG. 2 shows a functional block diagram of the image
processing apparatus 10 of the present exemplary embodiment,
as is the case with the first exemplary embodiment. The
26
configurations of the display unit 12 and the imaging unit
13 are the same as those of the first exemplary embodiment.
[0062]
As described in the first exemplary embodiment, the
recognition unit 14 specifies identification code5 s
represented by a figure or the like appearing in the captured
image. The recognition unit 14 deciphers each of the
specified identification codes. That is, the recognition
unit 14 deciphers a pattern of the identification code
10 represented by a figure or the like, and recognizes
information (for example, identification code consisting of
a combination of numbers or characters) corresponding to the
pattern. In a case where plural identification codes appear
in the captured image, the recognition unit 14 specifies the
15 plural identification codes, and performs a process of
recognition on the respective identification codes.
[0063]
The recognition unit 14 associates information
indicating whether the identification code is recognized
20 with information indicating a position within the captured
image of each specified identification code, and inputs the
result to the display image generation unit 11.
[0064]
The wording "the identification code is recognized"
25 means that the identification code represented by a figure
or the like is deciphered, and that information
corresponding to the pattern has been recognized. The
27
wording "the identification code is not recognized" means
that a process of deciphering the identification code
represented by a figure or the like is performed, but
information corresponding to the pattern has not been
recognized. The identification code may not be able to b5 e
recognized, for example, due to the reason that "the
identification code appearing in the captured image is small,
and its detailed pattern is obscured", "a portion of the
pattern does not appear in the captured image by the
10 superimposition of another object", "a portion in which the
pattern is obscured is present due to the light reflection
condition", or the like.
[0065]
As is the case with the first exemplary embodiment, the
15 display image generation unit 11 generates a display image
having the emphasis information displayed at a position
corresponding to the specified identification code in the
user's field of vision. The display image generation unit
11 generates a display image in which an identification code
20 recognized by the recognition unit 14 and an identification
code which is not recognized are distinguishable from each
other. A method of displaying these identification codes
in a distinguishable manner is not particularly limited.
[0066]
25 Here, reference will be made to FIG. 6 to describe an
example of a display image which is generated by the display
image generation unit 11 and display of a display image which
28
is performed by the display unit 12.
[0067]
FIG. 6(1) shows a user's field of vision through a
see-through-type display in a state where a display image
is not displayed. This corresponds to the user's field o5 f
vision of FIG. 3. A work table and four test objects placed
on the work table are present in the user's field of vision.
An identification code (bar code) A represented by a figure
or the like is attached to each of the four test objects.
10 [0068]
FIG. 6(2) is a display image generated by the display
image generation unit 11. In the example, emphasis
information B and emphasis information C which are
distinguishable from each other are displayed. The
15 emphasis information B is a rectangular shape of a solid line,
whereas the emphasis information C is a rectangle of a dotted
line. The emphasis information B is displayed at a position
corresponding to the identification code A recognized by the
recognition unit 14. On the other hand, the emphasis
20 information C is displayed at a position corresponding to
the identification code A which is specified by the
recognition unit 14 but is not recognized.
[0069]
In the display image, portions other than portions in
25 which the emphasis information B and the emphasis
information C are displayed are transparent. The display
image is displayed on the see-through-type display, that is,
29
the lens portion 20 of FIG. 3.
[0070]
FIG. 6(3) shows a user's field of vision through the
see-through-type display in a state where the display image
is displayed. The display image (FIG. 6(2)) is superimpose5 d
on the view in front of a user (FIG. 6(1)). The emphasis
information B and the emphasis information C are present at
positions corresponding to the identification codes A.
Note that the emphasis information B is displayed at a
10 position corresponding to the identification code
recognized by the recognition unit 14, and the emphasis
information C is displayed at a position corresponding to
the identification code which is not recognized by the
recognition unit 14.
15 [0071]
A user can intuitively recognize that the
identification codes A of all the four test objects present
in front are specified by the image processing apparatus 10,
on the basis of the field of vision as shown in FIG. 6(3).
20 In addition, it is possible to intuitively recognize that
the identification code A on the right-hand side of the back
corresponding to the emphasis information C is not
recognized by the image processing apparatus 10, and that
other identification codes A corresponding to the emphasis
25 information B are recognized by the image processing
apparatus 10.
[0072]
30
Next, an example of a flow of processes of the image
processing apparatus 10 of the present exemplary embodiment
will be described with reference to the flow diagram of FIG.
7.
[00735 ]
In a case where the imaging unit 13 captures an image
in the forward direction of a user (facing direction of a
user), and generates a captured image so as to include the
user's field of vision (S20), the recognition unit 14
10 analyzes the captured image, and performs a process of
identifying an identification code represented by a figure
or the like (S21). In a case where an identification code
is not present within the captured image (No of S22), the
process proceeds to S26.
15 [0074]
In a case where the identification code is present
within the captured image (Yes of S22), the recognition unit
14 performs a process of recognition on the specified
identification code (S23). The recognition unit 14
20 associate information indicating whether the
identification code is recognized with information
indicating a position within the captured image of each
specified identification code, and inputs the result to the
display image generation unit 11. The display image
25 generation unit 11 generates a display image which has
emphasis information displayed at a position corresponding
to the specified identification code in the user's field of
31
vision, on the basis of the information and in which the
recognized identification code and the unrecognized
identification code are distinguishable from each other
(S24).
[00755 ]
The display unit 12 displays the display image
generated in S24 so as to be superimposed on the user's field
of vision (S25). Thereafter, the process proceeds to S26.
[0076]
10 In S26, it is determined whether an instruction for
terminating the process is inputted. In a case where the
instruction is not inputted (No of S26), the process return
to S20, and the same process is repeated by acquiring the
next captured image. On the other hand, in a case where the
15 instruction is inputted (Yes of S26), the process is
terminated.
[0077]
According to the present exemplary embodiment
described above, it is possible to realize the same
20 advantageous effect as that of the first exemplary
embodiment. In addition, according to the present
exemplary embodiment, it is possible for a user to
intuitively recognize whether each identification code
present in the field of vision is recognized by the image
25 processing apparatus 10.
[0078]
Therefore, it is possible for a user to move a test
32
object to which the recognized identification code is
attached, that is, a test object of which information has
been read off the work table, to leave only a test object
to which the unrecognized identification code is attached
on the work table, and to perform a recognition process again5 .
In addition, it is possible for a user to move the test object
to which the unrecognized identification code is attached
to a position where an image of the test object can be easily
captured, and to perform the recognition process again. As
10 a result, the unrecognized identification code can be
recognized in the next process.
[0079]
In this manner, according to the present exemplary
embodiment, it is possible for a user to intuitively
15 recognize the test object to which the recognized
identification code is attached and the test object to which
the unrecognized identification code is attached, and to
appropriately cope with the respective test objects. As a
result, inspection efficiency is improved.
20 [0080]

An image processing apparatus 10 of the present
exemplary embodiment is different from those of the first
and second exemplary embodiments, in that only the
25 recognized identification code is emphatically displayed.
Other configurations are the same as those of the first and
second exemplary embodiments.
33
[0081]
FIG. 2 shows a functional block diagram of the image
processing apparatus 10 of the present exemplary embodiment,
as are the cases with the first and second exemplary
embodiments. The configurations of the display unit 12 an5 d
the imaging unit 13 are the same as those of the first and
second exemplary embodiments.
[0082]
As described in the first exemplary embodiment, the
10 recognition unit 14 specifies identification codes
represented by a figure or the like appearing in the captured
image. In addition, as described in the second exemplary
embodiment, the recognition unit 14 performs a process of
recognition on the specified identification code. In a case
15 where plural identification codes appear in the captured
image, the recognition unit 14 specifies the plural
identification codes, and performs a process of recognition
on the respective identification codes.
[0083]
20 The recognition unit 14 inputs information indicating
a position within the captured image of each identification
code which is specified and is recognized, to the display
image generation unit 11. Note that, as described in the
second exemplary embodiment, the recognition unit 14 may
25 associate information indicating whether the
identification code is recognized with information
indicating a position within the captured image of each
34
specified identification code, and input the result to the
display image generation unit 11.
[0084]
The display image generation unit 11 generates a
display image having the emphasis information displayed a5 t
a position corresponding to the identification code
recognized by the recognition unit 14 in the user's field
of vision. The emphasis information is not displayed at a
position corresponding to the identification code which is
10 specified by the recognition unit 14 but is not recognized.
[0085]
Here, reference will be made to FIG. 8 to describe an
example of a display image which is generated by the display
image generation unit 11 and display of a display image which
15 is performed by the display unit 12.
[0086]
FIG. 8(1) shows a user's field of vision through a
see-through-type display in a state where a display image
is not displayed. This corresponds to the user's field of
20 vision of FIG. 3. A work table and four test objects placed
on the work table are present in the user's field of vision.
An identification code (bar code) A represented by a figure
or the like is attached to each of the four test objects.
[0087]
25 FIG. 8(2) is a display image generated by the display
image generation unit 11. In the example, the emphasis
information B is displayed. The emphasis information B is
35
displayed at a position corresponding to the identification
code A recognized by the recognition unit 14. In the display
image, portions other than portions in which the emphasis
information B is displayed are transparent. The display
image is displayed on the see-through-type display, that is5 ,
the lens portion 20 of FIG. 3.
[0088]
FIG. 8(3) shows a user's field of vision through the
see-through-type display in a state where the display image
10 is displayed. The display image (FIG. 8(2)) is superimposed
on the view in front of a user (FIG. 8(1)). The emphasis
information B is present at a position corresponding to the
identification code A recognized by the recognition unit 14.
[0089]
15 A user can intuitively recognize that three
identification codes A corresponding to the emphasis
information B among four test objects present in the front
are recognized by the image processing apparatus 10, on the
basis of the field of vision as shown in FIG. 8(3).
20 [0090]
Next, an example of a flow of processes of the image
processing apparatus 10 of the present exemplary embodiment
will be described with reference to the flow diagram of FIG.
7.
25 [0091]
In a case where the imaging unit 13 captures an image
in the forward direction of a user (facing direction of a
36
user), and generates a captured image so as to include the
user's field of vision (S20), the recognition unit 14
analyzes the captured image, and performs a process of
specifying an identification code represented by a figure
or the like (S21). In a case where an identification cod5 e
is not present within the captured image (No of S22), the
process proceeds to S26.
[0092]
In a case where the identification code is present
10 within the captured image (Yes of S22), the recognition unit
14 performs a process of recognition on the specified
identification code (S23). The recognition unit 14 inputs,
for example, information indicating a position within the
captured image of each recognized identification code to the
15 display image generation unit 11. The display image
generation unit 11 generates a display image having the
emphasis information displayed at a position corresponding
to the recognized identification code in the user's field
of vision, on the basis of the information (S24).
20 [0093]
The display unit 12 displays the display image
generated in S24 so as to be superimposed on the user's field
of vision (S25). Thereafter, the process proceeds to S26.
[0094]
25 In S26, it is determined whether an instruction for
terminating the process is inputted. In a case where the
instruction is not inputted (No of S26), the process return
37
to S20, and the same process is repeated by acquiring the
next captured image. On the other hand, in a case where the
instruction is inputted (Yes of S26), the process is
terminated.
[00955 ]
According to the present exemplary embodiment
described above, it is possible to realize the same
advantageous effect as those of the first and second
exemplary embodiments. In addition, according to the
10 present exemplary embodiment, it is possible for a user to
intuitively recognize which identification code of those
present in the field of vision is recognized by the image
processing apparatus 10.
[0096]
15 Therefore, it is possible for a user to move a test
object to which the recognized identification code is
attached, that is, a test object of which information has
been read off the work table, to leave only a test object
to which the unrecognized identification code is attached
20 on the work table, and to perform a recognition process again.
In addition, it is possible for a user to move the test object
to which the unrecognized identification code is attached
to a position where an image of the test object can be easily
captured, and to perform the recognition process again. As
25 a result, the unrecognized identification code can be
recognized in the next process.
[0097]
38
In this manner, according to the present exemplary
embodiment, it is possible for a user to intuitively
recognize the test object to which the recognized
identification code is attached and the test object to which
the unrecognized identification code is attached, and t5 o
appropriately cope with the respective test objects. As a
result, inspection efficiency is improved.
[0098]

10 An image processing apparatus 10 of the present
exemplary embodiment is different from those of the first
to third exemplary embodiments, in that only an
identification code which is not able to be recognized is
emphatically displayed. Other configurations are the same
15 as those of the first to third exemplary embodiments.
[0099]
FIG. 2 shows a functional block diagram of the image
processing apparatus 10 of the present exemplary embodiment,
as are the cases with the first to third exemplary
20 embodiments. The configurations of the display unit 12 and
the imaging unit 13 are the same as those of the first to
third exemplary embodiments.
[0100]
As described in the first exemplary embodiment, the
25 recognition unit 14 specifies identification codes
represented by a figure or the like appearing in the captured
image. In addition, as described in the second exemplary
39
embodiment, the recognition unit 14 performs a process of
recognition on the specified identification code. In a case
where plural identification codes appear in the captured
image, the recognition unit 14 specifies the plural
identification codes, and performs a process of recognitio5 n
on the respective identification codes.
[0101]
The recognition unit 14 inputs information indicating
a position within the captured image of each identification
10 code which is specified but is not recognized, to the display
image generation unit 11. Note that, as described in the
second exemplary embodiment, the recognition unit 14 may
associate information indicating whether the
identification code is recognized with information
15 indicating a position within the captured image of each
determined identification code, and input the result to the
display image generation unit 11.
[0102]
The display image generation unit 11 generates a
20 display image having the emphasis information displayed at
a position corresponding to an identification code which is
specified by the recognition unit 14 but is not recognized
in the user's field of vision. The emphasis information is
not displayed at a position corresponding to an
25 identification code which is specified by the recognition
unit 14 and is recognized.
[0103]
40
Here, reference will be made to FIG. 9 to describe an
example of a display image which is generated by the display
image generation unit 11 and display of a display image which
is performed by the display unit 12.

WE CLAIM:
1. An image processing apparatus comprising:
a display image generation unit that generates a display
image;
a display unit that displays the display image so as
to be superimposed on a user's field of vision5 ;
an imaging unit that generates a captured image so as
to include the user's field of vision; and
a recognition unit that analyzes the captured image,
and specifies an identification code included in the captured
10 image,
wherein the display image generation unit generates the
display image having emphasis information displayed at a
position corresponding to the specified identification code
in the user's field of vision.
2. The image processing apparatus according to claim 1,
wherein the recognition unit performs a process of
recognition on the specified identification code, and
the display image generation unit generates the display
5 image in which a recognized identification code and an
unrecognized identification code are distinguishable from
each other.
3. The image processing apparatus according to claim 1 or
2, wherein in a case where a plurality of identification codes
58
are included in the captured image, the recognition unit
specifies the plurality of identification codes, and
the display image generation unit generates the displa5 y
image having the emphasis information displayed at a position
corresponding to each of the plurality of specified
identification codes in the user's field of vision.
4. An image processing apparatus comprising:
a display image generation unit that generates a display
image;
a display unit that displays the display image so as
5 to be superimposed on a user's field of vision;
an imaging unit that generates a captured image so as
to include the user's field of vision; and
a recognition unit that analyzes the captured image,
specifies an identification code included in the captured
10 image, and performs a process of recognition on the specified
identification code,
wherein the display image generation unit generates the
display image having emphasis information displayed at a
position corresponding to a recognized identification code
15 or a position corresponding to an unrecognized
identification code in the user's field of vision.
5. The image processing apparatus according to claim 4,
wherein in a case where a plurality of identification codes
is included in the captured image, the recognition unit
59
specifies the plurality of identification codes, and
performs a process of recognition on the respectiv5 e
identification codes, and
the display image generation unit generates the display
image having the emphasis information displayed at a position
corresponding to each of a plurality of recognized
10 identification codes or a position corresponding to each of
a plurality of unrecognized identification codes in the
user's field of vision.
6. The image processing apparatus according to any one of
claims 1 to 5, further comprising an input receiving unit
that receives a start instruction input from a user,
wherein the imaging unit starts to generate the captured
5 image in accordance with the start instruction input,
the recognition unit starts to analyze the captured
image in accordance with the generation of the captured
image,
the display image generation unit starts to generate
10 the display image in accordance with generation of a result
of the analysis of the captured image, and
the display unit starts to display the display image
in accordance with the generation of the display image.
7. The image processing apparatus according to any one of
claims 1 to 6, wherein the display unit includes a
transmission-type display, and displays the display image
60
on the transmission-type display.
8. The image processing apparatus according to any one of
claims 1 to 7, wherein the display unit includes a head
mounted display, and displays the display image on the head
mounted display.
9. An image processing method executed by a computer, the
method comprising:
a display image generation step of generating a display
image;
a display step of displaying the display image so a5 s
to be superimposed on a user's field of vision;
an imaging step of generating a captured image so as
to include the user's field of vision; and
a recognition step of analyzing the captured image and
10 specifying an identification code included in the captured
image,
wherein the display image generation step includes
generating the display image having emphasis information
displayed at a position corresponding to the specified
15 identification code in the user's field of vision.
11. An image processing method executed by a computer, the
method comprising:
a display image generation step of generating a display
image;
5 a display step of displaying the display image so as
to be superimposed on a user's field of vision;
an imaging step of generating a captured image so as
to include the user's field of vision; and
a recognition step of analyzing the captured image,
10 specifying an identification code included in the captured
image, and performing a process of recognition on the
specified identification code,
wherein the display image generation step includes
generating the display image having emphasis information
15 displayed at a position corresponding to a recognized
identification code or a position corresponding to an
62
unrecognized identification code in the user's field of
vision.