FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
[See section 10, Rule 13]
DIAGNOSTIC SYSTEM, CONTROL DEVICE, DIAGNOSTIC METHOD, AND
DIAGNOSTIC PROGRAM;
MITSUBISHI ELECTRIC CORPORATION, A CORPORATION ORGANISED
AND EXISTING UNDER THE LAWS OF JAPAN, WHOSE ADDRESS IS 7-
3, MARUNOUCHI 2-CHOME, CHIYODA-KU, TOKYO 1008310, JAPAN
THE FOLLOWING SPECIFICATION PARTICULARLY DESCRIBES THE
INVENTION AND THE MANNER IN WHICH IT IS TO BE PERFORMED.
2
DESCRIPTION
TITLE OF THE INVENTION:
DIAGNOSTIC SYSTEM, CONTROL DEVICE, DIAGNOSTIC METHOD, AND
5 DIAGNOSTIC PROGRAM
Field
[0001] The present disclosure relates to a diagnostic
system, a control device, a diagnostic method, and a
10 diagnostic program for diagnosing a machine.
Background
[0002] Some machines used as production facilities in
factories such as numerical control (NC) machine tools are
15 not provided with fitting ports for external storage media
such as a memory card and a universal serial bus (USB)
memory and are limited in connection to a communication
network to prevent data output from the machines to the
outside, in order to prevent leakage of manufacturing
20 technologies of products and parts manufactured using the
machines. Some machines that are required of a sealed
structure, for example, for the reason of the environments
in which the machines are used are not provided with
fitting ports for external storage media and are limited in
25 wired network connection. When such a machine is diagnosed
or maintained, it is difficult to remotely know the states
of the machine, components of the machine, etc. because of
limited means for extracting information from the machine.
[0003] As a technique to present information on a device
30 to the outside for failure diagnosis and maintenance
without using an external storage medium and communication,
Patent Literature 1 discloses a technique to display
information stored in information storage memory of an
3
apparatus as a two-dimensional code to save the user's
trouble.
Citation List
5 Patent Literature
[0004] Patent Literature 1: Japanese Patent Application
Laid-open No. 2013-101367
Summary
10 Technical Problem
[0005] In the technique described in Patent Literature
1, diagnostic information for failure diagnosis and
maintenance is presented using a two-dimensional code.
However, the amount of information that can be converted
15 into a two-dimensional code is limited, and thus the amount
of information may be insufficient for failure diagnosis.
Therefore, it is desirable to increase the amount of
information of diagnostic information that can be
presented.
20 [0006] The present disclosure has been made in view of
the above. It is an object of the present disclosure to
provide a diagnostic system that can increase the amount of
information of diagnostic information that can be
presented.
25
Solution to Problem
[0007] In order to solve the above-stated problems and
achieve the object, a diagnostic system according to the
present disclosure comprises: a control device to control a
30 machine, generate a plurality of pieces of divided data by
dividing output data to be used for at least one of
diagnosis or maintenance of the machine, generate
transmission data with data identification information that
4
is identification information on the output data and
division information indicating order of the plurality of
pieces of divided data added to each of the pieces of
divided data, convert the transmission data into a two5 dimensional code, and display the two-dimensional code; and
a server to receive captured image data that is data on an
image in which the displayed two-dimensional code is
captured from an information terminal that has captured the
image, extract the two-dimensional code from the captured
10 image data, decode the extracted two-dimensional code, and
restore the output data from a plurality of pieces of
decoded information obtained by decoding, using the data
identification information and the division information
included in the decoded information.
15
Advantageous Effects of Invention
[0008] The diagnostic system according to the present
disclosure has the effect of being able to increase the
amount of information of diagnostic information that can be
20 presented.
Brief Description of Drawings
[0009] FIG. 1 is a diagram illustrating an exemplary
configuration of a diagnostic system according to a first
25 embodiment.
FIG. 2 is a diagram illustrating an example of a
device data output screen in the first embodiment.
FIG. 3 is a diagram illustrating an example of a twodimensional code display screen in the first embodiment.
30 FIG. 4 is a diagram illustrating an example of data
generated by a transmission data conversion unit and a twodimensional code generation unit of a control device in the
first embodiment.
5
FIG. 5 is a diagram illustrating an example of a
captured image captured by a portable information terminal
in the first embodiment.
FIG. 6 is a diagram illustrating an example of a two5 dimensional code in the first embodiment.
FIG. 7 is a flowchart illustrating an example of
operation of a server in the first embodiment.
FIG. 8 is a diagram illustrating an exemplary
configuration of a computer system that implements the
10 control device in the first embodiment.
FIG. 9 is a diagram illustrating an example of a
device data output screen in a second embodiment.
FIG. 10 is a diagram illustrating an example of data
generated by a transmission data conversion unit and a two15 dimensional code generation unit of a control device in the
second embodiment when compression processing is performed
on output data.
FIG. 11 is a diagram illustrating an example of a twodimensional code output screen in the second embodiment.
20 FIG. 12 is a diagram illustrating an example of a twodimensional code output screen in the second embodiment.
FIG. 13 is a flowchart illustrating an example of
operation of a server in the second embodiment.
FIG. 14 is a diagram illustrating an exemplary
25 configuration of a diagnostic system according to a third
embodiment.
FIG. 15 is a diagram illustrating an example of the
size of a two-dimensional code output screen displayed by a
control device in the third embodiment.
30 FIG. 16 is a diagram illustrating an example of a twodimensional code displayed by the control device in the
first embodiment.
FIG. 17 is a diagram illustrating an example of a two-
6
dimensional code displayed by the control device in the
first embodiment.
FIG. 18 is a diagram illustrating an example of twodimensional codes displayed by the control device in the
5 third embodiment.
FIG. 19 is a diagram illustrating an exemplary
configuration of a diagnostic system according to a fourth
embodiment.
FIG. 20 is a diagram illustrating an example of screen
10 page display switching by an automatic page switching unit
and its time chart in the fourth embodiment.
FIG. 21 is a diagram illustrating an example of a
method of extracting two-dimensional code images when the
images are captured in a video in the fourth embodiment.
15 FIG. 22 is a diagram illustrating an example of a
method of extracting two-dimensional code images when the
images are captured by continuous shooting of still images
in the fourth embodiment.
FIG. 23 is a diagram illustrating an example of a
20 device data output screen in a fifth embodiment.
FIG. 24 is a diagram illustrating an example of data
generated by a transmission data conversion unit and a twodimensional code generation unit of a control device in the
fifth embodiment.
25 FIG. 25 is a flowchart illustrating an example of
operation of a server in the fifth embodiment.
FIG. 26 is a diagram illustrating an exemplary
configuration of a diagnostic system according to a sixth
embodiment.
30 FIG. 27 is a diagram illustrating an example of
feature portions on a two-dimensional code display screen
in the sixth embodiment.
FIG. 28 is a diagram illustrating an example of
7
diagnosis in the diagnostic system of the sixth embodiment.
Description of Embodiments
[0010] Hereinafter, a diagnostic system, a control
5 device, a diagnostic method, and a diagnostic program
according to embodiments will be described in detail with
reference to the drawings.
[0011] First Embodiment.
FIG. 1 is a diagram illustrating an exemplary
10 configuration of a diagnostic system according to a first
embodiment. A diagnostic system 6 of the present
embodiment includes a machine 1, a server 4, and a response
computer 5. The machine 1 of the present embodiment
displays a two-dimensional code indicating diagnostic
15 information that is information to be used for at least one
of the diagnosis of the state of the machine 1 or the
maintenance of the machine 1. The user of the machine 1
captures an image of an area including the two-dimensional
code with a portable information terminal 3 that is an
20 example of an information terminal. The captured image is
transmitted from the portable information terminal 3 to the
server 4. The server 4 acquires the diagnostic information
from the two-dimensional code and outputs the acquired
diagnostic information to the response computer 5. The
25 response computer 5 performs diagnosis and/or maintenance
using the diagnostic information, and presents diagnostic
results to the user. The server 4 and the response
computer 5 constitute a diagnostic apparatus. Although the
server 4 and the response computer 5 are separately
30 provided in FIG. 1, they may be integrated into a
diagnostic apparatus and provided. The portable
information terminal 3 may be included in the diagnostic
system 6.
8
[0012] In the present embodiment, in which the machine 1
displays diagnostic information for diagnosing the state of
the machine 1 in a two-dimensional code as described above,
diagnostic information on the machine 1 can be transmitted
5 to the server 4 even when the machine 1 is not provided
with a fitting port for an external storage medium and is
limited in communication. This allows the diagnostic
system 6 of the present embodiment to perform remote
diagnosis and remote maintenance of the machine 1, and
10 eliminates the need for an expert engineer to go to the
facility installation site to perform maintenance.
[0013] On the other hand, there is a limit to the amount
of information that can be converted into a two-dimensional
code, and thus the amount of information presented may be
15 insufficient. Therefore, the present embodiment also
allows the machine 1 to divide diagnostic information and
convert the divided pieces of diagnostic information into
two-dimensional codes. Consequently, the machine 1 can
increase the amount of information of diagnostic
20 information that can be presented as compared with that
when the division is not performed. When diagnostic
information to be presented can be represented by one twodimensional code, the diagnostic information may not be
divided. That is, the number of divisions when diagnostic
25 information is divided may be one.
[0014] Next, exemplary configurations of devices will be
described. As illustrated in FIG. 1, the machine 1
includes a control device 11, a drive unit 16, and a
machine signal processing unit 17. The machine 1 is, for
30 example, a machine tool that performs machining by
numerical control, but is not limited to this.
[0015] The drive unit 16 drives a motor (not
illustrated) or the like of the machine 1. The machine
9
signal processing unit 17 exchanges machine signals with
machine peripheral equipment 2. The control device 11
controls the drive unit 16 and the machine signal
processing unit 17 to control the operation of the machine
5 1 and the machine peripheral equipment 2. The machine
peripheral equipment 2 is, for example, an operating panel
for controlling the machine 1, and equipment that is
installed as standard in the machine 1 or connected to the
machine 1 and controlled by machine signals from the
10 control device 11, but is not limited to them. Examples of
machine signals obtained by the control device 11 include,
but are not limited to, a signal indicating an input
corresponding to an operation with the operating panel, a
signal from a sensor attached to the machine 1 to detect
15 the state of the machine 1, and signals indicating the
states of the machine peripheral equipment 2.
[0016] The control device 11 includes a screen display
unit 12, a two-dimensional code generation unit 13, a
transmission data conversion unit 14, and a memory 15. The
20 memory 15 stores output data. The output data includes
diagnostic information to be used for at least one of the
diagnosis or maintenance of the machine 1. Examples of the
output data include, but are not limited to, information
indicating the state of the control device 11, operation
25 history information (a log) on the drive unit 16,
information indicating the state of the drive unit 16, and
machine signals obtained by the machine signal processing
unit 17 from the machine peripheral equipment 2. The
memory 15 also stores system information on the machine 1
30 etc. Examples of the system information include, but are
not limited to, the model names and identification
information (such as serial numbers) of the machine 1 and
the control device 11, information on device system
10
components (system specifications), and state information
on connected sensors and system components. Note that FIG.
1 is an example, and diagnostic information on the machine
1 is not limited to control information on the drive unit
5 16, machine signals obtained from the machine peripheral
equipment 2, etc.
[0017] The transmission data conversion unit 14 divides
output data to generate a plurality of pieces of divided
data, and adds data identification information that is
10 identification information on the output data, and division
information indicating the order of the plurality of pieces
of divided data to each of the pieces of divided data.
Specifically, the transmission data conversion unit 14
reads output data stored in the memory 15 of the control
15 device 11, divides the read output data, and converts the
divided output data, which is the output data after the
division, into transmission data in a format determined
with the server 4. For example, the transmission data
conversion unit 14 adds a header and a footer described
20 later to the divided output data. The header includes, for
example, a data name, which is an example of the data
identification information. The header may also include
information indicating the number of divisions, which is an
example of the division information, and a division number,
25 which is an example of the division information, indicating
the order of the divided output data. The transmission
data conversion unit 14 divides the output data, for
example, into pieces of a division size that is a
predetermined data size. However, the pieces of divided
30 output data may not be equal in length. The division
method is not limited to this example. The division size
is, for example, a size obtained by subtracting the data
sizes of the header and the footer from the maximum data
11
size of the output data that can be contained in one twodimensional code. For example, the transmission data
conversion unit 14 determines the number of divisions,
based on a quotient obtained by dividing the data size of
5 the output data by the division size. When the data size
of the output data is divisible by the division size, the
quotient is the number of divisions. When the data size of
the output data is indivisible by the division size, the
number obtained by adding one to the quotient is the number
10 of divisions.
[0018] The two-dimensional code generation unit 13
converts the transmission data received from the
transmission data conversion unit 14 into a two-dimensional
code to generate the two-dimensional code, and outputs the
15 two-dimensional code to the screen display unit 12.
[0019] The screen display unit 12 includes a device data
output unit 121. The device data output unit 121 includes
a two-dimensional code display unit 122. The device data
output unit 121 generates a device data output screen that
20 is a screen to be displayed when the output data on the
machine 1 is output to the outside, and displays the
generated device data output screen. The device data
output screen will be described later. The two-dimensional
code display unit 122 displays the two-dimensional code
25 generated by the two-dimensional code generation unit 13 as
an image. Consequently, the output data stored in the
memory 15 is displayed as the two-dimensional code. Here,
an example in which the output data includes diagnostic
information for diagnosing the state of the machine 1 will
30 be described, but information displayed as a twodimensional code by the machine 1 is not limited to this
example.
[0020] FIG. 2 is a diagram illustrating an example of
12
the device data output screen in the present embodiment.
In the example illustrated in FIG. 2, data A indicates the
output data, that is, the types of the output data or the
data names of the output data, and data B indicates an
5 output destination. Here, the data names of the output
data are the file names of electronic files, but the data
names are not limited to this example. In the example
illustrated in FIG. 2, data to be output is selected from
the pieces of output data displayed as the data A by the
10 user's operation with input means (not illustrated in FIG.
1). Then, the user presses the portion “Transfer A→B” at
the bottom of the device data output screen in FIG. 2 using
the input means, so that the data selected in the data A is
output. The screen display unit 12 may be implemented
15 using, for example, a display integrated with the input
means such as a touch panel. In this case, the user taps
the portion “Transfer A→B”, for example, so that the data
selected in the data A is output.
[0021] In the example illustrated in FIG. 2,
20 “SYSTEM.DAT” that is an electronic file storing system
information on the control device 11 is selected as the
output data, that is, the data A. For example, a machine
that enables output to an external storage medium such as
an SD memory card allows the external storage medium to be
25 specified as the data B, which is the transfer destination,
on the device data output screen. The machine 1 of the
present embodiment does not allow output to an external
storage medium.
[0022] In the present embodiment, when “Transfer A→B” is
30 pressed by the user, a two-dimensional code indicating the
selected output data, that is, a two-dimensional code into
which the output data is converted is displayed. FIG. 3 is
a diagram illustrating an example of a two-dimensional code
13
display screen in the present embodiment. In the example
illustrated in FIG. 3, a quick response (QR) code
(registered trademark) indicating the output data is
displayed as an example of the two-dimensional code. The
5 user captures an image of an area including the displayed
two-dimensional code using the portable information
terminal 3, and causes data including a captured image
obtained by capturing the image to be transmitted from the
portable information terminal 3 to the server 4. Thus, the
10 portable information terminal 3 can transmit the output
data on the machine 1 to the server 4.
[0023] Return to the description of FIG. 1. As
illustrated in FIG. 1, the portable information terminal 3
includes a camera 31, a captured image memory 32, and a
15 network communication unit 33. The camera 31 captures the
image and stores captured image data indicating the
captured image in the captured image memory 32. The
network communication unit 33 transmits the captured image
data stored in the captured image memory 32 to the server
20 4, for example, by wireless communication. Note that a
communication line between the network communication unit
33 and the server 4 may be wired or wireless, or wired and
wireless communication lines may coexist. In FIG. 1, a
broken line arrow directed from the two-dimensional code
25 display unit 122 to the camera 31 is illustrated. This
broken line arrow means that the camera 31 captures an
image of a two-dimensional code displayed by the twodimensional code display unit 122.
[0024] The server 4 includes a captured image storage
30 unit 41, an image analysis unit 42, a two-dimensional code
decoding unit 43, an output data restoration unit 44, and a
restored data storage unit 45. The server 4 receives the
captured image data, which is data on the captured image of
14
the displayed two-dimensional code, from the portable
information terminal 3 by a communication unit (not
illustrated in FIG. 1). The received captured image data
is stored in the captured image storage unit 41.
5 [0025] The image analysis unit 42 includes a twodimensional code detection unit 421. The two-dimensional
code detection unit 421 extracts the two-dimensional code
from the captured image data. Specifically, the twodimensional code detection unit 421 reads the captured
10 image data received from the portable information terminal
3 from the captured image storage unit 41 on an individual
case basis, cuts out an image corresponding to the twodimensional code from the captured image as the twodimensional code, using the read captured image data, and
15 outputs the cut-out two-dimensional code to the twodimensional code decoding unit 43. A case is a unit in
which the user transmits information to the response
computer 5 for an inquiry to the response computer 5, a
diagnostic request to the response computer 5, etc., and
20 corresponds to output data before being divided by the
above-described transmission data conversion unit 14. For
example, in the example illustrated in FIG. 2, since output
data is selected as the data A on an individual electronic
file basis, the electronic file corresponds to one case.
25 [0026] The two-dimensional code decoding unit 43 decodes
the two-dimensional code extracted from the captured image
data. Specifically, the two-dimensional code decoding unit
43 decodes the two-dimensional code received from the image
analysis unit 42, and outputs decoded information that is
30 the decoding results to the output data restoration unit
44. Thus, the transmission data converted into the twodimensional code by the two-dimensional code generation
unit 13 of the control device 11 of the machine 1 is
15
obtained.
[0027] The output data restoration unit 44 restores the
output data from a plurality of pieces of decoded
information obtained by decoding, using the data
5 identification information and the division information
included in the decoded information. Specifically, the
output data restoration unit 44 restores the output data
using the decoding results decoded from the two-dimensional
code, and stores the restored output data in the restored
10 data storage unit 45. When division numbers are included
in the transmission data in the control device 11 of the
machine 1, pieces of divided output data are connected in
the order of the division numbers to restore the
transmission data. The division information is not limited
15 to division numbers and may be information indicating
times. The output data restoration unit 44 may connect
pieces of divided output data, based on information
indicating times corresponding to the pieces of divided
output data to restore the output data. Information
20 indicating a time is, for example, the reception time
(reception date and time) of captured image data or the
image capturing time (image capturing date and time) of
captured image data. For example, information indicating a
time is added to captured image data, and the output data
25 restoration unit 44 acquires the information indicating the
time from the image analysis unit 42 via the twodimensional code decoding unit 43. When a plurality of
two-dimensional codes are included on one screen page, the
output data restoration unit 44 may determine the division
30 order, based on the disposed positions of the plurality of
two-dimensional codes in addition to the information
indicating the time. For example, the output data
restoration unit 44 may acquire information about the
16
disposed positions of the two-dimensional codes from the
image analysis unit 42 via the two-dimensional code
decoding unit 43, and determine that the leftmost twodimensional code has the lowest division number, and the
5 division number increases toward the right.
[0028] The response computer 5 reads the output data
from the restored data storage unit 45 of the server 4, and
diagnoses the state of the machine 1, based on the
information indicating the state of the control device 11,
10 the operation history information (log) on the drive unit
16, the information indicating the state of the drive unit
16, the machine signals obtained by the machine signal
processing unit 17 from the machine peripheral equipment 2,
etc. included in the output data.
15 [0029] Next, the operation of the present embodiment
will be described. FIG. 4 is a diagram illustrating an
example of data generated by the transmission data
conversion unit 14 and the two-dimensional code generation
unit 13 of the control device 11 in the present embodiment.
20 In the example illustrated in FIG. 4, processing performed
by the transmission data conversion unit 14 is the addition
of a header and a footer, and the number of divisions is
one. FIG. 4 illustrates an example in which “SYSTEM.DAT”
is selected by the user as output data as illustrated in
25 FIG. 2.
[0030] As illustrated in FIG. 4, the transmission data
conversion unit 14 reads the electronic file of
“SYSTEM.DAT” from the memory 15 as output data, adds a
header (transmission header) and a footer (transmission
30 footer) to the read output data, and outputs the data to
the two-dimensional code generation unit 13. In the
example illustrated in FIG. 4, the footer includes the file
name “SYSTEM.DAT”, which is the identification information
17
on the output data, and a numerical value indicating the
page number. In the example illustrated in FIG. 4, the
header and the footer are tags indicating the document
structure. The transmission data conversion unit 14 adds
5 as the header to a portion indicating the
start position of “SYSTEM.DAT”, which is a unit of output
data read from the memory 15, and adds as the
footer to a portion indicating the end of “SYSTEM.DAT”. In
the example illustrated in FIG. 4, the number of divisions
10 is indicated by “PAGES”. “PAGES=1” indicates that the
number of divisions is one, that is, division is not
performed. Furthermore, in the example illustrated in FIG.
4, a division number indicating divided output data that
has been divided is indicated by a page number.
15 indicates the start position of the first page, and
indicates the end position of the first page.
indicates the start position of the output data, that is,
the end position of the header, and indicates the
end position of the output data, that is, the start
20 position of the footer. Note that the format of the
transmission data illustrated in FIG. 4 is an example, and
specific details of the header and the footer are not
limited to this example. Furthermore, as described above,
the transmission data conversion unit 14 may perform
25 processing other than the addition of the header and the
footer on the output data.
[0031] As illustrated in FIG. 4, the two-dimensional
code generation unit 13 converts the transmission data
generated by the transmission data conversion unit 14 into
30 a two-dimensional code. Although FIG. 4 illustrates the
two-dimensional code displayed as an image, the twodimensional code generation unit 13 generates information
indicating the two-dimensional code and outputs the
18
information to the two-dimensional code display unit 122,
and the two-dimensional code display unit 122 displays the
two-dimensional code as an image, whereby the twodimensional code illustrated in FIG. 4 is displayed.
5 [0032] The user captures an image of the two-dimensional
code displayed on the control device 11 using the portable
information terminal 3. The user makes an inquiry about or
a request for diagnosis of the machine 1 to the response
computer 5 when, for example, a failure occurs in the
10 machine 1 or there is a concern about the operation of the
machine 1. At this time, first, the user causes the device
data output screen illustrated in FIG. 2 to be displayed,
and selects output data with the device data output screen
displayed. Which output data to select may be determined
15 according to the nature of diagnosis, or may be specified
from the response computer 5. When the user selects output
data and presses “Transfer A→B”, processing illustrated in
FIG. 4 is performed to display a two-dimensional code.
[0033] FIG. 5 is a diagram illustrating an example of a
20 captured image captured by the portable information
terminal 3 of the present embodiment. When an image is
captured with the camera 31 of the portable information
terminal 3, at least one of tilt or deformation may occur
in the two-dimensional code in the captured image and a
25 portion displayed around the two-dimensional code,
depending on the states of and the positional relationship
between the camera 31 and the display screen on the machine
1 whose image is captured at the time of image capturing.
In the example illustrated in FIG. 5, the two-dimensional
30 code in the captured image is tilted.
[0034] The portable information terminal 3 transmits the
captured image to the server 4. At this time,
supplementary information may be transmitted to the server
19
4 together with captured image data indicating the captured
image. For example, the user operates input means (not
illustrated) to input the supplementary information to the
portable information terminal 3. The supplementary
5 information includes, for example, the subject of an
inquiry or a diagnostic request on an individual case
basis. The supplementary information may further include
text in which details of an inquiry are noted down, a
document for supplementary explanation, an image, an audio
10 file, etc. The captured image of the two-dimensional code
described above may include an image of information
indicating supplementary explanation in addition to the
two-dimensional code. In this case, the captured image
transmitted from the portable information terminal 3
15 includes both the two-dimensional code and the information
indicating the supplementary explanation. The server 4
stores the captured image data received from the portable
information terminal 3 in the captured image storage unit
41. When the supplementary information is transmitted
20 together with the captured image data, the server 4 also
stores the supplementary information in the captured image
storage unit 41 in association with the captured image
data.
[0035] FIG. 6 is a diagram illustrating an example of
25 the two-dimensional code in the present embodiment. FIG. 6
illustrates a QR code as an example of the two-dimensional
code. In a QR code, as illustrated in FIG. 6, squares are
disposed at three of four corners. By detecting three
images of these squares in one QR code from the captured
30 image indicated by the captured image data, the server 4
can detect the position, size, orientation, and tilt of the
QR code included in the image.
[0036] FIG. 7 is a flowchart illustrating an example of
20
operation of the server 4 in the present embodiment. As
illustrated in FIG. 7, the server 4 extracts the twodimensional code in the image from features of the twodimensional code (step S1). Specifically, the two5 dimensional code detection unit 421 of the image analysis
unit 42 reads the captured image data from the captured
image storage unit 41, extracts features of the twodimensional code from the captured image indicated by the
read captured image data, and extracts an area
10 corresponding to the two-dimensional code in the captured
image using the features. The features are, for example,
the squares at the three places illustrated in FIG. 6.
[0037] Next, the server 4 cuts out a two-dimensional
code image included in the image (step S2). Specifically,
15 the two-dimensional code detection unit 421 of the image
analysis unit 42 cuts out an image of the area
corresponding to the two-dimensional code extracted in step
S1 as a two-dimensional code image, and outputs the cut-out
two-dimensional code image to the two-dimensional code
20 decoding unit 43. The two-dimensional code detection unit
421 sequentially performs the processing in steps S1 and S2
on the pieces of captured image data stored in the captured
image storage unit 41.
[0038] Next, the server 4 decodes the two-dimensional
25 code of the two-dimensional code image (step S3).
Specifically, the two-dimensional code decoding unit 43
converts the two-dimensional code of the two-dimensional
code image received from the two-dimensional code detection
unit 421 into the transmission data, which is the data
30 before being converted into the two-dimensional code, and
outputs the transmission data to the output data
restoration unit 44.
[0039] Next, the server 4 separates the data obtained by
21
decoding into the output data identification information
(the header and the footer) and the output data (the
divided output data) (step S4). Specifically, the output
data restoration unit 44 separates the transmission data
5 received from the two-dimensional code detection unit 421
into the header and the footer, which are the output data
identification information, and the divided output data.
The output data identification information is information
including information for identifying the output data such
10 as the number of divisions and the data name (e.g., the
file name) of the output data. Here, the output data
identification information is the header and the footer,
but the method of adding the output data identification
information to the divided output data is not limited to
15 this example. The right side of FIG. 7 illustrates an
example in which the transmission data illustrated in FIG.
4 is displayed as the two-dimensional code, and the
captured image data obtained by capturing the image of the
two-dimensional code is transmitted from the portable
20 information terminal 3 to the server 4. In this example,
the number of divisions is one, and thus the divided output
data is equal to the output data.
[0040] Next, the server 4 restores the pre-division
output data, based on the data name and the number of
25 divisions (step S5). Specifically, when the number of
divisions included in the output data identification
information is one, the output data restoration unit 44
directly uses the divided output data separated in step S4
as the output data. When the number of divisions included
30 in the output data identification information is two or
more, the output data restoration unit 44 combines the
pieces of divided output data having the same data name
included in the output data identification information to
22
generate the output data. At this time, when division
numbers are included in the output data identification
information, the output data restoration unit 44 combines
the pieces of divided output data in the order of the
5 division numbers. The output data restoration unit 44 may
combine the pieces of divided output data, based on
information indicating times as described above.
[0041] Next, the server 4 stores the output data (step
S6). Specifically, the output data restoration unit 44
10 stores the output data restored in step S5 in the restored
data storage unit 45. The processing illustrated in FIG. 7
is performed on an individual case basis, for example, so
that the server 4 can restore the output data stored in the
memory 15 of the control device 11 in the machine 1. The
15 supplementary information is read from the captured image
storage unit 41 by a control unit (not illustrated) that
controls the server 4, and is stored in the restored data
storage unit 45 in association with the restored data.
Consequently, the response computer 5 can read the
20 supplementary information and the associated output data
from the restored data storage unit 45, and remotely
diagnose and maintain the machine 1 using the read
information.
[0042] Next, a hardware configuration of the control
25 device 11 in the machine 1 of the present embodiment will
be described. The control device 11 of the present
embodiment is implemented, for example, by a computer
system. That is, by a program that is a computer program
describing the processing in the control device 11 being
30 executed on the computer system, the computer system
functions as the control device 11. FIG. 8 is a diagram
illustrating an exemplary configuration of the computer
system that implements the control device 11 in the present
23
embodiment. As illustrated in FIG. 8, the computer system
includes a processor 101, a memory 102, a display 103, an
input unit 104, and a communication unit 105, which are
connected, for example, via a system bus.
5 [0043] In FIG. 8, the processor 101 is a processor such
as a central processing unit (CPU) or a micro processor
unit (MPU), and executes a program describing the
processing in the control device 11 of the present
embodiment. Note that part of the processor 101 may be
10 implemented by processing circuitry that is dedicated
hardware such as a field-programmable gate array (FPGA).
The memory 102 includes various types of memory such as
random access memory (RAM) and read only memory (ROM) and a
storage device such as a hard disk, and stores the program
15 to be executed by the above processor 101, necessary data
obtained during the processing, etc. The memory 102 is
also used as a temporary storage area for the program.
[0044] The input unit 104 includes, for example, a
keyboard and a mouse, and is used by the user of the
20 computer system to input various types of information. The
display 103 includes a display, a liquid crystal display
(LCD) panel, or the like, and displays various screens for
the user of the computer system. The input unit 104 and
the display 103 may be integrated and implemented by a
25 touch panel. The communication unit 105 is a receiver and
a transmitter that perform communication processing. Note
that FIG. 8 is an example, and the configuration of the
computer system is not limited to the example of FIG. 8.
[0045] Here, an example of operation of the computer
30 system before the program of the present embodiment becomes
executable will be described. In the computer system
having the above-described configuration, for example, the
computer program is installed in the memory 102 from a
24
recording medium. When the program is executed, the
program read from the memory 102 is stored in the main
storage area of the memory 102. In this state, the
processor 101 performs the processing as the control device
5 11 of the present embodiment, according to the program
stored in the memory 102.
[0046] In the above description, the program describing
the processing in the control device 11 is provided as the
recording medium, which is not limiting. For example, the
10 program provided via a transmission medium such as the
Internet through the communication unit 105 may be used,
depending on the configuration of the computer system, the
size of the provided program, etc.
[0047] A diagnostic program of the present embodiment
15 causes, for example, the control device 11 to perform
processing to generate a plurality of pieces of divided
data by dividing output data to be used for diagnosis,
generate transmission data with data identification
information that is identification information on the
20 output data and division information indicating the order
of the plurality of pieces of divided data added to each of
the pieces of divided data, convert the transmission data
into a two-dimensional code, and display the twodimensional code. Furthermore, the diagnostic program of
25 the present embodiment causes, for example, the server 4 to
perform processing to receive captured image data that is
data on an image in which the displayed two-dimensional
code is captured from a portable information terminal that
has captured the image, extract the two-dimensional code
30 from the captured image data, decode the extracted twodimensional code, and restore the output data from a
plurality of pieces of decoded information obtained by
decoding, using the data identification information and the
25
division information included in the decoded information.
[0048] The two-dimensional code generation unit 13 and
the transmission data conversion unit 14 illustrated in
FIG. 1 are implemented by the processor 101 illustrated in
5 FIG. 8 executing the computer program stored in the memory
102 illustrated in FIG. 8. The memory 102 illustrated in
FIG. 8 is also used to implement the two-dimensional code
generation unit 13 and the transmission data conversion
unit 14 illustrated in FIG. 1. The screen display unit 12
10 illustrated in FIG. 1 is implemented by the display 103 and
the processor 101 illustrated in FIG. 8. The memory 15
illustrated in FIG. 1 is part of the memory 102 illustrated
in FIG. 8.
[0049] The portable information terminal 3 is
15 implemented, for example, by adding the camera 31, which is
an image-capturing device, to a computer system of the
configuration illustrated in FIG. 8. The server 4 and the
response computer 5 are also each implemented, for example,
by a computer system of the configuration illustrated in
20 FIG. 8. The image analysis unit 42, the two-dimensional
code decoding unit 43, and the output data restoration unit
44 illustrated in FIG. 1 are implemented by the processor
101 illustrated in FIG. 8 executing the computer program
stored in the memory 102 illustrated in FIG. 8. The memory
25 102 illustrated in FIG. 8 is also used to implement the
image analysis unit 42, the two-dimensional code decoding
unit 43, and the output data restoration unit 44
illustrated in FIG. 1. The captured image storage unit 41
and the restored data storage unit 45 illustrated in FIG. 1
30 are part of the memory 102 illustrated in FIG. 8. The
server 4 and the response computer 5 may each be
implemented by a plurality of computer systems. For
example, the server 4 and the response computer 5 may each
26
be implemented by a cloud computer system.
[0050] As described above, in the present embodiment,
the machine 1 displays output data inside the machine 1 in
one or a plurality of two-dimensional codes, the portable
5 information terminal 3 captures an image of an area
including the two-dimensional code(s) on the machine 1 and
transmits captured image data to the server 4, and the
server 4 restores the output data from the captured image
data. Consequently, even when the machine 1 is not
10 provided with a fitting port for an external storage medium
and is limited in network connection, output data on the
machine 1 can be easily taken out. This enables the remote
diagnosis and remote maintenance of the machine 1 while
preventing information leakage. When the amount of
15 information of output data is large, the machine 1 divides
the output data and generates a two-dimensional code for
each piece of divided output data, and the server 4
restores the output data from the two-dimensional codes.
Thus, the amount of information of diagnostic information
20 that can be presented can be increased.
[0051] Second Embodiment.
Next, the diagnostic system 6 of a second embodiment
will be described. The configuration of the diagnostic
system 6 of the present embodiment and the configurations
25 of the devices constituting the diagnostic system 6 are the
same as those of the first embodiment. Hereinafter,
differences from the first embodiment will be mainly
described without explanations that are duplicates of those
in the first embodiment.
30 [0052] FIG. 9 is a diagram illustrating an example of a
device data output screen according to the present
embodiment. On the device data output screen illustrated
in FIG. 9, as on the device data output screen illustrated
27
in FIG. 2, a screen for selecting output data is displayed,
but “LOGDATA.DAT” is selected to be output. “LOGDATA.DAT”
stores a log in the machine 1. “LOGDATA.DAT” has a larger
amount of information than “SYSTEM.DAT” illustrated in the
5 description of the operation in the first embodiment.
[0053] When the amount of information of output data is
large, that is, the data size is large, the size of a twodimensional code into which the data is converted is also
large. The displayable size of a two-dimensional code is
10 limited by the displayable screen resolution and the
displayable area of the two-dimensional code display unit
122. Therefore, some output data cannot be represented by
one two-dimensional code. For this reason, division may be
performed as described in the first embodiment. To further
15 reduce the data size, compression may be performed. From
the viewpoint of preventing information leakage, at least
one of compression processing or encryption may be
performed on output data. The present embodiment describes
an example in which at least one of compression processing
20 or encryption is performed as conversion processing on
output data in the transmission data conversion unit 14.
[0054] FIG. 10 is a diagram illustrating an example of
data generated by the transmission data conversion unit 14
and the two-dimensional code generation unit 13 of the
25 control device 11 in the present embodiment when
compression processing is performed on output data. FIG.
10 illustrates an example in which “LOGDATA.DAT” is
selected on the device data output screen as illustrated in
FIG. 9. The transmission data conversion unit 14 reads the
30 electronic file of “LOGDATA.DAT” from the memory 15 as
output data, and compresses the read output data.
[0055] The transmission data conversion unit 14 divides
the compressed output data, which is the output data after
28
being compressed, as in the first embodiment, and outputs
the divided data (divided output data) to the twodimensional code generation unit 13. The divided output
data illustrated in FIG. 10 is converted output data that
5 has undergone compression processing as an example of the
conversion processing in the transmission data conversion
unit 14. As in the first embodiment, the transmission data
conversion unit 14 adds a header and a footer to each piece
of divided output data to generate transmission data. In
10 the example illustrated in FIG. 10, “ZIP” that is
information indicating the processing performed in the
transmission data conversion unit 14 is added to the header
after the data name. In the example illustrated in FIG.
10, the number of divisions is three. Thus, three pieces
15 of transmission data #1 to #3 are generated as the
transmission data corresponding to “LOGDATA.DAT”.
[0056] The two-dimensional code generation unit 13
converts the pieces of transmission data #1 to #3 into twodimensional codes (divided two-dimensional codes #1 to #3).
20 Although FIG. 10 illustrates the two-dimensional codes
displayed as images, the two-dimensional code generation
unit 13 generates information indicating the twodimensional codes and outputs the information to the twodimensional code display unit 122, and the two-dimensional
25 code display unit 122 displays the two-dimensional codes as
images, whereby the two-dimensional codes illustrated in
FIG. 10 are displayed.
[0057] FIGS. 11 and 12 are diagrams illustrating an
example of output screens of the two-dimensional codes in
30 the present embodiment. In the example illustrated in
FIGS. 11 and 12, the divided two-dimensional codes #1 and
#2 are displayed on the same screen page that is one
screen, and the divided two-dimensional code #3 is
29
displayed on another screen page. Although FIGS. 11 and 12
illustrate an example in which two two-dimensional codes
are displayed on one screen page, the number of twodimensional codes displayed on one screen page is not
5 limited to two, and may be one or more. The displayed
screen page is switched, for example, by pressing “Switch
page” at the bottom of the two-dimensional code output
screen.
[0058] An image of the displayed two-dimensional code(s)
10 is captured by the portable information terminal 3 as in
the first embodiment, and the portable information terminal
3 transmits captured image data indicating the captured
image to the server 4. As in the first embodiment,
supplementary information may be transmitted to the server
15 4 together with the captured image data.
[0059] FIG. 13 is a flowchart illustrating an example of
operation of the server 4 in the present embodiment. Steps
S1 to S4 are the same as those in the first embodiment.
When two two-dimensional codes are included in one captured
20 image as illustrated in FIG. 11, the two-dimensional code
detection unit 421 cuts out the two two-dimensional codes
and sequentially outputs the two two-dimensional codes to
the two-dimensional code decoding unit 43.
[0060] After step S4, in step S5a, the output data
25 restoration unit 44 combines the pieces of output data
according to the data name and the number of divisions, and
reversely converts (decompresses) the combined output data
according to the conversion method to restore the output
data. Specifically, as in the first embodiment, the output
30 data restoration unit 44 combines the pieces of divided
output data having the same data name, and performs reverse
conversion to the conversion performed in the control
device 11 on the combined data to restore the output data.
30
For example, as described above, when compression
processing is performed, decompression processing is
performed as the reverse conversion. When encryption is
performed in the control device 11, decryption is performed
5 as the reverse conversion to convert ciphertext into
plaintext. Step S6 after step S5a is the same as that in
the first embodiment. When both encryption and compression
are performed in the control device 11, reverse conversions
to both are performed. The operation of the present
10 embodiment other than that described above is the same as
that of the first embodiment.
[0061] As described above, in the present embodiment, at
least one of compression or encryption is performed on
output data, and as in the first embodiment, the output
15 data is displayed in one or a plurality of two-dimensional
codes, the portable information terminal 3 captures an
image of an area including the two-dimensional code(s) on
the machine 1 and transmits captured image data to the
server 4, and the server 4 restores the output data from
20 the captured image data. This can provide the same effects
as those of the first embodiment, and can achieve effects
such as increasing the data size that can be represented by
one two-dimensional code by compression and preventing
information leakage. Furthermore, by displaying a
25 plurality of two-dimensional codes on one screen page, the
data size of output data that can be transmitted with one
piece of captured image data can be increased.
[0062] Third Embodiment.
FIG. 14 is a diagram illustrating an exemplary
30 configuration of a diagnostic system according to a third
embodiment. As illustrated in FIG. 14, a diagnostic system
6a of the present embodiment is the same as that of the
first embodiment except that it includes a machine 1a
31
instead of the machine 1. The machine 1a is the same as
the machine 1 of the first embodiment except that it
includes a control device 11a instead of the control device
11. The control device 11a is the same as the control
5 device 11 of the first embodiment except that it includes a
transmission data conversion unit 14a instead of the
transmission data conversion unit 14. The same reference
numerals as those in the first embodiment are assigned to
components having the same functions as those of the first
10 embodiment without duplicated explanations. Hereinafter,
differences from the first embodiment will be mainly
described without explanations that are duplicates of those
in the first embodiment.
[0063] As illustrated in FIG. 14, the transmission data
15 conversion unit 14a includes a division size adjustment
unit 141. The division size adjustment unit 141 determines
the data size of pieces of divided data corresponding oneto-one to a plurality of two-dimensional codes to be
displayed simultaneously, based on the size of an area
20 where the two-dimensional codes can be displayed and the
data size of the output data. Specifically, the division
size adjustment unit 141 adjusts the size of twodimensional codes to be displayed on one screen and the
number of two-dimensional codes to be displayed on one
25 screen, according to the size of the area where the twodimensional codes can be displayed. In a two-dimensional
code, the amount of information that can be expressed by
the two-dimensional code, that is, converted into the twodimensional code increases, according to the number of
30 cells used in the two-dimensional code. Therefore, for
example, by determining in advance the number of pixels as
the size of each cell of a two-dimensional code, the data
size that can be converted into the two-dimensional code
32
can be associated with the size of the two-dimensional
code.
[0064] FIG. 15 is a diagram illustrating an example of
the size of a two-dimensional code output screen displayed
5 by the control device 11a of the present embodiment. In
the example illustrated in FIG. 15, two-dimensional codes
can be displayed in an area 201. With the resolution of
the display 103 that implements the machine 1a, the number
that can be displayed in the area 201 is 380 points (pt)
10 high and 640 pt wide.
[0065] FIGS. 16 and 17 are diagrams illustrating an
example of two-dimensional codes displayed by the control
device 11 of the first embodiment. In the example
illustrated in FIGS. 16 and 17, the two-dimensional codes
15 corresponding to output data whose number of divisions is
two are generated. In the first embodiment not including
the division size adjustment unit 141, for example, output
data is divided into pieces of a division size
corresponding to the displayable size of a two-dimensional
20 code with some margins left on the top, bottom, left, and
right in the area 201. In the first embodiment, when the
data size of output data is indivisible by the division
size, the last piece of divided output data is of less than
the division size. Consequently, as illustrated in FIGS.
25 16 and 17, for example, a two-dimensional code of 356
pt×356 pt is displayed on the first screen page, and a twodimensional code of 180 pt×180 pt is displayed on the
second screen page. In this example, the two twodimensional codes are displayed on two screen pages.
30 [0066] FIG. 18 is a diagram illustrating an example of
two-dimensional codes displayed by the control device 11a
of the present embodiment. The example illustrated in FIG.
18 illustrates an example in which output data having the
33
same size as the output data illustrated in FIGS. 16 and 17
is divided into two two-dimensional codes. Consequently,
in the example illustrated in FIG. 18, the two twodimensional codes can be displayed on one screen page, and
5 the portable information terminal 3 can capture an image of
the two two-dimensional codes at a time. Thus, in the
present embodiment, the division size adjustment unit 141
determines the size of two-dimensional codes so as to
reduce the number of screen pages on which to display the
10 two-dimensional codes, and determines the division size
according to the determined two-dimensional codes.
[0067] The transmission data conversion unit 14a
determines the division size, based on the data size of
output data read from the memory 15, so as to reduce the
15 number of screen pages on which to display two-dimensional
codes, divides the output data as in the first embodiment,
using the determined division size, and generates
transmission data in which a header and a footer are added
to the divided output data. The operation of the present
20 embodiment other than that described above is the same as
that of the first embodiment. The hardware configuration
of the control device 11a of the present embodiment is the
same as the hardware configuration of the control device 11
of the first embodiment.
25 [0068] Here, the example in which the division size
adjustment unit 141 is added to the transmission data
conversion unit 14 of the first embodiment has been
described. Likewise, the transmission data conversion unit
14 of the second embodiment may include the division size
30 adjustment unit 141. That is, the transmission data
conversion unit 14 may perform at least one of compression
processing or encryption processing on output data, and
determine the division size, based on the data size of the
34
processed data, so as to reduce the number of screen pages
on which to display two-dimensional codes.
[0069] As described above, the present embodiment
determines the division size so as to reduce the number of
5 screen pages on which to display two-dimensional codes.
This can provide the same effects as those of the first
embodiment and can reduce the number of screen pages on
which to display two-dimensional codes, and thus can reduce
the number of times the portable information terminal 3
10 performs image capturing.
[0070] Fourth Embodiment.
FIG. 19 is a diagram illustrating an exemplary
configuration of a diagnostic system according to a fourth
embodiment. As illustrated in FIG. 19, a diagnostic system
15 6b of the present embodiment is the same as that of the
first embodiment except that it includes a machine 1b
instead of the machine 1. The machine 1b is the same as
the machine 1 of the first embodiment except that it
includes a control device 11b instead of the control device
20 11. The control device 11b is the same as the screen
display unit 12 of the first embodiment except that it
includes a screen display unit 12a instead of the screen
display unit 12. The screen display unit 12a is the same
as the screen display unit 12 of the first embodiment
25 except that it includes a device data output unit 121a
instead of the device data output unit 121. The device
data output unit 121a is the same as the device data output
unit 121 of the first embodiment except that it includes a
two-dimensional code display unit 122a instead of the two30 dimensional code display unit 122. The same reference
numerals as those in the first embodiment are assigned to
components having the same functions as those of the first
embodiment without duplicated explanations. Hereinafter,
35
differences from the first embodiment will be mainly
described without explanations that are duplicates of those
in the first embodiment.
[0071] In the present embodiment, the two-dimensional
5 code display unit 122a includes an automatic page switching
unit 123. The automatic page switching unit 123
automatically switches screen pages on which twodimensional codes are displayed.
[0072] FIG. 20 is a diagram illustrating an example of
10 screen page display switching by the automatic page
switching unit 123 and its time chart in the present
embodiment. As illustrated in FIG. 20, in a case where
two-dimensional codes corresponding to one piece of output
data are displayed on a plurality of screen pages, the
15 automatic page switching unit 123 automatically switches
the screen pages, for example, when “Automatic switching”
at the bottom of the two-dimensional code display screen is
pressed. As illustrated in FIG. 20, the automatic page
switching unit 123 sequentially displays, for example,
20 screen pages from page #1 to the last page at a switching
interval of a fixed time. Repeated display may be
performed in which the screen pages from page #1 to the
last page are repeatedly displayed. When repeated display
is performed, after page #1 to the last page are displayed,
25 page #1 to the last page are displayed again after a
predetermined repeated display pause interval of time,
which is repeated until an instruction to stop the repeated
display is given or for a specified number of times. The
repeated display pause interval may be able to be set by
30 the user. The specified number of times may be determined
in advance or may be set by the user.
[0073] In the present embodiment, the portable
information terminal 3 captures images of the two-
36
dimensional code display screen by shooting a video or
consecutive still images so as to capture images of all
page screens of the screen pages from page #1 to the last
page displayed by automatic switching as described above.
5 Captured image data indicating data captured by shooting a
video or consecutive still images includes a plurality of
captured images corresponding to different times. The
portable information terminal 3 transmits the captured
image data to the server 4 as in the first embodiment.
10 [0074] FIG. 21 is a diagram illustrating an example of a
method of extracting two-dimensional code images when the
images are captured in a video in the present embodiment.
The image analysis unit 42 of the server 4 reads the
captured image data as video data from the captured image
15 storage unit 41, and cuts out images (image snaps) of all
the image pages from the video data at a predetermined
image cut-out interval. The image cut-out interval is
determined, for example, as the switching interval/N (N is
a natural number). If N is one, images may not be able to
20 be properly cut out when the timing of cutting out an image
from video data coincides with the timing of switching
pages on the two-dimensional code display screen. Thus, N
is preferably two or more. Note that this is not limiting.
It is sufficient that the image cut-out interval<(the
25 switching interval-the time required for image update).
The time required for image update is the time required to
update the image when the control device 11 switches
display images.
[0075] The two-dimensional code detection unit 421 of
30 the image analysis unit 42 cuts out two-dimensional code
images from each cut-out image as in the first embodiment,
and sequentially outputs the cut-out two-dimensional code
images to the two-dimensional code decoding unit 43.
37
[0076] The two-dimensional code detection unit 421 may
compare the two-dimensional codes of the cut-out images.
When the two-dimensional code detection unit 421 determines
that there are successive images of the same two5 dimensional code, the two-dimensional code detection unit
421 may select one of the same two-dimensional code images
and output the selected two-dimensional code image to the
two-dimensional code decoding unit 43. When the screen
pages are displayed in screen page display areas 202 to 204
10 on the two-dimensional code output screen as in the example
illustrated in FIGS. 11 and 12, for example, the image
analysis unit 42 may determine duplication based on the
screen page display areas 202 to 204. For example, the
image analysis unit 42 may detect the screen page display
15 areas 202 to 204 from the cut-out images, and detect
numbers representing the screen pages in the screen page
display areas 202 to 204 by image recognition processing.
When there are successive images with the same detected
number, the image analysis unit 42 may select one of the
20 successive images, and cut out the two-dimensional code
images from the unselected image, and may not cut out the
two-dimensional code images from the unselected image.
Alternatively, when the output data restoration unit 44 in
the subsequent stage obtains a plurality of pieces of
25 transmission data with the same page number, which is the
division number included in the output identification
information in the decoded transmission data, the output
data restoration unit 44 may restore the output data, using
a piece of transmission data selected from the plurality of
30 pieces of transmission data.
[0077] FIG. 22 is a diagram illustrating an example of a
method of extracting two-dimensional code images when the
images are captured by continuous shooting of still images
38
in the present embodiment. The image analysis unit 42 of
the server 4 reads captured image data obtained by
continuous shooting from the captured image storage unit
41, and cuts out still images from the captured image data.
5 When images are captured by continuous shooting, a
continuous shooting interval that is the period of
continuous shooting is 1/M seconds, where M (M is a natural
number) is the number of still images captured by
continuous shooting per second. If the switching interval
10 is much longer than the continuous shooting interval, the
same screen page is shot many times. Therefore, by setting
the switching interval to a short time of less than one
second, for example, the shooting time required to shoot
all screen pages can be shortened, and the data size of
15 captured image data can be reduced. For example, the
period of continuous shooting can be set to a period
obtained by dividing the switching interval by a natural
number. When image capturing is performed by continuous
shooting, each of a plurality of still images is generated
20 as an electronic file. Thus, captured image data
transmitted from the portable information terminal 3 is
data including a plurality of pieces of image data.
[0078] The two-dimensional code detection unit 421 of
the image analysis unit 42 cuts out the two-dimensional
25 code images from the plurality of images indicated by the
plurality of pieces of image data included in the captured
image data as in the first embodiment, and sequentially
outputs the cut-out two-dimensional code images to the twodimensional code decoding unit 43. As is the case with
30 video data, the two-dimensional code detection unit 421 may
compare the two-dimensional codes of the cut-out images.
When the two-dimensional code detection unit 421 determines
that there are successive images of the same two-
39
dimensional code, the two-dimensional code detection unit
421 may select one of the same two-dimensional code images
and output the selected two-dimensional code image to the
two-dimensional code decoding unit 43. Alternatively, as
5 is the case with video data, the two-dimensional code
detection unit 421 may select an image by determining
duplication, based on the screen page display areas 202 to
204, or the output data restoration unit 44 in the
subsequent stage may restore the output data using one
10 piece of transmission data selected from a plurality of
pieces of transmission data, using the page number, which
is the division number included in the output
identification information.
[0079] As described above, in the present embodiment,
15 when two-dimensional codes corresponding to one piece of
output data are displayed on a plurality of screen pages,
the two-dimensional code screen on which the control device
11b displays the two-dimensional codes automatically
switches the screen pages at a switching interval of a
20 fixed time. Captured image data captured by the portable
information terminal 3 is data on a video captured so as to
include a plurality of screen pages, or data on a plurality
of still images captured by continuous shooting at a period
obtained by dividing the switching interval by a natural
25 number. When captured image data is video data, the server
4 extracts images corresponding to a plurality of screen
pages from the captured image data, using the switching
interval, and extracts two-dimensional codes from the
extracted images. When captured image data is data
30 indicating a plurality of still images captured by
continuous shooting, the server 4 extracts images
corresponding to a plurality of screen pages from the
captured image data, using the continuous shooting
40
interval, and extracts two-dimensional codes from the
extracted images.
[0080] The operation of the present embodiment other
than that described above is the same as that of the first
5 embodiment. The hardware configuration of the control
device 11b of the present embodiment is the same as the
hardware configuration of the control device 11 of the
first embodiment.
[0081] Here, the example in which the automatic page
10 switching unit 123 is added to the two-dimensional code
display unit 122 of the first embodiment has been
described. The two-dimensional code display unit 122 of
the second or third embodiment may include the automatic
page switching unit 123, and the server 4 may perform the
15 operation in the present embodiment.
[0082] As described above, in the present embodiment,
the automatic page switching unit 123 automatically
switches screen pages. This eliminates the need for the
user to manually switch screen pages. The user only needs
20 to shoot a video or continuously shoot images, using the
portable information terminal 3. Thus, when twodimensional codes are displayed on a plurality of screen
pages, the user can easily and efficiently acquire captured
image data.
25 [0083] Fifth Embodiment.
Next, the diagnostic system 6 of a fifth embodiment
will be described. The configuration of the diagnostic
system 6 of the present embodiment and the configurations
of the devices constituting the diagnostic system 6 are the
30 same as those of the first embodiment. Hereinafter,
differences from the first embodiment will be mainly
described without explanations that are duplicates of those
in the first embodiment. The present embodiment describes
41
an example of converting a plurality of pieces of output
data into two-dimensional codes.
[0084] FIG. 23 is a diagram illustrating an example of a
device data output screen in the present embodiment. On
5 the device data output screen illustrated in FIG. 23, as on
the device data output screen illustrated in FIG. 2, a
screen for selecting output data is displayed, and three
objects, “TOOLDATA.DAT”, “OFFSET.DAT”, and “PARAMET.DAT”,
are selected to be output.
10 [0085] FIG. 24 is a diagram illustrating an example of
data generated by the transmission data conversion unit 14
and the two-dimensional code generation unit 13 of the
control device 11 in the present embodiment. The example
illustrated in FIG. 24 illustrates an example in which
15 “TOOLDATA.DAT”, “OFFSET.DAT”, and “PARAMET.DAT” are
selected by the user as output data as illustrated in FIG.
23.
[0086] As illustrated in FIG. 24, when “TOOLDATA.DAT”,
“OFFSET.DAT”, and “PARAMET.DAT” are selected as output
20 data, for example, the transmission data conversion unit 14
divides each piece of output data and adds output data
identification information including the data names of the
output data to the pieces of divided output data to
generate pieces of transmission data A to C. As described
25 in the first embodiment, the number of divisions may be
one. When the data size of output data is large, the
output data is divided. In the example illustrated in FIG.
24, the number of divisions of “TOOLDATA.DAT” is two, the
number of divisions of “OFFSET.DAT” is one, and the number
30 of divisions of “PARAMET.DAT” is two. Thus, the number of
the pieces of transmission data A corresponding to
“TOOLDATA.DAT”, which is output data A, is two, the number
of the transmission data B corresponding to “OFFSET.DAT”,
42
which is output data B, is one, and the number of the
pieces of transmission data C corresponding to
“PARAMET.DAT”, which is output data C, is two.
[0087] Further, as described in the second embodiment,
5 the output data may be subjected to conversion processing
that is at least one of compression or encryption. In the
example illustrated in FIG. 24, compression with ZIP is
performed on the output data. In the example illustrated
in FIG. 24, as in the second embodiment, information
10 indicating the data name, the number of divisions, the
division number, and the conversion processing of the
output data is added as a header. Note that FIG. 24
illustrates an example, and the conversion processing
performed on the output data, the number of divisions, etc.
15 are not limited to the example illustrated in FIG. 24.
Furthermore, the conversion processing may not be performed
on the output data.
[0088] The two-dimensional code generation unit 13
receives input of the pieces of transmission data generated
20 by the transmission data conversion unit 14, and generates
the corresponding two-dimensional codes. In the example
illustrated in FIG. 24, two two-dimensional codes A
corresponding to the output data A, one two-dimensional
code B corresponding to the output data B, and two two25 dimensional codes C corresponding to the output data C are
generated.
[0089] For example, the two two-dimensional codes A are
displayed on one screen page, the two-dimensional code B is
displayed on another screen page, and the two two30 dimensional codes C are displayed on still another screen
page. The portable information terminal 3 captures an
image of each screen page. Consequently, the portable
information terminal 3 acquires three pieces of captured
43
image data corresponding one-to-one to the screen pages,
and transmits the three pieces of captured image data to
the server 4.
[0090] FIG. 25 is a flowchart illustrating an example of
5 operation of the server 4 in the present embodiment. Steps
S1 to S4 and S6 illustrated in FIG. 25 are the same as
those in the first embodiment. In step S5b, the output
data restoration unit 44 restores the output data as in the
first embodiment. However, in the present embodiment, the
10 output data restoration unit 44 combines the output data in
the divided order, for example, based on the division
numbers, on an individual output data basis, that is, on an
individual header data name basis. Consequently, the
pieces of output data A to C can be restored as illustrated
15 in FIG. 25 from the captured image data obtained by
capturing the images of the two-dimensional codes A to C
illustrated in FIG. 24. In the example illustrated in FIG.
24, since compression is performed with ZIP as described in
the second embodiment, the output data restoration unit 44
20 performs decompression processing on the combined output
data.
[0091] The operation of the present embodiment other
than that described above is the same as that of the first
or second embodiment. The hardware configuration of the
25 control device 11b of the present embodiment is the same as
the hardware configuration of the control device 11 of the
first embodiment.
[0092] Here, the diagnostic system 6 of the first or
second embodiment has been described as an example. The
30 diagnostic system 6a of the third embodiment and the
diagnostic system 6b of the fourth embodiment can also
perform the same processing when a plurality of pieces of
output data are selected.
44
[0093] Furthermore, in the example illustrated in FIGS.
24 and 25, all of the pieces of output data A to C are
compressed, but conversion processing to be performed may
be determined for each piece of output data. For example,
5 the pieces of output data A and C may be compressed, and
the piece of output data B may not be subjected to
conversion processing. The nature of conversion processing
may be determined for each piece of output data, that is,
for each type of output data, or may be determined
10 according to the data size of output data.
[0094] As described above, even when a plurality of
types of output data are selected, the remote diagnosis and
remote maintenance of the machine 1 can be performed
without using an external storage medium and the network
15 connection function of the machine 1. When the amount of
information of output data is large, the machine 1 divides
the output data and generates a two-dimensional code for
each piece of divided output data, and the server 4
restores the output data from the two-dimensional codes.
20 Thus, the amount of information of diagnostic information
that can be presented can be increased.
[0095] Sixth Embodiment.
FIG. 26 is a diagram illustrating an exemplary
configuration of a diagnostic system according to a sixth
25 embodiment. A diagnostic system 6c of the present
embodiment includes a machine 1c, a Web server 7 that is an
example of the server 4 described in the first embodiment,
and the response computer 5. A portable information
terminal 3a may be included in the diagnostic system 6c.
30 The Web server 7 has a function as the server 4 described
in the first embodiment. The same reference numerals as
those in the first embodiment are assigned to components
having the same functions as those of the first embodiment
45
without duplicated explanations. Hereinafter, differences
from the first embodiment will be mainly described without
explanations that are duplicates of those in the first
embodiment.
5 [0096] The machine 1c is the same as the control device
11 of the first embodiment except that it includes a
control device 11c instead of the control device 11. The
control device 11c is the same as the control device 11 of
the first embodiment except that a self-diagnostic unit 18
10 is added. The self-diagnostic unit 18 performs the selfdiagnosis of the health state of the machine 1c, using
information indicating the state of the machine 1c, machine
signals of the machine peripheral equipment 2, etc. stored
in the memory 15, generates self-diagnostic data indicating
15 the self-diagnostic results, and outputs the selfdiagnostic data to the transmission data conversion unit
14. The transmission data conversion unit 14 generates
transmission data as in the first embodiment, using the
self-diagnostic data as output data in the first
20 embodiment. The operations of the two-dimensional code
generation unit 13 and the screen display unit 12 are the
same as those in the first embodiment.
[0097] The present embodiment describes an example in
which a diagnostic service to make a response to an inquiry
25 about the machine 1c, a diagnostic request, and the like is
provided on the Web. For example, the Web server 7 has a
function to provide information provided as a Web page (not
illustrated) to a terminal in response to an access request
from the terminal such as the portable information terminal
30 3a. The user who makes an inquiry about the machine 1c, a
diagnostic request, or the like operates the portable
information terminal 3a to cause the Web page information
to be displayed on the portable information terminal 3a.
46
[0098] The portable information terminal 3a is the same
as the portable information terminal 3 of the first
embodiment except that an authentication unit 34 is added.
The authentication unit 34 performs user authentication
5 processing for using the diagnostic service. For example,
the authentication unit 34 transmits a user identifier (ID)
and a password registered in advance for using the
diagnostic service to the Web server 7. The user ID and
the password may be input to the portable information
10 terminal 3a by the user, or may be stored in the portable
information terminal 3a in advance. Note that the
authentication method is not limited to this example.
[0099] As in the first embodiment, the user captures a
captured image including a two-dimensional code, using the
15 portable information terminal 3a, to acquire captured image
data. After being authenticated, the user posts post data
including the captured image data on a user post page that
is a post page for the exclusive use of the user, using the
portable information terminal 3a. That is, the portable
20 information terminal 3a transmits post data to the Web
server 7, based on input from the user. A post page may be
provided for each thread.
[0100] The Web server 7 includes an authentication unit
71, a user post data management unit 72, a post data
25 storage unit 73, an image recognition unit 74, a training
data storage unit 75, a data storage unit 76, a message
notification unit 77, the image analysis unit 42, the twodimensional code decoding unit 43, and the output data
restoration unit 44. The image analysis unit 42, the two30 dimensional code decoding unit 43, and the output data
restoration unit 44 are the same as the image analysis unit
42, the two-dimensional code decoding unit 43, and the
output data restoration unit 44 of the server 4 in the
47
first embodiment.
[0101] The authentication unit 71 performs
authentication processing with the portable information
terminal 3a. When receiving post data transmitted from the
5 portable information terminal 3a that has been successfully
authenticated, the authentication unit 71 outputs the post
data to the user post data management unit 72 together with
the corresponding user identification information. The
user post data management unit 72 stores the post data in
10 the post data storage unit 73. Furthermore, when receiving
the post data, the user post data management unit 72
notifies the message notification unit 77 of the post.
Post data stored in the post data storage unit 73 is
managed on an individual user basis. When a post page is
15 provided for each thread, post data stored in the post data
storage unit 73 may be further managed on an individual
thread basis.
[0102] The two-dimensional code detection unit 421 of
the image analysis unit 42 reads post data on each case
20 stored in the post data storage unit 73, extracts a twodimensional code image from captured image data included in
the post data, and outputs the extracted two-dimensional
code image to the two-dimensional code decoding unit 43.
The two-dimensional code detection unit 421, which may
25 extract the two-dimensional code image from the captured
image data in the same way as in the first embodiment, may
extract the two-dimensional code image, using image
recognition results obtained by the image recognition unit
74 illustrated in FIG. 26. In this case, the two30 dimensional code detection unit 421 outputs the captured
image data to the image recognition unit 74, and the image
recognition unit 74 identifies feature portions from the
captured image indicated by the captured image data, using
48
feature teaching data stored in the training data storage
unit 75, recognizes the two-dimensional code in the
captured image, using the identification results, and
notifies the two-dimensional code detection unit 421 of the
5 recognition results.
[0103] The image recognition unit 74 recognizes the
feature portions that are predetermined characteristic
portions by pattern recognition or the like. Examples of
the feature portions include a common frame that is the
10 outer frame on the two-dimensional code display screen, a
display frame that is an area where two-dimensional codes
can be displayed, square portions provided at three corners
in a two-dimensional code, and a portion where a screen
page is displayed. Pattern recognition may be performed by
15 machine learning. That is, the image recognition unit 74
may recognize the position of a two-dimensional code in an
image indicated by captured image data by machine learning,
based on features of an image showing the two-dimensional
code, and output the recognition results to the two20 dimensional code detection unit 421.
[0104] FIG. 27 is a diagram illustrating an example of
feature portions on a two-dimensional code display screen
of the present embodiment. FIG. 27 illustrates, as the
feature portions, a feature portion F1 that is a common
25 frame of the two-dimensional code output screen, a feature
portion F2 that is a display frame in which two-dimensional
codes can be displayed, feature portions F3 that are square
portions provided at three corners in each two-dimensional
code, and a feature portion F4 that is a portion where a
30 screen page is displayed. Information indicating the
disposition of the feature portions F1 to F4 as illustrated
in FIG. 27 and features of the feature portions F1 to F4
are stored in advance in the training data storage unit 75
49
as the feature teaching data by the two-dimensional codes.
The features, which may be of any kind, may include, for
example, the line shape, the line length, the line
inclination, and color, or may be an image itself. The
5 image recognition unit 74 identifies the feature portions
from a captured image indicated by captured image data,
using the feature teaching data stored in the training data
storage unit 75, and thus can improve the accuracy of
detection of the position of a two-dimensional code in the
10 captured image.
[0105] Image recognition by the image recognition unit
74 may be performed by machine learning such as supervised
learning. As a supervised learning algorithm, a neural
network, a support vector machine, or the like can be used,
15 but the algorithm is not limited to them. For example, the
image recognition unit 74 includes a learned model
generation unit, an inference unit, and a preprocessing
unit. The preprocessing unit cuts out a portion
corresponding to a two-dimensional code image from captured
20 image data and calculates features from the cut-out
portion. Further, an image that is not a two-dimensional
code is prepared, and features are calculated from the
image. The learned model generation unit uses the
calculated features as input data, uses the input data and
25 the corresponding correct data that is information
indicating whether or not the input data is a twodimensional code image as a training data set, generates a
learned model using a plurality of training data sets, and
stores the learned model in the training data storage unit
30 75. At the time of inference, that is, at the time of
extracting a two-dimensional code image, the preprocessing
unit cuts out a partial image of a captured image indicated
by captured image data and extracts features from the cut-
50
out image, and the inference unit inputs the features to
the learned model stored in the training data storage unit
75 to infer whether or not the input image is a twodimensional code image. These processes are performed,
5 sequentially changing image areas to be cut out from the
captured image, so that the inference unit can obtain a
cut-out image inferred to be a two-dimensional code image.
Note that the image recognition unit 74 may not include the
learned model generation unit. A learning apparatus that
10 generates a learned model may be separately provided, and
the learned model generated by the learning apparatus may
be stored in the training data storage unit 75.
[0106] Return to the explanation of FIG. 26. The twodimensional code decoding unit 43 and the output data
15 restoration unit 44 perform the same processing as in the
first embodiment. The output data restoration unit 44
stores the restored output data in the restored data
storage unit 45 in the data storage unit 76 on an
individual case basis. Of the post data, information other
20 than the captured image data is read from the post data
storage unit 73 by a control unit (not illustrated) that
controls the Web server 7, and is stored in the data
storage unit 76 in association with the restored data.
[0107] The message notification unit 77 that has been
25 notified of the post notifies the response computer 5 of
the post. The message notification unit 77 transmits a
response described later to the post from the response
computer 5 to the portable information terminal 3a. The
message notification unit 77 may notify an operator of the
30 post by transmitting the fact to a terminal (not
illustrated) of the operator, for example.
[0108] The response computer 5 includes a diagnostic
information storage unit 51, an artificial intelligence
51
(AI) bot 52, and a response transmitting unit 53. Note
that the response computer 5 of the first to fifth
embodiments may be the same as the response computer 5 of
the present embodiment, or may have a configuration
5 different from that of the response computer 5 of the
present embodiment.
[0109] The diagnostic information storage unit 51 stores
device diagnostic information for diagnosing the machine
1c. The device diagnostic information may be stored in the
10 diagnostic information storage unit 51, for example, as a
device diagnostic database (DB). The device diagnostic
information includes, for example, one or more of an
analysis flowchart for obtaining a primary diagnostic
result according to the content of output data, an analysis
15 flowchart for performing a secondary diagnosis based on the
primary diagnostic result, and a coping method based on the
primary diagnostic result (an inspection point, an
inspection method, a direct inquiry destination, etc.). As
the coping method, an image, a document, etc. for
20 explaining an inspection point, an inspection method, etc.
may be included in the device diagnostic information.
[0110] The AI bot 52 is an automatic conversation unit.
When notified of the post, the AI bot 52 outputs
information indicating a predetermined primary response to
25 the response transmitting unit 53, and acquires the output
data on an individual case basis from the restored data
storage unit 45 of the data storage unit 76 in the Web
server 7. The AI bot 52 generates a response to the post,
using the acquired output data and the device diagnostic
30 information stored in the diagnostic information storage
unit 51, and outputs the generated response to the response
transmitting unit 53. For example, the AI bot 52 performs
a primary diagnosis using the acquired output data and the
52
device diagnostic information stored in the diagnostic
information storage unit 51, and generates a response
including a primary diagnostic result and a coping method.
When a response to the coping method is received via the
5 portable information terminal 3a and the Web server 7 as a
result of the presentation of the coping method to the
user, the AI bot 52 performs a secondary diagnosis using
the response and the device diagnostic information stored
in the diagnostic information storage unit 51, and
10 generates a response including a secondary diagnostic
result and a coping method. Note that the method of
calculating a diagnostic result by the AI bot 52 is not
limited to this.
[0111] A response to a post may be made by the operator
15 when the operator is present, and may be made by the AI bot
52 when the operator is absent. For an inquiry that cannot
be handled by the AI bot 52, the operator may create a
response using a paper manual or the like.
[0112] The response transmitting unit 53 transmits a
20 response received from the AI bot 52 to the Web server 7.
The user post data management unit 72 of the Web server 7
outputs the response transmitted from the response
transmitting unit 53 to the message notification unit 77.
The message notification unit 77 transmits the response
25 received from the user post data management unit 72 to the
portable information terminal 3a.
[0113] FIG. 28 is a diagram illustrating an example of
diagnosis in the diagnostic system 6c of the present
embodiment. As illustrated in FIG. 28, for example, a user
30 post page screen 301 is displayed on the portable
information terminal 3a. The user of the machine 1c makes
a post by operating the portable information terminal 3a.
In the example illustrated in FIG. 28, the user inputs a
53
message indicating that the alarm xx has gone off, and
transmits, together with this message, captured image data
obtained by capturing images of two-dimensional codes
corresponding to self-diagnostic data on the machine 1c as
5 post data from the portable information terminal 3a to the
Web server 7. Two-dimensional codes corresponding to
another piece of output data may be generated together with
those of the self-diagnostic data, and captured image data
obtained by capturing an image of the two-dimensional codes
10 may be transmitted as post data.
[0114] Using the captured image data included in the
post data stored in the post data storage unit 73, the
self-diagnostic data, which is the output data, is restored
by the image analysis unit 42, the two-dimensional code
15 decoding unit 43, and the output data restoration unit 44.
On the other hand, in the Web server 7, the message
notification unit 77 notifies the AI bot 52 and the
operator that the post data has been posted, and the AI bot
52 or the operator makes a primary response. The primary
20 response of the AI bot 52 is transmitted to the portable
information terminal 3a via the Web server 7 as described
above. In the example illustrated in FIG. 28, the message
“Received.” is displayed as the primary response.
[0115] The AI bot 52 performs a primary diagnosis using
25 the self-diagnostic data and the device diagnostic DB, and
transmits a coping method corresponding to a primary
diagnostic result to the portable information terminal 3a
as a secondary response. The secondary response of the AI
bot 52 is also transmitted to the portable information
30 terminal 3a via the Web server 7. Alternatively, the
primary diagnostic result of the AI bot 52 may be
transmitted to the operator's terminal or the like, and the
operator may transmit the secondary response to the
54
portable information terminal 3a by the terminal or the
like. In the example illustrated in FIG. 28, the primary
diagnostic result, the coping method, and an image
corresponding to the coping method are displayed as the
5 secondary response.
[0116] FIG. 28 is an example, and specific response
content is not limited to the example illustrated in FIG.
28. In FIG. 26, a response of the AI bot 52 is transmitted
via the Web server 7, but may be transmitted from the
10 response computer 5 to the portable information terminal
3a.
[0117] The operation of the present embodiment other
than that described above is the same as that of the first
embodiment. The hardware configuration of the control
15 device 11c of the present embodiment is the same as the
hardware configuration of the control device 11 of the
first embodiment. The Web server 7 of the present
embodiment has the same hardware configuration as the
server 4 of the first embodiment.
20 [0118] Here, the differences from the first embodiment
have been described based on the first embodiment. The
configuration and operation described in the present
embodiment may be added to the diagnostic system of the
second to fifth embodiments.
25 [0119] As described above, in the present embodiment,
the portable information terminal 3a posts captured image
data obtained by capturing images of two-dimensional codes
corresponding to output data on the machine 1c on a user
post page managed by the Web server 7. Then, the Web
30 server 7 restores the output data from the captured image
data. Consequently, even when the response computer 5
needs to acquire a plurality of types of information for
diagnosis, the response computer 5 can easily check the
55
output data corresponding to the post. Furthermore, the
response computer 5 reads the output data on the machine 1c
from the Web server 7 and performs diagnosis using the
output data, so that diagnosis and maintenance can be
5 performed remotely without a worker going to the
installation site of the machine 1c.
[0120] The configurations described in the above
embodiments illustrate an example, and can be combined with
another known art. The embodiments can be combined with
10 each other. The configurations can be partly omitted or
changed without departing from the gist.
Reference Signs List
[0121] 1, 1a, 1b, 1c machine; 2 machine peripheral
15 equipment; 3, 3a portable information terminal; 4 server;
5 response computer; 6, 6a, 6b, 6c diagnostic system; 7
Web server; 11, 11a, 11b, 11c control device; 12, 12a
screen display unit; 13 two-dimensional code generation
unit; 14, 14a transmission data conversion unit; 15
20 memory; 16 drive unit; 17 machine signal processing unit;
18 self-diagnostic unit; 31 camera; 32 captured image
memory; 33 network communication unit; 34, 71
authentication unit; 41 captured image storage unit; 42
image analysis unit; 43 two-dimensional code decoding
25 unit; 44 output data restoration unit; 45 restored data
storage unit; 51 diagnostic information storage unit; 52
AI bot; 53 response transmitting unit; 72 user post data
management unit; 73 post data storage unit; 74 image
recognition unit; 75 training data storage unit; 76 data
30 storage unit; 77 message notification unit; 121, 121a
device data output unit; 122, 122a two-dimensional code
display unit; 123 automatic page switching unit; 141
division size adjustment unit; 421 two-dimensional code
detection unit.

We Claim :
1. A diagnostic system, comprising:
a control device to control a machine, generate a
plurality of pieces of divided data by dividing output data
5 to be used for at least one of diagnosis or maintenance of
the machine, generate transmission data with data
identification information that is identification
information on the output data and division information
indicating order of the plurality of pieces of divided data
10 added to each of the pieces of divided data, convert the
transmission data into a two-dimensional code, and display
the two-dimensional code; and
a server to receive captured image data that is data
on an image in which the displayed two-dimensional code is
15 captured from an information terminal that has captured the
image, extract the two-dimensional code from the captured
image data, decode the extracted two-dimensional code, and
restore the output data from a plurality of pieces of
decoded information obtained by decoding, using the data
20 identification information and the division information
included in the decoded information.
2. The diagnostic system according to claim 1, wherein
the control device determines a data size of the pieces of
25 divided data corresponding one-to-one to a plurality of the
two-dimensional codes displayed simultaneously, based on a
size of an area in which the two-dimensional codes can be
displayed and a data size of the output data.
30 3. The diagnostic system according to claim 1 or 2,
wherein
when the two-dimensional codes corresponding to one
piece of the output data are displayed on a plurality of
57
screen pages on a two-dimensional code screen on which the
control device displays the two-dimensional codes, the
screen pages are automatically switched at a switching
interval of a fixed time,
5 the captured image data is data on a video captured so
as to include the plurality of screen pages, and
the server extracts images corresponding to the
plurality of screen pages from the captured image data,
using the switching interval, extracts the two-dimensional
10 codes from the extracted images, decodes the extracted twodimensional codes, and restores the output data from the
plurality of pieces of decoded information obtained by
decoding, using the data identification information and the
division information included in the decoded information.
15
4. The diagnostic system according to claim 1 or 2,
wherein
when a plurality of the two-dimensional codes
corresponding to one piece of the output data are displayed
20 on a plurality of screen pages on a two-dimensional code
screen on which the control device displays the twodimensional codes, the screen pages are automatically
switched at a switching interval of a fixed time,
the captured image data is data on a plurality of
25 still images captured by continuous shooting at a period
obtained by dividing the switching interval by a natural
number so as to include the plurality of screen pages, and
the server extracts images corresponding to the
plurality of screen pages from the plurality of still
30 images, using the period, extracts the two-dimensional
codes from the extracted images, decodes the extracted twodimensional codes, and restores the output data from the
plurality of pieces of decoded information obtained by
58
decoding, using the data identification information and the
division information included in the decoded information.
5. The diagnostic system according to any one of claims 1
5 to 4, wherein the server recognizes a position of the twodimensional code in the image indicated by the captured
image data by machine learning, based on features of an
image showing the two-dimensional code, and extracts the
two-dimensional code from the captured image data, using a
10 recognition result.
6. A control device to control a machine, comprising:
a transmission data conversion unit to generate a
plurality of pieces of divided data by dividing output data
15 to be used for at least one of diagnosis or maintenance of
the machine, and generate transmission data with data
identification information that is identification
information on the output data and division information
indicating order of the plurality of pieces of divided data
20 added to each of the pieces of divided data;
a two-dimensional code generation unit to convert the
transmission data into a two-dimensional code; and
a two-dimensional code display unit to display the
two-dimensional code.
25
7. The control device according to claim 6, wherein when
the two-dimensional code display unit displays the twodimensional codes corresponding to one piece of the output
data on a plurality of screen pages, the two-dimensional
30 code display unit automatically switches the screen pages
at a switching interval of a fixed time.
8. The control device according to claim 7, wherein
59
captured image data captured by an information
terminal as a video so as to include the plurality of
screen pages is transmitted to a server, and
the server extracts images corresponding to the
5 plurality of screen pages from the captured image data,
using the switching interval, extracts the two-dimensional
codes from the extracted images, decodes the extracted twodimensional codes, and restores the output data from a
plurality of pieces of decoded information obtained by
10 decoding, using the data identification information and the
division information included in the decoded information.
9. The control device according to claim 7, wherein
data on a plurality of still images captured by
15 continuous shooting at a period obtained by dividing the
switching interval by a natural number so as to include the
plurality of screen pages is transmitted as captured image
data to a server, and
the server extracts images corresponding to the
20 plurality of screen pages from the plurality of still
images, using the period, extracts the two-dimensional
codes from the extracted images, decodes the extracted twodimensional codes, and restores the output data from a
plurality of pieces of decoded information obtained by
25 decoding, using the data identification information and the
division information included in the decoded information.
10. A diagnostic method, comprising:
generating, by a control device to control a machine,
30 a plurality of pieces of divided data by dividing output
data to be used for at least one of diagnosis or
maintenance of the machine, generating, by the control
device, transmission data with data identification
60
information that is identification information on the
output data and division information indicating order of
the plurality of pieces of divided data added to each of
the pieces of divided data, converting, by the control
5 device, the transmission data into a two-dimensional code,
and displaying, by the control device, the two-dimensional
code; and
receiving, by a server, captured image data that is
data on an image in which the displayed two-dimensional
10 code is captured from an information terminal that has
captured the image, extracting, by the server, the twodimensional code from the captured image data, decoding, by
the server, the extracted two-dimensional code, and
restoring, by the server, the output data from a plurality
15 of pieces of decoded information obtained by decoding,
using the data identification information and the division
information included in the decoded information.
11. The diagnostic method according to claim 10, wherein
20 the control device determines a data size of the pieces of
divided data corresponding one-to-one to a plurality of the
two-dimensional codes displayed simultaneously, based on a
size of an area in which the two-dimensional codes can be
displayed and a data size of the output data.
25
12. The diagnostic method according to claim 10 or 11,
wherein
when a plurality of the two-dimensional codes
corresponding to one piece of the output data are displayed
30 on a plurality of screen pages on a two-dimensional code
screen on which the control device displays the twodimensional codes, the screen pages are automatically
switched at a switching interval of a fixed time,
61
the captured image data is data on a video captured so
as to include the plurality of screen pages, and
the server extracts images corresponding to the
plurality of screen pages from the captured image data,
5 using the switching interval, extracts the two-dimensional
codes from the extracted images, decodes the extracted twodimensional codes, and restores the output data from the
plurality of pieces of decoded information obtained by
decoding, using the data identification information and the
10 division information included in the decoded information.
13. The diagnostic method according to claim 10 or 11,
wherein
when a plurality of the two-dimensional codes
15 corresponding to one piece of the output data are displayed
on a plurality of screen pages on a two-dimensional code
screen on which the control device displays the twodimensional codes, the screen pages are automatically
switched at a switching interval of a fixed time,
20 the captured image data is data on a plurality of
still images captured by continuous shooting at a period
obtained by dividing the switching interval by a natural
number so as to include the plurality of screen pages, and
the server extracts images corresponding to the
25 plurality of screen pages from the plurality of still
images, using the period, extracts the two-dimensional
codes from the extracted images, decodes the extracted twodimensional codes, and restores the output data from the
plurality of pieces of decoded information obtained by
30 decoding, using the data identification information and the
division information included in the decoded information.
14. The diagnostic method according to any one of claims
62
10 to 13, wherein the server recognizes a position of the
two-dimensional code in the image indicated by the captured
image data by machine learning, based on features of an
image showing the two-dimensional code, and extracts the
5 two-dimensional code from the captured image data, using a
recognition result.
15. A diagnostic program causing a control device to
control a machine to perform processing of:
10 generating a plurality of pieces of divided data by
dividing output data to be used for at least one of
diagnosis or maintenance of the machine, generating
transmission data with data identification information that
is identification information on the output data and
15 division information indicating order of the plurality of
pieces of divided data added to each of the pieces of
divided data, converting the transmission data into a twodimensional code, and displaying the two-dimensional code,
and
20 the diagnostic program causing a server to perform
processing of:
receiving captured image data that is data on an image
in which the displayed two-dimensional code is captured
from an information terminal that has captured the image,
25 extracting the two-dimensional code from the captured image
data, decoding the extracted two-dimensional code, and
restoring the output data from a plurality of pieces of
decoded information obtained by decoding, using the data
identification information and the division information
30 included in the decoded information