(Extracted from wipo)
Title of invention: Display, display method and display system
Technical field
[0001]
　The present invention relates to a display for guiding an operation procedure, a display method, and a display system.
Background art
[0002]
　In a control system including a control device that controls a controlled device and a display that displays information collected by the control device, if an alarm occurs due to a problem in the controlled device, the operator The data causing the alarm is corrected by operating the operation panel.
[0003]
　The display of such a control system guides the operation procedure in order to facilitate the operation of the operator. The operation support apparatus of Patent Document 1 selects an operation procedure based on an operation time that is a time required for the operation, and uses the selected operation procedure for operation guidance.
Prior art documents
Patent Literature
[0004]
Patent Document 1: Japanese Patent Application Laid-Open No. 2014-232377
Summary of the Invention
Problems to be solved by the invention
[0005]
　However, in Patent Document 1 as the conventional technique described above, when a plurality of events occur, the operation time of a series of operations is calculated, so that there is a problem in that an accurate operation time for each event cannot be calculated. It was.
[0006]
　The present invention has been made in view of the above, and an object of the present invention is to obtain a display device that can guide an appropriate operation procedure for each event even when a plurality of events occur.
Means for solving the problem
[0007]
　In order to solve the above-described problems and achieve the object, the present invention is directed to a display in which a first event and a second event that occur in an external device are sent from the external device to the first event. A calculation unit is provided that calculates an operation time, which is a time from when the first event ends by an operation until the second event ends by an operation to the second event. In addition, the display of the present invention includes a storage unit that stores an operation procedure that is a history of operations for the second event, an operation time corresponding to the operation procedure, and an operation procedure in the storage unit in accordance with an instruction from the calculation unit. A display unit for displaying any of the above. In addition, when the calculation unit finishes calculating the operation time and the second event is newly sent, the display unit of the present invention can select from the operation procedures in the storage unit based on the operation time in the storage unit. The operation guidance is executed by selecting an operation procedure used for the operation guidance and displaying the selected operation procedure on the display unit.
The invention's effect
[0008]
　The display according to the present invention has an effect that an appropriate operation procedure can be induced for each event even when a plurality of events occur.
Brief Description of Drawings
[0009]
1 is a diagram illustrating a configuration of a display according to a first embodiment of the present invention.
FIG. 2 is a diagram illustrating a first example of an operation procedure according to the first embodiment.
FIG. 3 is an operation according to the first embodiment. FIG
. 4 is a diagram for explaining a second example of the procedure. FIG . 4 is a diagram showing a configuration of operation history information according to the
first embodiment. FIG . 5 is a flowchart showing a processing procedure for operation guidance according to the first embodiment
.
FIG. 7 is a flowchart for explaining the operation history information accumulating process procedure according to the first embodiment. FIG. 7 is a diagram for explaining the operation guiding process according to the
first embodiment. FIG
. 9 is a diagram showing a first example of data. FIG . 9 is a diagram showing a second example of administrator data according to the
first embodiment. FIG . 10 is a hardware diagram of the overall processing unit included in the display according to the first embodiment. a configuration example illustrates
diagram showing a configuration of a [11] indicator according to a second embodiment of the present invention
written in [12] embodiment 2 Machine Learning apparatus flowchart illustrating a procedure of updating action value function
BEST MODE FOR CARRYING OUT THE INVENTION
[0010]
　Hereinafter, a display, a display method, and a display system according to embodiments of the present invention will be described in detail based on the drawings. Note that the present invention is not limited to these embodiments.
[0011]
Embodiment 1 FIG.
　FIG. 1 is a diagram showing a configuration of a display according to Embodiment 1 of the present invention. The display 10 is a device that displays various kinds of information and receives an operation by an operator. The display 10 is connected to the control device 30 and displays various information such as history information of operation processing performed by the operator, information for guiding an operation procedure, or event information described later transmitted from the control device 30. . The event information is event information such as an alarm occurrence.
[0012]
　The control device 30 is a controller such as a programmable logic controller (PLC) and controls a controlled device (not shown). An example of event information sent from the control device 30 is an alarm that occurs when a malfunction occurs in the controlled device, or a setup change at the time of changing the product type. When the event information is an alarm occurrence, the event information includes information indicating which malfunction has occurred in which controlled device. Further, when the event information is a setup change at the time of changing the product type, the event information includes information indicating from which product type the product type to be manufactured is changed to which product type. The event information includes information on the date and time when the event occurred. When the event information is sent from the control device 30, the display 10 accepts an operation by the operator and sends information corresponding to the operation content to the control device 30. An example of the operation by the operator is pressing a button or inputting a numerical value.
[0013]
　When the operation is performed by the operator so as to eliminate the cause of the event when the event occurs, the display device 10 stores the operation time, which is the time required for the operation, and the event in association with each other. . The display device 10 according to the first embodiment calculates an operation time for each event when a plurality of events occur, and stores each event and the operation time in association with each other. Then, when a new event that is the same as the stored event occurs, the display 10 performs a display for guiding the operation procedure to the operator based on the stored information. Thus, the display device 10 has an input guidance function for operations to the operator.
[0014]
　The display 10 performs communication between the input unit 11 that receives an operation from the operator, the display unit 12 that displays information for guiding an operation procedure when an event occurs, and the control device 30. And an interface (I / F: InterFace) unit 13.
[0015]
　The display unit 10 controls the overall processing of the display unit 10 and generates information to be displayed on the display unit 12 and the overall processing unit 20 that is a calculation unit that calculates the operation time for each event. A display information generation unit 21. In addition, the display device 10 includes a storage unit 22 that stores operation history information 101 (described later) in which an operation procedure by an operator is associated with an operation time.
[0016]
　The display device 10 may have a touch panel in which the input unit 11 and the display unit 12 are integrally formed. In the following description, a case where the display 10 has a touch panel having the function of the input unit 11 and the function of the display unit 12 will be described.
[0017]
　The display unit 12 in the touch panel displays information such as characters, numbers, symbols, tables, figures, and pictures generated by the display information generation unit 21. When the display unit 12 displays information for guiding the operation procedure, the display unit 12 changes the display mode such as the color, the way to shine, or the brightness of the object at the position that the operator wants to touch, so that it can Are displayed in different ways. The object here is an operation target on the screen. An example of an object whose display mode is changed by the display unit 12 is a button. In this case, the display unit 12 guides the operator to an operation on a specific button by displaying the display mode of the button in a mode different from other regions.
[0018]
　The input unit 11 in the touch panel accepts an operation corresponding to the pressed position when the touch screen, which is the screen of the touch panel, is pressed by the operator. The input unit 11 inputs position information indicating the position pressed by the operator to the overall processing unit 20.
[0019]
　The communication I / F unit 13 is connected to the control device 30 that is an external device, and executes communication with the control device 30 in accordance with an instruction from the overall processing unit 20. The external device is not limited to the control device 30 and may be a sensor or a robot. When receiving the event information from the control device 30, the communication I / F unit 13 sends the received event information to the overall processing unit 20. Further, the communication I / F unit 13 sends information corresponding to the operation processing by the operator to the control device 30. The event information sent from the control device 30 to the communication I / F unit 13 includes information indicating that the bit is turned on when the event occurs, and the bit is turned off when the event ends. It contains information indicating that it has become.
[0020]
　The overall processing unit 20 sends the content of the event information sent via the communication I / F unit 13 to the display information generating unit 21. The overall processing unit 20 detects which operation has been executed by the operator based on the information displayed on the display unit 12 and the position information sent from the input unit 11. The input unit 11 generates operation information indicating which operation has been executed by the operator based on the position information and the content displayed on the display unit 12, and the generated operation information is integrated with the overall processing unit. You may send to 20.
[0021]
　In addition, the overall processing unit 20 calculates an operation time, which is a time from the event occurrence timing to the end of the event, for the first event described later, which is the first event. The overall processing unit 20 calculates the operation time from the start timing of the event to the end of the event, not the event generation timing, for the second event, which will be described later, which is the second event. Further, the overall processing unit 20 creates operation history information 101 in which an event that has occurred, an operation procedure for an event by an operator, and an operation time are associated with each other. The overall processing unit 20 stores the operation history information 101 by storing the operation history information 101 in the storage unit 22.
[0022]
　When the event that is the same as the event included in the operation history information 101 newly occurs after accumulating the operation history information 101, the overall processing unit 20 guides the operator to operate the button for the new event. A guidance instruction is generated and sent to the display information generation unit 21. Further, the overall processing unit 20 generates a display instruction for displaying the event information and sends it to the display information generating unit 21.
[0023]
　The display information generation unit 21 generates display information such as characters, numbers, symbols, tables, figures, and pictures for displaying various information such as event information and operation guidance buttons in accordance with instructions from the overall processing unit 20. To do. The display information generation unit 21 causes the display unit 12 to display the generated display information.
[0024]
　Next, an example of an operation procedure when an event occurs will be described. FIG. 2 is a diagram illustrating a first example of the operation procedure according to the first embodiment, and FIG. 3 is a diagram for explaining a second example of the operation procedure according to the first embodiment. 2 and 3 show an example of the operation procedure when the first event and the second event occur. In the following, a case where the first event and the second event are occurrences of alarms due to malfunctions will be described.
[0025]
　The control device 30 transmits the same type of event to the display device 10 multiple times. Here, a case will be described in which the control device 30 transmits the first event and the second event to the display 10 and n times when n is a natural number of 2 or more. When the display 10 receives the first event and the second event, the display 10 displays the first event and the second event. As a result, the operator selects which of the first event and the second event is to be operated. Here, a case where the second event is selected as the operation target after the first event is selected as the operation target will be described.
[0026]
　FIG. 2 shows an example of an operation procedure for the first event and the second event that occurred first, and FIG. 3 shows an example of an operation procedure for the first event and the second event that occurred n times. Operations A, B, C, D, and E shown in FIG. 2 are operation histories that indicate operation procedures when the first event and the second event occur for the first time. In addition, operations A, B, D, E, and F shown in FIG. 3 are operation histories that indicate operation procedures when the first event and the second event occur at the nth time.
[0027]
　As shown in FIG. 2, after the first event and the second event occur for the first time, when the operation A for the first event is executed by the operator, the display 10 receives the operation A and performs the operation. Information corresponding to A is sent to the control device 30. After the operation A, when the operation B for the first event is executed by the operator, the display 10 receives the operation B and sends information corresponding to the operation B to the control device 30. Further, after the operation B, when the operation C for the first event is executed by the operator, the display 10 receives the operation C and sends information corresponding to the operation C to the control device 30. Thereby, the control apparatus 30 eliminates the malfunction corresponding to a 1st event, and restores the state of a to-be-controlled device. Examples of malfunctions are that there is no material used by the controlled device, the pressure in the controlled device exceeds a reference value, or a sensor provided in the controlled device detects an abnormal value.
[0028]
　Thereafter, the display device 10 starts to start the second event and accepts an operation for the second event. When the operation D for the second event is executed by the operator, the display 10 receives the operation D and sends information corresponding to the operation D to the control device 30. When the operation E for the second event is executed by the operator after the operation D, the display 10 receives the operation E and sends information corresponding to the operation E to the control device 30. Thereby, the control apparatus 30 eliminates the malfunction corresponding to a 2nd event, and restores the state of a to-be-controlled device.
[0029]
　The time required to recover from the defect corresponding to the first event is the time from the occurrence of the first event to the end of the first event. The time from the occurrence to the end of the first event is the operation time for the first event.
[0030]
　When the first event ends, a malfunction to the second event can be started. Therefore, the timing at which the first event ends is the timing at which a failure to the second event is started. For this reason, the time required to restore the second event is the time from the end of the first event to the end of the second event. The operation time from the end of the first event to the end of the second event is an operation time 51 to the second event. In other words, the operation time from the recovery of the first event to the recovery of the second event is the operation time 51 to the second event.
[0031]
　Assuming that the operation time for the second event is from the occurrence of the second event to the end, the time for starting the trouble for the first event is included in the operation time for the second event. Since the time for starting the trouble for the first event is a period during which the trouble for the second event cannot be started, it should not be included in the operation time for the second event. Therefore, in the first embodiment, the overall processing unit 20 calculates the time from the end of the first event to the end of the second event, and sets the calculated time as the net operation time 51 for the second event. In other words, the time from the end of the first event to the end of the second event is the net required time required for the operation to the second event.
[0032]
　The overall processing unit 20 correlates the calculated first operation time to the first event, the first event, and the order of the operation A, operation B, and operation C as the first operation procedure to the first event. And stored in the storage unit 22. The overall processing unit 20 also associates the calculated first operation time 51 with respect to the second event, the second event, and the order of operations D and E, which are the first operation procedures with respect to the second event. And stored in the storage unit 22. At this time, the overall processing unit 20 registers the associated information in the operation history information 101 in the storage unit 22.
[0033]
　As shown in FIG. 3, after the first event and the second event occur at the nth time, when the operation A for the first event is executed by the operator, the display 10 receives the operation A and performs the operation. Information corresponding to A is sent to the control device 30. When the operation B for the first event is executed by the operator after the operation A, the display 10 receives the operation B and sends information corresponding to the operation B to the control device 30. When the operation D for the first event is executed by the operator after the operation B, the display 10 receives the operation D and sends information corresponding to the operation D to the control device 30. Furthermore, when the operation E for the first event is executed by the operator after the operation D, the display device 10 accepts the operation E and sends information corresponding to the operation E to the control device 30. Thereby, the control apparatus 30 eliminates the malfunction corresponding to a 1st event, and restores the state of a to-be-controlled device.
[0034]
　Thereafter, the display device 10 starts to start the second event and accepts an operation for the second event. When the operation F for the second event is executed by the operator, the display 10 receives the operation F and sends information corresponding to the operation F to the control device 30. Thereby, the control apparatus 30 eliminates the malfunction corresponding to a 2nd event, and restores the state of a to-be-controlled device.
[0035]
　The overall processing unit 20 calculates the n-th operation time for the first event, the first event, and the order of the operation A, operation B, operation D, and operation E, which are the n-th operation procedure for the first event. Are associated with each other and stored in the storage unit 22. The overall processing unit 20 stores the calculated n-th operation time 52 for the second event, the second event, and the operation F, which is the n-th operation procedure for the second event, in association with each other. Store in the unit 22. At this time, the overall processing unit 20 registers the associated information in the operation history information 101 in the storage unit 22. In this way, the display device 10 acquires and accumulates an operation history when the display device 10 is operated in the same time series.
[0036]
　Thereafter, when the new first event occurs, the overall processing unit 20 selects an operation procedure for solving the problem of the first event, and when the second event newly occurs, the overall processing part 20 eliminates the problem of the second event. Select the operating procedure to do. At this time, the overall processing unit 20 selects an operation procedure with the shortest operation time from among the operation procedures registered in the operation history information 101. When the operation time of the first operation procedure to the first event is the shortest among the operation procedures to the first event, the overall processing unit 20 selects the operation procedure to the first event. When the operation time 52 of the operation procedure for the nth second event is the shortest among the operation procedures for the second event, the overall processing unit 20 selects the operation procedure for the nth second event. . As described above, the display device 10 according to the first embodiment selects, from the operation history information 101, an operation procedure having the shortest net required time from the start to the end of the event.
[0037]
　FIG. 4 is a diagram illustrating a configuration of operation history information according to the first embodiment. The operation history information 101 is information in which an operation procedure that is an operation history and an operation time are associated with each event. In the example illustrated in FIG. 4, the first event, the operation procedure of the operation A, the operation B, and the operation C are associated with the operation time of 10 seconds. The operation procedures of the operation A, the operation B, and the operation C are the operation procedures for the first event shown in FIG.
[0038]
　In the example of the operation history information 101 illustrated in FIG. 4, the first event, the operation procedure of the operation A, the operation B, the operation D, and the operation E are associated with the operation time of 15 seconds. The operation procedure of the operation A, the operation B, the operation D, and the operation E is an operation procedure for the nth first event shown in FIG.
[0039]
　In the example of the operation history information 101 illustrated in FIG. 4, the second event, the operation procedure of the operations D and E, and the operation time of 2 seconds are associated with each other. The operation procedures of the operation D and the operation E are the operation procedures for the first second event shown in FIG.
[0040]
　In the example of the operation history information 101 illustrated in FIG. 4, the second event, the operation F, and the operation time of 1 second are associated with each other. The operation F is an operation procedure for the n-th second event shown in FIG.
[0041]
　Next, a processing procedure of the operation history information 101 accumulation processing and operation guidance processing executed by the display device 10 will be described. FIG. 5 is a flowchart of an operation guidance processing procedure according to the first embodiment. Since the operation guidance to the first event and the operation guidance to the second event are the same processing, the operation guidance to the first event will be described here.
[0042]
　When the control device 30 sends event information to the display device 10, the display unit 12 displays the contents of the event information. Thereafter, when information for selecting the first event is input to the input unit 11 by the operator, the display unit 12 displays a screen for accepting an operation on the first event. Then, when an operation on the display device 10 is performed by the operator, in step S10, the input unit 11 receives operation information indicating an operation process performed by the operator. The input unit 11 sends the received operation information to the overall processing unit 20. The operation information received by the input unit 11 is an operation for the first event, and may be one operation such as the operation A described in FIGS. 2 and 3, or a series of operations such as the operation A and the operation B. The operation procedure may be used. The overall processing unit 20 may select a first event based on the importance of the event, and the display unit 12 may display a screen that accepts an operation for the first event selected by the overall processing unit 20. . An example of the importance level of an event is the shortest operation time required to operate the event.
[0043]
　In step S 20, the overall processing unit 20 determines whether or not there is an operation procedure that is operation information from the input unit 11 in the operation history information 101 stored in the storage unit 22. In other words, the overall processing unit 20 determines whether or not the operation information received in step S10 is included in the accumulated operation history. Specifically, when the operation information from the input unit 11 is operation A, the overall processing unit 20 determines whether there is an operation history in which the first operation is operation A in the accumulated operation history. judge. When the operation information from the input unit 11 is a series of operation procedures of operation A and operation B, the overall processing unit 20 indicates that the first operation procedure is operation A and operation B in the accumulated operation history. It is determined whether there is a certain operation history.
[0044]
　When the operation information is not included in the operation history information 101, that is, in the case of No in step S20, in step S50, the overall processing unit 20 is a storage process that is a process of registering new operation information in the operation history information 101. Execute.
[0045]
　On the other hand, when operation information is included in the operation history information 101, that is, in the case of Yes in step S20, the overall processing unit 20 determines the operation time in the operation procedure for the first event from the operation history information 101. Select the operation procedure with the shortest. The overall processing unit 20 selects an operation procedure for solving the problem of the first event when an operation for the first event is started when the first event has occurred.
[0046]
　When the operation time of the first operation procedure to the first event is the shortest among the operation procedures to the first event, the overall processing unit 20 selects the operation procedure to the first event. Thereby, the overall processing unit 20 determines an object that the operator wants to operate next in the touch screen based on the selected operation procedure. Specifically, the overall processing unit 20 sequentially selects unoperated operations in the selected operation procedure according to the operation procedure, and determines an object for executing the selected operation. Then, the overall processing unit 20 sends object information specifying the determined object to the display information generating unit 21. Accordingly, in step S30, the display information generation unit 21 generates an object in a highlighted state that is an object to be operated next, based on the object information sent from the overall processing unit 20. Then, the display information generation unit 21 sends the generated object to the display unit 12. The highlighting is a process for displaying an object to be operated next so that the object is more noticeable than other objects.
[0047]
　Accordingly, in step S40, the display unit 12 guides input to the operator by highlighting the object. And the indicator 10 continues the process which receives operation from an operator, guiding an input to an operator. At this time, in step S 50, the display device 10 performs a storage process that is a process of registering new operation information in the operation history information 101 when receiving an operation from the operator.
[0048]
　FIG. 6 is a flowchart of an operation history information accumulation process procedure according to the first embodiment. When an event occurs, the communication I / F unit 13 receives event information from the control device 30. Then, the communication I / F unit 13 sends event information to the overall processing unit 20. Thereby, in step S100, the overall processing unit 20 acquires event information.
[0049]
　When the touch screen is pressed by the operator, the input unit 11 of the display 10 determines an operation corresponding to the pressed position and generates operation information. Then, the input unit 11 inputs operation information to the overall processing unit 20. Thereby, in step S110, the overall processing unit 20 acquires operation information. The operation information acquired by the overall processing unit 20 is one or a plurality of operation procedures. The overall processing unit 20 starts measuring time when an event occurs.
[0050]
　In step S121, the overall processing unit 20 calculates an operation time that is a time from the occurrence of the first event to the recovery. Further, in step S122, the overall processing unit 20 calculates an operation time that is a time from the start to the recovery of the second event. The overall processing unit 20 here calculates an operation time for each event using the method described with reference to FIGS. 2 and 3.
[0051]
　In step S 130, the overall processing unit 20 associates the operation time for each event, the operation procedure for each event, and the event information. Furthermore, the overall processing unit 20 stores the associated information in the operation history information 101 for each event. In step S 140, the overall processing unit 20 accumulates the operation history information 101 in the storage unit 22. Thereby, the display device 10 ends the accumulation processing of the operation history information 101. When the storage process of the operation history information 101 is completed, the display device 10 returns to the process of step S10 and repeats the processes of steps S10 to S50.
[0052]
　Here, the guidance process of the operation procedure by the display device 10 will be described. FIG. 7 is a diagram for explaining the operation guidance process according to the first embodiment. FIG. 7 shows a screen example of the touch panel 15. The touch panel 15 having the functions of the input unit 11 and the display unit 12 displays buttons 61 to 64 on the screen. These buttons 61 to 64 are buttons that can be pressed by the operator. Operations such as operations A to F are assigned to the buttons 61 to 64. The touch panel 15 may display five or more buttons, or may display three or less buttons. The touch panel 15 may display an object such as a numeric keypad for inputting a numerical value or a dial for increasing or decreasing the numerical value by a rotation operation.
[0053]
　The display device 10 performs a process of accepting an operation from the operator while guiding the operation procedure to the operator. After the button 61 is pressed by the operator, if the object that the operator wants to operate next is the button 62, the display device 10 highlights the button 62. Thereafter, when the button 62 is pressed by the operator, the display 10 highlights the object that the operator wants to operate next.
[0054]
　When the operation guidance to the second event is performed, the display 10 highlights the button of the operation F after the button of the operation C that is the last operation among the operations to the first event is pressed. .
[0055]
　By the way, the control system in which the display 10 and the control device 30 are arranged is managed by an administrator. For this reason, the display 10 or the control device 30 may collect and manage data for the manager, and the display 10 may display the data for the manager. Further, an external management device other than the control device 30 may collect and manage data for the administrator. In this case, the external management device may receive data for the administrator from the control device 30 via the cloud computing system. The first example of the manager data managed by the display 10, the control device 30, or the external management device is the relationship between the operation procedure and the operation time. The second example of the manager data managed by the display 10, the control device 30, or the external management device is the relationship between the event and the operation time for the event.
[0056]
　FIG. 8 is a diagram illustrating a first example of the administrator data according to the first embodiment. FIG. 8 shows the relationship between the operation procedure for a specific event and the operation time when this operation procedure is executed. The horizontal axis in FIG. 8 is an operation procedure, and the vertical axis in FIG. 8 is a net operation time.
[0057]
　In FIG. 8, the operation procedure of operation A, operation B, and operation C is shown as operation procedure ST1. In addition, the operation procedures ST, operation B, operation D, and operation E are indicated by operation procedure STn. The display 10 can provide the manager with the operation time for each operation procedure, which is an information source for process improvement, in an easy-to-understand manner, by sorting and displaying information for identifying the operation procedure in the order of short operation time. .
[0058]
　FIG. 9 is a diagram illustrating a second example of the administrator data according to the first embodiment. FIG. 9 shows the relationship between the type of event and the net time of operation time for this event. The horizontal axis in FIG. 9 is an event, and the vertical axis in FIG. 9 is a net operation time.
[0059]
　In FIG. 9, the first event is indicated by the first event X1, the mth event when m is a natural number of 3 or more is indicated by the mth event Xm, and the second event is indicated by the second event X2. FIG. 9 illustrates the operation time of the first event X1, the operation time of the mth event Xm, and the operation time of the second event X2. The display device 10 can provide the administrator with the operation time for each event, which is an information source for process improvement, in an easy-to-understand manner, by sorting and displaying information for identifying events in the order of short operation time.
[0060]
　The overall processing unit 20 according to the first embodiment uses a series of operation procedures for operation guidance. However, the key operation for inputting a parameter such as a numerical value is different depending on the situation. The key operation for inputting parameters may be excluded from the operation procedure. As a result, the overall processing unit 20 can selectively use, for operation guidance, an operation that the user wants to execute the same operation even in different situations while excluding different operations depending on the situation.
[0061]
　In addition, the overall processing unit 20 may calculate the operation time by excluding the time from the end of the first event to the start of the operation by the operator on the second event. The operation time may be calculated. An example of the start of the operation is the first button press by the operator to the second event.
[0062]
　When the overall processing unit 20 calculates the operation time by excluding the time until the operation is started, the first operation by the operator to the second event is started until the second event is ended. The operation time is calculated.
[0063]
　Further, when calculating the operation time without excluding the time until the operation is started, the overall processing unit 20 calculates the operation time from the end of the first event to the end of the second event. Further, the overall processing unit 20 may calculate the operation time by excluding the time of the operation interval between operations by the operator.
[0064]
　Further, the overall processing unit 20 may calculate the operation time by excluding the time from the occurrence of the first event until the operation by the operator on the first event is started, or without excluding it. The operation time may be calculated. An example of the start of the operation is the first button press by the operator on the first event.
[0065]
　When the overall processing unit 20 calculates the operation time by excluding the time until the operation is started, from the start of the first operation by the operator to the first event until the end of the first event The operation time is calculated.
[0066]
　Further, when calculating the operation time without excluding the time until the operation is started, the overall processing unit 20 calculates the operation time from the occurrence of the first event to the end of the first event.
[0067]
　The overall processing unit 20 can calculate an accurate operation time by calculating the operation time by excluding the time until the operation is started. Further, the overall processing unit 20 can easily calculate the operation time by calculating the operation time without excluding the time until the operation is started. The overall processing unit 20 can calculate an accurate operation time by calculating the operation time by excluding the operation interval time.
[0068]
　The overall processing unit 20 may change the order of operation guidance by executing interruption or interruption based on the importance of the event during the operation by the operator to the event. In this case, when the overall processing unit 20 receives an event having a higher importance than the event being operated, the overall processing unit 20 interrupts or interrupts the event being operated, and operates the event having a higher importance than the event being operated. Accept.
[0069]
　Specifically, when the third event generated in the control device 30 is sent from the control device 30 during the operation to the second event, the overall processing unit 20 determines the importance level of the second event and the third event. Compare the importance of the event. Then, when the importance of the third event is higher than the importance of the second event, the overall processing unit 20 executes an interrupt or interruption to the operation to the second event, and performs the operation to the third event. Accept. In this case, when the third event occurs during the operation to the second event, the overall processing unit 20 interrupts the operation to the second event and accepts the operation to the third event, or goes to the second event. The operation reception is interrupted and the operation for the third event is accepted. Even when receiving an operation for the third event, the overall processing unit 20 guides the operation procedure. An example of the importance level of the event is the shortest operation time required to operate the event, or a level set by the administrator. The overall processing unit 20 determines that an event having the shortest operation time is a higher importance event, and determines that an event having a higher importance is higher as the level set by the administrator is higher.
[0070]
　Moreover, the control apparatus 30 may be connected to the some indicator 10 and the some indicator 10 may accept operation. In this case, the overall processing unit 20 of the display device 10 may guide the operation procedure for each event in parallel after being distributed to a plurality of operators. That is, the overall processing unit 20 may distribute a plurality of events to operators according to events. In other words, the overall processing unit 20 of the display device 10 may cause the other display device 10 to display the operation procedure by causing the other display device 10 to execute part of the operation guidance. In this case, the display device 10 displays an operation procedure for a specific event, and the other display device 10 displays an operation procedure for another event other than the specific event.
[0071]
　Specifically, the first overall processing unit 20 of the first display 10 guides the operation procedure to the first event that is the first operation procedure, and the second overall control of the second display 10 is performed. The processing unit 20 guides the operation procedure to the second event that is the second operation procedure. In this case, the first overall processing unit 20 transmits the second operation procedure to the second overall processing unit 20 via the control device 30. Note that the second overall processing unit 20 may transmit the first operation procedure to the first overall processing unit 20 via the control device 30. Thereby, the overall processing unit 20 can efficiently provide operation guidance to the control system including the plurality of displays 10. Note that the control device 30 may assign an operation to the event for each of the plurality of display devices 10.
[0072]
　Further, the overall processing unit 20 of the display device 10 may automatically switch the screen when it is necessary to display the content that the operator wants to guide over a plurality of screens. In other words, when the operation procedure desired to be provided to the operator extends over a plurality of screens, the overall processing unit 20 may automatically switch the screen and display the operation procedure. As a result, the operator does not need to perform a screen switching operation, and thus can easily perform an operation based on operation guidance.
[0073]
　Further, the overall processing unit 20 of the display device 10 may change the fineness of the operation guidance based on the skill level of the operator or the occurrence frequency of the event. An example of the fineness of operation guidance is the large number of display times for highlighting an object during operation guidance. When the operator's proficiency level is low or the occurrence frequency of the event is low, the overall processing unit 20 performs detailed operation guidance by increasing the number of times the object is highlighted. On the other hand, when the operator's proficiency level is high or the occurrence frequency of events is high, the overall processing unit 20 reduces the number of display times by omitting object highlighting on the specific screen. As a result, the overall processing unit 20 can execute appropriate operation guidance based on the operator's proficiency level or appropriate operation guidance based on the occurrence frequency of events.
[0074]
　Further, the overall processing unit 20 of the display device 10 may send an input signal to the control device 30 without an instruction from the operator at the time of operation guidance based on the history of the input signal to the control device 30. In this case, even if no operation is performed by the operator, the display unit 10 regards that the operation is virtually performed and inputs an input signal indicating that the operation has been performed to the control device 30. In this case, the process that is regarded as having been performed may be an operation on a hardware switch other than the display 10 or a touch operation on the touch screen. Thereby, since the number of operations is reduced, the operator can easily execute an operation based on the operation guidance.
[0075]
　Further, the overall processing unit 20 of the display device 10 may automatically execute an operation procedure presented at the time of operation guidance. In this case, the overall processing unit 20 automatically executes the operation procedure by assuming that the operation has been executed according to the operation procedure even if the operation by the operator is not executed. The overall processing unit 20 of the display device 10 may automatically execute the operation procedure when one operation is executed by the operator. Further, the overall processing unit 20 of the display device 10 may execute a simulation of an operation procedure presented at the time of operation guidance and evaluate the execution result. Thereby, the operator can confirm the validity of the operation procedure by simulation before executing the operation.
[0076]
　As in the prior art, when the apparatus selects an operation procedure based on the operation frequency, the amount of information that is retained to extract an appropriate operation procedure increases. For this reason, when the display device is a general-purpose device, it is difficult to provide an operation procedure in real time. Further, when an operation procedure is selected based on the operation frequency, the parameter setting operation cannot be excluded if a parameter setting operation is included in the middle of the operation procedure. Furthermore, when selecting an operation procedure based on the operation frequency, an appropriate operation procedure with a short operation time cannot be selected.
[0077]
　On the other hand, since the display device 10 according to the first embodiment does not need to store the operation frequency, the amount of information stored can be suppressed. Further, the display device 10 can exclude the parameter setting operation even when the parameter setting operation is included in the operation procedure. Further, since the display device 10 calculates the net operation time, an appropriate operation procedure with a short operation time can be selected.
[0078]
　Next, the hardware configuration of the overall processing unit 20 will be described. FIG. 10 is a diagram illustrating a hardware configuration example of the overall processing unit included in the display according to the first embodiment. The overall processing unit 20 can be realized by the control circuit 300 shown in FIG. 10, that is, the processor 301 and the memory 302. An example of the processor 301 is a CPU (Central Processing Unit, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, or a DSP) or a system LSI (Large Scale Integration). An example of the memory 302 is a RAM (Random Access Memory), a ROM (Read Only Memory), or a flash memory.
[0079]
　The overall processing unit 20 is realized by the processor 301 reading and executing a program stored in the memory 302 for executing the operation of the overall processing unit 20. It can also be said that this program causes a computer to execute the procedure or method of the overall processing unit 20. The memory 302 is also used as a temporary memory when the processor 301 executes various processes.
[0080]
　Thus, the program executed by the processor 301 is a computer program product having a computer-readable and non-transitory recording medium including a plurality of instructions for performing data processing that can be executed by a computer. is there. The program executed by the processor 301 causes the computer to execute data processing by a plurality of instructions.
[0081]
　Further, the overall processing unit 20 may be realized by dedicated hardware. Moreover, part of the functions of the overall processing unit 20 may be realized by dedicated hardware, and part of the functions may be realized by software or firmware.
[0082]
　As described above, according to the first embodiment, the overall processing unit 20 calculates the net operation time that is the time from the end of the first event to the end of the second event. Even when an event occurs, the operation time of the second event can be accurately calculated. Since the overall processing unit 20 selects the operation procedure used for operation guidance based on the accurately calculated operation time, the operation is completed in a short time even when a plurality of events occur. An appropriate operation procedure that can be performed can be guided for each event.
[0083]
Embodiment 2. FIG.
　Next, a second embodiment of the present invention will be described with reference to FIGS. In the second embodiment, the machine learning device is used for operation guidance based on the operation time from the end of the first event to the end of the second event and the number of operations for responding to the second event. Learn operating procedures. The operation time used in the second embodiment is the operation time used in the first embodiment.
[0084]
　First, the display system of Embodiment 2 will be described. The display system according to the second embodiment includes the display 10 according to the first embodiment and a machine learning device. Hereinafter, as an example of the display system, a display 10X in which the display 10 and the machine learning device are integrated will be described as an example. The machine learning device 23 may be integrated with the display device 10X, or may be provided outside the display device 10X.
[0085]
　FIG. 11 is a diagram showing the configuration of the display system according to the second embodiment of the present invention. Among the constituent elements in FIG. 11, constituent elements that achieve the same functions as those of the display 10 of the first embodiment shown in FIG. In addition to the constituent elements of the display device 10, the display device 10 X includes a machine learning device 23 that learns operation procedures. That is, the display system that learns and displays the operation procedure includes the display device 10 and the machine learning device 23. The machine learning device 23 may be disposed inside the display device 10X or may be disposed outside. In the second embodiment, a case where the machine learning device 23 is arranged inside the display 10X will be described.
[0086]
　The machine learning device 23 includes a state observation unit 40 and a learning unit 41. The state observation unit 40 is connected to the overall processing unit 20 and the learning unit 41. The learning unit 41 is connected to the storage unit 22.
[0087]
　The state observing unit 40 sends, from the overall processing unit 20, the operation time from the end of the first event to the end of the second event, the number of operations that are the number of operations to the second event, and the second event. Are observed as a state variable 56. The operation time and the number of operations acquired by the state observation unit 40 are associated with the operation procedure. The state observation unit 40 sends a state variable 56 that is an observation result to the learning unit 41.
[0088]
　The learning unit 41 learns an action 58 that is the next operation procedure according to the state variable 56. In other words, the learning unit 41 learns an operation procedure that shortens the operation time and reduces the number of operations. Specifically, the learning unit 41 learns the input operation according to the training data set created based on the state variable 56 including the operation time, the number of operations, and the operation procedure.
[0089]
　The learning unit 41 includes a reward calculation unit 45 and a function update unit 46. The reward calculation unit 45 calculates a reward based on the state variable 56. That is, the reward calculation unit 45 calculates a reward based on the net operation time calculated by the overall processing unit 20. The reward calculation unit 45 gives a larger reward as the operation time is shorter. Moreover, the reward calculation part 45 gives a big reward, so that there are few operations. The reward calculation unit 45 may weight the magnitude of the reward with the reward for the operation time and the reward for the number of operations. In this case, the reward calculation unit 45 gives a reward with a larger difference than the reward for the number of operations to the reward for the operation time. For example, the reward calculation unit 45 gives a reward of “+1” to “−1” to the operation time, and gives a reward of “+0.2” to “−0.2” to the number of operations.
[0090]
　The reward calculation unit 45 determines that the difference between the operation time calculated by the overall processing unit 20 and the minimum value of the operation time stored in the storage unit 22 is a difference of an error level, that is, a specific time difference. Only the number of operations may be rewarded. In this case, when there is a difference larger than the specific time, the reward calculation unit 45 gives a reward to the operation time and does not give a reward to the number of operations. The reward calculation unit 45 sends the calculated reward to the function update unit 46.
[0091]
　The function update unit 46 stores a function for determining the action 58, and updates the function for determining the action 58 based on the reward. An example of a function for determining the action 58 is an action value function Q (s t , a t ) described later . The function updating unit 46 of the second embodiment updates the action value function Q (s, a) every time the operation of the input unit 11 is performed and the state of the controlled device is restored. The function update unit 46 calculates an action 58 using the updated action value function Q (s, a). The function update unit 46 sends the calculated action 58 to the overall processing unit 20 and sends the updated action value function Q (s, a) to the storage unit 22.
[0092]
　The storage unit 22 of the second embodiment stores the learning data so far and the data used for learning. An example of learning data is a learned processing procedure, and an example of data used for learning is an action value function Q (s, a) used by the learning unit 41 during learning. The processing procedure stored in the storage unit 22 is the processing procedure with the highest reward in the past operation time. The storage unit 22 stores, for each event type, a combination of the processing procedure having the highest reward in the past operation time and the operation time and the number of operations corresponding to this processing procedure. The processing procedure stored in the storage unit 22 is read by the overall processing unit 20 and displayed on the display unit 12 when the same event occurs next time.
[0093]
　Any learning algorithm used by the learning unit 41 may be used. Here, as an example, a case where reinforcement learning (Reinforcement Learning) is applied to a learning algorithm will be described. In the reinforcement learning, an agent who is an action subject in a certain environment observes the current state indicated by the state variable 56 and determines an action 58 to be taken based on the observation result. The agent obtains a reward from the environment by selecting the action 58, and learns a policy in which the reward is obtained most through the series of actions 58. As typical methods of reinforcement learning, Q-learning (Q-Learning) and TD learning (TD-Learning) are known. For example, in the case of Q learning, an action value table that is a general update expression of the action value function Q (s, a) is expressed by the following expression (1). That is, an example of the behavior value table is the behavior value function Q (s, a) of Expression (1).
[0094]
[Equation 1]

[0095]
　In the formula (1), s t represents the environment at time t, a t represents the behavior in time t. Action A T by, the environment S T Tasu 1 change to. r t + 1 represents a reward obtained by a change in the environment, γ represents a discount rate, and α represents a learning coefficient. If you apply the Q-learning, operation input action A T becomes.
[0096]
　The update formula represented by the formula (1) is such that if the action value of the best action a at time t + 1 is greater than the action value Q of the action a executed at time t, the action value Q is increased and vice versa. In this case, the action value Q is decreased. In other words, the behavior value function Q (s, a) is updated so that the behavior value Q of the behavior a at the time t approaches the best behavior value at the time t + 1. As a result, the best behavioral value in a certain environment is gradually propagated to the behavioral value in the previous environment.
[0097]
　For example, the reward calculation unit 45 increases the reward r when the operation time is shorter than the stored conventional operation time. At this time, the reward calculation unit 45 gives a reward of “1”, for example. On the other hand, the reward calculation unit 45 reduces the reward r when the operation time is longer than the conventional operation time. At this time, the reward calculation unit 45 gives a reward of “−1”, for example. In addition, the reward calculation unit 45 increases the reward r, for example, when the number of operations is smaller than the stored number of conventional operations. At this time, the reward calculation unit 45 gives a reward of “0.2”, for example. On the other hand, the reward calculation unit 45 reduces the reward r when the number of operations is larger than the conventional number of operations. At this time, the reward calculation unit 45 gives a reward of “−0.2”, for example.
[0098]
　The function update unit 46 updates the function for determining the input operation that is the action 58 in accordance with the reward calculated by the reward calculation unit 45. For example, in the case of Q learning, the action value function Q (s t , a t ) represented by the equation (1) is a function for calculating the action 58, and the action value function Q (s t , a t ) is updated.
[0099]
　Next, the processing procedure of the reinforcement learning method for updating the behavior value function Q (s t , a t ) will be described. FIG. 12 is a flowchart of a behavior value function update procedure performed by the opportunity learning device according to the second embodiment.
[0100]
　When the event occurs, the display unit 12 displays information for guiding the operation procedure. When the input unit 11 receives an operation from the operator, the overall processing unit 20 displays the operation history information 101 in which the generated event, the operation procedure for the event by the operator, the operation time, and the number of operations are associated with each other. create.
[0101]
　The state observation unit 40 acquires the operation history information 101 as the state variable 56 from the overall processing unit 20 (step S200). The state observation unit 40 sends the state variable 56 to the reward calculation unit 45. That is, the state observation unit 40 sends information in which the event, the operation procedure, and the net operation time are associated with each other to the reward calculation unit 45.
[0102]
　The reward calculation unit 45 determines whether or not the net operation time acquired from the state observation unit 40 is longer than the previously stored shortest operation time (step S210). When the net operation time is longer than the previously stored shortest operation time (Yes in Step S210), the reward calculation unit 45 decreases the reward (Step S220).
[0103]
　On the other hand, when the net operation time is equal to or less than the previously stored shortest operation time (No in step S210), the reward calculation unit 45 increases the reward (step S230). The reward calculation unit 45 may increase the reward when the net operation time is shorter than the shortest operation time stored in advance. When the net operation time is the same as the shortest previous operation time stored in advance, the reward calculation unit 45 may maintain the reward without decreasing or increasing it.
[0104]
　The reward calculation unit 45 determines whether or not the number of operations acquired from the state observation unit 40 is greater than the minimum number of operations stored so far (step S240). When the number of operations is larger than the previously stored minimum number of operations (step S240, Yes), the reward calculation unit 45 decreases the reward (step S250).
[0105]
　On the other hand, when the number of operations is equal to or less than the previously stored minimum number of operations (step S240, No), the reward calculation unit 45 increases the reward (step S260). The reward calculation unit 45 may increase the reward when the number of operations is smaller than the previously stored minimum number of operations. When the number of operations is the same as the minimum number of operations stored in advance, the reward calculation unit 45 may maintain the reward without decreasing or increasing.
[0106]
　The function updating unit 46 updates the action value function Q (s t , a t ) based on the increased or decreased reward (Step S270). Thereafter, the display 10X returns to step S200 again, and obtains the action value Q for the newly input state variable 56. The display 10X repeatedly executes the processes of steps S200 to S270 at a specific cycle.
[0107]
　When the same event as the event stored in the storage unit 22 occurs in the controlled device, the display 10 X displays the operation procedure stored in the storage unit 22. Accordingly, it is possible to guide the operation using an operation procedure with a short operation time and a small number of operations.
[0108]
　In the second embodiment, the case where the machine learning device 23 performs machine learning using reinforcement learning has been described. However, the machine learning device 23 may use other known methods such as neural networks, genetic programming, functions, and the like. Machine learning may be performed according to logic programming, support vector machines, or the like.
[0109]
　Thus, according to the second embodiment, since the machine learning device 23 learns the operation procedure corresponding to the operation time and the number of operations, the second event is generated even when a plurality of events occur. It is possible to accurately learn the operation time and the number of operations. Thereby, even when a plurality of events occur, it is possible to guide an appropriate operation procedure that can easily finish the operation in a short time for each event.
[0110]
　The configuration described in the above embodiment shows an example of the content of the present invention, and can be combined with another known technique, and can be combined with other configurations within the scope of the present invention. It is also possible to omit or change the part.
Explanation of symbols
[0111]
　10, 10X display, 11 input unit, 12 display unit, 13 communication I / F unit, 15 touch panel, 20 overall processing unit, 21 display information generation unit, 22 storage unit, 23 machine learning device, 40 state observation unit, 41 Learning unit, 45 reward calculation unit, 46 function update unit, 56 state variable, 58 action, 30 control device, 61 to 64 buttons, 101 operation history information.
The scope of the claims
[Claim 1]
　When the first event and the second event generated in the external device are sent from the external device, the first event is ended by the operation to the first event, and then the operation to the second event is performed.
　A storage unit that stores an operation time that is a time until the second event ends , an operation procedure that is a history of operations on the second event, and the operation time corresponding to the operation procedure When,
　in accordance with an instruction from the calculation unit, a display unit for displaying one of the operation steps in said storage unit
　includes a,
　the calculation unit, after the calculation of the operating time has expired, the second event is new The operation procedure used for operation guidance is selected from the operation procedures in the storage unit based on the operation time in the storage unit, and the selected operation procedure is displayed on the display unit. It executes the operation induced by the
　indicator, characterized in that.
[Claim 2]
　The calculating unit selects a short operating time of the most operating time from the operation time in the storage unit, is displayed by selecting the operation procedure corresponding to the operation time selected as the operating procedure used for the operation inducement control,
　it The display device according to claim 1.
[Claim 3]
　The calculation unit calculates the operation time by excluding the time from said first event is completed until the operation to the second event is initiated,
　it in claim 1 or 2, characterized in The indicated indicator.
[Claim 4]

　The display system according to claim 13, 　wherein the function update unit updates an action value table indicating the function according to the reward .