Technical field
[0001]
The present invention relates to a work support device and a work support method.
Background technology
[0002]
Patent Document 1 describes, "A video analysis unit that acquires a video of a worker and analyzes the video to specify a gesture performed by the worker, and an input specific unit that specifies an input for starting or completing a process represented by the gesture. A work recording system including a control unit including an information processing unit that calculates the work time spent on the process by the operator from the time when the process start is input and the time when the process completion is input "is described." ing.
Prior art literature
Patent documents
[0003]
Patent Document 1: Japanese Unexamined Patent Publication No. 2019-109658
Outline of the invention
Problems to be solved by the invention
[0004]
The above technology can calculate the work time from the video that includes the movement of the worker, but it does not support the work according to the implementation status of the worker.
[0005]
An object of the present invention is to provide a technique for supporting work according to the implementation status of a worker.
Means to solve the problem
[0006]
The present application includes a plurality of means for solving at least a part of the above problems, and examples thereof are as follows. The work support device according to one aspect of the present invention determines whether or not the sensor information acquired by the sensor device attached to the worker satisfies a predetermined first condition, detects the interruption of the work, and performs the work. It includes an interruption detection unit for specifying, and an interruption state recognition unit for notifying the operator of the interruption by light, voice, or vibration when the interruption of the work is detected.
[0007]
Further, for example, in the above work support device, the interruption detection unit identifies the work content to be performed after resumption of the work for which interruption is detected, and generates display information for instructing the work content. May be good.
[0008]
Further, for example, in the above work support device, the sensor device acquires an image including at least a part or the whole of the operator's field of view as the sensor information, and the interruption state recognition unit is the interruption state at the time of the interruption. The screen information for displaying the image may be included in the display information to be created.
[0009]
Further, for example, in the above work support device, a restart operation determination unit that determines whether or not the sensor information satisfies a predetermined second condition and detects the restart of the work in which interruption is detected, and a restart operation determination unit. It may be provided with a restart notification unit for notifying the display information about the work in which the above is detected.
[0010]
Further, for example, in the above work support device, the interruption state recognition unit may at least specify the work to be performed after the interrupted work is resumed, and display an explanatory video of the work.
[0011]
Further, for example, in the above work support device, the interruption detection unit is in a state where the video includes a display screen or a procedure manual for the work, or the video does not include the operator's hand. In the case of, it may be determined that the above-mentioned predetermined first condition is satisfied.
[0012]
Further, for example, in the above work support device, the sensor device acquires at least the voice spoken by the worker as the sensor information, and the interruption detection unit receives the voice for a predetermined time or more with another person. It may be determined that the predetermined first condition is satisfied when the conversation is included.
[0013]
Further, for example, in the work support device, the sensor device acquires at least the biological information of the worker as the sensor information, and the interruption detection unit is in a state where the biological information is not in a predetermined normal range. In some cases, it may be determined that the predetermined first condition is satisfied.
[0014]
Further, for example, in the above work support device, the sensor device acquires a video including at least a part or the whole of the worker's field of view or a voice spoken by the worker as the sensor information, and determines the restart operation. The unit determines that the condition of the predetermined second condition is satisfied at least when the video contains the predetermined gesture of the worker or the voice contains the predetermined speech of the worker. May be.
[0015]
Further, for example, in the above work support device, the sensor device acquires at least the biological information of the worker as the sensor information, and the restart operation determination unit keeps the biological information in a predetermined normal range. In some cases, it may be determined that the predetermined second condition is satisfied.
[0016]
Further, for example, the work support device may include a calibration unit that calibrates a value that serves as a determination criterion for the first condition, the second condition, or both of them.
[0017]
Further, for example, the above work support device includes an evidence acquisition unit that stores the sensor information related to the work before and after the interruption in a predetermined storage unit and reproduces the sensor information in response to a request from another device. It may be a thing.
[0018]
Further, for example, the work support device may be provided with an improvement proposal unit that calculates statistical information related to the interruption for each worker and indicates a work having a large difference from other workers.
[0019]
Further, the work support method according to another aspect of the present invention is a work support method using a work support device, wherein the work support device includes a processing unit, and the processing unit is attached to an operator. When the interruption detection step for determining whether or not the sensor information acquired by the sensor device satisfies the predetermined first condition, detecting the interruption of the work and specifying the work, and detecting the interruption of the work, the worker It is characterized by carrying out an interruption state recognition step of notifying an interruption by light, voice or vibration.
Effect of the invention
[0020]
According to the present invention, it is possible to provide a technique for supporting work according to the implementation status of the worker.
[0021]
Issues, configurations and effects other than those described above will be clarified by the explanation of the following embodiments.
A brief description of the drawing
[0022]
[Fig. 1] Fig. 1 is a block diagram illustrating the configuration of a work support system according to an embodiment.
[Fig. 2] Fig. 2 is a diagram showing an example of a data structure of a setting storage unit.
[Fig. 3] Fig. 3 is a diagram showing an example of a data structure of an evidence storage unit.
[Fig. 4] Fig. 4 is a diagram showing an example of a data structure of an advice storage unit.
[Fig. 5] Fig. 5 is a diagram showing a hardware configuration example of a work support device.
[Fig. 6] Fig. 6 is a diagram showing an example of a detection start processing flow.
[Fig. 7] Fig. 7 is a diagram showing an example of a suspend / resume processing flow.
[Fig. 8] Fig. 8 is a diagram showing an example of an analysis processing flow.
[Fig. 9] Fig. 9 is a diagram showing an example of a setting screen.
[Fig. 10] Fig. 10 is a diagram showing an example of an evidence confirmation screen.
[Fig. 11] Fig. 11 is a diagram showing an example of an analysis result confirmation screen.
Embodiment for carrying out the invention
[0023]
Hereinafter, the work support system 1 to which the embodiment according to one aspect of the present invention is applied will be described with reference to the drawings. In the following embodiments, when necessary for convenience, the description will be divided into a plurality of sections or embodiments, but unless otherwise specified, they are not unrelated to each other, one of which is the other. It is related to some or all of the modified examples, details, supplementary explanations, etc.
[0024]
Further, in the following embodiments, when the number of elements (including the number, numerical value, quantity, range, etc.) is referred to, when it is specified in particular, or when it is clearly limited to a specific number in principle, etc. Except for this, the number is not limited to the specific number, and may be more than or less than the specific number.
[0025]
Furthermore, in the following embodiments, the components (including element steps and the like) are not necessarily essential unless otherwise specified or clearly considered to be essential in principle. Needless to say.
[0026]
Similarly, in the following embodiments, when the shape, positional relationship, etc. of the constituent elements are referred to, the shape is substantially the same, except when it is clearly stated or when it is considered that it is not clearly the case in principle. Etc., etc. shall be included. This also applies to the above numerical values ​​and ranges.
[0027]
Further, in all the drawings for explaining the embodiment, the same members are in principle given the same reference numerals, and the repeated description thereof will be omitted.
[0028]
Work is accompanied by work mistakes. It is thought that the background of work mistakes is "increased mispotential" that induces psychological upset and mistakes. In order to prevent the occurrence of work mistakes, it is important not to increase the mistake potential. An example of a work error is that a colleague talks to you, or the work you are doing is interrupted because you want to do something different from the work you are doing, and then you make an erroneous operation after returning from the interruption. .. In this case, it is considered that the interruption causes a decrease in attention, misunderstanding or forgetfulness of the work situation, and an increase in mispotential. In order to reduce the mispotential, it is considered effective to make the workers aware of the interruption and to surely inform the work status before the interruption and the work to be performed after the restoration at the time of return.
[0029]
Specifically, if the work status can be grasped at any time by the information processing device and notified to the worker, it is considered that the attention to the work content will be increased, the misunderstanding of the work status will be reduced, and the increase in the error potential will be suppressed. For that purpose, we utilize an information processing system that provides timely provision of work to be detected for interruption, detection of interruption, notification to workers, specification of interruption / return conditions, confirmation of next work after return, work restart instruction, etc. It is considered effective to do so.
[0030]
FIG. 1 is a block diagram illustrating the configuration of the work support system according to the present embodiment. In the work support system 1, an operator wears the sensor device 100 to perform work, and passes the detected sensor information to the work support device 200. The sensor device 100 preferably passes sensor information to the work support device 200 via the wireless network 50 and receives control from the work support device 200. The communication path between the sensor device 100 and the work support device 200 is not limited to the wireless network 50, but wireless communication such as Bluetooth (registered trademark) and 802.11 series, USB (Universal Serial Bus), etc. It may be via a wired connection such as LAN (Local Area Network) or a wired network such as LAN (Local Area Network).
[0031]
Further, the work support device 200 is communicably connected to the management device 300 via a communication path such as the Internet. The work support device 200 receives various settings related to detection of interruption or resumption from the management device 300. Further, the work support device 200 outputs the work record so as to be able to refer to it in response to a request from the management device 300.
[0032]
The wireless network 50 to which the work support device 200 and the sensor device 100 are connected for communication is further a WAN (Wide Area Network), the Internet, a mobile phone network, or a communication network in which these are combined. May be good. The wireless network 50 may be a VPN (Virtual Private Network) or the like on a wireless communication network such as a mobile phone communication network.
[0033]
To give an application example of the work support system 1, the work support system 1 includes a business system that supports work for managing structures such as bridges and buildings, in which workers work outdoors with both hands.
[0034]
In the work using the work support system 1, the worker will perform the work while moving the position where the work is performed according to the work content and the work target. Therefore, it is desirable that the sensor device 100 is a wearable device in which both hands can be easily used. Further, when one hand is used to grip the sensor device 100 or the movable range of both hands is limited, gripping the sensor device 100 may reduce work efficiency, so that it is wearable. A device is desirable, but a wearable device is not required. In the following embodiments, the sensor device 100 is mounted by a wearable device that can be handled hands-free. Make it a thing. For example, the sensor device 100 includes a wearable camera that acquires an image including at least a part or all of the operator's field of vision as sensor information, a wearable microphone that acquires the voice spoken by the operator as sensor information, and a biological information of the operator. It is a vital sensor acquired as sensor information.
[0035]
Further, the sensor device 100 is not limited to this, and the sensor device 100 includes a glove type sensor (a composite of a fingertip pressure sensor, an inertial sensor, and a microphone), a heart rate sensor (worker's heart rate acquisition by wearing conductive fiber clothes), and a watch sensor (wearer's vein). Even if it includes various sensors such as blood oxygen concentration (SpO2: percutaneous oxygen saturation), room temperature sensor (temperature sensor), myoelectric sensor (acquires the amount of movement of the worker), etc. good.
[0036]
The sensor device 100 includes a detection processing unit 110, a communication unit 120, and a display unit 130. The detection processing unit 110 receives control via the wireless network 50 and detects the measurement target. The communication unit 120 transmits sensor information including information on the measurement target detected by the detection processing unit 110 via the wireless network 50. The display unit 130 displays screen information, a message, AR (Augmented Reality), VR (Visual Reality), MR (Mixed Reality), and the like. If there are a plurality of sensor devices 100 that the operator can wear, the display unit 130 may be provided in any one of them.
[0037]
The work support device 200 is an information processing device including a storage unit 210, a processing unit 220, and a communication unit 230. The work support device 200 is, for example, a smartphone or tablet PC owned by the worker. In that case, the wireless network 50 is a short-range wireless communication network such as Bluetoot or NFC (Near Field Communication) or a wired peer-to-peer communication line such as a USB cable.
[0038]
Alternatively, the work support device 200 may be mounted by a server device or the like on the cloud. In that case, the wireless network 50 is a wide area communication network such as the Internet or a mobile phone network.
[0039]
The storage unit 210 includes a setting storage unit 211, an evidence storage unit 212, and an advice storage unit 213.
[0040]
FIG. 2 is a diagram showing an example of a data structure of a setting storage unit. The setting storage unit 211 stores setting information necessary for the work support device 200 to operate in a key-value format (a data structure in which a setting item and a setting value of the item are stored in association with each other). In particular, the setting storage unit 211 includes settings for defining interruption of work, a notification method when interruption is detected, and settings for restarting when interruption is detected.
[0041]
The example of the setting storage unit 211 in FIG. 2 is an example in which the setting layer 211A, the item 211B, the setting value 211C, the valid period 211D, and the invalid period 211E are stored in association with each other. Information for specifying the setting hierarchy is stored in the setting hierarchy 211A. Each setting value is hierarchically defined in consideration of the operation set by a plurality of setters, and the setting of the lower layer is preferentially adopted. Specifically, the settings of the lower organization under the jurisdiction of the upper organization are set across the board, and the lower organization adopts the setting of the upper organization as the default value and overwrites it by setting its own setting value so as to be suitable for the work of the lower organization. It is a structure that can be done.
[0042]
For example, in order to set common settings for each company under the company group and allow each company under the company to overwrite and use the settings of its own company, the upper layer is set as the setting layer of the company group. , The lower hierarchy is set as the setting layer of each company, and the lower hierarchy is further set for each department of the company, and different setting values ​​are held for each business field.
[0043]
Note that this setting value may be set to be stricter than the setting of the higher layer in the lower layer, or may be set to be loosened. For example, assuming that the rule for each department sets a setting value of "determining that looking away for 5 seconds is interrupted", depending on the work on the day, each worker may be asked to "determine looking away for 3 seconds as interruption". It may be stricter, or it may be loosened by saying "10 seconds of looking away is judged to be interrupted".
[0044]
Information for specifying a setting item is stored in item 211B. The set value 211C stores the set value of the item specified by the item 211B.
[0045]
The validity period 211D stores information that specifies the period during which the set value of the item specified by the item 211B is valid.
[0046]
The invalid period 211E stores information for specifying the period during which the set value of the item specified by the item 211B is invalid.
[0047]
FIG. 3 is a diagram showing an example of the data structure of the evidence storage unit. The evidence storage unit 212 includes the worker identifier 212A, the execution work 212B, the presence / absence of interruption 212C, the interruption time 212D, and the video information 212E.
[0048]
The worker identifier 212A is information that identifies the worker. The implementation work 212B is information that identifies the work performed by the worker specified by the worker identifier 212A. The presence / absence of interruption 212C is information for specifying whether or not the interruption is detected in the execution work 212B. The interruption time 212D is information for specifying the time when the interruption occurs when it is indicated that there is an interruption in the interruption presence / absence 212C. The video information 212E is an image over a predetermined period (for example, between 15 seconds before the interruption and 15 seconds after the interruption) before and after the time when the interruption occurred.
[0049]
FIG. 4 is a diagram showing an example of the data structure of the advice storage unit. The advice storage unit 213 stores advice information such as improvement points for each worker obtained as a result of acquiring statistical information on interruption for each worker and performing analysis by a predetermined algorithm. The advice storage unit 213 includes a worker identifier 213A, an interruption frequency 213B, an interruption reason 213C, an interruption work 213D, an interruption time 213E, and an advice 213F.
[0050]
The worker identifier 213A is information that identifies the worker. The interruption frequency 213B is information for specifying the frequency of interruption in the work performed by the worker specified by the worker identifier 213A. The interruption reason 213C is information in which the interruption reasons (conditions satisfied when the interruption is detected) are arranged in the order of the frequency of appearance as the interruption reason in the worker. The interruption work 213D is information in which the work in which the interruption frequently appears in the worker is arranged. The interruption time 213E is information in which the time zones in which the interruption appears in the worker are arranged in the order of appearance frequency. Advice 213F is an improvement point for each worker obtained as a result of analysis by a predetermined algorithm using information of the interruption frequency 213B, the interruption reason 213C, the interruption work 213D, and the interruption time 213E for each worker. It is information of advice such as.
[0051]
The processing unit 220 excludes the interruption detection unit 221, the interruption state recognition unit 222, the restart operation determination unit 223, the restart notification unit 224, the setting unit 225, the improvement proposal unit 226, and the calibration unit 227. A work setting unit 228 and an evidence acquisition unit 229 are included.
[0052]
The interruption detection unit 221 determines whether or not the sensor information acquired by the sensor device 100 attached to the operator satisfies a predetermined first condition, detects the interruption of the work, and identifies the work. The predetermined first condition is that the state of the worker estimated by the predetermined algorithm from the sensor information is in a state predetermined as a set value.
[0053]
Specifically, as a state for detecting interruption, a state in which a laptop (notebook PC) or the display screen of the laptop is displayed for a predetermined time (for example, 2 seconds) in a part of the image of the operator's view. A state in which a manual (documents such as work procedure manuals) is shown for a predetermined time (for example, 2 seconds) in a part of the image of the worker's view, and a worker's hand is shown in a part of the image of the worker's view for a specified time. Various biological information such as no image (for example, 10 seconds), the voice of the worker including a conversation with another person for a predetermined time or longer, the worker's heartbeat, blood oxygen concentration, myoelectric potential, etc. Includes situations where is not within the specified normal range.
[0054]
When the interruption state recognition unit 222 detects the interruption of the worker's work, the interruption state recognition unit 222 notifies the operator of the interruption by light (visual information), guidance voice, or vibration.
[0055]
Further, the interruption state recognition unit 222 generates display information for the work in which the interruption is detected. For example, the interruption state recognition unit 222 creates the display information by including the screen information for displaying the image of the operator's view at the time of interruption. Further, for example, the interruption state recognition unit 222 specifies at least the work content to be performed after resumption and generates display information for instructing the work content. Further, for example, the interruption state recognition unit 222 identifies and displays the work completed by the interruption. Alternatively, the interruption state recognition unit 222 identifies and displays at least the interrupted work and the work to be performed after the work is restarted. Further, when the interrupted state recognition unit 222 specifies the work to be performed after the interrupted work is resumed, the storage unit 210 refers to the work information (not shown) to specify and display the explanatory video of the work to be performed after the restart. You may.
[0056]
The restart operation determination unit 223 determines whether or not the sensor information satisfies a predetermined second condition, and detects that the work for which interruption has been detected has been restarted. The predetermined second condition is that the state of the worker estimated by the predetermined algorithm from the sensor information is in a state predetermined as a set value.
[0057]
Specifically, as a state for detecting resumption, a state in which a part of the image of the worker's field of view includes a predetermined gesture of the worker, a state in which the voice of the worker includes a predetermined speech, and a state of the worker. It includes a state in which biometric information is within a predetermined normal range, or a combination thereof.
[0058]
When the restart operation determination unit 223 detects the restart of the work, the restart notification unit 224 notifies the worker of the work to be performed after the restart. Specifically, the restart notification unit 224 creates display information indicating the work performed by the worker, the history of the work content, and the work to be performed after the restart, and displays it on the display unit 130 of the sensor device 100. Let me.
[0059]
The setting unit 225 receives the setting from the management device 300 via the network and stores it in the setting storage unit 211. Further, when the setting unit 225 receives a request from the management device 300, the setting unit 225 creates a setting screen for accepting the setting and displays it on the management device 300.
[0060]
The improvement proposal unit 226 calculates statistical information related to work interruption for each worker. The improvement proposal unit 226 creates a screen for proposing an improvement in work efficiency by indicating a work or a time zone in which a difference is large as compared with other workers, and displays it on the management device 300.
[0061]
The calibration unit 227 calibrates a value that serves as a criterion for determining the first condition, the second condition, or both of the above. Specifically, it performs calibration processing or learning processing to widen the similar tolerance range in gesture judgment to allow variations in worker movements, or to judge gestures more accurately to reduce false positives. .. Even for the same worker, learning processing is required because the sensor information may vary due to changes in the work environment (work position, work posture, work target, outside temperature, etc.). The algorithm used for this calibration or learning process may be an existing one.
[0062]
The exclusion work setting unit 228 receives the setting of the work for excluding the application of interruption detection from the management device 300 via the network, and stores it in the setting storage unit 211. Further, when the exclusion work setting unit 228 receives a request from the management device 300, the exclusion work setting unit 228 creates a setting screen for accepting the setting and displays it on the management device 300.
[0063]
The evidence acquisition unit 229 stores the sensor information in the evidence storage unit 212. In addition, the evidence acquisition unit 229 has sensor information related to the work before and after the interruption.Is stored in the evidence storage unit 212, and the sensor information is reproduced in response to a request from the management device 300.
[0064]
The communication unit 230 receives the sensor information including the information of the measurement target detected by the sensor device 100 via the wireless network 50. In addition, operation control such as detection start instruction and detection stop of the sensor device 100 is performed.
[0065]
The management device 300 is an information processing device such as a personal computer or a workstation, is connected to the work support device 200 via a communication network such as the Internet (not shown), inputs a set value, and is stored in the work support device 200. Refer to the record of the work being done. The management device 300 is not limited to this, and may be a smartphone, a tablet device, or a server device.
[0066]
Workers can, for example, wearable cameras, wearable microphones, vital sensors, glove-type sensors (combined fingertip pressure sensor, inertial sensor, and microphone), which are composites of various sensor devices, and heartbeat sensors (worker's heartbeat acquisition using conductive fiber clothes). ), Watch sensor (acquires the blood oxygen concentration (SpO2: percutaneous oxygen saturation) of the wearer's vein), room temperature sensor (temperature sensor), myoelectric sensor (acquires the amount of movement of the worker), etc. Wear one or more as a sensor device 100.
[0067]
Then, an example is a usage method in which a smartphone owned by a worker is used as a work support device 200, paired with a worn sensor device 100, sensor information is acquired, and interruption / restart is detected. In addition, the work support device 200 is accessed from the management device 300 provided in the organization that controls the worker to check the evidence of the worker's work and perform management work such as setting change for optimizing the support operation. conduct. Further, the improvement points for each worker calculated by the improvement proposal unit 226 are acquired from the management device 300 and used for training and work quality management.
[0068]
Not limited to the above mounting example, for example, if the sensor device 100 can operate as an IoT (Internet оf Things) device, the work support device 200 is mounted as a cloud server and the sensor device 100 can operate the sensor via the Internet. It is also possible to configure it to receive information.
[0069]
Further, for example, a smartphone owned by the worker may be used as the work support device 200, and the sensor device 100 may be realized by the work support device 200. That is, by using the camera function of the smartphone as a wearable camera to obtain the view of the worker, it is possible to make the equipment of the worker lightweight so as not to reduce the work efficiency. Needless to say, other mountable devices may be combined to acquire and control the same information.
[0070]
FIG. 5 is a diagram showing a hardware configuration example of the work support device 200. The work support device 200 includes a hardware configuration realized by a so-called server device, a workstation, a personal computer, a smartphone or a tablet terminal housing. The work support device 200 includes a calculation device 201, a main storage device 202, an auxiliary storage device 203, a communication device 204, and a bus 207 connecting each device. The same applies to the management device 300. In addition, the management device 300 includes input / output devices such as a touch panel, a keyboard, a microphone, and a display.
[0071]
The calculation device 201 is, for example, a calculation device such as a CPU (Central Processing Unit).
[0072]
The main storage device 202 is, for example, a memory device such as a RAM (Random Access Memory).
[0073]
The auxiliary storage device 203 is a non-volatile storage device such as a so-called hard disk (Hard Disk Drive), SSD (Solid State Drive), or flash memory that can store digital information.
[0074]
The communication device 204 is a wired communication device such as a network card or a wireless communication device.
[0075]
The interruption detection unit 221 of the work support device 200, the interruption state recognition unit 222, the restart operation determination unit 223, the restart notification unit 224, the setting unit 225, the improvement proposal unit 226, and the calibration unit 227. The exclusion work setting unit 228 and the evidence acquisition unit 229 are realized by a program that causes the arithmetic unit 201 to perform processing. This program is stored in the main storage device 202, the auxiliary storage device 203, or a ROM device (not shown), is loaded on the main storage device 202 for execution, and is executed by the arithmetic unit 201.
[0076]
Further, the storage unit 210 of the work support device 200 is realized by the main storage device 202 and the auxiliary storage device 203. Further, the communication unit 230 is realized by the communication device 204. The above is an example of the hardware configuration of the work support device 200.
[0077]
The configuration of the work support device 200 can be further classified into more components according to the processing content. It can also be categorized so that one component performs more processing.
[0078]
Further, each processing unit (interruption detection unit 221, interruption state recognition unit 222, restart operation determination unit 223, restart notification unit 224, setting unit 225, improvement proposal unit 226, calibration unit 227, and exclusion. The work setting unit 228 and the evidence acquisition unit 229) may be constructed by dedicated hardware (ASIC, GPU, etc.) that realizes each function. Further, the processing of each processing unit may be executed by one hardware or may be executed by a plurality of hardware.
[0079]
Next, the operation of the work support system 1 in this embodiment will be described.
[0080] [0080]
FIG. 6 is a diagram showing an example of a detection start processing flow. The detection start process is started by starting the setting input from the management device 300.
[0081]
First, the management device 300 accepts the setting input (step S001). Specifically, when the management device 300 requests the work support device 200 to input the setting, displays the setting value input screen and accepts the input by the operator, the management device 300 receives the setting value input to the work support device 200. hand over.
[0082]
The setting unit 225 of the work support device 200 updates the set value according to the received set value (step S002). Then, the calibration unit 227 performs the calibration process (step S003). For example, the calibration unit 227 prompts the operator to perform the gesture operation a plurality of times (for example, 10 times in a fixed manner, or a plurality of times until sufficient accuracy is obtained), and performs learning and calibration processing.
[0083]
Then, the interruption detection unit 221 gives a control instruction to the sensor device 100 to start detection (step S004). After that, the sensor device 100 continuously detects at a predetermined sampling rate and reports the sensor information to the work support device 200 (step S005). Further, the interruption detection unit 221 intermittently performs the interruption detection process using the reported sensor information (step S006).
[0084]
The above is an example of the detection start processing flow. According to the detection start processing flow, it is possible to start work interruption detection with high accuracy.
[0085]
FIG. 7 is a diagram showing an example of a suspend / resume processing flow. The interruption / resumption processing is started when the interruption of work is detected during the detection processing in the work support device 200.
[0086]
The interruption state recognition unit 222 specifies the work at the time of interruption (step S101). Specifically, the interruption state recognition unit 222 identifies the work performed at the time of interruption according to the progress of the work instruction sheet (not shown). For example, when an operator performs an operation of referring to a laptop to check the work contents, the work being performed is specified with the time when the laptop is reflected in the camera as the interruption time.
[0087]
Then, the suspension state recognition unit 222 specifies the work at the time of resumption (step S102). Specifically, the interruption state recognition unit 222 specifies the work following the work being carried out specified in step S101 as the work at the time of resumption.
[0088]
Then, the interruption state recognition unit 222 notifies the operator that the interruption has been detected and the work after resumption (step S103). Specifically, the interruption state recognition unit 222 provides the operator with a visual display such as a screen, AR, VR, MR, etc., an auditory stimulus such as a guidance voice, or a tactile stimulus such as vibration through the sensor device 100. Notify the worker of the interruption by either or a combination of these.
[0089]
Then, the restart operation determination unit 223 gives a control instruction to the sensor device 100 to start detection (step S104). After that, the sensor device 100 continuously detects at a predetermined sampling rate and reports the sensor information to the work support device 200 (step S105). Further, using the reported sensor information, the restart operation determination unit 223 intermittently performs the restart detection process (step S106).
[0090]
Then, when the restart operation determination unit 223 detects the restart of the work, the restart notification unit 224 notifies the worker of the work to be performed after the restart (step S107). Specifically, the restart notification unit 224 is a display, voice, vibration information information indicating the work performed by the worker, the history of the work content, and the work to be performed after the restart, or a combination thereof. Is created and displayed on the display unit 130 of the sensor device 100.
[0091]
The above is an example of the suspend / resume processing flow. According to the suspend / resume processing flow, it is possible to detect the restart of work with high accuracy and indicate at least the next work to be performed at the time of restart. As a result, the worker can specifically recall the memory before the interruption, and can receive the support of resumption to reduce the mispotential.
[0092]
FIG. 8 is a diagram showing an example of an analysis processing flow. The analysis process is started in the work support device 200 at a predetermined cycle (for example, every day or every week).
[0093]
First, the improvement proposal unit 226 specifies the frequency of interruption from the total number of operations performed and the number of interruptions for each worker (step S201). Then, the improvement proposal unit 226 aggregates the number of interruptions for each work content using the work content and the number of interruptions, and identifies the work with the largest number of interruptions as a weak work (step S202).
[0094]
Then, the improvement proposal unit 226 estimates the relationship between the occurrence of interruption and the time of occurrence (step S203). Specifically, the improvement proposal unit 226 estimates the most frequent occurrence time zone by associating a predetermined occurrence time zone with each interruption that has occurred.
[0095]
Then, the improvement proposal unit 226 estimates the correlation between the frequency of interruptions and the work situation (step S204). Specifically, the improvement proposal unit 226 aggregates the working hours of a predetermined period (for example, one month or one week) for each worker, and estimates the degree of correlation with the number of interruptions in the period.
[0096]
Then, the improvement proposal unit 226 identifies a time zone in which interruption is likely to occur (step S205). Specifically, the improvement proposal unit 226 divides the time into predetermined time zones, totals the number of interruptions in each time zone, and interrupts occur in a time zone in which the frequency of interruptions is higher than the predetermined time zone. Specify as an easy time zone.
[0097]
Then, the setting unit 225 changes the accuracy of interruption detection (step S206). Specifically, the setting unit 225 calculates the accuracy of interruption detection, that is, the occurrence rate of false detection, changes the detection conditions in various ways, specifies the setting value at which the accuracy of interruption detection is the highest, and sets storage unit 211. To memorize.
[0098]
When the management device 300 requests the analysis result for each worker (step S207), the improvement proposal unit 226 calculates a predetermined statistical value for each worker and sets it with the statistical value of another worker. Contrast is performed (step S208).
[0099]
Then, the improvement proposal unit 226 identifies the content of the advice and presents it together with the analysis result (step S209). Specifically, the improvement proposal unit 226 is in steps S203 to S205.A screen that identifies an item that has a large deviation from the average of other workers, creates predetermined advice content for improving the item, and displays it together with the information in steps S202 to S205. Is created and transmitted to the management device 300.
[0100]
The above is an example of the analysis processing flow. According to the analysis processing flow, it is possible to detect the tendency of work interruption with high accuracy and to consider measures to suppress the interruption by identifying the factors that increase the mispotential based on the actual results.
[0101]
FIG. 9 is a diagram showing an example of a setting screen. The setting screen 400 is a screen that the setting unit 225 transmits to the management device 300 for output. The setting screen 400 includes, for example, a setting 401 related to interruption, a setting 402 related to a notification method at the time of interruption detection, and a setting 403 related to performing for restarting.
[0102]
The setting 401 regarding interruption accepts an input for selecting one or more actions (first condition) to be regarded as interruption. For example, "looking at a laptop," "looking at a manual," "talking to another person," "out of sight," and so on.
[0103]
The setting 402 regarding the notification method at the time of interruption detection accepts an input for specifying the notification method to the worker at the time of interruption detection. For example, alert sound, voice, vibration, light (patrol lamp, etc.) and the like.
[0104]
The setting 403 for resuming work accepts an input for selecting one or more conditions (second condition) indicating resumption of work. For example, "pointing confirmation", "pressing a button on a tablet", "pressing a safety confirmation button", saying "confirmation", etc.
[0105]
FIG. 10 is a diagram showing an example of an evidence confirmation screen. The evidence confirmation screen 500 includes a date input area 501, a worker selection input area 502, a list display area 503, an evidence detail display area 504, and a seek bar display area 505.
[0106]
The date input area 501 accepts selection input of a predetermined date. The worker selection input area 502 accepts the selection input of the worker whose evidence is to be confirmed. In the list display area 503, evidence, that is, work records are displayed in a list by dividing items such as date and time, presence / absence of work interruption, and interruption time. Whether or not the work is interrupted corresponds to whether or not the work includes the interruption, the interruption time corresponds to the interruption time when the interruption is included, and the evidence detail display area 504 corresponds to the evidence selected in the list display area 503. The camera image of a predetermined length before and after the interruption is displayed as video information. The image before and after the interruption also displays a link for playing back the video information. In the seek bar display area 505, a seek bar, which is information for specifying a reproduction time point of video information, is displayed. The seek bar includes a time range marked in a band shape, and the marked time range can be displayed to emphasize the time determined to be interrupted.
[0107]
FIG. 11 is a diagram showing an example of an analysis result confirmation screen. The analysis result confirmation screen 600 includes a worker selection input area 601, a period input area 602, an analysis result display area 603, and an advice item 604.
[0108]
The worker selection input area 601 accepts the selection input of the target worker whose analysis result is to be confirmed. The period input area 602 accepts selection input for a predetermined period. In the analysis result display area 603, the analysis result is displayed by dividing items such as the interruption frequency, the work that is not good, the time when the most interruption occurs, and the interruption ratio with respect to the work amount. The item of each analysis result is an item for displaying the result of analysis using a predetermined analysis algorithm in the analysis processing flow. The advice item 604 is an item for displaying the content of advice created by specifying an item having a large deviation from the average of other workers.
[0109]
The above is an example of the work support system according to the embodiment. According to the example of the work support system according to the embodiment, the work can be supported according to the implementation status of the worker, so that the worker receives appropriate guidance when resuming the interrupted work and surely restarts the work. be able to.
[0110]
Further, in the example of the above embodiment, general work has been described, but more specifically, the work procedure can be replaced with a recipe and applied to cooking, or the procedure can be applied to a day's time. It is also possible to replace it with a table and apply it to housekeeping.
[0111]
Further, the technical elements of the above-described embodiment may be applied independently, or may be divided into a plurality of parts such as a program component and a hardware component and applied.
[0112]
The present invention has been described above with a focus on embodiments.
Description of the sign
[0113]
1 ... work support system, 50 ... wireless network, 100 ... sensor device, 110 ... detection processing unit, 120 ... communication unit, 130 ... display unit, 200 ... work support Device, 210 ... Storage unit, 211 ... Setting storage unit, 212 ... Evidence storage unit, 213 ... Advice storage unit, 220 ... Processing unit, 221 ... Interruption detection unit, 222.・ ・ Interruption state recognition unit 223 ・ ・ ・ restart operation judgment unit 224 ・ ・ ・ restart notification unit 225 ・ ・ ・ setting unit 226 ・ ・ ・ improvement proposal unit 227 ・ ・ ・ calibration unit 228 ・ ・-Exclusion work setting unit, 229 ... Evidence acquisition unit, 230 ... Communication unit, 300 ... Management device.
The scope of the claims
[Claim 1]
The interruption detection unit that determines whether the sensor information acquired by the sensor device attached to the worker satisfies the predetermined first condition, detects the interruption of the work, and identifies the work.
When the interruption of the work is detected, the interruption state recognition unit that notifies the worker of the interruption by light, voice or vibration,
A work support device characterized by being equipped with.
[Claim 2]
The work support device according to claim 1.
The interruption state recognition unit specifies the work content to be performed after resumption of the work for which interruption is detected, and generates display information for instructing the work content.
A work support device characterized by that.
[Claim 3]
The work support device according to claim 2.
The sensor device acquires an image including at least a part or the whole of the worker's field of view as the sensor information.
The interruption state recognition unit is created by including the screen information for displaying the image at the time of the interruption in the display information.
A work support device characterized by that.
[Claim 4]
The work support device according to claim 2 or 3.
A restart operation determination unit that determines whether or not the sensor information satisfies a predetermined second condition and detects the restart of the work in which interruption is detected,
The restart notification unit that notifies the display information about the work for which restart was detected, and
A work support device characterized by being equipped with.
[Claim 5]
The work support device according to any one of claims 1 to 4.
The interruption state recognition unit identifies at least the work to be performed after resuming the interrupted work, and displays an explanation video of the work.
A work support device characterized by that.
[Claim 6]
The work support device according to claim 3,
The interruption detection unit is the predetermined first condition when the video includes a display screen or a procedure manual for the work, or when the video does not include the operator's hands. Judge to meet,
A work support device characterized by that.
[Claim 7]
The work support device according to any one of claims 1 to 6.
The sensor device acquires at least the voice spoken by the worker as the sensor information.
The interruption detection unit determines that the predetermined first condition is satisfied when the voice includes a conversation with another person for a predetermined time or longer.
A work support device characterized by that.
[Claim 8]
The work support device according to any one of claims 1 to 7.
The sensor device acquires at least the biological information of the worker as the sensor information, and
The interruption detection unit determines that the predetermined first condition is satisfied when the biometric information is not in the predetermined normal range.
A work support device characterized by that.
[Claim 9]
The work support device according to claim 4,
The sensor device acquires, as the sensor information, a video including at least a part or all of the worker's field of view or a voice spoken by the worker.
The restart operation determination unit satisfies the predetermined second condition when at least the video contains a predetermined gesture of the worker or the voice contains a predetermined speech of the worker. Judging,
A work support device characterized by that.
[Claim 10]
The work support device according to claim 4,
The sensor device acquires at least the biological information of the worker as the sensor information, and
The restart operation determination unit determines that the predetermined second condition is satisfied when the biometric information is in a predetermined normal range.
A work support device characterized by that.
[Claim 11]
The work support device according to any one of claims 1 to 10.
A calibration unit that calibrates a value that serves as a criterion for determining the first condition, the second condition, or both of them.
A work support device characterized by being equipped with.
[Claim 12]
The work support device according to any one of claims 1 to 11.
Evidence acquisition unit that stores the sensor information related to the work before and after the interruption in a predetermined storage unit and reproduces the sensor information in response to a request from another device.
A work support device characterized by being equipped with.
[Claim 13]
The work support device according to any one of claims 1 to 12.
The improvement proposal department, which calculates statistical information related to the interruption for each worker and shows the work that is significantly different from other workers.
A work support device characterized by being equipped with.
[Claim 14]
It is a work support method using a work support device,
The work support device is equipped with a processing unit.
The processing unit
A break detection step that determines whether or not the sensor information acquired by the sensor device attached to the worker satisfies the predetermined first condition, detects the interruption of the work, and specifies the work.
When the interruption of the work is detected, the interruption state recognition step of notifying the worker of the interruption by light, voice or vibration, and
A work support method characterized by implementing.