Specification
Specification Title of the invention
COOPERATIVE OPERATION DEVICE, COOPERATIVE OPERATION METHOD, COOPERATIVE OPERATION CONTROL PROGRAM, AND DEVICE COOPERATION SYSTEM
Technical field
The present invention relates to a cooperative operation device which realizes a predetermined function by operating in cooperation with another device, a cooperative operation method, a cooperative operation control program, and a device cooperation system in which a plurality of devices operate in cooperation with each other to realize a predetermined function.
Background art
In recent years, an electronic device (hereinafter, simply referred to as a "device") such as a portable phone, a personal computer (hereinafter, referred to as a "PC"), or the like has various additional functions such as an image photographing function, a music reproducing/recording function, and the like in addition to a communication function, an information processing function, and the like that are basic functions of the device. The additional function is becoming further diversified and complicated.
When each device has various functions, the convenience for the user is improved. However, when the number of functions provided in the device is increased, there is a possibility that the cost, the weight, the size, and the power consumption of the device are increased. Therefore, if a function that is provided in another device but not provided in the device can be used by the device as needed basis, efficiency can be greatly improved.
Further, if a function provided in a neighboring device can be used by the device although the device has the same function, a new effect that cannot be obtained by only one device may be obtained. For example, it is assumed that a device A and a device B have respective image photographing functions. When the device A takes an image by itself, only an image X taken by the device A is obtained. However, the device A and the device B can take the image at a different position or at a different angle at the same time. By using this, a new effect can be obtained. Namely, when the device A makes the device B take an image Y and obtains the image Y, it can obtain new information for example, an image Z obtained by combining the image X and the image Y or the like, from the image X and the image Y.
Various systems in which a plurality of devices operate in cooperation with each other in order to obtain a combined result are disclosed (refer to for example, patent documents 1 and 2). A composite service providing apparatus described in patent document 1 makes the devices connected to respective plurality of networks operate in cooperation with each other and provide a composite service.
In a voice communication system disclosed in patent document 2, a web browser terminal and a PC operate in cooperation with each other and whereby, when the web browser terminal receives a call, a user can smoothly respond it.
As a specific example of a device cooperation system, there is a system in which an apparatus having an image photographing function and an apparatus having a voice recording function operate in cooperation with each other (reference to, for example, patent document 3). In an electronic camera system disclosed in patent document 3, an image photographed by an electronic still camera is associated with a voice recorded by a portable telephone set as a voice memorandum and it is recorded.
There is a sound reproduction system which uses a plurality of portable terminal apparatuses having a sound reproduction function (reference to, for example patent document 4). In the sound reproduction system described in patent document 4, sound data is distributed to each of the plurality of portable terminal apparatuses and each portable terminal apparatus reproduces the voice.
A sound image localization mobile communication system in which the sound image of the communication voice can be localized at an azimuth for communication with a communication partner is disclosed (reference to, for example patent document 5).
A network system in which a plurality of mobile apparatuses having a sensor function operate in cooperation with each other is disclosed (reference to, for example patent document 6). In the network system disclosed in patent document 6, the plurality of mobile apparatuses share sensor information (photographed image), search for a target, detect it, and track it.
Prior art document
patent document 1: Japanese Patent Application Laid-Open No. 2002-237829 (page 3 and Fig. 1)
patent document 2: Japanese Patent Application Laid-Open No. 2005-295149 (pages 6 to 7 and Fig. 1)
patent document 3: Japanese Patent Application Laid-Open No. 2004-96165 (pages 11 to 12 and Fig.1)
patent document 4: Japanese Patent Application Laid-Open No. 2003-47098 (page 15 and Fig. 29)
patent document 5: Japanese Patent Application Laid-Open No. 2007-13407 (pages 9 to 10 and Fig. 1)
patent document 6: Japanese Patent Application Laid-Open No. 2006-344075 (pages 16 to 18 and Figs.10 to 12)
Brief summary of the invention Problems to be solved by the invention
In technology described in patent documents 1 and 2, the devices operate in cooperation with each other. In this case, the devices separately exist. However, this feature is not utilized. Namely, although the devices operate in cooperation with each other, the operations of all the functions operated in each device are the same as those of all the functions when each device operates as the stand-alone device. Thus, in the technology described in patent documents 1 and 2, there is a problem in which the relative relationship between the devices is not taken into the consideration and not used although the plurality of devices operate in cooperation with each other.
In the technology described in patent document 3, a shutter of a camera is remotely operated by a portable phone. Therefore, in this point, we can say that the devices cooperatively operate. However, the portable phone merely transmits a photographing instruction to the camera unilaterally and the camera performs only a photographing operation according to the instruction. Thus, the technology described in patent document 3 has a problem in which the relative relationship between the portable phone and the camera is not taken into consideration and not used.
In the technology described in patent document 4, each of the plurality of portable terminal apparatuses independently reproduces the voice and as a whole, a predetermined acoustic effect is obtained.
Therefore, in this point, a predetermined effect is obtained by the cooperation of the devices. However, when the plurality of portable terminal apparatuses are arbitrarily arranged, the desired acoustic effect is not always obtained. Therefore, in the technology described in patent document 4, when the voice is distributed to all the portable terminal apparatuses and reproduced, in order to obtain the desired acoustic effect, all the portable terminal apparatuses have to be correctly arranged at the predetermined position such as front/back position, left/right position, or the like. If the voice can be distributed by considering the positional relationships between the plurality of portable terminal apparatuses, the cooperation of the portable terminal apparatuses for obtaining the predetermined acoustic effect will be easily obtained. However, in the technology described in patent document 4, because the voice cannot be distributed by taking the positional relationship between the portable terminal apparatuses into consideration, there is a problem in which the accurate arrangement of the portable terminal apparatuses is required.
In the technology described in patent document 5, a mobile communication terminal receives a voice transmitted from a communication partner and achieves the sound image localization of the voice at the azimuth of the communication partner's terminal. Therefore, in this point, a relative positional relationship between the mobile communication terminal and the communication partner is used. However, new information using information held by the mobile communication terminal itself and the received voice or the like is not produced. In other words, the technology described in patent document 5 has a problem in which the cooperative operation in which the relative relationship between the transmission side terminal and the partner terminal is taken into consideration and used cannot be performed.
In the technology described in patent document 6, sensor information obtained by a plurality of mobile apparatuses is shared. However, the relative relationship between the plurality of mobile apparatuses cannot be taken into consideration and cannot be used. Therefore, the plurality of mobile apparatuses move completely independently from each other. Accordingly, there is a problem in which the plurality of mobile apparatuses cannot perform an efficient operation in which the mobile apparatuses move by using information about the positional relationship between them, find out a target early, and trace it.
The present invention is made in view of the above technical problem. An object of the present invention is to provide a cooperative operation device which operates in cooperation with another device and uses a relative relationship with the another device, a cooperative operation method, and a cooperative operation device control program.
An object of the present invention is to provide a device cooperation system in which a plurality of devices operate in cooperation with each other and a relative relationship between these devices is used.
Means for solving the problems
A device cooperation system of the present invention includes a first device which has a first transmission function to transmit first information and a second device which has a first relative relationship with the first device, has a first reception function to receive the first information, and generates third information based on the first relative relationship, the first information, and second information.
A device cooperation system of the present invention includes a first device which has a first transmission function to transmit first information, a second device which is arranged so as to provide a first relative relationship with the first device and has a second transmission function to transmit second information, and a third device which is arranged so as to provide a second relative relationship with the second device and a third relative relationship with the first device, has a first reception function to receive the first information and the second information, and generates third information based on at least one among the first relative relationship, the second relative relationship, and the third relative relationship, as well as the first information and the second information.
A cooperative operation device of the present invention includes first reception means which have a first relative relationship with a first device having a first transmission function to transmit first information and receive the first information and information generation means which generate third information based on the first relative relationship, the first information, and second information.
A cooperative operation device of the present invention includes first reception means which have a first relative relationship with a first device having a first transmission function to transmit first information, have a second relative relationship with a second device having a second transmission function to transmit second information, have a third relative relationship with the first device, and receive the first information and the second information and information generation means which generate third information based on at least one among the first relative relationship, the second relative relationship, and the third relative relationship, as well as the first information and the second information.
A device cooperation method of the present invention comprises transmitting first information from a first device, receiving the first information by using a second device which has a first relative relationship with the first device, and generating third information based on the first relative relationship, the first information, and second information.
A device cooperation method of the present invention comprises transmitting first information from a first device, transmitting second information from a second device which has a first relative relationship with the first device, receiving the first information and the second information by using a third device arranged so as to have a second relative relationship with the second device and a third relative relationship with the first device, and generating third information based on at least one among the first relative relationship, the second relative relationship, and the third relative relationship, as well as the first information and the second information.
A cooperative device control program of the present invention causes a computer provided in a second device which has a first relative relationship with a first device that transmits first information to function as means for receiving the first information and means for generating third information based on the first relative relationship, the first information and second information.
A cooperative device control program of the present invention causes a computer provided in a third device which has a second relative relationship with a first device which transmits first information, a first relative relationship with a first device, and a third relative relationship with a second device that transmits second information to function as means for receiving the first information and the second information and means for generating third information based on at least one among the first relative relationship, the second relative relationship, and the third relative relationship, as well as the first information and the second information.
Effect of the invention
The cooperative operation device, the cooperative operation method, and the cooperative operation device control program of the present invention have the effects in which the cooperative operation device can operate in cooperation with another device and a result using a relative positional relationship with the another devices can be obtained.
The device cooperation system of the present invention has an effect in which a plurality of devices can operate in cooperation with each other and a result using a relative positional relationship between these devices can be obtained.
Brief description of the drawings
[Fig. 1] Fig. 1 is a block diagram showing a configuration of a device cooperation system of a first exemplary embodiment of the present invention.
[Fig. 2] Fig. 2 is a block diagram showing a configuration of a first modification example of a device cooperation system of a first exemplary embodiment of the present invention.
[Fig. 3] Fig. 3 is an example of a flowchart when performing a process of a second device by using software in a device cooperation system of a first exemplary embodiment of the present invention.
[Fig. 4] Fig. 4 is a block diagram showing a configuration of a second modification example of a device cooperation system of a first exemplary embodiment of the present invention.
[Fig. 5] Fig. 5 is an example of a flowchart when performing a process of a third device by using software in a second modification example of a device cooperation system of a first exemplary embodiment of the present invention.
[Fig. 6] Fig. 6 is a block diagram showing a configuration of a stereophonic recording system of a second exemplary embodiment of the present invention.
[Fig. 7] Fig. 7 is a block diagram showing a configuration of a first modification example of a stereophonic recording system of a second exemplary embodiment of the present invention.
[Fig. 8] Fig. 8 is a block diagram showing a configuration of a second modification example of a stereophonic recording system of a second exemplary embodiment of the present invention.
[Fig. 9] Fig. 9 is a block diagram showing a configuration of a stereophonic voice reproduction system of a third exemplary embodiment of the present invention.
[Fig. 10] Fig. 10 is a block diagram showing a configuration of a panoramic image photographing system of a fourth exemplary embodiment of the present invention.
[Fig. 11] Fig. 11 is a block diagram showing a configuration of an image voice complex system of a fifth exemplary embodiment of the present invention.
[Fig. 12] Fig. 12 is a block diagram showing a configuration of a cooperative navigation system of a sixth exemplary embodiment of the present invention.
[Fig. 13] Fig. 13 is a block diagram showing a configuration of a distance estimation system of a seventh exemplary embodiment of the present invention.
[Fig. 14A] Fig. 14A is a block diagram showing a configuration of a first modification example of a distance estimation system of a seventh exemplary embodiment of the present invention.
[Fig. 14B] Fig. 14B is a figure showing an example of an image range of a device 701 in a whole image 712 of a seventh exemplary embodiment of the present invention.
[Fig. 15] Fig. 15 is a block diagram showing a configuration of a second modification example of a distance estimation system of a seventh exemplary embodiment of the present invention.
[Fig. 16] Fig. 16 is a block diagram showing a configuration of an image sharing system of an eighth exemplary embodiment of the present invention.
[Fig. 17] Fig. 17 is a block diagram showing a configuration of an image correction system of a ninth exemplary embodiment of the present invention.
[Fig. 18A] Fig. 18A is a block diagram showing a configuration of an object discrimination system of a
tenth exemplary embodiment of the present invention.
[Fig. 18B] Fig. 18B shows an example of an image displayed in an image inputting/recording apparatus shown in Fig. 18A.
[Fig. 19A] Fig. 19A is a block diagram showing a configuration of an object discrimination system of a tenth exemplary embodiment of the present invention.
[Fig. 19B] Fig. 19B shows an example of an image displayed in an image inputting/recording apparatus shown in Fig. 19A.
Mode for carrying out the invention
(First exemplary embodiment)
A configuration and operation of a device cooperation system of a first exemplary embodiment of the present invention will be described by using Fig. 1. Fig. 1 is a block diagram showing a configuration of the device cooperation system of the first exemplary embodiment. Fig. 2 and Fig. 4 are block diagrams showing configurations of a first modification example and a second modification example of the device cooperation system of the first exemplary embodiment, respectively. Fig. 3 is an example of a flowchart when performing a process of a second device by using software in the device cooperation system of the first exemplary embodiment. Fig. 5 is an example of a flowchart when performing a process of a third device by using software in a second modification example of a device cooperation system of the first exemplary embodiment.
The device cooperation system of the exemplary embodiment comprises a first device 101 and a second device 102. The first device 101 and the second device 102 are arranged so as to have a predetermined relative positional relationship or an arbitrary positional relationship.
First information 111 is information provided in the first device 101. For example, the first device 101 may have a first function and a first information generation function to generate the first information 111 as a process result of the first function. The first device 101 has a first transmission function to transmit the first information 111.
Second information 112 is information provided in the second device 102. For example, the second device 102 may have a second function and a second information generation function to generate the second information (not shown) as a process result of the second function.
The above-mentioned "information" is information provided in the first device 101 and the second device 102. The "function" means inputting some signal and a state from the outside and performing a predetermined process. The "information" may be output information outputted as the process result. The form of the information is not limited in particular. The information may be represented by an analog signal or may be represented by a digital signal. The format of the information is arbitrary.
The function is for example, a voice input function and the information is voice information generated based on the inputted voice. The form of the voice information may be the analog signal obtained by only converting the voice into the electrical signal. Further, the form of the voice information may be digital information composed of a set of digitized digital values after sampling the voice or coded information obtained by applying a signal processing such as encryption, compression, or the like to the digital information.
An image input function, a measurement function to measure an ambient environment such as temperature, pressure, or illumination intensity, or the like is an example of another function.
The "transmission" means sending the information to a destination-side device. Accordingly, the means for transmission are not limited in particular.
For example, the information may be transmitted in a form of the electrical signal by using a cable or may be transmitted as a wireless signal. A procedure for the transmission is not limited in particular.
The first device 101 generates the first information by the first function at a position at which the first device 101 is located. The second device 102 generates the second information by the second function at a position at which the second device 102 is located. There is a predetermined relative relationship between the first device 101 and the second device 102 that depends on the arrangement of the first device 101 and the second device 102. The relative relationship is for example, a "distance" that is defined as a positional difference between the positions at which the devices are located, a "directional difference" that is a difference between the directions which the predetermined planes of the devices face, or the like. In case of the distance, a length between predetermined reference points (not shown) that are set to the first device 101 and the second device 102 may be used as the distance. In case of the directional difference, as shown in Fig. 2, an angle between the normal lines of predetermined planes PI and P2 that are set to the first device 101 and the second device 102 may be used as the directional difference.
The second device receives the first information 111 from the first device 101. The second device generates third information 113 based on the first information 111, the second information, and the relative positional relationship between the first device 101 and the second device 102.
A method for acquiring the relative relationship is not limited. For example, when the distance between the first device 101 and the second device 102 is used as the relative relationship, the relative relationship can be obtained as follows. First, position information on the first device 101 is transmitted from the first device 101 to the second device 102. The second device 102 acquires the position information on the second device 102. The second device 102 calculates the distance between the first device 101 and the second device 102 from the difference between the position information on the first device 101 and the position information on the second device 102. The GPS (Global Positioning System) or the like can be used for obtaining the position information. Further, the distance can be estimated by using a method shown in a seventh exemplary embodiment as an example.
When the relative relationship is the directional difference between the first device 101 and the second device 102, the relative relationship can be obtained as follows. First, direction information on the first device 101 is transmitted from the first device 101 to the second device 102. The second device 10 acquires the direction information on the second device 102. The second device 102 obtains the directional difference between the first device and second device 102 from the difference between the direction information on the first device 101 and the direction information on the second device 102. A geomagnetism sensor or the like can be used for acquiring the direction information.
Not only the position or the angle but also a relationship between the attribute of the first device 101 and the attribute of the second device 102 may be used as the "relative relationship". The attribute is for example, a physical parameter. Specifically, the first device 101 and the second device 102 have the following attributes.
1) the weight of the first device 101 and the weight of the second device 102
2) the pressure received by the predetermined plane of the first device 101 and the pressure
received by the predetermined plane of the second device 102
3) the temperature of the first device 101 and the temperature of the second device 102
4) the illumination intensity on the predetermined plane of the first device 101 and the illumination intensity on the predetermined plane of the second device 102
In other words, the "relative relationship" in the exemplary embodiment is the difference between the predetermined states that can be expressed by a numerical value. Therefore, the "relative relationship" in the exemplary embodiment is not limited to the "distance", an "angle difference", and the "attribute" described above as an example.
As described above, the device cooperation system of the exemplary embodiment generates new
information based on the information generated by each of the devices which have the relative positional relationship and the relative relationship. Therefore, the device cooperation system has an effect in which information using the relative positional relationship between the devices can be obtained.
Hereinafter, a system in which a plurality of devices which have the relative relationship between them operate in cooperation with each other and information is generated based on information generated by each of the plurality of devices and the relative relationship between the devices is called a "device cooperation system".
A process performed by the second device 102 can be realized through a software process performed by a computer incorporated in the second device 102. Fig. 3 is an example of a flowchart when the second device 102 performs the process by using software. The second device 102 receives the first information 111 (step SI) and generates the third information 113 based on the relative relationship, the first information 111, and the second information 112 (step S2).
As shown in Fig. 4, the function to generate the third information may be provided in the third device 103 instead of the second device 102.
In the device cooperation system shown in Fig. 4, there are three relative positional relationships between the devices. Namely, there are three relative positional relationships: the relative positional relationship between the first device 101 and the second device 102 (first relative positional relationship), the relative positional relationship between the second device 102 and the third device 103 (second relative positional relationship), and the relative positional relationship between the third device 103 and the first device 101 (third relative positional relationship).
The third device 103 receives the first information 111 from the first device 101 and receives the second information 112 from the second device 102. The third device 103 generates the third information 113 based on the first information 111, the second information 112, and at least one relative positional relationship among the first relative positional relationship, the second relative positional relationship, and the third relative positional relationship.
The process performed by the third device 103 can be realized through a software process performed by the computer incorporated in the third device 103. Fig. 5 is an example of a flowchart when the third device 103 performs the process by using software. The third device 103 receives the first information 111 and the second information 112 (step SI). The third device 103 generates the third information 113 based on the relative relationship, the first information 111, and the second information 112 (step S2). Here, the relative relationship means at least one relative positional relationship among the first relative positional relationship, the second relative positional relationship, and the third relative positional relationship.
(Second exemplary embodiment)
The specific exemplary embodiment of the present invention will be described. As an example of the device cooperation system, there is a stereophonic recording system in which two voice input apparatuses and two voice recording apparatuses operate in cooperation with each other and stereophonic recording is achieved.
Fig. 6 is a block diagram showing a configuration of the stereophonic recording system of the second exemplary embodiment of the present invention. The stereophonic recording system comprises a voice input apparatus 201, a voice input apparatus 202, and a voice recording apparatus 203.
The "voice input apparatus" may have only a voice input function and a voice information output function. Therefore, a common microphone which just converts the external voice into an electrical signal can be used as the voice input apparatus. Further, it may have a recording function in addition to the voice input function. Accordingly, the voice input apparatus may be a voice recorder, or a portable telephone set or a PC that has a voice input recording function.
The "voice recording apparatus" may have only the recording function and a predetermined processing function. Accordingly, the portable telephone set or the PC that includes recording means is used as the voice recording apparatus and a process required for the voice may be performed by using software.
The voice input apparatus 201, the voice input apparatus 202, and the voice recording apparatus 203 are arranged at a predetermined position or an arbitrary position. Where LI is the distance between the voice input apparatus 201 and the voice recording apparatus 203, L2 is the distance between the voice input apparatus 202 and the voice recording apparatus 203, and L3 is the distance between the voice input apparatus 201 and the voice input apparatus 202.
The distances between three apparatuses: the voice input apparatus 201, the voice input apparatus 202, and the voice recording apparatus 203 are measured or detected by a predetermined method. For example, each of the voice input apparatus 201, the voice input apparatus 202, and the voice recording apparatus 203 obtains the position information thereon by using the GPS, informs the other apparatuses of the obtained position information, and calculates the difference between the position information, and whereby, each of the voice input apparatus 201, the voice input apparatus 202, and the voice recording apparatus 203 may measure the distance between them. Further, the distance can be estimated by using a method shown in a seventh exemplary embodiment as an example.
A method for discriminating the positions, a right side position and a left side position of the voice recording apparatus 203, at which the voice input apparatus 201 and the voice input apparatus 202 are located is not limited in particular. For example, a method in which the voice recording apparatus 203 acquires the position information from the voice input apparatus 201 and the voice input apparatus 202, compares these information with the position information on the voice recording apparatus 203, and discriminates the positions at which the voice input apparatus 201 and the voice input apparatus 202 are located may be used. Further, a user of the voice recording apparatus 203 may input the information about the positional relationships between the voice input apparatus 201, the voice input apparatus 202, and the voice recording apparatus 203 by using a predetermined method.
The voice input apparatus 201 and the voice input apparatus 202 have the voice input function. The voice input apparatus 201 and the voice input apparatus 202 input surrounding voices SI and S2 and transmit voice signals 211 and 212 to the voice recording apparatus 203, respectively. When the voice input function has directivity, the information about the directivity, that are information on directions Dl and D2 which the voice input functions face, may be transmitted from the voice input apparatus 201 and the voice input apparatus 202 to the voice recording apparatus 203.
Voice information SD1 and SD2 based on the voices SI and S2 are included in the voice signals 211 and 212, respectively. The method for transmitting the voice signals 211 and 212 by the voice input apparatus 201 and the voice input apparatus 202 and the form of the voice information SD1 and SD2 are not limited in particular. The voice information SD1 and SD2 may be analog information represented by the analog signal or digital information represented by the set of the digital values. When the voice information SD1 and SD2 are the digital information, the signal processing such as compression, encryption, and the like may be additionally performed.
The voice recording apparatus 203 receives the voice signals 211 and 212 and extracts the voice information SD1 and SD2. The voice recording apparatus 203 performs the predetermined process to the voice information SD1 and SD2 based on the distances LI, L2, and L3. Further, the voice recording apparatus 203 may perform the process based on the directions Dl and D2.
By the way, the distance LI is not always equal to the distance L2.
Accordingly, the volume levels of the voices S1 and S2 represented by the voice information SD1 and SD2 are adjusted so as to compensate the distance difference between the distance L1 and the distance L2. Namely, the voice information SD1 and SD2 are changed so as to obtain a desired loudness with respect to the voices S1 and S2.
When the distance L1 is equal to the distance L2, the loudness of the voice may be intentionally adjusted as if the distance L1 and the distance L2 are different from each other. Namely, when the distance between the voice recording apparatus 3 and the voice input apparatus 201 is equal to the distance between the voice recording apparatus 3 and the voice input apparatus 202, the loudness of the voice S1 may be reduced as if the distance between the voice recording apparatus 203 and the voice input apparatus 201 is greater than the distance between the voice recording apparatus 203 and the voice input apparatus 202.
In the above-mentioned description, only one voice recording apparatus 203 is used as the voice recording apparatus. As shown in Fig. 7, the stereophonic recording system of the exemplary embodiment can use a plurality of voice recording apparatuses. The stereophonic recording system shown in Fig. 7 is a first modification example of the stereophonic recording system shown in Fig. 6 and in the stereophonic recording system shown Fig. 7, a voice recording apparatus 204 is added to the stereophonic recording system shown in Fig. 6. When the stereophonic recording system shown in Fig. 7 is used, the voice recording apparatus 204 may perform the process that is the same as the process performed by the above-mentioned voice recording apparatus 203 by using the distance between the voice recording apparatus 204 and the voice input apparatus 201, the distance between the voice recording apparatus 204 and the voice input apparatus 202 (correspond to the distance L1 and the distance L2), and the distance L3.
As described above, in the stereophonic recording system of the exemplary embodiment, the predetermined process is applied to the voice information obtained from two voice input apparatuses by using the distance between the voice input apparatus and the voice recording apparatus. Accordingly, the stereophonic recording system of the exemplary embodiment has an effect in which even when the set position of the voice input apparatus is not the best position for the stereophonic recording, the required compensation can be performed and the stereophonic voice information can be generated.'
Further, one of two voice input apparatuses may have the voice recording function. Fig. 8 shows a second modification example of the stereophonic recording system of the second exemplary embodiment. A voice input recording apparatus 205 has both the function of the voice input apparatus 202 and the function of the voice recording apparatus 203 that are explained above. However, the voice input recording apparatus 205 does not have the transmission function to transmit the voice information SD2.
The voice input recording apparatus 205 inputs the surrounding voice S2 and generates the voice information SD2 based on the voice S2. The voice input recording apparatus 205 generates stereophonic voice information SSD based on the voice information SD2, the voice information SD1 based on the voice SI that is received from the voice input apparatus 201, and the distance LI.
(Third exemplary embodiment)
The specific exemplary embodiment of the present invention will be described. As an example of the device cooperation system, there is a stereophonic voice reproduction system in which two voice input apparatuses and two voice reproduction apparatuses operate in cooperation with each other and the stereophonic reproduction is performed.
Fig. 9 shows the stereophonic voice reproduction system of the third exemplary embodiment of the present invention. The stereophonic voice reproduction system comprises the voice input apparatus 201, the voice input apparatus 202, a voice reproduction apparatus 301, and a voice reproduction apparatus 302.
A "voice reproduction apparatus speaker" may have only the voice reproduction function and a voice information processing function. Accordingly, the portable telephone set or the PC that includes voice output means may be used as the speaker and a process of the voice information may be performed by software.
The "voice input apparatus" of the third exemplary embodiment is the same as that of the second exemplary embodiment.
The voice input apparatus 201, the voice input apparatus 202, the voice reproduction apparatus 301, and the voice reproduction apparatus 302 are arranged at a predetermined position or an arbitrary position.
The distances between the apparatuses: the voice input apparatus 201, the voice input apparatus 202, the voice reproduction apparatus 301, and the voice reproduction apparatus 302 are represented by the following symbol.
The distance between the voice input apparatus 201 and the voice input apparatus 202: L1.
The distance between the voice reproduction apparatus 301 and the voice reproduction apparatus 302: L2
The distance between the voice input apparatus 201 and the voice reproduction apparatus 301: L11.
The distance between the voice input apparatus 202 and the voice reproduction apparatus 301: L21.
The distance between the voice input apparatus 201 and the voice reproduction apparatus 302: L12.
The distance between the voice input apparatus 202 and the voice reproduction apparatus 302: L22.
The distances between the apparatuses: the voice input apparatus 201, the voice input apparatus 202, the voice reproduction apparatus 301, and the voice reproduction apparatus 302 are measured or detected by a predetermined method. For example, each of the voice input apparatus 201, the voice input apparatus 202, the voice reproduction apparatus 301, and the voice reproduction apparatus 302 obtains the position information thereon by using the GPS, informs the other apparatus of the obtained the position information, and calculates the difference between the position information, and whereby, each of the voice input apparatus 201, the voice input apparatus 202, the voice reproduction apparatus 301, and the voice reproduction apparatus 302 may measure the distance between them. Further, the distances between the apparatuses: the voice input apparatus 201, the voice input apparatus 202, the voice reproduction apparatus 301, and the voice reproduction apparatus 302 can be estimated by using a method shown in the seventh exemplary embodiment as an example.
A method for discriminating the positions, a right side position and a left side position of the voice reproduction apparatus, at which the voice input apparatus 201 and the voice input apparatus 202 are located is the same as that of the second exemplary embodiment.
The voice input apparatus 201 and the voice input apparatus 202 have the voice input function. The voice input apparatus 201 and the voice input apparatus 202 input the surrounding voices SI and S2 and transmit the voice signals 211 and 212 to the voice reproduction apparatus 301 and the voice reproduction apparatus 302, respectively. The directivity is the same as the directivity of the second exemplary embodiment.
The voice information SD1 and SD2 based on the voices SI and S2 are included in the voice signals 211 and 212, respectively. The method for transmitting the voice signals 211 and 212 by the voice input apparatus 201 and the voice input apparatus 202 and the form of the voice information SD1 and SD2 are not limited in particular. The voice information SD1 and SD2 may be analog information or digital information. When the voice information SD1 and SD2 are the digital information, the signal processing such as compression, encryption, and the like may be additionally performed.
The voice reproduction apparatus 301 and the voice reproduction apparatus 302 receive the voice signals 211 and 212 and extract the voice information SD1 and SD2. The voice reproduction apparatus 301 and the voice reproduction apparatus 302 perform the predetermined process to the voice information SD1 and SD2 based on the distances L1, L11, L21, L12, L22, and L2. The voice reproduction apparatus 301 and the voice reproduction apparatus 302 may additionally perform a process to the voice information SD1 and SD2 based on the directions Dl and D2.
The sound reproduction device 301 generates voice information SD3 representing the voice outputted by the voice reproduction apparatus 301. The voice reproduction apparatus 302 generates voice information SD4 representing the voice outputted by the voice reproduction apparatus 4.
With respect to the voice information SD1 and SD2, the loudness of the voice may be adjusted based on the distances LI and L2 like the second exemplary embodiment.
As described above, in the stereophonic voice reproduction system of the exemplary embodiment, the predetermined process is applied to the voice information obtained from two voice input apparatuses by using the distance between the voice input apparatus and the voice reproduction apparatus.
Accordingly, the stereophonic voice reproduction system of the exemplary embodiment has an effect in which even when the set position of the voice input apparatus is not the best position for the voice input for the stereophonic voice reproduction, the required compensation can be performed and the stereophonic voice can be reproduced.
(Fourth exemplary embodiment)
An image that cannot be obtained by using one image input apparatus can be created by cooperatively operating two image input apparatuses and an image recording apparatus and combining the images photographed by the plurality of image input apparatuses. As an example of such device cooperation system, there is a panoramic image photographing system. Namely, by combining the images photographed in different directions by the plurality of image input apparatuses, a panoramic image is created.
Fig. 10 is a block diagram showing a configuration of the panoramic image photographing system of the exemplary embodiment. The panoramic image photographing system of the exemplary embodiment comprises image input apparatuses 401 and 402, and an image recording apparatus 403.
The "image input apparatus" means an apparatus having an image input function to input an image that is a light from an object and an image information output function to output image information. The image input apparatus may not have an image information recording function to record the image information. Accordingly, a CCD camera, an USB camera, or the like that has only an image sensor and a signal output function, inputs the image, and outputs the image signal or the image information can be used as the image input apparatus. Even when a common camera having the image information recording function is used, because it has at least the image input function and the image information output function, it can be used as the image input apparatus.
The "image recording apparatus" means an apparatus having the image information recording function. The image recording apparatus may not have the image input function and the image information output function. Accordingly, a video recorder, a PC or the like which has only a function to input for example, an image signal or image information and record it can be used as the image recording apparatus. Even when the common camera having the image input function and the image information output function is used, because it has the image information recording function, it can be used as the image recording apparatus.
The "image input recording apparatus" has the image input function, the image information recording function, and the image information output function. Namely, a portable telephone set or a PC that includes a common camera or a camera function can be used as the image input recording apparatus. As described above, the image input recording apparatus can be used as the image input apparatus or the image recording apparatus. Namely, the portable telephone set or the PC that includes the common camera or the camera function can be used as the image input apparatus or the image recording apparatus by using a part of the function provided therein.
The image input apparatus 401 includes an image input unit (not shown). An image input plane of the image input unit is arranged so that it faces the direction Dl. The image input unit of the image input apparatus 401 inputs an image VI in the direction Dl.
Similarly, the image input apparatus 2 includes the image input unit (not shown). An image input plane of the image input unit is arranged so that it faces the direction D2. The image input unit of the image input apparatus 402 inputs an image V2 in the direction D2.
The image input unit is for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The image input unit may include an optical system such as a lens and an automatic focus adjustment function. Because a specific configuration and an attached function of the image input unit are not important in the exemplary embodiment, the detailed description will be omitted.
The image input apparatuses 401 and 402 input the image VI in the direction Dl and the image V2 in the direction D2 and transmit image signals 411 and 412 to the image recording apparatus 3, respectively.
Image information VD1 and VD2 based on the images VI and V2 are included in the image signals 411 and 412, respectively. A method for transmitting the image signals 411 and 412 by the image input apparatuses 401 and 402 and the form of the image information VD1 and VD2 are not limited in particular. The image information VD1 and VD2 may be analog information or digital information.
When the image information VD1 and VD2 are the digital information, the signal processing such as compression, encryption, and the like may be additionally performed.
The image input apparatuses 401 and 402 transmit the direction information about the directions Dl and D2 to the image recording equipment 3, respectively. The direction information are the information about the directions Dl and D2 which the image input planes of the image input apparatuses 401 and 402 face and indicate photographing directions of the image input apparatuses 401 and 402, respectively. The direction information includes for example, a value of an angle (azimuth direction) in a horizontal plane and a value of an angle (elevation angle, depression angle) in a vertical plane.
The directions Dl and D2 can be detected by various methods. For example, a magnetic field sensor is provided in the image input apparatuses 401 and 402 and the directions may be directly measured.
The image recording apparatus 403 determines the arrangement of the images received from the image input apparatuses 401 and 402 based on the direction information. For example, when the direction Dl is the east direction and the direction D2 is the south direction, the image received from the image input apparatus 401 is arranged in a left side and the image received from the image input apparatus 402 is arranged in a right side.
The image recording apparatus 403 receives the image signals 411 and 412 and extracts the image information VD1 and VD2. The predetermined process is applied to the image information VD1 and VD2 based on the directions Dl and D2. Specifically, the image recording apparatus 3 inputs the image signals VI and V2 and generates combined image information V3 based on the directions Dl and D2.
The times at which the images VI and V2 included in the image information VD1 and VD2 have been photographed may be different from each other. Namely, the still images that are photographed at a different time may be combined.
The image inputted by another image input apparatus may be used by using an image sharing method shown in an eight exemplary embodiment as an example.
As described above, the image sharing method shown in the ninth exemplary embodiment as an example can be additionally used as means for correcting the image.
When the images are combined, the image recording apparatus 403 may acquire the predetermined information acquired at the positions at which the image input apparatuses 401 and 402 are located from the image input apparatuses 401 and 402 and correct the images based on the acquired information. A specific example of the method for correcting the image is described in the ninth exemplary embodiment later.
The image recording apparatus 403 may acquire the information about the positions of the image input apparatuses 401 and 402. The image recording apparatus 403 also acquires the information about its own position. The image recording apparatus 403 obtains the distance between the image input apparatuses 401 and 402. The image recording apparatus 403 performs the process in which the image information VD1 and VD2 are corrected based on the distance and the sizes of the images VI and V2 are adjusted and any other process.
The distance between the image recording apparatus 403 and the image input apparatus 401 and the distance between the image recording apparatus 403 and the image input apparatus 402 may be estimated by using the distance estimation function shown in the seventh exemplary embodiment. Namely, by operating the image recording apparatus 403 and the image input apparatus 401 as the devices 401 and 402 in the seventh exemplary embodiment, the distance between the image recording apparatus 403 and the image input apparatus 401 is estimated. Similarly, the distance between the image recording apparatus 403 and the image input apparatus 402 is estimated.
Further, in case of a moving image, a still image at a certain specific time can be extracted.
Accordingly, by acquiring the moving images that are taken in a time range including a certain common time tO from the image input apparatuses 401 and 402, the images at the time tO can be combined. Namely, the image input apparatus 401 takes the moving image during a period from the time t1l to the time tl2 including the time tO and the image input apparatus 402 takes the moving image during a period from the time t21 to the time t22 including the time tO. Here, t11 < tO < tl2 and t21 < tO
Documents