Sign In to Follow Application
View All Documents & Correspondence

Information Processing Device, Information Processing Method, And Program

Abstract: In order to enable a user to measure his/her own head-related transfer characteristic with high precision, provided is an information processing device (10) equipped with a interface control unit (140) for controlling a user interface related to measurement of the head-related transfer function of a user, wherein the interface control unit controls the output of guide information for guiding the orientation of the user's head in a designated direction. Also provided is an information processing method that involves a processor (871) controlling a user interface related to measurement of a user's head-related transfer function, and the control of the user interface further includes controlling the output of guide information for guiding the orientation of the user's head in a designated direction.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
01 March 2021
Publication Number
16/2021
Publication Type
INA
Invention Field
ELECTRONICS
Status
Email
mahua.ray@remfry.com
Parent Application
Patent Number
Legal Status
Grant Date
2025-03-21
Renewal Date

Applicants

SONY CORPORATION
1-7-1, Konan, Minato-ku, Tokyo 1080075

Inventors

1. OKIMOTO, Koyuru
c/o Sony Corporation, 1-7-1, Konan, Minato-ku, Tokyo 1080075
2. NAKAGAWA, Toru
c/o Sony Corporation, 1-7-1, Konan, Minato-ku, Tokyo 1080075
3. MAGARIYACHI, Tetsu
c/o Sony Corporation, 1-7-1, Konan, Minato-ku, Tokyo 1080075

Specification

Title of invention: Information processing device, information processing method, and program
Technical field
[0001]
 The present disclosure relates to information processing devices, information processing methods, and programs.
Background technology
[0002]
 In recent years, a head-related transfer function (HRTF) that shows the sound transfer characteristics from a sound source to both ears has been attracting attention. In addition, a method for efficiently measuring the head-related transfer function has also been proposed. For example, Patent Document 1 discloses a technique for shortening the measurement time of a head-related transfer function to reduce the burden on a subject.
Prior art literature
Patent documents
[0003]
Patent Document 1: Japanese Unexamined Patent Publication No. 2007-251248
Outline of the invention
Problems to be solved by the invention
[0004]
 However, since the measuring method disclosed in Patent Document 1 requires large-scale measuring equipment, it is difficult for a general user to easily measure his / her own head-related transfer characteristics.
Means to solve problems
[0005]
 According to the present disclosure, an interface control unit for controlling a user interface related to measurement of a user's head-related transfer function is provided, and the interface control unit provides guide information for guiding the direction of the user's head in a designated direction. An information processing device that controls the output is provided.
[0006]
 Further, according to the present disclosure, the processor controls the user interface related to the measurement of the user's head related transfer function, and controlling the user interface means that the orientation of the user's head is in a designated direction. Information processing methods are provided that further include controlling the output of guided guide information.
[0007]
 Further, according to the present disclosure, the computer includes an interface control unit that controls a user interface related to measurement of a user's head-related transfer function, and the interface control unit directs the direction of the user's head in a designated direction. A program for functioning as an information processing device that controls the output of the guide information to be guided is provided.
A brief description of the drawing
[0008]
FIG. 1 is a diagram showing an example of user interface and guide information according to an embodiment of the present disclosure.
[Fig. 2] Fig. 2 is a block diagram showing an example of a functional configuration of an information processing device according to the same embodiment.
[Fig. 3] Fig. 3 is a diagram showing a specific example of interface control according to the same embodiment.
[Fig. 4] Fig. 4 is a diagram showing a specific example of interface control according to the same embodiment.
[Fig. 5] Fig. 5 is a diagram showing a specific example of interface control according to the same embodiment.
[Fig. 6] Fig. 6 is a diagram showing a specific example of interface control according to the same embodiment.
[Fig. 7] Fig. 7 is a diagram for explaining personal optimization of a multi-channel head-related transfer function using the information processing device according to the same embodiment.
FIG. 8 is a diagram showing an example of a user interface corresponding to the multi-channel measurement mode according to the same embodiment.
[Fig. 9] Fig. 9 is a flowchart showing a flow of control by the interface control unit according to the same embodiment.
FIG. 10 is a diagram showing a hardware configuration example according to an embodiment of the present disclosure.
[Fig. 11] Fig. 11 is a diagram for explaining the measurement of a general head-related transfer function using a dummy head microphone.
Mode for carrying out the invention
[0009]
 Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, and duplicate description will be omitted.
[0010]
 The explanations will be given in the following order.
 1. 1. Embodiment
  1.1. Overview
  1.2. Functional configuration example of information processing device 10
  1.3. Specific example of control
  1.4. Control flow
 2. Hardware configuration example
 3. Summary
[0011]
 <1. Embodiment>
 << 1.1. Outline >>
 First, an outline of one embodiment of the present disclosure will be described. As described above, in recent years, a head-related transfer function that mathematically expresses the transfer characteristics of sound from a sound source to both ears has attracted attention. According to the head-related transfer function, for example, a sound output device such as headphones can express a sound image in three dimensions.
[0012]
 The head-related transfer function is generally measured using a dummy head microphone. Here, with reference to FIG. 11, the measurement of a general head-related transfer function using a dummy head microphone will be described.
[0013]
 In the measurement of a general head-related transfer function, first, as shown on the left side of the figure, the speaker 30 and the dummy head microphone 40 are installed in the reference sound field RSF to be reproduced by the headphones 50.
[0014]
 Next, the measurement signal is reproduced from the speaker 30, and as shown in the center of the figure, the head-related transfer functions of the left ear and the right ear are acquired by the microphones provided at both ear positions of the dummy head microphone 40.
[0015]
 Next, as shown on the right side of the figure, the head-related transfer functions of the left and right ears are convoluted with respect to the voice signal (source signal) to be reproduced, and the signals for the left ear and the body of the right ear are generated. Generate. By reproducing the signal generated as described above on the headphones 50, the sound image can be expressed three-dimensionally.
[0016]
 The measurement of the head-related transfer function using the dummy head microphone has been described above. On the other hand, in recent years, it is known that the effect of the three-dimensional expression of the sound image as described above is further enhanced by using the head-related transfer function measured for each user.
[0017]
 However, measurement of head-related transfer characteristics requires large-scale measurement equipment such as an anechoic chamber, a listening room, and a large speaker. For this reason, it has been difficult for a general user to easily measure his / her own head-related transfer characteristics.
[0018]
 Further, in order to measure an effective head-related transfer function with high accuracy, it is necessary to clarify the relative position between the sound source that outputs the measurement signal and both ears of the user. However, when a user with little specialized knowledge tries to measure the head-related transfer function by himself / herself, it is difficult to grasp the position and posture suitable for the measurement.
[0019]
 The technical idea according to the present disclosure was conceived by paying attention to the above points, and enables the user to measure his / her own head-related transfer characteristics with high accuracy. To this end, the information processing apparatus 10 according to the embodiment of the present disclosure includes an interface control unit 140 that controls a user interface related to measurement of a user's head related transfer function. Further, one of the features of the interface control unit 140 according to the embodiment of the present disclosure is to control the output of guide information that guides the direction of the user's head in a designated direction.
[0020]
 FIG. 1 is a diagram showing an example of user interface and guide information according to the present embodiment. FIG. 1 shows a control example of a user interface when a user U measures his / her head-related transfer function using the information processing device 10 according to the present embodiment. Note that FIG. 1 shows an example in which the information processing device 10 according to the present embodiment is a smartphone.
[0021]
 First, as shown on the left side of FIG. 1, the user U attaches the microphones 20L and 20R to the left ear and the right ear, and operates the information processing device 10 to activate the user interface according to the present embodiment. In the center of FIG. 1, an example of a GUI (Graphical User Interface) displayed on the display unit 110 by the interface control unit 140 based on the operation of the user U is shown. As described above, the user interface according to the present embodiment may include a GUI.
[0022]
 At this time, one of the features of the interface control unit 140 according to the present embodiment is that the interface control unit 140 outputs guide information for guiding the direction of the head of the user U in a designated direction. Here, the above-mentioned designated direction may be a direction suitable for measuring the head-related transfer function. For example, when it is desired to output the measurement signal from the front direction of the user U and measure the head-related transfer function of the user U, the above-mentioned designated direction is the measurement signal related to the measurement of the head-related transfer function starting from the user U. It may be in the direction in which the output audio output unit 170 is located. That is, the designated direction according to the present embodiment can be set so that the user U and the voice output unit 170 face each other, for example.
[0023]
 The interface control unit 140 according to the present embodiment guides the direction of the head of the user U in the designated direction as described above, thereby fixing the posture of the user at the positions of both ears suitable for measuring the head related transfer function. It is possible to realize highly accurate measurement of the head-related transfer function.
[0024]
 Here, an example of guide information in which the interface control unit 140 according to the present embodiment controls the output will be described. The guide information according to the present embodiment includes, for example, various visual information. The interface control unit 140 according to the present embodiment may display a guide object that guides the direction of the head of the user U in a designated direction on the display unit 110.
[0025]
 Further, the interface control unit 140 according to the present embodiment may display the image of the user U captured by the photographing unit 120 on the display unit 110 in real time, and superimpose the guide object on the image.
[0026]
 For example, in the case of the example shown in FIG. 1, the interface control unit 140 sends a head-shaped frame object FF corresponding to a designated direction and a message for inducing the frame object FF to align the position of the photographed face. , It is displayed on the display unit 110 as guide information.
[0027]
 According to the above-mentioned control by the interface control unit 140 according to the present embodiment, the user U can easily align the face UF with the frame object FF while checking his / her own image, and is particularly conscious of it. It is possible to take a posture suitable for measuring the head-related transfer function without any problem.
[0028]
 Further, the interface control unit 140 according to the present embodiment starts the measurement of the head related transfer function based on the determination by the recognition unit 150 that the orientation of the head of the user U substantially matches the designated direction. You may control the output of the indicated start notification information. At this time, the recognition unit 150 substantially matches the direction of the head of the user U in the designated direction based on, for example, that the face UF of the user U in the captured image is contained inside the frame object FF. It may be determined that it has been done.
[0029]
 On the right side of FIG. 1, as an example of the start notification information, the interface control unit 140 causes the voice output unit 170 to output the system utterance SO1 indicating the start of measurement, and displays a message indicating the start of measurement on the display unit 110. The case is shown.
[0030]
 According to the start notification information as described above, the user U can be guided to fix the head at the start of measurement, and it is possible to measure the head-related transfer function with high accuracy.
[0031]
 Further, the interface control unit 140 according to the present embodiment may control the start or interruption of the measurement process of the head related transfer function. For example, the interface control unit 140 according to the present embodiment transmits the head to the signal processing unit 160, which will be described later, based on the determination that the recognition unit 150 substantially matches the orientation of the head of the user U in the designated direction. The measurement process of the function may be started.
[0032]
 Further, for example, in the interface control unit 140 according to the present embodiment, after the signal processing unit 160 starts the measurement process of the head-related transfer function, the user U's head is before the measurement process is completed. When the recognition unit 150 determines that the orientation does not substantially match the designated direction, the signal processing unit 160 may interrupt the measurement process.
[0033]
 According to the above-mentioned function of the interface control unit 140 according to the present embodiment, when the direction of the head of the user U deviates from the designated direction during measurement, that is, the posture of the user U is suitable for measuring the head-related transfer function. When the posture is not correct, the signal processing unit 160 interrupts the measurement process, so that the accuracy of the acquired head-related transfer function can be maintained.
[0034]
 The interface control unit 140 can also perform the above control based on the noise level around the user U. For example, the interface control unit 140 according to the present embodiment may control the signal processing unit 160 so that the measurement process of the head related transfer function is not started when the noise level measured by the recognition unit 150 exceeds the threshold value.
[0035]
 Further, for example, when the interface control unit 140 according to the present embodiment detects that the noise level exceeds the threshold value after the signal processing unit 160 starts the measurement processing of the head-related transfer function, the signal processing unit 140 The measurement process may be interrupted by 160.
[0036]
 According to the above control by the interface control unit 140 according to the present embodiment, it is possible to prevent the acquisition of a low-precision head-related transfer function in an environment with a high noise level.
[0037]
 Further, the interface control unit 140 according to the present embodiment may display the noise information NI related to the noise level measured by the recognition unit 150 on the display unit 110, for example, as shown in FIG. In the case of the example shown in FIG. 1, the interface control unit 140 displays the noise information NI as a meter, and presents the current noise level and the noise level band (hatched portion in the figure) that allows measurement to the user U. ..
[0038]
 According to the above display, the user U is made to grasp whether or not the noise level in the surrounding environment is suitable for the measurement of the head-related transfer function. For example, when the noise level is high, the noise level is high. It is possible to guide the movement to a lower place.
[0039]
 The outline of the user interface controlled by the interface control unit 140 according to the present embodiment has been described above. According to the above-mentioned control by the interface control unit 140 according to the present embodiment, by guiding the user to a posture suitable for measurement, the user can easily and accurately measure his / her head-related transfer characteristics. ..
[0040]
 << 1.2. Functional configuration example of the information processing device 10 >>
 Next, a functional configuration example of the information processing device 10 according to the present embodiment will be described. The information processing device 10 according to the present embodiment may be, for example, a mobile terminal such as a smartphone or a tablet.
[0041]
 FIG. 2 is a block diagram showing a functional configuration example of the information processing device 10 according to the present embodiment. As shown in FIG. 2, the information processing device 10 according to the present embodiment includes a display unit 110, a photographing unit 120, a sensor unit 130, an interface control unit 140, a recognition unit 150, a signal processing unit 160, and an audio output unit 170. Be prepared.
[0042]
 (Display Unit 110)
 The display unit 110 according to the present embodiment displays a GUI related to the measurement of the head related transfer function based on the control by the interface control unit 140. For this purpose, it relates to this embodiment.
[0043]
 For this purpose, the display unit 110 according to the present embodiment includes a display device or the like that presents visual information. Examples of the display device include a liquid crystal display (LCD: Liquid Crystal Display) device, an OLED (Organic Light Emitting Mode) device, and a touch panel.
[0044]
 (Shooting unit 120)
 The shooting unit 120 according to the present embodiment has a function of capturing, for example, an image of a user. For this purpose, the photographing unit 120 according to the present embodiment includes a photographing device capable of photographing an image. The above image includes a moving image as well as a still image.
[0045]
 (Sensor unit 130)
 The sensor unit 130 according to the present embodiment has a function of collecting various sensor information regarding the information processing device 10 and the surrounding environment. The sensor information collected by the sensor unit 130 is used for various recognition processes by the recognition unit 150. The sensor unit 130 according to the present embodiment includes, for example, a gyro sensor, an acceleration sensor, a geomagnetic sensor, a microphone, and the like.
[0046]
 (Interface Control Unit 140)
 The interface control unit 140 according to the present embodiment has a function of controlling a user interface related to measurement of a user's head-related transfer function. As described above, one of the features of the interface control unit 140 according to the present embodiment is that it controls the output of guide information that guides the direction of the user's head in a designated direction.
[0047]
 (Recognition Unit 150)
 The recognition unit 150 according to the present embodiment performs various recognition processes based on the image captured by the photographing unit 120 and the sensor information collected by the sensor unit 130. For example, the recognition unit 150 according to the present embodiment recognizes the orientation of the user's head. The recognition unit 150 may recognize the orientation of the user's head based on the image captured by the photographing unit 120.
[0048]
 Further, as described above, in the recognition unit 150, for example, the orientation of the user's head is substantially one in the designated direction based on the fact that the user's face in the captured image is contained inside the frame object. It can also be determined that it is done.
[0049]
 Further, for example, when the microphone 20 worn by the user is provided with a gyro sensor or the like, the recognition unit 150 may recognize the orientation of the user's head based on the sensor information acquired from the microphone 20.
[0050]
 Further, the recognition unit 150 according to the present embodiment has a function of measuring the noise level in the surrounding environment based on the sound information collected by the sensor unit.
[0051]
 (Signal Processing Unit 160)
 The signal processing unit 160 according to the present embodiment starts the measurement process of the head related transfer function based on the control by the interface control unit 140. For example, the signal processing unit 160 according to the present embodiment may cause the voice output unit 170 to output a measurement signal based on the measurement start instruction input from the interface control unit 140.
[0052]
 Further, the signal processing unit 160 according to the present embodiment receives the head-related transfer functions acquired by the microphones 20L and 20R worn by the user, performs convolution processing based on the head-related transfer functions, and performs convolution processing for the left and right ears. Generate an audio signal. The signal processing unit 160 according to the present embodiment can generate an audio signal by using a known convolution technique. The signal processing unit 160 according to the present embodiment may use, for example, a technique disclosed in Japanese Patent Application Laid-Open No. 2014-060691 filed by the applicant of the present disclosure.
[0053]
 (Audio Output Unit 170)
 The audio output unit 170 according to the present embodiment outputs audio based on control by the interface control unit 140 and the signal processing unit 160. For example, the voice output unit 170 according to the present embodiment may output guide information and start notification information based on the control by the interface control unit 140. Further, for example, the voice output unit 170 according to the present embodiment may output a measurement signal based on the control by the signal processing unit 160.
[0054]
 The functional configuration example of the information processing apparatus 10 according to the present embodiment has been described above. The above configuration described with reference to FIG. 2 is merely an example, and the functional configuration of the information processing apparatus 10 according to the present embodiment is not limited to such an example. For example, the information processing device 10 according to the present embodiment is realized as a server, and may control a mobile terminal including a display unit, a photographing unit, an audio output unit, and the like via a network. Further, the information processing device 10 according to the present embodiment is realized as a microphone worn by the user in the ear, and the mobile terminal may be controlled via a network. The functional configuration of the information processing apparatus 10 according to the present embodiment can be flexibly modified according to specifications and operations.
[0055]
 << 1.3. Specific Examples of Control >>
 Next, the control by the interface control unit 140 according to the present embodiment will be described in more detail with reference to FIGS. 3 to 6 with reference to specific examples. 3 to 6 are diagrams showing specific examples of interface control according to the present embodiment.
[0056]
 For example, FIG. 1 describes a case where the interface control unit 140 according to the present embodiment displays a head-shaped frame object on the display unit 110 as guide information, but the guide information according to the present embodiment is an example. Not limited. The guide object according to the present embodiment may be, for example, a wearable object type object worn on the head.
[0057]
 In the case of the example shown in FIG. 3, the interface control unit 140 according to the present embodiment displays the eyeglass-shaped wearable object AO on the display unit 110 in addition to the head-shaped frame object FF.
[0058]
 By displaying such a wearable object AO on the display unit 110, it is possible to further enhance the guidance effect related to the orientation of the user's head as compared with the case where only the frame object FF is displayed.
[0059]
 At this time, in the interface control unit 140 according to the present embodiment, in addition to the face FF of the user U being housed inside the frame object FF in the recognition unit 150, the user's left eye LE and right eye RE are inside the mounted object AO. The signal processing unit 160 may start the measurement process of the head-related transfer function based on the recognition that the position is within the assumed position in. According to the above control by the interface control unit 140 according to the present embodiment, it is possible to make the user U take a posture more suitable for the measurement and measure the head related transfer function with high accuracy.
[0060]
 The wearable object AO according to the present embodiment is not limited to the shape of eyeglasses as shown in FIG. 3, and may have various shapes such as a hat, headphones, and a headphone.
[0061]
 Further, in FIG. 1, the case where the interface control unit 140 outputs the system utterance to the voice output unit 170 as the start notification information has been described as an example, but the start notification information according to the present embodiment is not limited to such an example. As shown in FIG. 3, the start notification information according to the present embodiment may be, for example, a jingle J, a light such as a flash by the photographing unit 120, a message, an image, a symbol, or the like. Further, the user U may be able to start the measurement of the head-related transfer function by touching the measurement button displayed on the display unit 110.
[0062]
 Further, the designated direction according to the present embodiment is not necessarily limited to the direction in which the voice output unit 170 is located starting from the user's head. The designated direction according to the present embodiment may be appropriately set to measure the head related transfer function at an arbitrary ear position.
[0063]
 For example, in the case of the example shown in FIG. 4, the interface control unit 140 causes the display unit 110 to display the frame object FF that guides the user U to turn his / her profile. As described above, the interface control unit 140 according to the present embodiment can display the head-shaped frame object FF corresponding to the designated direction on the display unit 110. According to the above-mentioned function of the interface control unit 140 according to the present embodiment, it is possible to guide the direction of the user's head in various designated directions and measure the head-related transfer function corresponding to various ear positions. It will be possible.
[0064]
 Further, the guide information according to the present embodiment may be voice information. For example, the interface control unit 140 according to the present embodiment may have the voice output unit 170 output a voice that guides the direction of the user's head in a designated direction.
[0065]
 FIG. 5 shows an example in which the interface control unit 140 causes the signal processing unit 160 to start the measurement process of the head related transfer function based on the recognition unit 150 recognizing the smile of the user U. .. The recognition unit 150 according to the present embodiment can also recognize the direction of the user's head by smile recognition in this way.
[0066]
 At this time, the interface control unit 140 may output the system utterance SO2 such as "Please look at the screen and laugh" to the voice output unit 170 as guide information. As described above, the interface control unit 140 according to the present embodiment can effectively guide the direction of the user's head in the designated direction by outputting the guide information as visual information or audio information.
[0067]
 Further, in the above description, the case where the user adjusts the direction of the head while photographing himself / herself with the photographing unit 120 (so-called IN camera) provided on the surface of the display unit 110 by the information processing device 10 has been described. Head orientation adjustments may be made by a collaborator.
[0068]
 In the example shown in FIG. 6, the collaborator C adjusts the head orientation of the user U while photographing the user U using the photographing unit 120 (so-called OUT camera) provided on the back side of the information processing device 10. An example is shown.
[0069]
 As described above, according to the information processing apparatus 10 according to the present embodiment, it is possible to cope with shooting by a collaborator, and the user U himself / herself cannot visually recognize the display unit 110 due to factors such as a designated direction. However, the head-related transfer function can be measured with high accuracy.
[0070]
 At this time, the interface control unit 140 according to the present embodiment outputs a measurement signal based on the position of the photographing unit 120 selected by the operator such as the user U or the collaborator C via the user interface. The output unit 170 may be selected.
[0071]
 For example, when the user U activates the photographing unit 120 arranged on the display unit 110 side, the interface control unit 140 performs signal processing so that the audio output unit 170 also arranged on the display unit 110 side outputs a measurement signal. Instructions may be given to unit 160.
[0072]
 On the other hand, as shown in FIG. 6, when the collaborator C activates the photographing unit 120 arranged on the back side of the information processing device 10, the interface control unit 140 also arranges the sound on the back side of the information processing device 10. The signal processing unit 160 may be instructed to output the measurement signal to the output unit 170.
[0073]
 According to the above control by the interface control unit 140 according to the present embodiment, the microphone 20 worn by the user U is secured with a path through which the measurement signal output from the voice output unit 170 is directly transmitted. It is possible to measure the head-related transfer function with high accuracy.
[0074]
 The example of the interface control according to the present embodiment has been described above with specific examples. The interface control unit 140 according to the present embodiment may have a plurality of user interfaces corresponding to the measurement mode of the head related transfer function in addition to the user interfaces shown in FIGS. 1 and 3 to 6. In this case, the interface control unit 140 according to the present embodiment can control the switching of the user interface based on the measurement mode of the selected head-related transfer function.
[0075]
 The above measurement mode may be set according to the number of measurement channels, for example. That is, the interface control unit 140 according to the present embodiment can provide the user with a user interface according to the number of measurement channels.
[0076]
 FIG. 7 is a diagram for explaining personal optimization of a multi-channel head-related transfer function using the information processing device 10 according to the present embodiment. For example, when performing personal optimization of the head-related transfer function of 5 channels, the user U moves the information processing device 10 to the 5 positions P1 to P5 corresponding to the 5 channels as shown on the left side of the figure, and each of them It is required to measure the head related transfer function at the position. The positions P1 to P5 may be relative positions with respect to the front surface of the head of the user U.
[0077]
 At this time, the interface control unit 140 according to the present embodiment causes the display unit 110 to display a user interface that guides the direction of the user's head so that the head related transfer function can be accurately measured at the positions P1 to P5. According to the above user interface controlled by the interface control unit 140 according to the present embodiment, as shown on the right side of the figure, a virtual sound field including five sound images SI1 to SI5 corresponding to positions P1 to P1 is reproduced. It is possible to realize a richer three-dimensional expression of sound.
[0078]
 FIG. 8 is a diagram showing an example of a user interface corresponding to the multi-channel measurement mode according to the present embodiment. As shown in the figure, the interface control unit 140 according to the present embodiment displays, for example, the targets T1 to T5 corresponding to each channel and the marker M indicating the direction of the user's head recognized by the recognition unit 150. Display in real time.
[0079]
 Here, as shown on the left side of the figure, when the direction of the user's head deviates from the designated direction, that is, the targets T1 to T5, the interface control unit 140 outputs the system utterance SO3 as guide information. May guide the orientation of the user's head.
[0080]
 On the other hand, as shown on the left side of the figure, when the orientation of the user's head substantially matches the targets T1 to T5, the interface control unit 140 measures the user by outputting the system utterance SO4 as start notification information. Let them know the start of the process and guide them to maintain their posture. The interface control unit 140 according to the present embodiment may repeat the above control until the measurement process is completed for all the targets T.
[0081]
 The individual optimization of the multi-channel head-related transfer function according to the present embodiment has been described above. As described above, according to the information processing apparatus 10 according to the present embodiment, the user can easily and accurately measure his / her own head-related transfer characteristics regardless of the number of channels.
[0082]
 << 1.4. Control flow >>
 Next, the control flow by the interface control unit 140 according to the present embodiment will be described in detail. FIG. 9 is a flowchart showing a flow of control by the interface control unit 140 according to the present embodiment.
[0083]
 Referring to FIG. 9, the interface control unit 140 first activates the user interface and the photographing unit 120 based on the user operation (S1101).
[0084]
 Next, the interface control unit 140 causes the display unit 110 and the audio output unit 170 to output guide information (S1102).
[0085]
 Next, the recognition unit 150 determines whether or not the orientation of the user's head and the designated direction are substantially matched (S1103). The recognition unit 150 repeatedly executes the determination process in step S1103 until it determines that the orientation of the user's head and the designated direction are substantially the same.
[0086]
 On the other hand, when it is determined that the orientation of the user's head and the designated direction are substantially the same (S1103: YES), the recognition unit 150 determines whether or not the noise level in the surrounding environment is equal to or less than the threshold value (S1104).
[0087]
 Here, when the noise level in the surrounding environment exceeds the threshold value (S1104: NO), the recognition unit 150 may return to step S1103.
[0088]
 On the other hand, when the recognition unit 150 determines that the noise level in the surrounding environment is equal to or lower than the threshold value (S1104: YES), the interface control unit 140 causes the signal processing unit 160 to start the measurement process of the head related transfer function (S1105). ..
[0089]
 Next, the recognition unit 150 again determines whether or not the orientation of the user's head and the designated direction are substantially matched (S1106).
[0090]
 Here, when it is detected that the orientation of the user's head and the designated direction do not substantially match, that is, the orientation of the user's head deviates from the designated direction (S1106: NO), the interface control unit 140 , The signal processing unit 160 is stopped from the measurement process of the head related transfer function (S1109).
[0091]
 Further, the recognition unit 150 determines whether or not the noise level in the surrounding environment is equal to or less than the threshold value (S1107).
[0092]
 Here, when it is detected that the noise level in the surrounding environment exceeds the threshold value (S1107: NO), the interface control unit 140 causes the signal processing unit 160 to stop the measurement process of the head-related transfer function (S1109).
[0093]
 On the other hand, when the noise level in the surrounding environment is equal to or less than the threshold value (S1107: YES), the interface control unit 140 determines whether or not the measurement process of the head related transfer function is completed (S1108).
[0094]
 Here, when the measurement process of the head-related transfer function is not completed (S1108: NO), the information processing apparatus 10 returns to step S1106 and repeatedly executes the subsequent determinations.
[0095]
 <2. Hardware Configuration Example>
 Next, a hardware configuration example of the information processing apparatus 10 according to the embodiment of the present disclosure will be described. FIG. 10 is a block diagram showing a hardware configuration example of the information processing apparatus 10 according to the embodiment of the present disclosure. Referring to FIG. 10, the information processing device 10 includes, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, and an output device 879. It has a storage 880, a drive 881, a connection port 882, and a communication device 883. The hardware configuration shown here is an example, and some of the components may be omitted. In addition, components other than the components shown here may be further included.
[0096]
 (Processor 871) The
 processor 871 functions as, for example, an arithmetic processing unit or a control device, and operates or one of the overall operations of each component based on various programs recorded in the ROM 872, the RAM 873, the storage 880, or the removable recording medium 901. Control the part.
[0097]
 (ROM872, RAM873) The
 ROM872 is a means for storing a program read into the processor 871 and data used for calculation. The RAM 873 temporarily or permanently stores, for example, a program read into the processor 871 and various parameters that change as appropriate when the program is executed.
[0098]
 (Host Bus 874, Bridge 875, External Bus 876, Interface 877)
 Processors 871, ROM 872, and RAM 873 are connected to each other via, for example, a host bus 874 capable of high-speed data transmission. On the other hand, the host bus 874 is connected to the external bus 876, which has a relatively low data transmission speed, via, for example, the bridge 875. Further, the external bus 876 is connected to various components via the interface 877.
[0099]
 (Input device 878) For the
 input device 878, for example, a mouse, a keyboard, a touch panel, buttons, switches, levers, and the like are used. Further, as the input device 878, a remote controller (hereinafter referred to as a remote controller) capable of transmitting a control signal using infrared rays or other radio waves may be used. Further, the input device 878 includes a voice input device such as a microphone.
[0100]
 (Output device 879) The
 output device 879 is, for example, a display device such as a CRT (Cathode Ray Tube), an LCD, or an organic EL, an audio output device such as a speaker or a headphone, a printer, a mobile phone, a facsimile, or the like. Is a device capable of visually or audibly notifying the user. Further, the output device 879 according to the present disclosure includes various vibration devices capable of outputting a tactile stimulus.
[0101]
 (Storage 880) The
 storage 880 is a device for storing various types of data. As the storage 880, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used.
[0102]
 (Drive 881) The
 drive 881 is a device that reads information recorded on a removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information on the removable recording medium 901.
[0103]
 (Removable Recording Medium 901) The
 removable recording medium 901 is, for example, a DVD media, a Blu-ray (registered trademark) media, an HD DVD media, various semiconductor storage media, and the like. Of course, the removable recording medium 901 may be, for example, an IC card equipped with a non-contact type IC chip, an electronic device, or the like.
[0104]
 (Connection port 882) The
 connection port 882 connects an external connection device 902 such as a USB (Universal Serial Bus) port, an IEEE1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or an optical audio terminal. It is a port to do.
[0105]
 (External Connection Device 902) The
 external connection device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, an IC recorder, or the like.
[0106]
 (Communication device 883) The
 communication device 883 is a communication device for connecting to a network, and is, for example, a wired or wireless LAN, a Modem®, or a communication card for WUSB (Wireless USB), a router for optical communication. , ADSL (Asymmetric Digital Subscriber Line) router, modem for various communications, and the like.
[0107]
 <3. Summary> As
 described above, the information processing device 10 according to the embodiment of the present disclosure includes an interface control unit 140 that controls a user interface related to measurement of a user's head-related transfer function. Further, one of the features of the interface control unit 140 according to the embodiment of the present disclosure is to control the output of guide information that guides the direction of the user's head in a designated direction. According to such a configuration, the user can measure his / her head-related transfer characteristics with high accuracy.
[0108]
 Although the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that anyone with ordinary knowledge in the technical field of the present disclosure may come up with various modifications or modifications within the scope of the technical ideas set forth in the claims. Is, of course, understood to belong to the technical scope of the present disclosure.
[0109]
 In addition, the effects described herein are merely explanatory or exemplary and are not limited. That is, the techniques according to the present disclosure may exhibit other effects apparent to those skilled in the art from the description herein, in addition to or in place of the above effects.
[0110]
 Further, it is possible to create a program for causing the hardware such as the CPU, ROM, and RAM built in the computer to exhibit the same function as the configuration of the information processing device 10, and read the program into the computer. Possible non-transient recording media may also be provided.
[0111]
 Further, each step related to the processing of the information processing apparatus 10 of the present specification does not necessarily have to be processed in chronological order in the order described in the flowchart. For example, each step related to the processing of the information processing apparatus 10 may be processed in an order different from the order described in the flowchart, or may be processed in parallel.
[0112]
 The following configurations also belong to the technical scope of the present disclosure.
(1)
 An interface control unit for controlling a user interface related to measurement of a user's head-related transfer function
 is provided, and the
 interface control unit controls output of guide information for guiding the direction of the user's head in a designated direction. to,
 the information processing apparatus.
(2)
 The guide information may include visual information,
 the interface control unit displays the guide object to induce orientation of the head of the user in the designated direction to the display unit,
 information according to (1) Processing equipment.
(3)
 The information processing device according to (2), wherein the interface control unit displays a captured image of the user on the display unit in real time, and superimposes the guide object on the image of the user.
(4)
 The information processing device according to (2) above, wherein the guide object includes a frame object having a head shape corresponding to the designated direction.
(5)
 The information processing device according to (3) or (4) above, wherein the guide object includes a wearable object that is attached to the head.
(6) The
 guide information includes voice information.

 The information processing device according to any one of (1) to (5)  above, wherein the interface control unit outputs a voice that guides the direction of the user's head in the designated direction to the voice output unit .
(7) The
 designated direction includes the direction in which the voice output unit that outputs the measurement signal related to the measurement of the head-related transfer function is located starting from the head of the user. The information processing device according to any one.
(8) The
 interface control unit outputs start notification information indicating the start of measurement of the head-related transfer function based on the determination that the orientation of the user's head substantially matches the designated direction. The information processing apparatus according to any one of (1) to (5) above, which is controlled.
(9)
 The information processing device according to any one of (1) to (8 ) above, wherein the interface control unit controls switching of the user interface based on the measurement mode of the head related transfer function.
(10)
 The information processing device according to (9) above, wherein the measurement mode is set according to the number of measurement channels.
(11)
 Any of the above (1) to (10), wherein the interface control unit causes a mobile terminal including an audio output unit for outputting a measurement signal related to the measurement of the head related transfer function to output the guide information. The information processing device described in.
(12) The
 mobile terminal includes at least two shooting units and at least two audio output units.

 The information processing according to (11) above  , wherein the interface control unit selects the audio output unit to output the measurement signal based on the position of the photographing unit selected by the operator via the user interface. apparatus.
(13) The
 interface control unit starts the measurement process of the head-related transfer function based on the determination that the orientation of the user's head substantially matches the designated direction. The information processing apparatus according to any one of (12).
(14) The
 interface control unit does not substantially match the orientation of the user's head with the designated direction after the measurement process of the head-related transfer function is started and before the measurement process is completed. The information processing apparatus according to (13), wherein the measurement process is interrupted based on the determination that the measurement process has been performed.
(15)
 The information processing device according to (13) or (14), wherein the interface control unit controls so that the measurement process is not started when the measured noise level exceeds a threshold value.
(16) The
 interface control unit interrupts the measurement process when it is detected that the noise level exceeds the threshold value after starting the measurement process of the head-related transfer function. The information processing device described.
(17)
 The information processing device according to (15) or (16), wherein the interface control unit controls the output of noise information related to the measured noise level.
(18)
 The information processing device according to any one of (1) to (17), further comprising a recognition unit that recognizes the orientation of the user's head.
(19) The
 processor controls the user interface related to the measurement of the user's head-related transfer function, and controlling the
 user interface includes guiding information that guides the direction of the user's head in a designated direction.
 Information processing methods , including further controlling the output .
(20) The
 computer is
 provided with an interface control unit that controls a user interface related to measurement of a user's head-related transfer function, and the
 interface control unit provides guide information for guiding the direction of the user's head in a designated direction.
 A program that controls the output and functions as an information processing device.
Code description
[0113]
 10 Information processing device
 110 Display unit
 120 Imaging unit
 130 Sensor unit
 140 Interface control unit
 150 Recognition unit
 160 Signal processing unit
 170 Audio output unit
 20 Microphone
The scope of the claims
[Claim 1]
 Interface control unit that controls the user interface according to the measurement of the head related transfer function of the user,
 provided with,
 the interface control unit controls the output of the guide information to guide the orientation of the head of the user in the designated direction,
 information Processing equipment.
[Claim 2]
 The information  processing device according to claim 1, wherein the guide information includes visual information, and the
 interface control unit displays a guide object that guides the direction of the user's head in the designated direction on the display unit
.
[Claim 3]
 The information processing device according to claim 2, wherein the interface control unit displays a captured image of the user on the display unit in real time, and superimposes the guide object on the image of the user.
[Claim 4]
 The information processing device according to claim 2, wherein the guide object includes a frame object having a head shape corresponding to the designated direction.
[Claim 5]
 The information processing device according to claim 3, wherein the guide object includes a wearable object that is attached to the head.
[Claim 6]
 The information  processing device according to claim 1, wherein the guide information includes voice information, and the
 interface control unit outputs a voice that guides the direction of the user's head in the designated direction to the voice output unit
.
[Claim 7]
 The information processing apparatus according to claim 1, wherein the designated direction includes a direction in which an audio output unit that outputs a measurement signal related to measurement of the head-related transfer function is located, starting from the user's head.
[Claim 8]
 The interface control unit controls the output of start notification information indicating the start of measurement of the head-related transfer function based on the determination that the orientation of the user's head substantially matches the designated direction. The information processing device according to claim 1.
[Claim 9]
 The information processing device according to claim 1, wherein the interface control unit controls switching of the user interface based on the measurement mode of the head-related transfer function.
[Claim 10]
 The information processing apparatus according to claim 9, wherein the measurement mode is set according to the number of measurement channels.
[Claim 11]
 The information processing device according to claim 1, wherein the interface control unit causes a mobile terminal including a voice output unit that outputs a measurement signal related to the measurement of the head-related transfer function to output the guide information.
[Claim 12]
 The mobile terminal includes at least two imaging units and at least two audio output units, and the
 interface control unit measures the measurement based on the position of the imaging unit selected by the operator via the user interface.
 The information processing apparatus according to claim 11, wherein the audio output unit for outputting an interface is selected .
[Claim 13]
 The information processing according to claim 1, wherein the interface control unit starts a measurement process of the head-related transfer function based on the determination that the orientation of the user's head substantially matches the designated direction. apparatus.
[Claim 14]
 The interface control unit determines that the orientation of the user's head does not substantially match the designated direction after the measurement process of the head-related transfer function is started and before the measurement process is completed. The information processing apparatus according to claim 13, wherein the measurement process is interrupted based on the above.
[Claim 15]
 The information processing device according to claim 13, wherein the interface control unit controls so that the measurement process is not started when the measured noise level exceeds a threshold value.
[Claim 16]
 The information processing according to claim 15, wherein the interface control unit interrupts the measurement process when it is detected that the noise level exceeds a threshold value after starting the measurement process of the head-related transfer function. apparatus.
[Claim 17]
 The information processing device according to claim 15, wherein the interface control unit controls the output of noise information related to the measured noise level.
[Claim 18]
 The information processing device according to claim 1, further comprising a recognition unit that recognizes the orientation of the user's head.
[Claim 19]
 The processor controls the user interface related to the measurement of the user's head-related transfer function, and controlling the
 user interface controls the output of guide information that guides the direction of the user's head in a specified direction.
 Information processing methods , including further .
[Claim 20]
 The computer is
 provided with an interface control unit that controls a user interface related to measurement of a user's head-related transfer function, and the interface control unit
 controls output of guide information that guides the direction of the user's head in a designated direction. A
 program to function as an information processing device.

Documents

Application Documents

# Name Date
1 202117008473-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [01-03-2021(online)].pdf 2021-03-01
2 202117008473-STATEMENT OF UNDERTAKING (FORM 3) [01-03-2021(online)].pdf 2021-03-01
3 202117008473-PRIORITY DOCUMENTS [01-03-2021(online)].pdf 2021-03-01
4 202117008473-POWER OF AUTHORITY [01-03-2021(online)].pdf 2021-03-01
5 202117008473-FORM 1 [01-03-2021(online)].pdf 2021-03-01
6 202117008473-DRAWINGS [01-03-2021(online)].pdf 2021-03-01
7 202117008473-DECLARATION OF INVENTORSHIP (FORM 5) [01-03-2021(online)].pdf 2021-03-01
8 202117008473-COMPLETE SPECIFICATION [01-03-2021(online)].pdf 2021-03-01
9 202117008473-Proof of Right [08-04-2021(online)].pdf 2021-04-08
10 202117008473-Verified English translation [21-04-2021(online)].pdf 2021-04-21
11 202117008473-FORM 3 [24-06-2021(online)].pdf 2021-06-24
12 202117008473.pdf 2021-10-19
13 202117008473-FORM 18 [18-08-2022(online)].pdf 2022-08-18
14 202117008473-FER.pdf 2023-02-23
15 202117008473-OTHERS [21-08-2023(online)].pdf 2023-08-21
16 202117008473-Information under section 8(2) [21-08-2023(online)].pdf 2023-08-21
17 202117008473-FORM-26 [21-08-2023(online)].pdf 2023-08-21
18 202117008473-FORM 3 [21-08-2023(online)].pdf 2023-08-21
19 202117008473-FER_SER_REPLY [21-08-2023(online)].pdf 2023-08-21
20 202117008473-DRAWING [21-08-2023(online)].pdf 2023-08-21
21 202117008473-CORRESPONDENCE [21-08-2023(online)].pdf 2023-08-21
22 202117008473-COMPLETE SPECIFICATION [21-08-2023(online)].pdf 2023-08-21
23 202117008473-CLAIMS [21-08-2023(online)].pdf 2023-08-21
24 202117008473-PatentCertificate21-03-2025.pdf 2025-03-21
25 202117008473-IntimationOfGrant21-03-2025.pdf 2025-03-21
26 202117008473-MARKED COPIES OF AMENDEMENTS [15-04-2025(online)].pdf 2025-04-15
27 202117008473-FORM 13 [15-04-2025(online)].pdf 2025-04-15
28 202117008473-AMENDED DOCUMENTS [15-04-2025(online)].pdf 2025-04-15

Search Strategy

1 202117008473E_22-02-2023.pdf

ERegister / Renewals