Specification
The present disclosure relates to an information processing device.
Background A1t
In recent years, with advances in communication technologies or
miniaturization of various devices, types of devices such as so-called information
processing devices have been diversified. The information processing devices are
15 not limited to personal computers (PCs) or the like and information processing
devices such as smmtphones or tablet terminals which can be carried by users have
also been widespread. In pmticular, so-called wearable devices which can be worn
on pmts of the bodies of users to be usable while being carried have also recently
been proposed.
20 [0003]
25
30
In addition, in recent years, with development of so-called voice recognition
technologies or natural language processing technologies, information processing
devices that have user interfaces (Uis) with which users can instruct to execute
various processes by voice inputs have also be widespread.
Citation List
Patent Literature
[0004]
Patent Literature I : JP-20 12-203122A
Disclosure of Invention
Technical Problem
[0005]
2/82
SP364646W001
In addition, in information processing devices capable of collecting voices
spoken by users for voice recognition, voice calling, and the like, structures capable
5 of further improving sound collection quality by suppressing other acoustic sound
(that is, noise) other than collection target voice have been examined. For example,
Patent Literature I discloses an example of a structure for suppressing noise.
[0006)
On the other hand, as use scenes of the infonnation processing devices are
10 diversified as in cases or the like in which information processing devices are used
outdoors, situations in which surrounding environments of the information
processing devices are dynamically changed are assumed. In such situations, cases
in which sounds produced from information processing devices, such as wind noise
or sounds accompanied by vibration, are collected as noise can also be assumed.
15 Such sounds are noise occurring at random since occurrence locations or occurrence
times are irregular.
[0007)
Accordingly, the present disclosure proposes an information processmg
device capable of collecting a target sound in a more suitable aspect even under an
20 environment in which noise occurs at random.
Solution to Problem
[0008)
According to the present disclosure, there is provided an information
25 processing device including: a sound collection unit; and a holding member
configured to have a projection portion with a streamline shape in at least a part and
hold the sound collection unit so that the sound collection unit is located at a front
end or near the front end of the projection portion.
30 Advantageous Effects of Invention
[0009)
5
10
SP364646WOOJ
3/82
The present disclosure described above provides an information processing
device capable of collecting a target sound in a more suitable aspect even under an
environment in which noise occurs at random.
[0010]
Note that the effects described above are not necessarily limitative. With
or in the place of the above effects, there may be achieved any one of the effects
described in this specification or other effects that may be grasped from this
specification.
BriefDescription of Drawings
[0011]
[FIG. I] FIG. I is an explanatory diagram illustrating an example of a schematic
configuration of an information processing device according to a first embodiment of
the present disclosure.
15 [FIG. 2] FIG. 2 is an explanatory diagram illustrating an example of the schematic
configuration of the information processing device according to the embodiment of
the present disclosure.
[FIG. 3] FIG. 3 is an explanatory diagram illustrating an example of a measurement
environment in which an influence of a wind sound is measured.
20 [FIG. 4] FIG. 4 is a diagram illustrating examples of installation positions of a
plurality of sound collection units installed in the information processing device.
[FIG. 5] FIG. 5 is an explanatory diagram illustrating examples of measurement
results of wind sounds by sound collection units in a case in which wind arrives at
different angles in the information processing device.
25 [FIG. 6] FIG. 6 is a block diagram illustrating an example of a functional
configuration ofthe information processing device according to the embodiment.
[FIG. 7] FIG. 7 is a diagram illustrating an example of a process of acquiring a target
sound based on a sound collection result of each of the plurality of sound collection
units in the information processing device according to the embodiment.
30 [FIG. 8] FIG. 8 is a flowchart illustrating an example of a flow of a series of
processes of the information processing device according to the embodiment.
SP364646W001
4/82
[FIG. 9] FIG. 9 is an explanatory diagram illustrating an example of an information
processing device according to Example I.
[FIG. I OJ FIG. I 0 is an explanatory diagram illustrating another example of the
information processing device according to Example I.
5 [FIG. II] FIG. II is an explanatory diagram illustrating another example of the
information processing device according to Example I.
[FIG. 12] FIG. 12 is an explanatory diagram illustrating an example of an information
processing device according to Example 2.
[FIG. 13] FIG. 13 is an explanatory diagram illustrating another example of the
10 information processing device according to Example 2.
[FIG. 14] FIG. 14 is an explanatory diagram illustrating another example of the
information processing device according to Example 2.
[FIG. 15] FIG. 15 is an explanatory diagram illustrating another example of the
information processing device according to Example 2.
15 [FIG. 16] FIG. 16 is an explanatory diagram illustrating an example of the
information processing device according to Example 3.
[FIG. 17] FIG. 17 is an explanatory diagram illustrating an example of a use form of
the information processing device 30 according to Modification Example 3.
[FIG. 18] FIG. 18 is an explanatory diagram illustrating an example of an information
20 processing device according to Example 4.
[FIG. 19] FIG. 19 is an explanatory diagram illustrating another example of the
information processing device according to Example 4.
[FIG. 20] FIG. 20 is an explanatory diagram illustrating an example of an information
processing device according to Example 5.
25 [FIG. 21] FIG. 21 is an explanatory diagram illustrating an example of a schematic
configuration near of a lens of an imaging unit in the information processing device
according to Example 5.
[FIG. 22] FIG. 22 is a block diagram illustrating an example of a functional
configuration of an information processing device according to a second embodiment
30 of the present disclosure.
[FIG. 23] FIG. 23 is an explanatory diagram illustrating a basic principle of a process
SP36164GW001
5/82
of an uncorrelated component power estimation unit.
[FIG. 24] FIG. 24 is a block diagram illustrating an example of a functional
configuration of an information processing device according to a third embodiment
of the present disclosure.
5 [FIG. 25] FIG. 25 is a diagram illustrating an example of a hardware configuration of
a signal processing device according to the embodiment.
10
Mode(s) for Carrying Out the Invention
[0012]
Hereinafter, (a) preferred embodiment(s) of the present disclosure will be
described in detail with reference to the appended drawings. Note that, in this
specification and the appended drawings, structural elements that have substantially
the same function and structure are denoted with the same reference numerals, and
repeated explanation of these structural elements is omitted.
15 [0013]
Also, the description will be made in the following order.
1. First embodiment
1.1. Overview
1.2. Examination of installation position of sound collection unit
20 1.3. Functional configuration
I .4. Process
1.5. Examples
1.5.1. Example 1: example of wearable device worn around neck
1.5.2. Example 2: example of wearable device worn on head
25 1.5.3. Example 3: application example to portable information terminal
1.5.4. Example 4: application example to watch type wearable device
1.5.5. Example 5: application example to imaging device
2. Second embodiment
2.1. Overview
30 2.2. Functional configuration
2.3. Details ofuncorrelated component power estimation unit
6/82
2.4. Details of random noise power estimation unit
2.5. Evaluation
3. Third embodiment
3. l. Overview
5 3.2. Functional configuration
3.3. Details of method of calculating multichannel Wiener-filter
3.4. Evaluation
4. Hardware configuration
5. Conclusion
10 [0014]
<<1. First embodiment>>
<1.1. Overview>
SP364646W001
First, an example of a schematic configuration of an information processing
device according to a first embodiment of the present disclosure will be described
15 with reference to Fig. l. Subsequently, a technical problem of the information
processing device according to the embodiment will be described. FIG. I is an
explanatory diagram illustrating an example of a schematic configuration of the
information processing device according to the first embodiment of the present
disclosure.
20 (0015]
In the example illustrated in FIG. 1, an information processing device I 0
includes a so-called wearable device. More specifically, the information processing
device I 0 is formed in a partially opened ring shape (in other words, a headband
form or a U-shaped form) and is worn on a user so that at least a part of the inner
25 surface of the ring shape comes into contact with a part of the neck of the user (that
is, is hung around the neck).
[00 16]
In addition, the information processmg device 10 includes a sound
collection unit such as a so-called microphone and collects a voice spoken by the
30 user as acoustic information from the sound collection unit. For example, in the
example illustrated in FIG. I, the information processing device I 0 includes a
5
SP36461GW001
7/82
plurality of sound collection units denoted by reference numerals Ill to 113. More
specifically, the sound collection units Ill to 113 are held by, for example, a casing
I 0 I of the information processing device I 0.
[0017]
For example, FIG. 2 is an explanatory diagram illustrating an example of the
schematic configuration of the information processing device I 0 according to the
embodiment and is a diagram illustrating an example of a configuration of a portion
in which the sound collection unit Ill is installed in the information processing
device 10. As illustrated in FIGS. I and 2, when the information processing device
10 I 0 is worn on the neck of the user, a projection portion that has a streamline shape
and projects toward the front side of the user is installed near the mouth of the user
and the sound collection unit Ill is installed at a front end (or near the front end) of
the projection portion to face in a direction in which !he projection portion projects.
In addition, the sound collection unit Ill may be a device separated from the
15 information processing device 10 and may be held at the front end (or near the fi·ont
end) of the projection portion to face in the direction in which the projection portion
projects. Also, in the following description, in a case in which it is described that a
sound collection unit II 0 is installed in the information processing device I 0, a case
in which the sound collection unit II 0 is separated from the information processing
20 device I 0 and is held by at least a part of the information processing device I 0 is
assumed to be also included.
[00 18]
In addition, as illustrated in FIG. I, the sound collection units 112 and 113
are installed to face in mutually different directions in the information processing
25 device 10. More specifically, when the information processing device 10 is worn
on the neck of the user, the sound collection units 112 and 113 are installed at
positions substantially symmetric to each other setting the neck of the user as a
reference. Also, the positions at which the sound collection units are installed will
be described in detail separately below. In addition, in the example illustrated in
30 FIG. I, the sound collection units 112 and 113 are installed on the casing 101 with a
ring shape to face the outside of the ring (that is, the opposite side to the center of the
SF 364646W 001
8/82
ring). That is, the sound collection units 112 and 113 are installed to face in the
mutually opposite directions.
[00 19]
In the configuration, for example, the information processing device I 0 may
5 recognize content spoken by the user by executing analysis based on a voice
recognition technology or a natural language processing technology on a voice
(acoustic information) of the user collected by the sound collection units (for
example, the sound collection units Ill to 113). Thus, for example, the information
processing device I 0 can recognize instruction content from the user and can execute
10 various processes (applications) in accordance with a recognition result.
[0020]
In addition, as another example, the information processing device I 0 may
have a so-called calling function. In this case, the information processing device I 0
may transfer the voice collected by the sound collection units (for example, the
15 sound collection units I 11 to 113) to another information processing device which is
a calling partner.
[0021]
On the other hand, for example, a situation in which a surrounding
environment of the information processing device 10 is dynamically changed in
20 diverse use scenes such as a case in which the information processing device 10,
such as a so-called wearable device illustrated in FIG. 1, which can be carried by the
user is used outdoors is assumed. In the situation, for example, noise occurring at
random, such as a wind sound, noise accompanied by vibration, and a rustle
accompanied due to wearing of the device, is collected by the sound collection units
25 of the information processing device I 0 in some cases.
[0022]
Accordingly, in the present disclosure, an installation position of each sound
collection unit and an example of signal processing based on a sound collection
result obtained by the sound collection units will be described in detail as an example
30 of a structure capable of collecting target sounds in a more suitable aspect even in an
environment in which noise occurs at random.
SP36164GW001
9/82
[0023]
<1.2. Examination of installation position of sound collection unit>
First, a result of the examination of the installation positions of the sound
collection units capable of collecting a voice of a user in a more suitable aspect in an
5 example of a case in which the information processing device 10 according to the
embodiment includes a wearable device worn on the neck of the user, as illustrated in
FIG. I, will be described. More specifically, an example of a measurement result of
a wind sound by each of the sound collection units in the information processing
device I 0 in which the sound collection units are installed at a plurality of spots in a
10 case in which wind arrives at mutually different angles will be described assuming a
so-called wind sound as noise.
[0024]
For example, FIG. 3 is an explanatory diagram illustrating an example of a
measurement environment in which an influence of a wind sound is measured. In
15 the measurement, as illustrated in FIG. 3, the information processing device 10 is
worn around the neck of a dummy doll U I resembling a part above the chest of the
user and a circulator U2 is disposed in front of the dummy doll U I. Then, by
setting the vertical direction of the dummy doll Ul as an axis and rotating the
dummy doll Ul by 10 degrees within a range ofO degrees to 360 degrees, an angle at
20 which wind arrives from the circulator U2 to the information processing device I 0 is
changed and a level of a wind sound collected by each sound collection unit was
measured.
[0025]
FIG. 4 is a diagram illustrating examples of installation positions of the
25 plurality of sound collection units installed in the information processing device I 0
in the measurement. Specifically, in an example illustrated in FIG. 4, sound
collection units M I to MG are installed in the information processing device I 0.
Markers appended in the information processing device I 0 schematically indicate
positions at which the sound collection units Ml to M6 are installed. Also, in the
30 markers to which the arrows are appended, the arrows indicate the directions of the
sound collection units corresponding to the markers. In addition, for markers to
SP364G46W001
10/82
which no arrow is appended, the sound collection units (that is, the sound collection
units M3 and M6) corresponding to the markers are assumed to be set to face the
upward vet1ical direction (that is, the near side in the depth direction of the drawing)
ofthe information processing device 10.
5 [0026]
Specifically, the sound collection unit Ml is equivalent to the sound
collection unit Ill in the information processing device I 0 described with reference
to FIG. I. That is, when the information processing device I 0 is worn on the user,
the sound collection unit M I is installed at the front end of the projection portion
10 installed to project toward the front side of the user at a position equivalent to the
vicinity of the mouth of the user. In addition, the sound collection unit M5 is
equivalent to the sound collection unit 112 in the infonnation processing device I 0
described with reference to FIG. I. That is, when the information processing device
I 0 is worn on the user, the sound collection unit M5 is installed outside of the casing
15 101 of the infonnation processing device 10 at a position equivalent to the left of the
user (the direction of about 270 degrees in FIG. 3) to face the outside of the casing
I 01 (in other words, the direction of about 270 degrees in FIG. 3).
[0027]
In addition, when the information processing device I 0 is worn on the user,
20 the sound collection units M2 to M4 and M6 are installed at positions equivalent to
areas in the right fi·ont of the user (in other words, the direction of about 45 degrees
in FIG. 3). At this time, the sound collection unit M2 is installed to face the inside
of the casing 101 via a space between the casing 101 of the information processing
device 10 and the neck of the user. In addition, the sound collection unit M4 is
25 installed on the outside of the casing 101 of the information processing device I 0 to
face the outside of the casing I 0 I (in other words, the direction of about 45 degrees
in FIG. 3). Also, the sound collection units M3 and M6 are installed to face the
upward vet1ica1 direction, as described above.
30
[0028]
In addition, FIG. 5 is an explanatory diagram illustrating examples of
measurement results of wind sounds by the sound collection units in a case in which
SP:364646W001
11/82
wind arrives at different angles in the information processing device 10. That is,
FIG. 5 illustrates examples of sound collection results of the wind sounds by the
sound collection units M 1 to M6 described with reference to FIG. 4 in the
measurement environment described with reference to FIG. 3. Also, in graphs
5 showing the sound collection results of the sound collection units M 1 to M6, as
illustrated in FIG. 5, numerical values written in the circumferential directions
indicate directions 111 which wind arrive from the circulator U2. In addition,
numerical values written in the radial directions of the graphs indicate levels of
acoustic sounds collected by the corresponding sound collection units (that is,
10 measurement levels of the sound collection units). That is, in the graphs showing
the sound collection results of the sound collection units Ml to M6 illustrated in FIG.
5, it is meant that influences of the wind sounds (that is, noise) are smaller as the
measurement levels are smaller (in other words, measurement values are located on
the inner sides of the graphs).
15 [0029]
Here, when the measurement result of the sound collection unit Ml is
focused on, particularly, it can be understood that the influence of the wind sound is
small in a situation at which the wind arrives from the front side of the user (that is,
the direction of 0 degrees). In addition, for the sound collection unit Ml, it can be
20 understood that the influence of the wind sound is smaller than in the other sound
collection units even in a case in which the wind arrives from a direction other than
the front.
[0030]
From this, for example, it is estimated that an influence of noise occurring at
25 random, such as the wind sound, can be decreased by installing a sound collection
unit at the front end (or near the tfont end) of the streamline projection portion to
face in a direction in which the projection portion projects, as in the sound collection
unit Ill illustrated in FIG. I.
30
[003 I]
In addition, when the measurement results of the sound collection units M5
and M6 are focused on, it can be understood that the influence of the wind sound is
SP3G4646W001
12/82
small in a case in which the wind arrives from the neck side of the user to the sound
collection unit. It is estimated that this is because the wind is blocked by the neck
or the head of the user and thus the influence ofthc wind sound decreases.
[0032]
5 From this, for example, it is estimated that characteristics of another sound
collection unit (for example, the sound collection unit 111 illustrated in FIG. 1) are
compensated for by installing a sound collection unit so that a pa1i (for example, the
neck or the head) of the user on which the information processing device I 0 is worn
can be used as a shield against wind or the like, as in the sound collection units 112
10 and 113 illustrated in FIG. 1.
[0033]
The result of the examination of the installation positions of the sound
collection units capable of collecting a voice of the user in the more suitable aspect
(that is, causing the influence ofthe noise such as a wind sound to be smaller) in the
15 example of the case in which the information processing device I 0 according to the
embodiment includes the wearable device worn on the neck of the user has been
described above with reference to FIGS. 3 to 5.
20
[0034]
<1.3. Functional configuration>
Next, an example of a functional configuration of the information
processing device 10 according to the embodiment will be described with reference
to FIG. 6 particularly by focusing on a process of acquiring a target sound (for
example, a voice of a user) on the basis of the sound collection result of each of the
plurality of sound collection units in the information processing device 10. FIG. 6
25 is a block diagram illustrating an example of the functional configuration of the
information processing device 10 according to the embodiment.
[0035]
As illustrated in FIG. 6, the information processing device 10 includes a
plurality of sound collection units ll I to 11M (where M is a positive integer), a
30 frequency decomposition unit 13, a channel power estimation unit I 5, a filter
estimation unit 16, a filter processing unit 17, and a frequency combination unit I 8.
SP36464GW001
13/82
Also, in the following description, in a case in which the sound collection units Ill
to II Mare not particularly distinguished from each other, the sound collection units
Ill to II M are referred to as the "sound collection units II 0" in some cases. In
addition, the number (that is, M) of sound collection units II 0 is not particularly
5 limited as long as the number of sound collection units is plural. The number of
sound collection units is preferably 3 or more.
[0036]
The sound collection unit II 0 includes a sound collection device that
collects an acoustic sound (that is, an acoustic sound propagating through an external
10 environment and arriving) of the external environment, as in a so-called microphone.
Also, a voice input from the user is collected by the sound collection units II 0 to be
received by the information processing device I 0. In addition, for example, the
sound collection unit II 0 may include a plurality of sound collection devices as in a
microphone array. The sound collection unit 110 outputs an acoustic signal based
15 on a sound collection result of the acoustic sound of the external environment to the
frequency decomposition unit 13. Also, a gain of an acoustic signal output from the
sound collection unit I I 0 may be adjusted by, for example, an amplifier or the like,
the adjusted acoustic signal may be converted from an analog signal to a digital
signal through AD conversion, and the digital signal may be input to the frequency
20 decomposition unit 13. Also, in the following description, in a case in which m
(where lsmsM) is a channel number of the sound collection unit 110 and n is a
discrete time, an acoustic signal output from the sound collection unit II 0 is
expressed as Xm(n).
25
[0037]
The frequency decomposition unit 13 decomposes the acoustic signal Xm(n)
output from the sound collection unit II 0 into frequency components and outputs the
frequency components. Specifically, the frequency decomposition unit 13
decomposes the acoustic signal Xm(n) into the frequency components by performing
processes such as frame partitioning, application of a predetermined window
30 function, time-frequency conversion (for example, Fast Fourier Transform (FFT),
Discrete Fourier Transform (DFT), or the like), and the like on the acquired acoustic
SP364646WOOJ
14/82
signal Xm(n). Also, in the following description, the frequency components of the
acoustic signal Xm(n) are written as Xm(i, k) in some cases. Here, i indicates a frame
number and k indicates a discrete frequency number. Then, the frequency
decomposition unit 13 outputs each frequency component Xm(i, k) of the acquired
5 acoustic signal Xm(n) to each of the filter processing unit 17 and the channel power
estimation unit 15 located at the rear stage. Thus, in regard to each of the sound
collection units Ill to II M, each frequency component Xm(i, k) of the acoustic
signal Xm(n) is output to each of the filter processing unit 17 and the channel power
estimation unit 15.
10 [0038]
The channel power estimation unit 15 acquires each frequency component
Xm(i, k) of the acoustic signal Xm(n) for each sound collection unit 110 (that is, each
of the sound collection units 111 to II M) from the frequency decomposition unit 13.
Subsequently, the channel power estimation unit 15 estimates a power spectrum of
15 each sound collection unit II 0 for each frequency on the basis of each frequency
component Xm(i, k) of the acoustic signal Xm(n) corresponding to each sound
collection unit 110. Here, in a case in which P m(i, k) is a power spectrum
corresponding to an i frame and a frequency k in an m-th sound collection unit II 0
(that is, a sound collection unit lim), the power spectrum Pm(i, k) is expressed in a
20 calculation expression indicated below as (Expression I). Also, in the following
(Expression I), Xm *(i, k) indicates a conjugate complex number of Xm(i, k). In
addition, in (Expression 1), r is a smoothing coefficient of a frame direction for
suppressing an abrupt change in the power spectrum (Osr
Next, an example of a process of a series of processes of the information
processing device 10 according to the embodiment will be described with reference
to FIG. 8 particularly by focusing on a process of acquiring a target sound (for
15 example, a voice of the user) on the basis of the sound collection result of each of the
plurality of sound collection units in the infonnation processing device I 0. FIG. 8
is a flowchart illustrating an example of the flow of the series of processes of the
information processing device I 0 according to the embodiment.
[0065]
20 (Step SIOI)
An acoustic sound of an external environment is collected by the plurality of
sound collection units 110 to be received by the information processing device 10.
The sound collection units II 0 adjusts the gain of the acoustic signal (the analog
signal) based on the sound collection result, converts the adjusted acoustic signal
25 from the analog signal to the digital signal through AD conversion, and outputs the
converted acoustic signal (the digital signal) Xm(n) to the frequency decomposition
unit 13.
30
[0066]
(Step S103)
The frequency decomposition unit 13 decomposes the acoustic signal Xm(n)
into the fi·equency components by executing the frame pa1iitioning, the application of
SP364646W001
22/82
the predetermined window function, the time-frequency conversion, and the like on
the acoustic signal Xm(n) output from the sound collection units II 0. Then, the
frequency decomposition unit 13 outputs each frequency component Xm(i, k) of the
acoustic signal Xm(n) to each of the filter processing unit 17 and the channel power
5 estimation unit 15 located at the rear stage. Thus, for each of the plurality of sound
collection units 110, the frequency component Xm(i, k) of the acoustic signal Xm(n) is
output to each of the filter processing unit 17 and the channel power estimation unit
15.
[0067]
10 (Step S I 05)
The channel power estimation unit 15 acquires each frequency component
X,(i, k) of the acoustic signal Xm(n) for each sound collection unit II 0 from the
frequency decomposition unit 13. Subsequently, the channel power estimation unit
15 estimates the power spectrum of each sound collection unit II 0 for each
15 frequency on the basis of the fi·equency component Xm(i, k) of the acoustic signal
Xm(n) corresponding to each sound collection unit 110. Then, the channel power
estimation unit 15 outputs the estimation result of the power spectrum Pm(i, k) of
each sound collection unit II 0 for each frequency to the filter estimation unit 16.
[0068]
20 (Step S I 07)
The filter estimation unit 16 calculates the filter coefficient w(i, k) used for
the filter processing unit 17 to be described below to execute the filtering process on
the basis of the estimation result of the power spectrum Pm(i, k) of each sound
collection unit II 0 for each frequency output ti·om the channel power estimation unit
25 15.
[0069]
Specifically, the filter estimation unit 16 generates the matrix R(i, k) on the
basis of the power spectrum Pm(i, k) of each sound collection unit 110. In addition,
for each sound collection unit II 0, the filter estimation unit 16 calculates the array
30 manifold vector a(k) indicating attenuation and delay characteristics until the sound
collection unit II 0 for each frequency on the basis of the distance between the sound
SP:364646W001
23/82
collection unit 110 and the sound source of the target sound. Then, the filter
estimation unit 16 calculates the filter coefficient w(i, k) on the basis of the generated
matrix R(i, k) and the calculated array manifold vector a(k) and outputs the filter
coefficient w(i, k) to the filter processing unit 17.
5 [0070]
(StepS 1 09)
The filter processing unit 17 acquires each frequency component Xm(i, k) of
the acoustic signal Xm(n) for each sound collection unit 110 from the frequency
decomposition unit 13. In addition, the filter processing unit 17 acquires the filter
10 coefficient w(i, k) calculated for each frequency from the filter estimation unit 16.
The filter processing unit 17 uses each frequency component Xm(i, k) of the acoustic
signal Xm(n) of each sound collection unit 110 as an input signal and generates the
output signal Y(i, k) for each frequency by executing weighting addition on the input
signal on the basis of the acquired filter coefficient w(i, k) for each fi"equency. Then,
15 the filter processing unit 17 outputs the output signal Y(i, k) generated for each
frequency to the frequency combination unit 18.
[0071]
(StepS Ill)
The frequency combination unit 18 combines the output signal Y(i, k) for
20 each frequency by executing the processes such as the frequency-time conversion,
the application of the predetermined window function, and the frame combination on
the output signal Y(i, k) for each frequency output from the filter processing unit 17.
Thus, the acoustic signal y(n) in which the sound collection result of each sound
collection unit II 0 is combined is generated. Also, the acoustic signal y(n)
25 generated by the frequency combination unit 18 is used as the sound collection result
for, for example, various processes (for example, voice recognition, voice calling,
and the like) which are executed by the information processing device I 0.
[0072]
The example of the process of the series of processes of the information
30 processing device I 0 according to the embodiment has been described with reference
to FIG. 8 particularly by focusing on the process of acquiring the target sound on the
5
SP361G16W001
24/82
basis of the sound collection result of each of the plurality of sound collection units
in the information processing device I 0.
[0073]
<1.5. Examples>
Next, other types of information processing device I 0 according to the
embodiment will be described as examples.
[0074]
<1.5.1. Example 1: example of wearable device worn around neck>
First, according to Example I, examples of the information processing
10 device including a wearable device which can be mounted on the neck of a uset; such
as a so-called neckband type wearable device illustrated in FIG. I, will be described
with reference to FIGS. 9 to 11.
[0075]
For example, FIG. 9 is an explanatory diagram illustrating an example ofthe
15 information processing device according to Example I and illustrating an example of
the information processing device including a wearable device which can be worn on
the neck of the user. Also, in the description, the information processing device
illustrated in FIG. 9 is referred to as an "information processing device lOa" in some
cases to distinguish the information processing device from the information
20 processing device 10 according to the above-described embodiment or information
processing devices according to other examples.
[0076]
As illustrated in FIG. 9, the information processing device 1 Oa includes the
sound collection units Ill to 114. The sound collection units Ill to 113 correspond
25 to the sound collection units Ill to 113 of the information processing device 10
described above with reference to FIG. I. In addition, in a case in which the
information processing device I Oa is worn on the neck of a user, the sound collection
unit 114 is installed to face to the rear side of the user at a position on the rear side of
the user. In this contiguration, for example, it is possible to further alleviate an
30 influence of noise arriving from the rear side of the user.
[0077]
SP364646W001
25/82
In addition, in the information processing device I Oa, projection pmtions
with streamline shapes projecting in directions in which the sound collection units
112 to 114 face are installed at positions at which the sound collection units 112 to
114 are installed and the sound collection units 112 to 114 are installed at the front
5 ends of the projection portions. In this configuration, as in the sound collection unit
111, the influence of noise such as a wind sound can be alleviated, and thus the
sound collection units 112 to 114 can collect acoustic sounds aiTiving in the
directions in which the projection portions project (that is, the directions in which the
sound collection units face) in the more suitable aspect.
10 [0078]
Also, the positions at which the projection portions are installed (that is, the
positions at which the sound collection units 110 are installed) arc not patticularly
limited. Therefore, for example, the projection portions may be installed at spots at
which bulges occur in the casing 101 by installing various circuits such as drivers, a
15 battery, and the like and the sound collection units 110 may be installed at the front
ends (or near the front end) of the projection portions.
[0079]
In addition, FIG. 10 is an explanatory diagram illustrating another example
of the information processing device according to Example I and illustrating an
20 example of the information processing device including a wearable device which can
be worn on the neck of the user. Also, in the description, the information
processing device illustrated in FIG. 10 is referred to as an "information processing
device 1 Ob" in some cases to distinguish the information processing device fi·om the
information processing device 10 according to the above-described embodiment or
25 information processing devices according to other examples.
[0080]
As illustrated in FIG. 10, the information processing device lOb has a ring
shape and has a configuration in which a portion denoted by reference numeral 19
can be opened. Also, ends separated from each other by opening the portion
30 denoted by reference numeral 19 can be detached and attached. In this
configuration, the information processing device I Ob is worn on the user so that the
SP364646W001
26/82
inner surface of the ring po1·tion comes in contact with the neck of the user (that is, is
worn around the neck).
(0081]
In addition, in the information processing device lOb, the sound collection
5 units 115 to 118 are installed to face the outside of the ring (that is, the opposite side
to the center of the ring) at mutually different positions along the circumference of
the casing formed in the ring form. Also, in the information processing device I Ob,
the sound collection units 115 to 118 are equivalent to the sound collection units II 0
(for example, the sound collection units Ill to 113 or the like illustrated in FIG. I)
10 according to the above-described embodiment.
[0082]
In this configuration, for each of the sound collection units 115 to 118, an
influence of noise is alleviated since the noise arriving from the opposite sides to the
directions in which the sound collection units face are shielded by the pa1t (that is,
15 the neck) of the user on which the information processing device I Ob is worn. In
particular, in the information processing device I Ob illustrated in FIG. I 0, the
influence of noise (particularly, noise arriving from the neck side of the user) such as
a wind sound is further alleviated since each ofthe sound collection units 115 to 118
is held to be closer to the neck of the user than the information processing device I 0
20 illustrated in FIG. I. This is also apparent in that an influence of noise arriving
from a part side of the user is further alleviated in the sound collection units M5 and
M6 (that is, the sound collection units closer to the part of the user), as described
with reference to FIG. 5. In addition, since the sound collection units 115 to 118 are
installed to face in mutually different directions, for example, it is also possible to
25 compensate for the characteristics of the other sound collection units on the basis of
the sound collection results of some of the sound collection units.
(0083]
Also, even in the information processing device I Ob illustrated in FIG. 10,
the projection portions with the streamline shape may be installed in at least pmts of
30 the casing and the sound collection units II 0 (for example, at least some of the sound
collection units 115 to 118) may be installed at the front ends (or near the ti·ont ends)
of the projection portions.
[0084]
27/82
SP :364646W 001
In addition, FIG 11 is an explanatory diagram illustrating still another
example of the information processing device according to Example I and
5 illustrating an example of the information processing device including a wearable
device which has a so-called necklace shape. Also, in the description, the
information processing device illustrated in FIG. II is referred to as an "information
processing device 1 Oc" in some cases to distinguish the information processing
device from the information processing device 10 according to the above-described
10 embodiment or information processing devices according to other examples.
[0085]
In FIG. II, reference numeral 119 denotes an example of the sound
collection unit 110 of the information processing device 10 according to the abovedescribed
embodiment. That is, in the information processing device I Oc with the
15 necklace shape, for example, a streamline projection portion may be installed in a
portion equivalent to a so-called pendant to face the front side of !he user when the
user wears the information processing device JOe. A sound collection unit 119 may
be installed at the front end (or near the front end) of the projection portion.
20
[0086]
Also, in the example illustrated in FIG. II, one sound collection unit 110 is
installed in the information processing device JOe, but the plurality of sound
collection units II 0 may be installed. In addition, in a case in which the plurality of
sound collection units II 0 are installed in the information processing device 1 Oc, the
plurality of sound collection units 110 may each be installed to face in mutually
25 different directions.
[0087]
As Example I, the examples of the information processing device 10
including the wearable device worn on the neck of the user such as the so-called
neckband type wearable device illustrated in FIG. I have been described above with
30 reference to FIGS. 9 to 11.
[0088]
SP364646WOOl
28/82
<1.5.2. Example 2: example of wearable device worn on head>
Next, according to Example 2, examples of the information processmg
device including a wearable device which can be wom on a head will be described
with reference to FIGS. 12 to 15.
5 [0089]
For example, FIG. 12 is an explanatory diagram illustrating an example of
the information processing device according to Example 2 and illustrating an
example of the information processing device including a wearable device which can
be worn on the head of a user. Also, in the description, the information processing
10 device illustrated in FIG. 12 is referred to as an "information processing device 20a"
in some cases to distinguish the information processing device from the information
processing device 10 according to the above-described embodiment or information
processing devices according to other examples.
15
[0090]
As illustrated in FIG. 12, when the infonnation processing device 20a is
worn on the head of the use1; a casing in which a circuit and the like are embedded to
realize various functions is held near an ear of the user. As a specific example, in
the example illustrated in FIG. 12, the information processing device 20a includes an
earphone unit inserted into an ear hole of the user and a holding member that has a
20 cable form and supports the casing when the holding member is hooked on the ear of
the user. In the information processing device 20a, the casing is held near the ear of
the user by the earphone unit and the holding member with the cable form.
[0091]
In addition, as illustrated in FIG. 12, the information processing device 20a
25 includes sound collection units 211 and 212. Also, in the information processing
device 20a, the sound collection units 211 and 212 are equivalent to the sound
collection units 110 (for example, the sound collection units 111 to 113 or the like
illustrated in FIG. 1) of the information processing device 10 according to the abovedescribed
embodiment.
30 [0092]
Specitlcally, the information processing device 20a has a projection portion
SP361646W001
29/82
with a streamline shape projecting to face in the front side at an end pmiion of the
casing held near the ear of the user and located on the front side of the user in a state
in which the infonnation processing device 20a is worn on the head of the user.
Then, the sound collection unit 211 is installed at the front end of the projection
5 portion to face in a direction (the front side of the user) in which the projection
potiion projects. In addition, in a case in which the information processing device
20a is worn on the head of the user, the sound collection unit 212 is installed in at
least a pati of a side surface located on the outside (that is, the opposite side to the
head) of the casing to face in the outside direction (that is, the transverse direction of
10 the user). In addition, the information processing device 20a may include a
projection portion with a streamline shape projecting in the outside direction of the
casing on a side surface of the casing, and the sound collection unit 212 may be
installed at the fi·ont end of the projection portion.
15
[0093]
Also, the example illustrated in FIG. 12 has been described focusing on the
casing held near the left ear of the user, but a casing held near the right ear of the user
can also have a similar configuration to the casing held near the left ear.
Specifically, the casing held on the right ear may have the configuration equivalent to
the sound collection unit 212 or may have the configuration equivalent to the sound
20 collection units 211 and 212.
[0094]
In addition, FIG. 13 is an explanatory diagram illustrating another example
of the information processing device according to Example 2 and illustrating an
example of the information processing device including a so-called glasses type
25 wearable device which can be worn on the head of the user. Also, in the description,
the information processing device illustrated in FIG. 13 is referred to as an
"information processing device 20b" in some cases to distinguish the information
processing device from the information processing device I 0 according to the abovedescribed
embodiment or information processing devices according to other
30 examples.
[0095]
SP364646W001
30/82
As illustrated in FIG. I 3, the information processing device 20b include
sound collection units 213 to 215. Also, in the information processing device 20b,
the sound collection units 213 to 215 are equivalent to the sound collection units 110
(for example, the sound collection units 111 to 113 or the like illustrated in FIG. 1) of
5 the information processing device 10 according to the above-descr!bed embodiment.
[0096]
For example, in the information processing device 20b, the sound collection
unit 213 is installed in at least a part of a portion equivalent to the front of glasses.
As a more specific example, the information processing device 20b includes a
10 projection pmiion with a streamline shape projecting on the front side in a portion
equivalent to a bridge of the glasses, and the sound collection unit 213 is installed at
the front end of the projection portion to face in a direction in which the projection
portion projects. In addition, as another example, as denoted by reference numeral
213', the projection portion and the sound collection unit may be installed in another
15 pmiion different from a pottion equivalent to the bridge in the pmiion equivalent to
the front of the glasses.
[0097]
In addition, in the information processing device 20b, the sound collection
units 214 and 215 are installed in at least parts of portions equivalent to temples of
20 the glasses. Also, for example, in a case in which the information processing device
20b is worn on the head of the user, the sound collection units 214 and 215 may be
installed to face in the direction of the opposite side to the head (the transverse
direction of the user).
25
[0098]
In addition, FIG. 14 is an explanatory diagram illustrating still another
example of the information processing device according to Example 2 and
illustrating another example of the information processing device including a
wearable device which can be worn on the head of the user. Also, in the description,
the information processing device illustrated in FIG. 14 is referred to as an
30 "information processing device 20c" in some cases to distinguish the information
processing device from the information processing device 10 according to the aboveSP
364646W 001
31/82
described embodiment or information processmg devices according to other
examples.
[0099]
As illustrated in FIG. 14, the information processing device 20c includes
5 sound collection units 216 to 218. Also, in the information processing device 20c,
the sound collection units 216 to 218 are equivalent to the sound collection units II 0
(for example, the sound collection units Ill to 113 or the like illustrated in FIG. I) of
the information processing device I 0 according to the above-described embodiment.
[0 1 00]
10 More specifically, the sound collection units 216 to 218 are installed at
mutually different positions of portions (for example, the fi·ont and temples)
equivalent to the frame of the glasses to face in mutually different directions. More
specifically, in a case in which the information processing device 20c is worn on the
head of the user, the sound collection units 216 to 218 are installed to face the
15 direction ofthe opposite side to the head.
[010 I]
In this configuration, for each of the sound collection units 216 to 218, an
influence of noise is alleviated since the noise arriving from the opposite sides to the
directions in which the sound collection units face are shielded by the head of the
20 user. In addition, since the sound collection units 216 to 218 are installed to face in
mutually different directions, for example, it is also possible to compensate for the
characteristics of the other sound collection units on the basis of the sound collection
results of some of the sound collection units.
25
[0 I 02]
In addition, FIG. 15 is an explanatory diagram illustrating still another
example of the information processing device according to Example 2 and
illustrating an example of the information processing device including an overhead
type wearable device such as a so-called headphone. Also, in the description, the
information processing device illustrated in FIG. 15 is referred to as an "information
30 processing device 20d" in some cases to distinguish the information processing
device from the information processing device I 0 according to the above-described
SP 364646W 001
32/82
embodiment or information processing devices according to other examples.
[0103]
In the example illustrated in FIG. 15, the information processing device 20d
includes an imaging unit 25 and a sound collection unit 219. Also, in the
5 information processing device 20d, the sound collection unit 219 is equivalent to the
sound collection units 110 (for example, the sound collection units Ill to 113 or the
like illustrated in FIG. I) of the information processing device I 0 according to the
above-described embodiment.
10
[0104]
Specifically, in a case in which the information processing device 20d is
worn on the head of the user, the imaging unit 25 is installed at a position at which
the front side of the user is within an angle of view in a casing of the information
processing device 20d. For example, in the example illustrated in FIG. 15, the
imaging unit 25 is installed on the casing of the information processing device 20d to
15 tace the front side of the user.
[0 I 05]
In addition, the information processing device 20d has a projection portion
with a streamline shape projecting on the front side of the user in at least a part of the
casing in a state in which the information processing device 20d is worn on the head
20 of the user, and the sound collection unit 219 is installed at the front end of the
projection portion to face in a direction in which the projection portion projects.
For example, in the example illustrated in FIG. 15, the sound collection unit 219 is
installed near the imaging unit 25. In addition, as another example, as denoted by
reference numeral 219', the projection pmtion with the streamline shape projecting to
25 face on the front side of the user may be installed in at least a pmt of the holding
member that holds the information processing device 20d on the head of the user, the
sound collection unit may be installed at the front end of the projection portion to
face in the direction in which the projection portion projects.
30
[0 I 06]
As Example 2, the examples of the information processing device including
the wearable device which can be worn on the head have been described above with
SP36461GW001
33/82
reference to FIGS. 12 to 15. Also, the above-described examples are merely
examples and the present disclosure is not necessarily limited to the foregoing
examples. As a specific example, the information processing device including the
head-mounted wearable device with a so-called headband shape may have a
5 configuration equivalent to the sound collection units 110 of the information
processing device I 0 according to the above-described embodiment.
[0 1 07]
<1.5.3. Example 3: application example to portable infonnation terminal>
Next, according to Example 3, an example of an information processing
10 device including a pmiable information terminal such as a so-called smartphone will
be described with reference to FIGS. 16 and 17.
[0 I 08]
For example, FIG. 16 is an explanatory diagram illustrating an example of
the infmmation processing device according to Example 3. Also, in the description,
15 the information processing device illustrated in FIG. 16 is referred to as an
"information processing device 30" in some cases to distinguish the information
processing device from the information processing device I 0 according to the abovedescribed
embodiment or information processing devices according to other
examples.
20 [0109]
As illustrated in FIG. 16, the information processing device 30 includes
sound collection units 311 to 314. Also, in the information processing device 30,
the sound collection units 311 to 314 are equivalent to the sound collection units II 0
(tor example, the sound collection units 111 to 113 or the like illustrated in FIG. I) of
25 the information processing device I 0 according to the above-described embodiment.
[0 II 0]
Specifically, a casing of the information processing device 30 has a
substantially rectangular surface 36 in at least a part, and projection portions with
streamline shapes are formed in predetermined regions including corners of the
30 surface 36 (that is, the corners or near the corners) to face the outside of the casing.
In other words, the casing of the information processing device 30 has the
SP361646W001
34/82
substantially planar surface 36 and a plurality of side surfaces 371 to 374 formed to
face different directions along the end portions of the surface 36, and the projection
portions with the streamline shape in predetermined regions including portions in
which the side surfaces are connected. Also, the surface 36 can be equivalent to,
5 for example, a surface on which a display unit such as a display is installed. In
addition, the corners of the casing of the information processing device 30 may be
the projection portions. Then, each of the sound collection units 311 to 314 is
installed at one front end (or near the front end) of the projection pot1ions to face the
outside of the casing of the information processing device 30.
10 [0111]
In addition, FIG. 17 is an explanatory diagram illustrating an example of a
use form of the information processing device 30 according to Modification Example
3 and illustrating an example of a case in which a user executes voice calling using
the information processing device 30.
15 [0112]
As illustrated in FIG. 17, for example, in a case in which the user executes
the voice calling while holding the information processing device 30 near the right
ear of the user, the information processing device 30 is held so that the sound
collection unit 312 faces the substantially front side of the user. In this
20 configuration, for example, in a situation in which the user executes the voice calling
while moving, the sound collection unit 3\2 rarely receives an influence of a wind
sound accompanied by wind arriving from the front side due to the movement of the
user. Also, a case in which the user executes voice calling while holding the
information processing device 30 near the left ear of the user can also be assumed.
25 In this case, the information processing device 30 is held so that the sound collection
3 II faces the substantially front side of the user, and thus the sound collection unit
3 II rarely receives an int1uencc of a wind sound accompanied by wind arriving from
the front side due to the movement of the user. That is, the information processing
device 30 can alleviate the influence of the wind sound accompanied by the wind
30 arriving from the front side due to the movement of the user on the basis of the
above-described configuration.
SP364G4GW001
35/82
[0113]
In addition, in the information processing device 30, the sound collection
units 311 to .114 are installed to face in mutually different directions. In this
configuration, the infonnation processing device 30 can compensate for
5 characteristics of the other sound collection units on the basis of the sound collection
results of at least some of the sound collection units.
[01!4]
As Example 3, the examples of the information processing device including
the portable information terminal such as a so-called smartphone have been
10 described above with reference to FIGS. 16 and 17.
[0 115]
<1.5.4. Example 4: application example to watch type wearable device>
Next, according to Example 4, examples of the information proccssmg
device including a so-called watch type wearable device which can be worn on an
15 arm will be described with reference to FIGS. 18 and 19.
[0 116]
For example, FIG. 18 is an explanatory diagram illustrating an example of
an information processing device according to Example 4. Also, in the description,
the information processing device illustrated in FIG. 18 is referred to as an
20 "information processing device 40a" in some cases to distinguish the information
processing device from the infonnation processing device I 0 according to the abovedescribed
embodiment or information processing devices according to other
examples.
25
[0 117]
As illustrated in FIG. 18, the information processing device 40a includes
sound collection units 411 to 415. Also, in the information processing device 30,
the sound collection units 411 to 415 are equivalent to the sound collection units II 0
(for example, the sound collection units Ill to !13 or the like illustrated in FIG. I) of
the information processing device I 0 according to the above-described embodiment.
30 [0118]
Specifically, the information processing device 40a includes a casing 481 1n
SP364646W001
36/82
which circuits and the like are embedded to realize various functions and a holding
member 482 with a belt shape holding the casing 481 on the arm of the user. The
casing 481 has a substantially rectangular surface in at least a pati, and projection
portions with streamline shapes are formed in predetermined regions including
5 corners of the substantially rectangular surface to face the outside of the casing 481
as in the information processing device 30 according to the above-described Example
3. Also, the substantially rectangular surface is equivalent to a surface on a side on
which a dial plate of a so-called watch is installed. Then, each of the sound
collection units 411 to 414 is installed at one front end (or near the front end) of the
10 projection potiions to face the outside of the casing 481.
[0 119]
In addition, in the holding member 482, a sound collection unit 415 is
installed at a position substantially symmetric to the casing 481 setting the ann as a
reference to face in the direction of the opposite side to the ann in a state in which
15 the information processing device 40a is worn on the arm.
[0120]
In this configuration, at least one of the sound collection units 411 to 414 of
the information processing device 40a faces in substantially the same direction as an
arm swing direction, for example, even in a situation in which the user swings his or
20 her arm on which the information processing device 40a is worn. Therefore, the
information processing device 40a can alleviate an influence of a wind sound
accompanied by the swing of the arm in accordance with sound collection results by
the sound collection units 411 to 414. In addition, in the information processing
device 40a, the sound collection units 411 to 415 are installed to face in mutually
25 different directions. In patticulat; for the sound collection unit 415, noise arriving
from the opposite side to the direction in which the sound collection unit 415 faces is
shielded by the arm on which the information processing device 40a is worn. In
this configuration, the information processing device 40a can also compensate
characteristics of the other sound collection units on the basis of the sound collection
30 results of at least some sound collection units among the sound collection units 411
to 415.
SP364646W001
37/82
[0 121]
In addition, FIG 19 is an explanatory diagram illustrating another example
of the information processing device according to Example 4. Also, in the
description, the information processing device illustrated in FIG. 19 is referred to as
5 an "information processing device 40b" in some cases to distinguish the information
processing device from the information processing device I 0 according to the abovedescribed
embodiment or information processing devices according to other
examples.
10
[0122]
As illustrated in FIG. I 9, the information processing device 40b includes a
sound collection unit 416 in a portion equivalent to a screw pottion of a so-called
watch denoted by reference numeral 483 (hereinafter referred to as a "screw portion
483"). Specifically, by forming the screw portion 483 in a streamline shape, the
screw portion 483 may be used as a projection pottion in which the sound collection
15 unit 416 is installed. Also, in the information processing device 40b, the sound
20
25
collection unit 416 is equivalent to the sound collection units 110 (for example, the
sound collection unit I I 1) of the information processing device 10 according to the
above-described embodiment.
[0 123]
As Example 4, the examples of the information processing device including
the so-called watch type wearable device which can be worn on the arm have been
described above with reference to FIGS. 18 and 19.
[0124)
<1.5.5. Example 5: application example to imaging device>
Next, according to Example 5, examples of an information processing
device including an imaging device capable of capturing a moving image or a still
image will be described with reference to FIGS. 20 and 21.
[0 125)
For example, FIG. 20 is an explanatory diagram illustrating an example of
30 an information processing device according to Example 5. Also, in the description,
the information processing device illustrated in FIG. 20 is referred to as an
SP364646W001
38/82
"information processing device 50" in some cases to distinguish the information
processing device from the information processing device 10 according to the abovedescribed
embodiment or information processing devices according to other
examples.
5 [0126]
In FIG. 20, reference numeral 53 denotes an imaging unit that captures an
image such as a moving image or a still image. In addition, reference numerals 511
and 512 denote examples of sound collection units installed in the information
processing device 50. Also, in the information processing device 50, the sound
10 collection units 51 I and 512 are equivalent to the sound collection units 110 (for
example, the sound collection units Ill to 113 or the like illustrated in FIG. 1) of the
information processing device 10 according to the above-described embodiment.
[0127]
Specifically, as illustrated in FIG. 20, the information processing device 50
15 includes, for example, a projection portion with a streamline shape projecting in a
direction in which the imaging unit 53 captures an image (hereinafter also referred to
as an "imaging direction") in a part of a surface which is a surface of the casing
holding the imaging unit 53 and faces in the imaging direction. Then, the sound
collection unit 5 I I is installed at the front end (or near the front end) of the
20 projection portion to face in the imaging direction (in other words, the front side) of
the imaging unit 53.
[0 128]
In addition, the sound collection unit 512 may be installed near the imaging
unit 53 (for example, near a lens of the imaging unit 53). For example, FIG. 21 is
25 an explanatory diagram illustrating an example of a schematic configuration near of
the lens of the imaging unit 53 in the information processing device 50 according to
Example 5. In the example illustrated in FIG. 21, in the information processing
device 50, a p•·ojection pmtion 551 projecting toward the outside of the casing of the
information processing device 50 is installed near the lens of the imaging unit 53.
30 In addition, the projection portion 551 includes a projection portion 553 with a
streamline shape projecting in the imaging direction (that is, the front side) of the
SP364646W001
39/82
imaging unit 53, and the sound collection unit 513 is installed at the front end (or
near the front end) of the projection p011ion 553.
[0129]
In this configuration, the information processing device 50 can alleviate an
5 influence of a wind sound accompanied by wind arriving from the front side due to
movement of a user, for example, even in a situation in which the user captures an
image while moving.
[0 130]
In addition, although not illustrated in FIGS. 20 and 21, the information
10 processing device SO may include other sound collection units different from the
sound collection units S II and S 12. In this case, the other sound collection units
may be installed to face different directions from the sound collection units 511 and
512. As a more specific example, for example, the other sound collection units may
be installed on a surface which is a surface of the casing of the information
15 processing device 50 and is on the opposite side to the imaging direction of the
imaging unit 53 to face in the direction (that is, the rear side) on the opposite side to
the imaging direction. In this configuration, for example, it is possible to
compensate for characteristics of the sound collection units 511 and 512 on a basis of
sound collection results of the other sound collection units.
20 [0131]
As Example 5, the examples of the information processing device including
the imaging device capable of capturing a moving image or a still image have been
described above with reference to FIGS. 20 and 21.
[0 132]
25 <<2. Second embodiment>>
<2.1. Overview>
Next, a second embodiment of the present disclosure will be described. In
the information processing device I 0 according to the above-described first
embodiment, it is possible to reduce the influence of noise such as a wind sound
30 occurring at random by executing the filtering process so that an input of the sound
collection unit with a less measurement level (that is, a level of the collected acoustic
SP364646W001
40/82
sound) is prioritized on the basis of the sound collection result of each of the plurality
of sound collection units. Through the control, it is possible to alleviate the
influence of the noise in the more suitable aspect particularly in a case in which the
influence of the noise such as a wind sound occurring at random is larger.
5 (0 133]
On the other hand, in a case in which the sound collection result of each
sound collection unit is evaluated without change as in the above-described control,
the sound collection result of the sound collection unit collecting a target sound at a
higher level is not used in a situation in which the target sound such as a voice is
10 collected as a main component. That is, in a situation in which the influence of the
noise such as a wind sound occurring at random is small, for example, the sound
collection result of the sound collection unit with a small signal-to-noise ratio (SN
ratio) is used preferentially.
15
[0134]
Accordingly, in the embodiment, an example of a structure capable of
maintaining an effect of suppressing noise such as a wind sound occurring at random
as in the above-described first embodiment and further acquiring a target sound in a
more suitable aspect in a case in which an influence of noise occurring at random is
small will be proposed.
20 [0135]
<2.2. Functional configuration>
First, an example of a functional configuration of the information processing
device according to the embodiment will be described with reference to FIG. 22.
FIG. 22 is a block diagram illustrating an example of a functional configuration of
25 the information processing device according to the embodiment. Also, in the
description, the information processing device according to the embodiment is
referred to as an "information processing device 60" in some cases to explicitly
distinguish the information processing device from the information processing device
10 (see FIG. 6) according to the above-described first embodiment.
30 [0136]
As illustrated in FIG. 22, the information processing device 60 according to
SP36464GW001
41/82
the embodiment includes a plurality of sound collection units I I I to II M (where M
is a positive integer), a frequency decomposition unit 13, a channel power estimation
unit 65, a filter estimation unit 66, a filter processing unit 17, and a frequency
combination unit 18. Also, the plurality of sound collection units I I I to II M
5 (where M is a positive integer), the frequency decomposition unit 13, the filter
processing unit 17, and the frequency combination unit 18 are equivalent to the
configurations to which the same reference numerals are affixed in the information
processing device I 0 (see FIG. 6) according to the above-described first embodiment.
That is, the information processing device 60 according to the embodiment is
10 different from the information processing device I 0 according to the above-described
first embodiment in the processing content of the channel power estimation unit 65
and the filter estimation unit 66. Accordingly, the functional configuration of the
information processing device 60 according to the embodiment will be described
below particularly focusing on differences from the information processing device I 0
15 according to the above-described first embodiment. The detailed description of the
same configut·ation as that of the information processing device I 0 will be omit1ed.
[0137]
As illustrated in FIG. 22, the channel power estimation unit 65 includes an
input power estimation unit 65 I, an uncorrelated component power estimation unit
20 653, and a random noise power estimation unit 655.
[0138]
The input power estimation unit 651 is equivalent to the channel power
estimation unit I 5 of the information processing device 10 according to the abovedescribed
first embodiment. That is, the input power estimation unit 65 I estimates
25 a power spectrum of each sound collection unit I I 0 for each frequency on the basis
of each n·equeney component Xm(i, k) of the acoustic signal Xm(n) corresponding to
each sound collection unit I I 0. Then, the input power estimation unit 651 outputs
an estimation result of the power spectrum Pm(i, k) of each sound collection unit I 10
for each ti'equency to the random noise power estimation unit 655.
30 [0139]
The uncorrelated component power estimation unit 653 receives a feedback
SP:364646W001
42/82
of an output signal Y(i, k) generated by executing the filtering process by the filter
processing unit 17. Also, the output signal Y(i, k) is an acoustic sound in which the
influence of noise (random noise) is suppressed in each frequency component Xm(i,
k) of the acoustic signal Xm(n) collected previously by each sound collection unit II 0
5 and is equivalent to, for example, a frequency component of the target sound such as
a voice spoken by a user in each sound collection unit II 0. Subsequently, the
uncorrelated component power estimation unit 653 estimates a power spectrum Qm(i,
k) of a component uncorrelated with the output signal Y(i, k) on a basis of correlation
between each frequency component Xm(i, k) of the acoustic signal Xm(n)
10 corresponding to each sound collection unit II 0 and the fed-back output signal Y(i,
k). Also, a component uncorrelated with the output signal Y(i, k) (hereinafter also
simply referred to as an "uncorrelated component") in the frequency component Xm(i,
k) is equivalent to a noise component such as random noise included in the frequency
component Xm(i, k). In addition, the details of signal processing by the
15 uncorrelated component power estimation unit 653 will be described separately
below. Then, the uncorrelated component power estimation unit 653 outputs an
estimation result of the power spectrum Qm(i, k) of each sound collection unit 110 for
each frequency to the random noise power estimation unit 655.
[0 140]
20 The random noise power estimation unit 655 acquires the estimation result
of the power spectrum Pm(i, k) of each sound collection unit 110 for each frequency
from the input power estimation unit 651. In addition, the random noise power
estimation unit 655 acquires the estimation result of the power spectrum Qm(i, k) of
the uncorrelated component corresponding to each sound collection unit 110 for each
25 frequency from the uncorrelated component power estimation unit 653. Then, the
random noise power estimation unit 655 decides a power spectrum Wm(i, k) of each
sound collection unit 110 for each frequency used for the filter estimation unit 66 to
calculate the filter coefficient w(i, k) on the basis of the estimation results of the
acquired power spectrum Pm(i, k) and the acquired power spectrum Qm(i, k). Also,
30 the details of a process related to the decision of the power spectrum Wm(i, k) by the
random noise power estimation unit 655 will be described separately below. Then,
5
SP364646W001
43/82
the random noise rower estimation unit 655 outputs information indicating the power
spectrum Wm(i, k) of each sound collection unit II 0 for each frequency to the filter
estimation unit 66.
[0 141]
The filter estimation unit 66 calculates the filter coefficient w(i, k) used for
the filter processing unit 17 to execute a filtering process on the basis of the
information indicating the power spectrum Wm(i, k) of each sound collection unit
II 0 for each frequency output from the channel power estimation unit 65. Also, at
this time, the filter estimation unit 66 is different from the filter estimation unit 16
10 according to the above-described first embodiment in that the power spectrum Wm(i,
k) is applied in place of the power spectrum P m(i, k) at the time of generating the
matrix R(i, k) described above in (Expression 2).
[0142]
On the other hand, a subsequent process, that is, the process related to
15 calculation of the filter coefficient w(i, k) on the basis of the array manifold vector
a(k) and the generated matrix R(i, k) described above on the basis of (Expression 3)
to (Expression 6), is the same as that of the filter estimation unit 16 according to the
above-described first embodiment. Therefore, the detailed description of the
content of the process will be omitted.
20 [0143]
As described above, the filter estimation unit 66 calculates the filter
coefficient w(i, k) on the basis of the information indicating the acquired power
spectrum Wm(i, k) of each sound collection unit II 0 for each frequency and outputs
the calculated t1lter coefficient w(i, k) to the t1lter processing unit 17. Also,
25 subsequent processes are the same as those of the information processing device I 0
(see FIG. 6) according to the above-described first embodiment.
[0144]
The example of the functional configuration of the information processing
device according to the embodiment will be described above with reference to FIG.
30 22.
[0 145]
SP:i64G4GW001
44/82
<2.3. Details ofuncorrelated component power estimation unit>
Next, the details of a process of calculating the power spectrum Q,(i, k) of
the uncorrelated component corresponding to each sound collection unit II 0 for each
frequency in the uncorrelated component power estimation unit 653 will be described.
5 [0146]
First, a basic principle for calculating the power spectrum Qm(i, k) in the
uncorrelated component power estimation unit 653 will be described. An acoustic
sound (signal) input to a sound collection unit such as a microphone includes, for
example, a target sound Sm such as a voice or the like of the user, so-called
10 background noise Nm, and random noise W m such as a wind sound. That is, each
frequency component Xm(i, k) of the acoustic signal Xm(n) of each sound collection
unit II 0 is expressed in a relation expression indicated below as (Expression 8) on
the basis of the target soundS"" the background noise N"" and the random noise W m.
[0147]
15 [Math. 7] -
(Expression 8)
[0148]
Sm(i, k)+Nm(i, k)+Wm(i, k)
Here, when an acoustic sound (signal) input to each of M sound collection
20 units is collected, the acoustic sounds are expressed in a correlation expression
indicated below as (Expression 9).
[0149]
[Math. 8]
X S+N+W= akSorg+N+W
25 (Expression 9)
[0150]
In the foregoing (Expression 9), S is a collection of the target sound Sm of
SP364646W001
45/82
the M sound collection units. Similarly, N is a collection of the background noise
N.n of the M sound collection units and W is a collection of the random noise W, of
the M sound collection units. Also, S, N, and W are expressed as vectors. In
addition, Socg indicates the target sound output from a sound source and is expressed
5 as a scalar value. In addition, ak is equivalent to the above-described array manifold
vector a(k). That is, S indicates a component of the target sound in consideration of
an influence of deterioration, delay, or the like of a signal occurring when the target
sound Socg output fi·om the sound source propagates in a space until the target sound
arrives at the sound collection units.
10 [0151]
Here, an occurrence timing of the random noise W such as a wind sound is
random and can be defined as a signal with no correlation approximately between the
plurality of sound collection units (particularly, the sound collection units disposed in
a distributive manner, as illustrated in FIG. I) in the information processing device
15 according to the present disclosure.
[0 152]
On the basis of the characteristics, the foregoing (Expression 9) can be
defined as relation among the vectors illustrated in FIG. 23. FIG. 23 is an
explanatory diagram illustrating a basic principle of a process of the uncorrelated
20 component power estimation unit 653. Also, the example illustrated in FIG. 23
shows a case in which a voice spoken by the user is collected as a target sound. In
addition, a vector space illustrated in FIG. 23 is defined on the basis of the manifold
vector ak.
[0153]
25 In FIG. 23, X indicates an acoustic sound (that is, an input signal) collected
by the sound collection unit and is equivalent to X expressed in (Expression 9). In
addition, Y is ideally equivalent to a component (that is, a speech component of the
user) based on the estimation result of the target sound Smg in the input signal X.
That is, the component Y schematically indicates a speech component of the user (or
30 a component that has correlation with the speech component of the user) among
components included in the input signal X. On the other hand, Z is equivalent to a
SP 364 646W 001
46/82
component that has small correlation (or has no correlation) with the speech
component of the user among the components included in the input signal X.
[0 154)
Also, when both the background noise N and the random noise W can be
5 suppressed, the component Z is only the components of the background noise Nand
the random noise W. However, in the configuration in which each sound collection
unit is disposed around the neck as in the information processing device (for example,
see FIG I) according to the present disclosure, the sound collection units are located
relatively nearby. Therefore, the background noise N is measured as a component
10 that has correlation among the sound collection units. Therefore, the component Y
includes the component of the background noise N in addition to a speech
component S of the user. On the other hand, since the random noise W such as a
wind sound has small correlation with the speech component of the user, the random
noise W is shown as the component Z.
15 [0155)
Using the foregoing characteristics, the uncorrelated component power
estimation unit 653 extracts the component that has small correlation (or no
correlation) with the output signal Y as the component of the random noise W using
feedback of the output signal Y (that is, the speech component of the user). Also, in
20 the following description, the component Z is referred to as an "uncorrelated
component Z."
[O 156)
For example, in a case in which the number of sound collection units 110 is
4, the array manifold vector ak is expressed in a calculation expression indicted
25 below as (Expression I 0) on the basis of the calculation expression described above
as (Expression 4).
[0157)
[Math. 9)
(Expression 1 0)
[0 158]
47/82
SP :364646WOO 1
Here, on the basis of an inner product of the input signal X and the manifold
vector ab a component obtained by projecting the input signal X to the manifold
5 vector ak can be extracted. From the characteristics, the uncorrelated component Z
can be extracted as a component 01thogonal to the manifold vector ak on a basis of a
calculation expression indicated below as (Expression 11 ).
10
[0 159]
[Math. 10]
(Expression 11)
[0 160]
Here, in the foregoing (Expression 11), a component indicated as (akHakr
'·ak"-X is equivalent to the speech component Y of the user illustrated in FIG. 23.
15 That is, the foregoing (Expression 11) can be expressed as a calculation expression
indicated below as (Expression 12).
[0 161]
[Math. 11]
z
20 (Expression 12)
[0 162]
-
Here, when the output signal Y (that is, the output signal subjected to the
filtering process by the filter processing unit 17) fed back as the component Yin the
foregoing (Expression 12) is applied, the foregoing (Expression 12) can be expressed
25 as a calculation expression indicated below as (Expression 13) on the basis of the
above-described (Expression 6).
[0 163]
5
[Math. 12]
z
(Expression 13)
[0 164]
SP36464GW001
48/82
aH (k)R(i, k) -l
------·X
aH (k)R(i, k)-1ak
By calculating the power of the signal on the basis of the uncorrelated
component Z calculated in this way and executing time smoothing, it is possible to
estimate the power spectrum of the uncorrelated component Z. Here, the power
spectrum Om(i, k) of the uncorrelated component Z corresponding to an i frame and
the frequency k in the m-th sound collection unit ll 0 (that is, the sound collection
10 unit lim) is expressed in a calculation expression indicated below as (Expression 14).
Also, Zm*(i, k) in the following (Expression 14) indicates a conjugate complex
number of Zm(i, k). In addition, in (Expression 14), r indicates a smoothing
coefficient of a frame direction for suppressing an abrupt change in a power
spectrum (O:o;r
Next, the details of a process of deciding the power spectrum Wm(i, k) of
15 each sound collection unit II 0 for each frequency used for the random noise power
estimation unit 655 to calculate the filter coefficient w(i, k) will be described.
[0 170)
As described above, the random noise power estimation unit 655 decides the
power spectrum Wm(i, k) on the basis of the estimation results of the power
20 spectrum Pm(i, k) acquired from the input power estimation unit 651 and the power
spectrum OmO, k) of the uncorrelated component acquired from the uncorrelated
component power estimation unit 653.
25
[0 171]
(Case in which power spectrum Om is applied)
For example, the random noise power estimation unit 655 may output the
estimation result of the power spectrum Om(i, k) of the uncotTelated component as
the power spectrum Wm(i, k) to the filter estimation unit 66. Also, in this case, the
channel power estimation unit 65 may not include the input power estimation unit
651.
30 [0172]
(Case in which power spectrum Pm and power spectrum Qm are selectively switched)
SP864616W001
50/82
In addition, as another example, the random noise power estimation unit 655
may selectively output one of the estimation results of the power spectrum P,(i, k)
and the power spectrum Qm(i, k) on a basis of a predetermined condition as the
power spectrum Wm(i, k) to the filter estimation unit 66.
5 [0173)
(Case in which power spectrum W, is adaptively calculated)
In addition, as still another example, the random noise power estimation unit
655 may adaptively calculate the power spectrum Wm(i, k) on the basis of the
estimation results of the power spectrum Pm(i, k) and the power spectrum Q,(i, k).
10 [0174)
For example, the random noise power estimation unit 655 calculates a
power spectrum w,- in which a relation between a target sound (a voice or the like)
and random noise is considered using the power spectrum P m(i, k) and the power
spectrum Q,(i, k) as inputs on the basis of a calculation expression indicated below
15 as (Expression 15). Also, "Wm" indicates a letter affixed by a tide above "W m·"
In addition, Pm and Qm shown below are written by generalizing the power
spectrum P m(i, k) and the power spectrum Qm(i, k).
20
[0175)
[Math. 14)
(Expression 15)
[0176]
--
For example, the following (Expression I 6) indicates a specific example of
a function F of calculating the power spectrum W,- in which a relation between a
25 target sound and random noise is considered using the power spectrum P,(i, k) and
the power spectrum Qm(i, k) as inputs.
[0 177]
[Math. 15)
(Expression 16)
[0 178]
51/82
SP364646W001
Then, the random no1se power estimation unit 655 calculates the power
5 spectrum Wm on a basis of a calculation expression indicated below as (Expression
17) on the basis of the power spectrum W m- in which the above-described relation
between the target sound and the random noise is considered. Also, in (Expression
17), r indicates a smoothing coefficient of a frame direction for suppressing an abrupt
change in a power spectrum (O:S:r<1 ). That is, the random noise power estimation
10 unit 655 may smooth the power spectrum Wm calculated on a basis of a calculation
expression indicated below as (Expression 17) between frames on the basis of setting
of the coefficient r.
15
[0 179]
[Math. 16]
(Expression 17)
[0 180]
r · Wm(i- 1, k) + (1- r) · Wm
Here, the power spectrum Pm expressed in (Expression 16), that is, the
estimation result of the power spectrum Pm(i, k) by the input power estimation unit
20 651, is equivalent to a level of an acoustic sound collected by the sound collection
unit 110, as described above. On the other hand, the power spectrum Om expressed
in (Expression 16), that is, the estimation result of the power spectrum Qm(i, k) by
the uncorrelated component power estimation unit 653, is equivalent to a level of
random noise such as a wind sound. That is, a weight Om/(Pm+Qm) expressed in
25 (Expression 16) changes on the basis of the relation between the target sound such as
a voice.and the random noise such as a wind sound.
SP364646W001
52/82
[0 181]
Specifically, in a case 111 which the signal level of the target sound with
respect to the random noise is sufficiently large, the influence of the power spectrum
Pm is dominant and the weight Qm/(Pm+Qm) becomes smaller. That is, in this case,
5 the weight Qm/(Pm+Qm) indicates control for further suppressing use of the sound
collection result of a corresponding channel (that is, the sound collection unit 11 0).
Here, the reciprocal of the weight Qm/(Pm+Qm) is applied to the calculation of the
filter coefficient w(i, k). Therefore, in a case in which the signal level of the target
sound with respect to the random noise is sufficiently large, the filter coefficient w(i,
10 k) is calculated so that the use of the sound collection result by the CotTesponding
channel is further prioritized.
[0 182]
Conversely, in a case in which the influence of the random noise such as a
wind sound is larger, the influence of the power spectrum Qm is more dominant and
15 the weight Qm/(Pm+Qm) becomes larger. That is, in this case, the weight
Qm/(Pm+Qm) indicates control for fwther prioritizing use of the sound collection
result of a corresponding channel (that is, the sound collection unit II 0). Here, the
reciprocal of the weight Qm/(Pm+Qm) is applied to the calculation of the filter
coefficient w(i, k), as described above. Therefore, in a case in which the influence
20 of the random noise is sufficiently large, the filter coefficient w(i, k) is calculated so
that the use of the sound collection result by the corresponding channel is further
suppressed.
[0 183]
That is, through the above-described control, the sound collection result of
25 the sound collection unit 110 obtained by collecting a voice at a higher level of the
voice is more preferentially used and the filter coefficient w(i, k) is calculated in a
situation in which the influence of the random noise such as a wind sound is small
and the voice is mainly collected. Thus, in a situation in which the influence of the
random noise such as a wind sound is large, as in the above-described first
30 embodiment, the sound collection result of the sound collection unit 110 in which the
measurement level is less is more preferentially used and the filter coefficient w(i, k)
SP36461GW001
53/82
ts calculated. In this way, the random notse power estimation unit 655 can
adaptively calculate the power spectrum Wm(i, k) for calculating the filter coefficient
w(i, k) in accordance with the relation between the target sound such as a voice and
the random noise such as a wind sound.
5 [0184]
10
Then, the random noise power estimation unit 655 may output the power
spectrum Wm(i, k) calculated on the basis of the foregoing (Expression 17) to the
filter estimation unit 66.
[0185]
The details of the process of deciding the power spectrum Wm(i, k) of each
sound collection unit 110 for each frequency used for the random noise power
estimation unit 655 to calculate the filter coefficient w(i, k) has been described above.
Also, the above-described example is merely an example. The content is not
particularly limited as long as the power spectrum Wm(i, k) can be decided on the
15 basis of the estimation result of at least one of the power spectrum P m(i, k) and the
power spectrum Qm(i, k).
[0186]
<2.5. Evaluation>
As described above, the information processing device 60 according to the
20 embodiment estimates the power spectrum Qm(i, k) of the uncorrelated component
on the basis of the sound collection results of at least two sound collection units 110
among the plurality of sound collection units 110 and the feedback of the output
signal Y(i, k) of the titter processing unit 17. Then, the information processing
device 60 uses the estimation result of the power spectrum Qm(i, k) of the
25 uncorrelated component in the estimation of the filter coefficient w(i, k). In this
configuration, the information processing device 60 can maintain the effect of
suppressing noise such as a wind sound occurring at random as in the abovedescribed
first embodiment and can further acquire a target sound in the more
suitable aspect in a case in which an influence of noise occurring at random is small.
30 [0187]
Also, the signal processing according to the embodiment has been described
SP364646W001
54/82
above focusing on, for example, the case of the application to the so-called neckband
type wearable device illustrated in FIG. I. On the other hand, an application
destination of the signal processing according to the embodiment is not necessarily
limited to only the example illustrated in FIG. I. Specifically, the signal processing
5 according to the embodiment can be applied as long as a device includes a plurality
of sound collection units. Also, more preferably, the plurality of sound collection
units may be disposed so that distances from a sound source (for example, a mouth
speaking a voice) of a target sound are different. In addition, more preferably, the
plurality of sound collection units may be disposed to be located in mutually
10 different directions with respect to the sound source of the target sound.
[OI88]
<<3. Third embodiment>>
<3.1. Overview>
Next, an example of a case in which the technology according to the present
15 disclosure is applied to a so-called multichannel Wiener filter will be described
according to a third embodiment of the present disclosure.
[0189]
First, an overview of the multichannel Wiener filter will be described to
further facilitate features of the information processing device according to the
20 embodiment. The multichannel Wiener filter is a technology used to suppress
background noise. For example, in a case in which Wmwr is the multichannel
Wiener filter, Wmwr is calculated on a basis of a calculation expression indicated
below as (Expression 18).
[0 190]
25 [Math. 17]
(Expression 18)
[0 191]
SP364646W001
55/82
In the foregoing (Expression 18), S indicates a target sound such as a voice
and is equivalent to Socg expressed in the above-described (Expression 9). In
addition, X indicates an acoustic sound (that is, an input signal) collected by the
sound collection unit and is equivalent to X expressed in the above-described
5 (Expression 9). In addition, W schematically indicates a filter to be applied to the
input signal X in the multichannel Wiener filter. That is, ideally, the multichannel
Wiener filter restores an original signal on a basis of a filter that minimizes a cost
function expressed in the foregoing (Expression 18).
[0192]
10 However, in general, it is difficult to independently measure the target sound
S. Therefore, the measurement is substituted with a minimization problem for
trading off signal deterioration against a suppression amount of noise using some of a
plurality of channels (that is, the sound collection units) as references. In this case,
for example, the multichannel Wiener filter Wmwf is expressed in a calculation
15 expression indicated below as (Expression 19).
[0 193]
[Math. 18]
wmwf = arg;ninE[Ixi- WH Xl2
+ JLWHN
2
]
= (Rx + JLRn t Rxei
(Expression 19)
20 [0194]
In the foregoing (Expression 19), X; indicates an output signal based on a
sound collection result by a channel used as a reference. Also, in the following
description, the channel used as the reference is referred to as a "reference
microphone." In addition, N indicates background noise and is equivalent to N
25 expressed in the above-described (Expression 9). In addition, a coefficient f-l is a
coefficient (weight) set in accordance with a suppression amount of noise with
SP36464GW001
56/82
respect to a target sound and, for example, is set in advance on a basis of a result of a
previous experiment or the like. In addition, R, and Rn in the foregoing (Expression
I 9) are expressed in calculation expressions indicated below as (Expression 20) and
(Expression 2 I). In addition, in (Expression 19), the reference microphone is
5 specified bye;. Here, e; is an M-arder vector that takes I for only an i-th value and
takes 0 for other values and, for example, is expressed as in the following
(Expression 22).
[0 195]
[Math. 19]
10
(Expression 20)
(Expression 21)
e - [o ... 1 ... of i - ' ' '
15 (Expression 22)
[0196]
Also, in the foregoing (Expression 20), X indicates an input signal based on
a sound collection result by each of the plurality of channels as a vector. That is, R,
is calculated from the input signal X. In addition, in (Expression 21 ), N indicates
20 an input signal (that is, a signal equivalent to noise) based on a sound collection
result by each of the plurality of channels in a section in which a target sound is not
collected (hereinafter also referred to as a "pause section") as a vector. Therefore,
for example, Rn is calculated in a pause section specified on a basis of a detection
result of a section in which a target sound is collected (hereinafter also referred to as
25 a "target sound section"). Also, hereinafter, Rx is also referred to as an "input
SP364646W001
57/82
correlated matrix" and Rn is also referred to as a "noise correlated matrix."
[0 197)
Here, as described above in the other embodiments, random noise such as a
wind sound, noise accompanied by vibration, and a rustle accompanied due to
5 wearing of a device is collected by the sound collection unit in some cases in a
situation in which a surrounding environment such as a case in which the device is
used outdoors dynamically changes. On the other hand, in a case in which the
random noise is mixed in the sound collection unit (that is, the reference
microphone) fixedly decided by e; in (Expression 19), it is difficult to suppress the
10 random noise in a multichannel Wiener filter of the related art.
[0 198]
Accordingly, in the embodiment, an example of a structure further reducing
an influence of random noise in the multichannel Wiener filter by applying the
above-described technology to the multichannel Wiener filter in the other
15 embodiments will be proposed.
[0 199]
Specifically, in the information processing device according to the
embodiment, the influence of the random noise is further reduced by adaptively
selecting the sound collection unit in which the influence of the random noise is less
20 as the reference microphone on the basis of the estimation result of the abovedescribed
power spectrum Pm (or the power spectrum Wm). For example, a
calculation expression indicated below as (Expression 23) indicates a basic principle
related to derivation of the multichannel Wiener filter Wmwf in the information
processing device according to the embodiment.
25 [0200)
[Math. 20]
(Expression 23)
[020 I]
SP 364646W 001
58/82
As understood in comparison between the foregoing (Expression 23) and
the above-described (Expression 19), the output signal Y based on the estimation
result of the power spectrum Pm (or the power spectrum Wm) described above in the
other embodiments is applied as an output signal X; based on a sound collection
5 result by the reference microphone in the information processing device according to
the embodiment. On the basis of the configuration, the information processing
device according to the embodiment dynamically select the sound collection unit in
which the influence of the random noise is less as the reference microphone even in a
situation in which the influence of the random noise is more apparent (that is, a
10 situation in which the surrounding environment dynamically changes). Thus, the
information processing device according to the embodiment can further reduce the
influence of the random noise and extract a target sound in the more suitable aspect
than a device to which a multichannel Wiener filter of the related a11 is applied.
Also, hereinafter, the information processing device according to the embodiment
15 will be further described in detail.
[0202]
<3.2. Functional configuration>
An example of a functional configuration of the information processing
device according to the embodiment will be described with reference to FIG. 24.
20 FIG. 24 is a block diagram illustrating an example of the functional configuration of
the information processing device according to the embodiment. Also, in the
description, the information processing device according to the embodiment is
referred to as an "information processing device 70" in some cases to explicitly
distinguish the information processing device from the information processing
25 devices (for example, the information processing devices I 0 and 60) according to the
above-described other embodiments.
[0203]
As illustrated in FIG. 24, the information processing device 70 according to
the embodiment includes a plurality of sound collection units 111 to 11M (where M
30 is a positive integer), a frequency decomposition unit 13, a channel power estimation
unit 71, a filter estimation unit 72, an input correlated matrix calculation unit 73, a
SP3G464GWOOJ
59/82
noise correlated matrix calculation unit 74, a multichannel Wiener filter calculation
unit 75, a multichannel Wiener filter processing unit 76, and a frequency
combination unit 77. Also, the plurality of sound collection units Ill to 11M
(where M is a positive integer) and the frequency decomposition unit 13 are
5 equivalent to the configurations to which the same reference numerals are affixed in
the information processing device I 0 (see FIG. 6) according to the above-described
first embodiment That is, the information processing device 70 according to the
embodiment is different from the information processing device 10 according to the
above-described first embodiment in the processing content of the channel power
10 estimation unit 71, the filter estimation unit 72, the input correlated matrix
calculation unit 73, the noise correlated matrix calculation unit 74, the multichannel
Wiener filter calculation unit 75, the multichannel Wiener filter processing unit 76,
and the frequency combination unit 77. Accordingly, the functional configuration
of the infotmation processing device 70 according to the embodiment will be
15 described below particularly focusing on differences from the information processing
device 10 according to the above-described first embodiment. The detailed
description of the same configuration as that of the information processing device 10
will be omitted.
[0204]
20 (Multichannel Wiener filter processing unit 76)
The multichannel Wiener filter processing unit 76 acquires each frequency
component Xm(i, k) of the acoustic signal Xm(n) of each sound collection unit 110
from the frequency decomposition unit 13. In addition, the multichannel Wiener
filter processing unit 76 acquires the calculation result of the multichannel Wiener
25 filter WmwJ(i, k) for each frequency from the multichannel Wiener filter calculation
unit 75 to be described below. Also, the details of a method of calculating the
multichannel Wiener filter Wnm1(i, k) will be described separately below. Also, the
multichannel Wiener filter processing unit 76 uses each frequency component Xm(i,
k) of the acoustic signal x,(n) of each sound collection unit 110 as an input signal
30 and generates the output signal S for each frequency by executing a filtering process
based on the multichannel Wiener filter WmwJ(i, k). For example, the output signal
SP364616W001
60/82
Sis expressed in a calculation expression indicated below as (Expression 24). Also,
in the following (Expression 24), the frame number i and the discrete frequency
number k are not written.
[0205]
5 [Math. 21]
H
S=Wmwf X
(Expression 24)
[0206]
Then, the multichannel Wiener filter processing unit 76 outputs the output
10 signalS generated for each frequency to the frequency combination unit 77.
[0207]
(Frequency combination unit 77)
The frequency combination unit 77 acquires the output signal S generated
for each frequency from the multichannel Wiener filter processing unit 76. The
15 frequency combination unit 77 generates an acoustic signal by combining the
acquired output signal S for each frequency. Also, since the process by the
frequency combination unit 77 is the same as the process of generating the acoustic
signal y(n) by combining the output signal Y(i, k) for each frequency in the
frequency combination unit 18 according to the above-described first and second
20 embodiments, the detailed description thereof will be omitted.
[0208]
(Channel power estimation unit 71 and filter estimation unit 72)
Next, a configuration of the channel power estimation unit 71 and the filter
estimation unit 72 will be described. The channel power estimation unit 71 and the
25 filter estimation unit 72 may have the configuration by applying the same structure as
that of the information processing device I 0 according to the above-described first
embodiment or may have the configuration by applying the same structure as that of
the information processing device 60 according to the second embodiment.
Accordingly, the configuration will be described below focusing each case.
SP364646W001
61/82
[0209)
(Configuration Example I of channel power estimation unit 71 and the filter
estimation unit 72)
First, a case of the configuration of the channel power estimation unit 71
5 and the filter estimation unit 72 will be described applying the same structure as that
of the first information processing device I 0 (see FIG. 6) according to the abovedescribed
first embodiment. In this case, the channel power estimation unit 71 and
the filter estimation unit 72 are equivalent to the channel power estimation unit 15
and the filter estimation unit 16 according to the first embodiment.
10 [0210)
Specifically, the channel power estimation unit 71 estimates the power
spectrum P m(i, k) of each sound collection unit II 0 for each frequency on the basis
of each frequency component Xm(i, k) of the acoustic signal Xm(n) corresponding to
each of the sound collection unit 110.
15 [0211)
In addition, the filter estimation unit 72 calculates the filter coefficient w(i,
k) on the basis of the estimation result of the power spectrum Pm(i, k). Then, the
filter estimation unit 72 calculates a filter G for each frequency on a basis of a
calculation result of the filter coefficient w(i, k) and outputs a calculation result of
20 the filter G to the multichannel Wiener filter calculation unit 75 to be described
below.
25
[0212)
(Configuration example 2 of channel power estimation unit 71 and the filter
estimation unit 72)
Next, a case of the configuration of the channel power estimation unit 71
and the filter estimation unit 72 will be described applying the same structure as that
of the first information processing device 60 (see FIG. 22) according to the abovedescribed
second embodiment. In this case, the channel power estimation unit 71
and the filter estimation unit 72 are equivalent to the channel power estimation unit
30 65 and the filter estimation unit 66 according to the second embodiment.
[0213)
SP364646W001
62/82
Specifically, the channel power estimation unit 71 estimates the power
spectrum Pm(i, k) of each sound collection unit 110 for each frequency on the basis
of each frequency component Xm(i, k) of the acoustic signal Xm(n) corresponding to
each of the sound collection unit 110.
5 [0214]
10
In addition, the channel power estimation unit 71 receives a feedback of the
acoustic signal for each fi·equency in which the influence of noise (particularly,
random noise) is suppressed on the basis of the filtering process.
[0215]
As a specific example, the filter estimation unit 72 may receive a teedback
of the acoustic signalS for each frequency output as a result of the filtering process
by the multichannel Wiener filter processing unit 76.
[0216]
In addition, as another example, by separately installing a configuration
15 equivalent to the filter processing unit 17 in the information processing device 60
according to the second embodiment, the filter estimation unit 72 may receive the
feedback of the acoustic signal for each frequency in which the noise component is
suppressed from the configuration. In this case, the filter estimation unit 72
receives the feedback of the acoustic signal equivalent to the output signal Y(i, k) in
20 the information processing device 60 according to the second embodiment.
[021 7]
When the feedback is received, the channel power estimation unit 71
estimates the power spectrum Qm(i, k) of the acoustic signal and the uncorrelated
component on the basis of correlation between the fed-back acoustic signal and the
25 frequency component Xm(i, k) of the acoustic signal Xm(n) corresponding to each
sound collection unit 110.
[0218]
Then, the channel power estimation unit 71 may decide the power spectrum
Wm(i, k) of each sound collection unit 110 for each frequency used for the filter
30 estimation unit 72 to calculate the filter coefficient w(i, k) on the basis of the
estimation results of the power spectrum Pm(i, k) and the power spectrum Qm(i, k).
SP364646W001
63/82
Also, since the method of calculating the power spectrum Pm(i, k) and the power
spectrum Om(i, k) or the method of deciding the power spectrum Wm(i, k) are the
same as those of the channel power estimation unit 65 according to the abovedescribed
second embodiment, the detailed description thereof will be omitted.
5 (0219]
In addition, the filter estimation unit 72 calculates the filter coefficient w(i,
k) on the basis of the estimation result of the power spectrum Wm(i, k). Then, the
filter estimation unit 72 may calculate the filter G for each frequency on the basis of
the calculation result of the filter coefficient w(i, k) and output the calculation result
10 of the filter G to the multichannel Wiener filter calculation unit 75 to be described
below.
[0220]
Also, as described above, the filter G is calculated on the basis of the filter
coefficient w(i, k). Therefore, in view of the above-described (Expression 2) to
15 (Expression 6), for example, the filter G can be expressed in calculation expressions
indicated below as (Expression 25) and (Expression 26).
[0221]
[Math. 22]
G = rRw-Ia
20 (Expression 25)
(Expression 26)
(0222]
Also, in the foregoing (Expression 25) and (Expression 26), Rw is equivalent
25 to the matrix R(i, k) in the above-described (Expression 6). That is, in the case of
the basis of the same idea as that of the first embodiment, Rw is a matrix based on the
estimation result of the power spectrum Pm(i, k). In addition, in the case of the
5
SP364646W001
64/82
basis of the same idea as that of the first embodiment, Rw is a matrix based on the
power spectrum Wm(i, k) decided in accordance with the estimation results of the
power spectrum Pm(i, k) and the power spectrum Q,(i, k).
[0223]
Subsequently, the input correlated matrix calculation unit 73, the noise
correlated matrix calculation unit 74, and the multichannel Wiener filter calculation
unit 75 will be described.
[0224]
(Input correlated matrix calculation unit 73)
10 The input correlated matrix calculation unit 73 acqUires each frequency
component Xm(i, k) of the acoustic signal x,(n) of each sound collection unit 110
from the frequency decomposition unit 13. Subsequently, the input correlated
matrix calculation unit 73 calculates the input correlated matrix R, for each
frequency on the basis of the above-described (Expression 20) using each acquired
15 frequency component Xm(i, k) as an input Then, the input correlated matrix
calculation unit 73 outputs the input correlated matrix R, calculated for each
frequency to the multichannel Wiener filter calculation unit 75.
20
[0225]
(Noise correlated matrix calculation unit 74)
The noise correlated matrix calculation unit 74 acquires each frequency
component Xm(i, k) of the acoustic signal x,(n) of each sound collection unit II 0
from the frequency decomposition unit 13. Subsequently, the noise correlated
matrix calculation unit 74 specifies a pause section on the basis of the acquisition
result of each frequency component Xm(i, k) of the acoustic signal x,(n). Then, the
25 noise correlated matrix calculation unit 74 calculates the noise correlated matrix R,
for each ft·equency on the basis of the above-described (Expression 21) using each
frequency component X,(i, k) in the specified pause section as an input Then, the
noise correlated matrix calculation unit 74 outputs the noise correlated matrix R,
calculated for each frequency to the multichannel Wiener filter calculation unit 75.
30 [0226]
(Multichannel Wiener filter calculation unit 75)
SP364646W001
65/82
The multichannel Wiener filter calculation unit 75 acquires the calculation
result of the filter G based on the filter coefficient w(i, k) for each frequency from the
filter estimation unit 72. In addition, the multichannel Wiener filter calculation unit
75 acquires the calculation result of the input correlated matrix R, for each frequency
5 from the input correlated matrix calculation unit 73. In addition, the multichannel
Wiener filter calculation unit 75 acquires the calculation result of the noise correlated
matrix Rn for each frequency from the noise correlated matrix calculation unit 74.
Subsequently, the multichannel Wiener filter calculation unit 75 calculates the
multichannel Wiener filter W mw1(i, k) for each frequency on the basis of the filter G,
10 the input correlated matrix Rx. and the noise correlated matrix Rn acquired for each
frequency. Then, the multichannel Wiener filter calculation unit 75 outputs the
calculation result of the multichannel Wiener filter W mw1(i, k) to the multichannel
Wiener filter processing unit 76. Thus, the multichannel Wiener filter processing
unit 76 can execute the filtering process on each frequency component Xm(i, k) of the
15 acoustic signal Xm(n) of each sound collection unit 110 on the basis of the .
multichannel Wiener filter Wmwt(i, k). Also, the more detailed content of the
method of calculating the multichannel Wiener filter W mwt(i, k) will be described
separately below.
20
[0227]
The example of the functional configuration of the information processing
device according to the embodiment has been described above with reference to FIG.
24. Also, for example, the multichannel Wiener filter calculation unit 75 and the
multichannel Wiener filter processing unit 76 in the configuration of the abovedescribed
information processing device 70 are equivalent to an example of an
25 "output control unit."
[0228]
<3.3. Details of method of calculating multichannel Wiener filter>
Next, a method of calculating the multichannel Wiener filter W mwt(i, k) will
be described in more detail. Also, in the description, the description of the frame
30 number i and the discrete number k will be omitted.
[0229]
SP364646WOOJ
66/82
First, the above-described (Expression 23) will be focused on. As
described above, the filter G is calculated on the basis of the filter coefficient w(i, k).
Therefore, the output signal Y expressed in (Expression 23) can be expressed in a
calculation expression indicated below as (Expression 27) in accordance with the
5 input signal X and the filter G based on the filter coefficient w(i, k) in view of the
above-described (Expression 7).
[0230]
[Math. 23]
10 (Expression 27)
[0231]
That is, the above-described (Expression 23) can be expressed in a
calculation~ expression indicated below as (Expression 28) in accordance with the
output signal Y, the filter G, the input correlated matrix Rx, and the noise correlated
15 matrix Rn expressed in the foregoing (Expression 27).
[0232]
[Math. 24]
Wmwf = (Rx + Jll?.n t1 E[XYH]
= (Rx + JLRJ-1E[XXHG]
= (Rx + Jll?.n t RxG
(Expression 28)
20 [0233]
Here, as understood in comparison between the foregoing (Expression 28)
and the above-described (Expression 19), the foregoing (Expression 28) can be
known to be equivalent to a calculation expression in which the matrix e; specifying
SP36464GW001
67/82
the reference microphone is substituted with the filter G in the above-described
(Expression 19). ln addition, the filter G can also be expressed in a calculation
expression indicated below as (Expression 29) in view of the above-described
(Expression 25) and (Expression 26).
5 (0234]
10
[Math. 25]
gl
G= 0
0
(Expression 29)
[0235]
0
0
0 al
0 = (glal '· · ·,giai, · · · gMaM Y
gM aM
Here, in the foregoing (Expression 29), coefficients g1, ... , g;, ... , gM are
coefficients decided on the basis of the matrix Rw in (Expression 25) and (Expression
26). More specifically, the coefficients g,, ... , g;, ... , gM are decided on the basis of,
for example, the estimation result of the power spectrum Pm(i, k) in the abovedescribed
first embodiment or the estimation result of the power spectrum Wm(i, k)
15 in the second embodiment. That is, the coefficients g1, ... , g;, ... , gM indicate
weights in accordance with magnitude of the influence of the random noise in each
sound collection unit 110 and, in other words, indicate how much the sound
collection result of each sound collection unit 110 is reliable as the sound collection
result of a target sound.
20 [0236]
That is, in the information processing device 70 according to the
embodiment, the coefficients g 1, ... , g;, ... , gM change in accordance with the sound
collection result of the acoustic sound (particularly, random noise) by each sound
collection unit 110 and, for example, the sound collection unit 110 in which the
25 influence of the random noise is less is dynamically selected as the reference
SP364G46W001
68/82
microphone in accordance with the coefficients.
[0237]
<3.4. Evaluation>
As described above, the information processing device 70 according to the
5 embodiment estimates the power spectrum (for example, the above-described power
spectrum Pm(i, k) or power spectrum Wm(i, k)) of each sound collection unit II 0 for
each frequency on the basis of each frequency component Xm(i, k) of the acoustic
signal Xm(n) corresponding to each sound collection unit II 0. Then, the
information processing device 70 estimates the filter coefficient w(i, k) on the basis
10 of the estimation result of the power spectrum and uses the estimation result of the
filter coefficient w(i, k) to calculate the multichannel Wiener filter Wm"1(i, k). In
this configuration, the information processing device 70 according to the
embodiment can dynamically select the sound collection unit II 0 in which the
influence of the random noise is less as the reference microphone among the plurality
15 of sound collection units 110. That is, the information processing device 70
according to the embodiment can further reduce the influence of the random noise
and further extract the target sound in the more suitable aspect than the case in which
the multichannel Wiener filter of the related art in which the reference microphone is
fixedly set is applied.
20 [0238]
Also, an application destination of the signal processing according to the
embodiment is not necessarily limited to only the example of the so-called neckband
type wearable device illustrated in FIG. I. Specifically, the signal processing
according to the embodiment can be applied as long as a device includes a plurality
25 of sound collection units. Also, more preferably, the plurality of sound collection
units may be disposed so that distances from a sound source (for example, a mouth
speaking a voice) of a target sound are different from each other. In addition, more
preferably, the plurality of sound collection units may be disposed to be located in
mutually different directions with respect to the sound source of the target sound.
30 [0239]
<<4. Hardware configuration>>
SP364616W001
69/82
Next, an example of a hardware configuration of the information processing
device I 0 (that is, the above-described signal processing devices I I to 14) according
to each embodiment of the present disclosure will be described with reference to FIG.
25. FIG. 25 is a diagram illustrating an example of a hardware configuration of the
5 information processing device I 0 according to the embodiment of the present
disclosure.
[0240]
As illustrated in FIG. 25, the information processing device I 0 according to
the embodiment includes a processor 90 I, a memory 903, a storage 905, a
10 manipulation device 907, a report device 909, an acoustic device 911, a sound
collection device 913, and a bus 917. In addition, the information processing
device I 0 may include a communication device 915.
[0241]
The processor 90 I may be, for example, a central processing unit (CPU), a
15 graphics processing unit (GPU), a digital signal processor (DSP), or a system on chip
(SoC) and executes various processes of the information processing device I 0. The
processor 90 I can include, for example, an electronic circuit that executes various
arithmetic processes. Also, the frequency decomposition unit 13, the channel
power estimation unit 15, the filter estimation unit 16, the filter processing unit 17,
20 and the frequency combination unit 18 described above can be realized by the
processor 90 I.
[0242]
The memory 903 includes a random access memory (RAM) and a read-only
memory (ROM) and stores data and a program executed by the processor 90 I. The
25 storage 905 can include a storage medium such as a semiconductor memory or a hard
disk.
[0243]
The manipulation device 907 has a function of generating an input signal so
that a user executes a desired manipulation. The manipulation device 907 can
30 include, for example, a touch panel. In addition, as another example, the
manipulation device 907 may include, for example, an input unit such as a button, a
SP36464GW001
70/82
switch, or a keyboard used by the user to input information and an input control
circuit that generate an input signal on a basis of an input by the user and supplies the
input signal to the processor 901.
[0244]
5 The report device 909 is an example of an output device and may be, for
10
example, a device such as a liquid crystal display (LCD) device or an organic light
emitting diode (OLEO) display. In this case, the report device 909 can report
predetermined information to the user by displaying the information on a screen.
[0245]
Also, the example of the rep01t device 909 described above is merely an
example. The aspect of the report device 909 is not particularly limited as long as
predetennined infonnation can be reported to a user. As a specific example, the
report device 909 may be a device that repo1ts predetermined information to a user
by a blinking pattern as in a light emitting diode (LED). In addition, the rep01t
15 device 909 may also be a device that reports predetennined infonnation to a user by
executing vibration as in a so-called vibrator.
[0246]
The acoustic device 911 is a device that reports predetermined information
to a user by outputting a predetermined acoustic signal as in a speaker or the like.
20 [0247]
The sound collection device 913 is a device that collects a voice spoken
from a user or an acoustic sound of a smTounding environment and acquires the
sound or the acoustic sound as acoustic information (acoustic signal) as in a
microphone. In addition, the sound collection device 913 may acquire data
25 indicating an analog acoustic signal indicating the collected voice or acoustic sound
as acoustic information or may convert the analog acoustic signal into a digital
acoustic signal and acquire data indicating the converted digital acoustic signal as
acoustic information. Also, the above-described sound collection units II 0 (for
example, the sound collection units Ill to II M illustrated in FIG. 6) can be realized
30 by the sound collection device 913.
[0248]
SP364646W001
71/82
The communication device 915 is communication means included in the
information processing device I 0 and communicates with an external device via a
network. The communication device 915 is a wired or wireless communication
interface. In a case in which the communication device 915 is a wireless
5 communication interface, the communication device 915 may include a
communication antenna, a radio frequency (RF) circuit, and a baseband processor.
[0249]
The communication device 915 has a function of executing various kinds of
signal processing on a signal received from an external device and can supply a
10 digital signal generated from a received analog signal to the processor 901.
[0250]
The bus 917 connects the processor 901, the mem01y 903, the storage 905,
the manipulation device 907, the report device 909, the acoustic device 911, the
sound collection device 913, and the communication device 915. The bus 917 may
15 include a plurality of types ofbuses.
(0251]
In addition, a program that causes hardware such as a processor, a memory,
and a storage contained in a computer to exert the same functions as the
configuration of the foregoing information processing device 10 can also be
20 generated. In addition, a computer-readable storage medium recording the program
can also be provided.
[0252]
<<5. Conclusion>>
As described above, the information processing device I 0 according to the
25 embodiments has the projection pmiion with the streamline shape in at least a pmi.
The sound collection unit 110 is held so that the sound collection unit is located at
the front end or near the front end of the projection portion. In this configuration,
for example, it is possible to alleviate an influence of noise occurring at random,
such as a wind sound, noise accompanied by vibration, and a rustle accompanied due
30 to wearing of the device, and collect the target sound (for example, a voice of the
user) in the more suitable aspect.
SP364646W001
72/82
[0253]
In addition, the information processing device I 0 according to the
embodiment may include the plurality of sound collection units II 0. The plurality
of sound collection units II 0 may be held so that the sound collection units II 0 face
5 in mutually different directions. In this configuration, even in a situation in which
noise such as a wind sound, noise accompanied by vibration, and a rustle
accompanied due to wearing of the device occurs at random, it is possible to
compensate for the characteristics of the other sound collection units on the basis of
the sound collection results of some of the sound collection units (that is, the sound
10 collection units for which the influence of the noise is small).
[0254]
The preferred embodiment(s) of the present disclosure has/have been
described above with reference to the accompanying drawings, whilst the present
disclosure is not limited to the above examples. A person skilled in the art may find
15 various alterations and modifications within the scope of the appended claims, and it
should be understood that they will naturally come under the technical scope of the
present disclosure.
[0255]
Fwther, the effects described in this specification are merely illustrative or
20 exemplified effects, and are not limitative. That is, with or in the place of the above
effects, the technology according to the present disclosure may achieve other effects
that are clear to those skilled in the art from the description of this specification.
[0256]
25 (I)
Additionally, the present technology may also be configured as below.
An information processing device including:
a sound collection unit; and
a holding member configured to have a projection portion with a streamline
shape in at least a part and hold the sound collection unit so that the sound collection
30 unit is located at a front end or near the ti·ont end of the projection portion.
(2)
SP36461GW001
73/82
The information processing device according to (I), further including:
one or more second sound collection units configured to be different from a
first sound collection unit which is the sound collection unit in addition to the first
sound collection unit.
5 (3)
The information processing device according to (2), in which
the holding member holds the plurality of second sound collection units so
that the plurality of second sound collection units face in mutually different
directions.
10 (4)
The information processing device according to (I), in which
the holding member is worn on a predetennined part of a user and holds the
sound collection unit so that the sound collection unit and the part have a
predetermined positional relation.
15 (5)
The information processing device according to (4), in which
the part is a neck, and
in a case in which the holding member is worn on the neck, the projection
portion is installed so that the front end of the projection pmtion faces in a
20 substantially front side of the user.
(6)
The information processing device according to (4) or (5), including:
a plurality of second sound collection units configured to be different from a
first sound collection unit which is the sound collection unit in addition to the first
25 sound collection unit,
30
in which at least two second sound collection units of the plurality of second
sound collection units are held at mutually substantially symmetric positions setting
the part as a reference.
(7)
The information processing device according to (2), including:
a signal processing unit configured to suppress a noise component in regard
5
SPil64646W001
74/82
to an acoustic sound arriving lo the tirst sound collection unit in a predetermined
direction on a basis of an acoustic sound collected from each of the first sound
collection unit and the one or more second sound collection units.
(8)
The information processing device according to (7), in which
the signal processing unit estimates a signal level of each frequency
component of an acoustic on the basis of the acoustic sound collected from each of
the first sound collection unit and the one or more second sound collection units and
suppresses the noise component on a basis of an estimation result of the signal level.
10 (9)
The information processing device according to (7), in which
on a basis of correlation between a first acoustic sound collected from at
least each of a plurality of sound collection units among the first sound collection
unit and the one or more second sound collection units and a second acoustic sound
15 of which the noise component is suppressed through a previous process, the signal
processing unit suppresses the noise component included in the first acoustic sound.
(I 0)
The information processing device according to (9), in which
the holding member holds the plurality of sound collection units so that
20 distances between a predetermined sound source and at least two sound collection
units of the plurality of sound collection units are different from each other.
(II)
The information processing device according to (9) or (I 0), in which
the holding member holds the plurality of sound collection units so that each
25 of at least two sound collection units of the plurality of sound collection units are
located in mutually different directions with respect to a predetermined sound source.
(12)
The information processing device according to (2), including:
an output control unit configured to selectively output acoustic sounds
30 collected by some of sound collection units among the first sound collection unit and
the one or more second sound collection units,
SP364G46W001
75/82
in which the output control unit estimates a signal level of each frequency
component of an acoustic sound on a basis of the acoustic sound collected from each
of the first sound collection unit and the one or more second sound collection units
and selects the some of the sound collection units on a basis of an estimation result of
5 the signal level.
(13)
The information processing device according to ( 12), in which
the output control unit includes a multichannel Wiener filter and selects a
reference microphone of the multichannel Wiener filter on the basis of the estimation
10 result of the signal level.
(14)
The information processing device according to (1 ), in which
the holding member is a casing that has a substantially rectangular surface
in at least a part, and
15 the casing has the projection portion in a predetermined region including a
20
corner of the substantially rectangular surface and holds the sound collection unit at a
front end or near the front end of the projection portion.
(15)
The information processing device according to (14), in which
the information processing device includes a plurality of the sound
collection units, and
the casing has, for each of a plurality of corners among corners of the
substantially rectangular surface, the projection portion in a predetermined regiOn
including the corner, and holds the sound collection units at a front end or near the
25 front end of the projection potiion.
(16)
The information processing device according to (14) or (15), including:
a band portion configured to hold the casing in regard to an arm of a user,
in which, in a case in which the information processing device is worn on
30 the ann, the band portion includes another sound collection unit different from the
sound collection units at a position substantially symmetric to the casing setting the
5
SP36464GW001
76/82
arm as a reference.
(17)
The information processing device according to (I), in which
the holding member is a glasses type frame worn on a head of a user, and
the frame has the projection portion in at least a part of a front and holds the
sound collection unit at a front end or near the front end of the projection portion.
( 18)
The information processing device according to (17), in which
the frame has the projection portion in a bridge or near the bridge and holds
10 the sound collection unit at a front end or near the fi·ont end of the projection portion.
Reference Signs List
[0257]
I 0 information processing device
15 13 frequency decomposition unit
15 channel power estimation unit
16 filter estimation unit
17 filter processing unit
18 frequency combination unit
20 ll 0 to 113 sound collection unit
60 information processing device
65 channel power estimation unit
651 input power estimation unit
653 uncorrelated component power estimation unit
25 655 random noise power estimation unit
66 filter estimation unit
5
10
Claim I
77/82
CLAIMS
An information processing device comprising:
a sound collection unit; and
SP364646W001
a holding member configured to have a projection portion with a streamline
shape in at least a part and hold the sound collection unit so that the sound collection
unit is located at a front end or near the front end of the projection portion.
Claim2
The information processing device according to claim 1, further comprising:
one or more second sound collection units configured to be different from a
first sound collection unit which is the sound collection unit in addition to the first
sound collection unit.
15 Claim 3
20
The information processing device according to claim 2, wherein
the holding member holds the plurality of second sound collection units so
that the plurality of second sound collection units face in mutually different
directions.
Claim4
The information processing device according to claim 1, wherein
the holding member is worn on a predetermined part of a user and holds the
sound collection unit so that the sound collection unit and the part have a
25 predetermined positional relation.