Sign In to Follow Application
View All Documents & Correspondence

Encoding Device And Method , Decoding Device And Method

Abstract: The present invention relates to an encoding device and method a decoding device and method and a program with which a music signal can be reproduced with higher sound quality by expanding the frequency band. A bandpass filter divides an input signal into a plurality of sub band signals. A feature quantity calculation circuit calculates feature quantities using the plurality of sub band signals obtained by said division and/or the input signal. A high range sub band power inferring circuit calculates an inferred value for the high range sub band power by using the calculated feature quantities. A high range signal generating circuit generates a high range signal component by using the plurality of sub band signals obtained by the division performed by the bandpass filter and the inferred value for the high range sub band power calculated by the high range sub band power inferring circuit. A frequency band expansion device expands the frequency band of the input signal by using the high range signal component generated by the high range signal generating circuit. The present invention can be applied for example to a frequency band expansion device an encoding device and a decoding device and the like.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
08 April 2013
Publication Number
15/2016
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
remfry-sagar@remfry.com
Parent Application
Patent Number
Legal Status
Grant Date
2021-07-20
Renewal Date

Applicants

SONY CORPORATION
1 7 1 Konan Minato ku Tokyo 1080075

Inventors

1. YAMAMOTO Yuki
c/o SONY CORPORATION 1 7 1 Konan Minato ku Tokyo 1080075
2. CHINEN Toru
c/o SONY CORPORATION 1 7 1 Konan Minato ku Tokyo 1080075

Specification

DESCRIPTION Title of Invention: ENCODING DEVICE AND METHOD, DECODING DEVICE AND METHOD, AND PROGRAM Technical Field [0001] The present invention relates to an encoding device and method, a decoding device and method, and a program, and specifically relates to an encoding device and method, a decoding device and method, and a program which enable music signals to be played with high sound quality by expanding a frequency band. Background Art [0002] In recent years, music distribution service to distribute music data via the Internet or the like has been spreading. With this music distribution service, encoded data obtained by encoding music signals is distributed as music data. As a music signal encoding technique, an encoding technique has become the mainstream wherein a bit rate is lowered while suppressing file capacity of encoded data so as not to take time at the time of downloading. [0003] Such a music signal encoding techniques, are roughly - 2 - SP313141 divided into an encoding technique such as MP3 (MPEG (Moving Picture Experts Group) Audio Layer 3) (International Standards ISO/IEC 11172-3) and so forth, and an encoding technique such as HE-AAC (High Efficiency MPEG4 AAC) (International Standards ISO/IEC 14496-3) and so forth. [0004] With the encoding technique represented by MP3, of music signals, signal components in a high-frequency band (hereinafter, referred to as high-frequency) equal to or greater than around 15 kHz of hardly sensed by the human ear, are deleted, and signal components in the remaining lowfrequency band (hereinafter, referred to as low-frequency) are encoded. Such an encoding technique will be referred to as high-frequency deletion encoding technique. With this high-frequency deletion encoding technique, file capacity of encoded data may be suppressed. However, high-frequency sound may slightly be sensed by the human ear, and accordingly, at the time of generating and outputting sound from music signals after decoding obtained by decoding encoded data, there may be deterioration in sound quality such as loss of sense of presence that the original sound has, or the sound may seem to be muffled. [0005] On the other hand, with the encoding technique represented by HE-AAC, characteristic information is - 3 - SP313141 extracted from high-frequency signal components, and encoded along with low-frequency signal components. Herein after, such an encoding technique will be referred to as a highfrequency characteristic encoding technique. With this high-frequency characteristic encoding technique, only characteristic information of high-frequency signal components is encoded as information relating to the highfrequency signal components, and accordingly, encoding efficiency may be improved while suppressing deterioration in sound quality. [0006] With decoding of encoded data encoded by this highfrequency characteristic encoding technique, low-frequency signal components and characteristic information are decoded, and high-frequency signal components are generated from the low-frequency signal components and characteristic information after decoding. Thus, a technique to expand the frequency band of low-frequency signal components by generating high-frequency signal components from lowfrequency signal components will hereinafter be referred to as a band expanding technique. [0007] As one application of the band expanding technique, there is post-processing after decoding of encoded data by the above-mentioned high-frequency deletion encoding - 4 - SP313141 technique. With this post-processing, high-frequency signal components lost by encoding are generated from the lowfrequency signal components after decoding, thereby expanding the frequency band of the low-frequency signal components (see PTL 1). Note that the frequency band expanding technique according to PTL 1 will hereinafter be referred to as the band expanding technique according to PTL 1. [0008] With the band expanding technique according to PTL 1, a device takes low-frequency signal components after decoding as an input signal, estimates high-frequency power spectrum (hereinafter, referred to as high-frequency frequency envelopment as appropriate) from the power spectrum of the input signals, and generates high-frequency signal components having the high-frequency frequency envelopment from the low-frequency signal components. [0009] Fig. 1 illustrates an example of the low-frequency power spectrum after decoding, serving as the input signal, and the estimated high-frequency frequency envelopment. [0010] In Fig. 1, the vertical axis indicates power by a logarithm, and the horizontal axis indicates frequencies. [0011] - 5 - SP313141 The device determines the band of low-frequency end of high-frequency signal components (hereinafter, referred to as expanding start band) from information of the type of an encoding method relating to the input signal, sampling rate, bit rate, and so forth (hereinafter, referred to as side information). Next, the device divides the input signal serving as low-frequency signal components into multiple subband signals. The device obtains average for each group regarding a temporal direction of power (hereinafter, referred to as group power) of each of multiple subband signals following division, that is to say, the multiple subband signals on the lower frequency side than the expanding start band (hereinafter, simply referred to as low-frequency side). As illustrated in Fig. 1, the device takes a point with average of group power of each of the multiple subband signals on the low-frequency side as power, and also the frequency of the lower end of the expanding start band as the frequency, as the origin. The device performs estimation with a primary straight line having predetermined inclination passing through the origin thereof as frequency envelopment on higher frequency side than the expanding start band (hereinafter, simply referred to as high-frequency side). Note that a position regarding the power direction of the origin may be adjusted by a user. The device generates each of the multiple subband signals on - 6 - SP313141 the high-frequency side from the multiple subband signals on the low-frequency side so as to obtain the estimated frequency envelopment on the high-frequency side. The device adds the generated multiple subband signals on the high-frequency side to obtain high-frequency signal components, and further adds the low-frequency signal components thereto and output these. Thus, music signals after expanding the frequency band approximates to the original music signals. Accordingly, music signals with high sound quality may be played. [0012] The above-mentioned band expanding technique according to PTL 1 has a feature wherein, with regard to various highfrequency deletion encoding techniques and encoded data with various bit rates, the frequency band regarding music signals after decoding of the encoded data thereof can be expanded. Citation List Patent Literature [0013] PTL 1: Japanese Unexamined Patent Application Publication No. 2008-139844 Summary of Invention Technical Problem [0014] t3 - 7 - SP313141 However, with the band expanding technique according to PTL 1, there is room for improvement in that the estimated frequency envelopment on the high-frequency side becomes a primary straight line with predetermined inclination, i.e., in that the shape of the frequency envelopment is fixed. [0015] Specifically, the power spectrums of music signals have various shapes, there may be many cases to greatly deviate from the frequency envelopment on the high-frequency side estimated by the band expanding technique according to PTL 1, depending on the types of music signals. [0016] Fig. 2 illustrates an example of the original power spectrum of a music signal of attack nature (music signal with attack) accompanying temporal rapid change such as strongly hitting a drum once. [0017] Note that Fig. 2 also illustrates frequency envelopment on the high-frequency side estimated by the band expanding technique according to PTL 1 from signal components on the low-frequency side of a music signal with attack serving as an input signal. [0018] As illustrated in Fig. 2, the original power spectrum on the high-frequency side of the music signal with attack - 8 - SP313141 is generally flat. [0019] On the other hand, the estimated frequency envelopment on the high-frequency side has a predetermined negative inclination, and accordingly, even when adjusting the power at the origin approximate to the original power spectrum, as the frequency increases, difference with the original power spectrum increases. [0020] Thus, with the band expanding technique according to PTL 1, according to the estimated frequency envelopment on the high-frequency side, the original frequency envelopment on the high-frequency side cannot to be reproduced with high precision. As a result thereof, at the time of generating and outputting sound from a music signal after expanding the frequency band, clearness of sound has been lost as compared to the original sound on listenability. [0021] Also, with the above-mentioned high-frequency characteristic encoding technique such as HE-AAC or the like, though frequency envelopment on the high-frequency side is employed as characteristic information of high-frequency signal components to be encoded, it is demanded that the decoding side reproduces the frequency envelopment on the high-frequency side with high precision. - 9 - SP313141 [0022] The present invention has been made in the light of such situations, and enables music signals to be played with high sound quality by expanding the frequency band. Solution to Problem [0023] An encoding device according to a first aspect of the present invention includes: subband diving means configured to divide an input signal into multiple subbands, and to generate a low-frequency subband signal made up of multiple subbands on the low-frequency side, and a high-frequency subband signal made up of multiple subbands on the highfrequency side; feature amount calculating means configured to calculate feature amount that represents features of the input signal based on at least any one of the low-frequency subband signal and the input signal; smoothing means configured to subject the feature amount smoothing; pseudo high-frequency subband power calculating means configured to calculate pseudo high-frequency subband power that is an estimated value of power of the high-frequency subband signal based on the smoothed feature amount and a predetermined coefficient; selecting means configured to calculate high-frequency subband power that is power of the high-frequency subband signal from the high-frequency subband signal, and to compare the high-frequency subband - 10 - SP313141 power and the pseudo high-frequency subband power to select any of the multiple coefficients; high-frequency encoding means configured to encode coefficient information for obtaining the selected coefficient, and smoothing information relating to the smoothing to generate highfrequency encoded data; low-frequency encoding means configured to encode a low-frequency signal that is a lowfrequency signal of the input signal to generate lowfrequency encoded data; and multiplexing means configured to multiplex the low-frequency encoded data and the highfrequency encoded data to obtain an output code string. [0024] The smoothing means may subject the feature amount to smoothing by performing weighted averaging for the feature amount of a predetermined number of continuous frames of the input signal. [0025] The smoothing information may be information that indicates at least one of the number of the frames used for the weighted averaging, or weight used for the weighted averaging. [0026] The encoding device may include parameter determining means configured to determine at least one of one of the number of the frames used for the weighted averaging, or - 11 - SP313141 weight used for the weighted averaging based on the highfrequency subband signal. [0027] The coefficient may be generated by learning with the feature amount and the high-frequency subband power obtained from a broadband supervisory signal as an explanatory variable and an explained variable. [0028] The broadband supervisory signal may be a signal obtained by encoding a predetermined signal in accordance with an encoding method and encoding algorithm and decoding the encoded predetermined signal; with the coefficient being generated by the learning using the broadband supervisory signal for each of multiple different encoding methods and encoding algorithms. [0029] An encoding method or program according to the first aspect of the present invention includes the steps of: dividing an input signal into multiple subbands, and generating a low-frequency subband signal made up of multiple subbands on the low-frequency side, and a highfrequency subband signal made up of multiple subbands on the high-frequency side; calculating feature amount that represents features of the input signal based on at least any one of the low-frequency subband signal and the input - 12 - SP313141 signal; subjecting the feature amount smoothing; calculating pseudo high-frequency subband power that is an estimated value of power of the high-frequency subband signal based on the smoothed feature amount and a predetermined coefficient; calculating high-frequency subband power that is power of the high-frequency subband signal from the high-frequency subband signal, and comparing the high-frequency subband power and the pseudo high-frequency subband power to select any of the multiple coefficients; encoding coefficient information for obtaining the selected coefficient, and smoothing information relating to the smoothing to generate high-frequency encoded data; encoding a low-frequency signal that is a low-frequency signal of the input signal to generate low-frequency encoded data; and multiplexing the low-frequency encoded data and the high-frequency encoded data to obtain an output code string. [0030] With the first aspect of the present invention, an input signal is divided into multiple subbands, a lowfrequency subband signal made up of multiple subbands on the low-frequency side, and a high-frequency subband signal made up of multiple subbands on the high-frequency side are generated, feature amount that represents features of the input signal is calculated based on at least any one of the low-frequency subband signal and the input signal, the - 13 - SP313141 feature amount is subjected to smoothing, pseudo highfrequency subband power that is an estimated value of power of the high-frequency subband signal is calculated based on the smoothed feature amount and a predetermined coefficient, high-frequency subband power that is power of the highfrequency subband signal is calculated from the highfrequency subband signal, the high-frequency subband power and the pseudo high-frequency subband power are compared to select any of the multiple coefficients, coefficient information for obtaining the selected coefficient, and smoothing information relating to the smoothing to generate high-frequency encoded data are encoded, a low-frequency signal that is a low-frequency signal of the input signal is encoded to generate low-frequency encoded data, and the lowfrequency encoded data and the high-frequency encoded data are multiplexed to obtain an output code string. [0031] A decoding device according to a second aspect of the present invention includes: demultiplexing means configured to demultiplex input encoded data into low-frequency encoded data, coefficient information for obtaining a coefficient, and smoothing information relating to smoothing; lowfrequency decoding means configured to decode the lowfrequency encoded data to generate a low-frequency signal; subband dividing means configured to divide the low- 14 - SP313141 frequency signal into multiple subbands to generate a lowfrequency subband signal for each of the subbands; feature amount calculating means configured to calculate feature amount based on the low-frequency subband signals; smoothing means configured to subject the feature amount to smoothing based on the smoothing information; and generating means configured to generate a high-frequency signal based on the coefficient obtained from the coefficient information, the feature amount subjected to smoothing, and the low-frequency subband signals. [0032] The smoothing means may subject the feature amount to smoothing by performing weighted averaging on the feature amount of a predetermined number of continuous frames of the low-frequency signal. [0033] The smoothing information may be information indicating at least one of the number of frames used for the weighted averaging, or weight used for the weighted averaging. [0034] The generating means may include decoded high-frequency subband power calculating means configured to calculate decoded high-frequency subband power that is an estimated value of subband power making up the high-frequency signal based on the smoothed feature amount and the coefficient, - 15 - SP313141 and high-frequency signal generating means configured to generate the high-frequency signal based on the decoded high-frequency subband power and the low-frequency subband signal. [0035] The coefficient may be generated by learning with the feature amount obtained from a broadband supervisory signal, and power of the same subband as a subband making up the high-frequency signal of the broadband supervisory signal, as an explanatory variable and an explained variable. [0036] The broadband supervisory signal may be a signal obtained by encoding a predetermined signal in accordance with a predetermined encoding method and encoding algorithm and decoding the encoded predetermined signal; with the coefficient being generated by the learning using the broadband supervisory signal for each of multiple different encoding methods and encoding algorithms. [0037] A decoding method or program according to the second aspect of the present invention includes the steps of: demultiplexing input encoded data into low-frequency encoded data, coefficient information for obtaining a coefficient, and smoothing information relating to smoothing; decoding the low-frequency encoded data to generate a low-frequency - 16 - SP313141 signal; dividing the low-frequency signal into multiple subbands to generate a low-frequency subband signal for each of the subbands; calculating feature amount based on the low-frequency subband signals; subjecting the feature amount to smoothing based on the smoothing information; and generating a high-frequency signal based on the coefficient obtained from the coefficient information, the feature amount subjected to smoothing, and the low-frequency subband signals. [0038] With the second aspect of the present invention, input encoded data is demultiplexed into low-frequency encoded data, coefficient information for obtaining a coefficient, and smoothing information relating to smoothing, the lowfrequency encoded data is decoded to generate a lowfrequency signal, the low-frequency signal is divided into multiple subbands to generate a low-frequency subband signal for each of the subbands, feature amount is calculated based on the low-frequency subband signals, the feature amount is subjected to smoothing based on the smoothing information, and a high-frequency signal is generated based on the coefficient obtained from the coefficient information, the feature amount subjected to smoothing, and the low-frequency subband signals. Advantageous Effects of Invention - 17 - SP313141 [0039] According to the first aspect and second aspect of the present invention, music signals may be played with higher sound quality by expanding the frequency band. Brief Description of Drawings [0040] [Fig. 1] Fig. 1 is a diagram illustrating an example of low-frequency power spectrum after decoding serving as an input signal, and estimated high-frequency frequency envelopment. [Fig. 2] Fig. 2 is a diagram illustrating an example of the original power spectrum of a music signal with attack, accompanying temporal rapid change. [Fig. 3] Fig. 3 is a block diagram illustrating a functional configuration example of a frequency band expanding device according to a first embodiment of the present invention. [Fig. 4] Fig. 4 is a flowchart for describing frequency band expanding processing by the frequency band expanding device in Fig. 3. [Fig. 5] Fig. 5 is a diagram illustrating the power spectrum of a signal to be input to the frequency band expanding device in Fig. 3, and locations of band pass filters on the frequency axis. [Fig. 6] Fig. 6 is a diagram illustrating an example of - 18 - SP313141 frequency characteristic within a vocal section, and an estimated high-frequency power spectrum. [Fig. 7] Fig. 7 is a diagram illustrating an example of the power spectrum of a signal to be input to the frequency band expanding device in Fig. 3. [Fig. 8] Fig. 8 is a diagram illustrating an example of the power spectrum after liftering of the input signal in Fig. 7. [Fig. 9] Fig. 9 is a block diagram illustrating a functional configuration example of a coefficient learning device for performing learning of a coefficient to be used at a high-frequency signal generating circuit of the frequency band expanding device in Fig. 3. [Fig. 10] Fig. 10 is a flowchart for describing an example of coefficient learning processing by the coefficient learning device in Fig. 9. [Fig. 11] Fig. 11 is a block diagram illustrating a functional configuration example of an encoding device according to a second embodiment of the present invention. [Fig. 12] Fig. 12 is a flowchart for describing an example of encoding processing by the encoding device in Fig. 11. [Fig. 13] Fig. 13 is a block diagram illustrating a functional configuration example of a decoding device according to the second embodiment of the present invention. - 19 - SP313141 [Fig. 14] Fig. 14 is a flowchart for describing an example of decoding processing by the decoding device in Fig. 13. [Fig. 15] Fig. 15 is a block diagram illustrating a functional configuration example of a coefficient learning device for performing learning of a representative vector to be used at a high-frequency encoding circuit of the encoding device in Fig. 11, and a decoded high-frequency subband power estimating coefficient to be used at the highfrequency decoding circuit of the decoding device in Fig. 13. [Fig. 16] Fig. 16 is a flowchart for describing an example of coefficient learning processing by the coefficient learning device in Fig. 15. [Fig. 17] Fig. 17 is a diagram illustrating an example of a code string that the encoding device in Fig. 11 outputs. [Fig. 18] Fig. 18 is a block diagram illustrating a functional configuration example of an encoding device. [Fig. 19] Fig. 19 is a flowchart for describing encoding processing. [Fig. 20] Fig. 20 is a block diagram illustrating a functional configuration example of a decoding device. [Fig. 21] Fig. 21 is a flowchart for describing decoding processing. [Fig. 22] Fig. 22 is a flowchart for describing encoding processing. - 20 - SP313141 [Tig. 23] Fig. 23 is a flowchart for describing decoding processing. [Fig. 24] Fig. 24 is a flowchart for describing encoding processing. [Fig. 25] Fig. 25 is a flowchart for describing encoding processing. [Fig. 26] Fig. 26 is a flowchart for describing encoding processing. [Fig. 27] Fig. 27 is a flowchart for describing encoding processing. [Fig. 28] Fig. 28 is a diagram illustrating a configuration example of a coefficient learning processing. [Fig. 29] Fig. 29 is a flowchart for describing coefficient learning processing. [Fig. 30] Fig. 30 is a block diagram illustrating a functional configuration example of an encoding device. [Fig. 31] Fig. 31 is a flowchart for describing encoding processing. [Fig. 32] Fig. 32 is a block diagram illustrating a functional configuration example of a decoding device. [Fig. 33] Fig. 33 is a flowchart for describing decoding processing. [Fig. 34] Fig. 34 is a block diagram illustrating a configuration example of hardware of a computer which executes processing to which the present invention is - 21 - SP313141 applied using a program. Description of Embodiments [0041] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that description will be made in accordance with the following order. 1. First Embodiment (Case of Having Applied Present Invention to Frequency Band Expanding Device) 2. Second Embodiment (Case of Having Applied Present Invention to Encoding Device and Decoding Device) 3. Third Embodiment (Case of Including Coefficient Index in High-frequency Encoded Data) 4. Fourth Embodiment (Case of Including Coefficient Index and Pseudo High-frequency Subband Power Difference in Highfrequency Encoded Data) 5. Fifth Embodiment (Case of Selecting Coefficient Index Using Evaluated Value) 6. Sixth Embodiment (Case of Sharing Part of Coefficients) 7. Seventh Embodiment (Case of Subjecting Feature Amount to Smoothing) [0042] <1. First Embodiment> With the first embodiment, low-frequency signal components after decoding to be obtained by decoding encoded - 22 - SP313141 data using the high-frequency deletion encoding technique is subjected to processing to expand the frequency band (hereinafter, referred to as frequency band expanding processing). [0043] [Functional Configuration Example of Frequency Band Expanding Device] Fig. 3 illustrates a functional configuration example of a frequency band expanding device to which the present invention has been applied. [0044] A frequency band expanding device 10 takes a lowfrequency signal component after decoding as an input signal, and subjects the input signal thereof to frequency band expanding processing, and outputs a signal after the frequency band expanding processing obtained as a result thereof as an output signal. [0045] The frequency band expanding device 10 is configured of a low-pass filter 11, a delay circuit 12, band pass filters 13, a feature amount calculating circuit 14, a highfrequency subband power estimating circuit 15, a highfrequency signal generating circuit 16, a high-pass filter 17, and a signal adder 18. [0046] - 23 - SP313141 The low-pass filter 11 performs filtering of an input signal with a predetermined cutoff frequency, and supplies a low-frequency signal component which is a signal component of low-frequency to the delay circuit 12 as a signal after filtering. [0047] In order to synchronize the time of adding a lowfrequency signal component from the low-pass filter 11 and a later-described high-frequency signal component, the delay circuit 12 delays the low-frequency signal component by fixed delay time to supply to the signal adder 18. [0048] The band pass filters 13 are configured of band pass filters 13-1 to 13-N each having a different passband. The band pass filter 13-i (1 < i < N) passes a predetermined passband signal of input signals, and supplies this to the feature amount calculating circuit 14 and high-frequency signal generating circuit 16 as one of the multiple subband signals. [0049] The feature amount calculating circuit 14 calculates a single or multiple feature amounts using at least any one of the multiple subband signals from the band pass filters 13 or the input signal to supply to the high-frequency subband power estimating circuit 15. Here, the feature amount is - 24 - SP313141 information representing features as a signal of the input signal. [0050] The high-frequency subband power estimating circuit 15 calculates a high-frequency subband power estimated value which is power of a high-frequency subband signal for each high-frequency subband based on a single or multiple feature amounts from the feature amount calculating circuit 14, and supplies these to the high-frequency signal generating circuit 16. [0051] The high-frequency signal generating circuit 16 generates a high-frequency signal component which is a highfrequency signal component based on the multiple subband signals from the band pass filters 13, and the multiple high-frequency subband power estimated values from the highfrequency subband power estimating circuit 15 to supply to the high-pass filter 17. [0052] The high-pass filter 17 subjects the high-frequency signal component from the high-frequency signal generating circuit 16 to filtering with a cutoff frequency corresponding to a cutoff frequency at the low-pass filter 11 to supply to the signal adder 18. [0053] - 25 - SP313141 The signal adder 18 adds the low-frequency signal component from the delay circuit 12 and the high-frequency signal component from the high-pass filter 17, and outputs this as an output signal. [0054] Note that, with the configuration in Fig. 3, in order to obtain a subband signal, the band pass filters 13 are applied, but not restricted to this, and a band dividing filter as described in PTL 1 may be applied, for example. [0055] Also, similarly, with the configuration in Fig. 3, in order to synthesize subband signals, the signal adder 18 is applied, but not restricted to this, a band synthetic filter as described in PTL 1 may be applied. [0056] [Frequency Band Expanding Processing of Frequency Band Expanding Device] Next, the frequency band expanding processing by the frequency band expanding device in Fig. 3 will be described with reference to the flowchart in Fig. 4. [0057] In step SI, the low-pass filter 11 subjects the input signal to filtering with a predetermined cutoff frequency, and supplies the low-frequency signal component serving as a signal after filtering to the delay circuit 12. - 26 - SP313141 [0058] The low-pass filter 11 may set an optional frequency as a cutoff frequency, but with the present embodiment, a predetermined band is taken as a later-described expanding start band, and a cutoff frequency is set corresponding to the lower end frequency of the expanding start band thereof. Accordingly, the low-pass filter 11 supplies a low-frequency signal component which is a lower frequency signal component than the expanding start band to the delay circuit 12 as a signal after filtering. [0059] Also, the low-pass filter 11 may also set the optimal frequency as a cutoff frequency according to the highfrequency deletion encoding technique of the input signal, and encoding parameters such as the bit rate and so forth. As the encoding parameters, side information employed by the band expanding technique according to PTL 1 may be used, for example. [0060] In step S2, the delay circuit 12 delays the lowfrequency signal component from the low-pass filter 11 by fixed delay time and supplies this to the signal adder 18. [0061] In step S3, the band pass filters 13 (band pass filters 13-1 to 13-N) divided the input signal to multiple subband - 27 - SP313141 signals, and supplies each of the multiple subband signals after division to the feature amount calculating circuit 14 and high-frequency signal generating circuit 16. Note that, with regard to input signal dividing processing by the band pass filters 13, details thereof will be described later. [0062] In step S4, the feature amount calculating circuit 14 calculates a single or multiple feature amounts using at least one of the multiple subband signals from the band pass filters 13, and the input signal to supply to the highfrequency subband power estimating circuit 15. Note that, with regard to feature amount calculating processing by the feature amount calculating circuit 14, details thereof will be described later. [0063] In step S5, the high-frequency subband power estimating circuit 15 calculates multiple high-frequency subband power estimated values based on a single or multiple feature amounts from the feature amount calculating circuit 14, and supplies these to the high-frequency signal generating circuit 16. Note that, with regard to processing to calculate high-frequency subband power estimated values by the high-frequency subband power estimating circuit 15, details thereof will be described later. [0064] - 28 - SP313141 In step S6, the high-frequency signal generating circuit 16 generates a high-frequency signal component based on the multiple subband signals from the band pass filters 13, and the multiple high-frequency subband power estimated values from the high-frequency subband power estimating circuit 15, and supplies this to the high-pass filter 17. The high-frequency signal component mentioned here is a higher frequency signal component than the expanding start band. Note that, with regard to high-frequency signal component generation processing by the high-frequency signal generating circuit 16, details thereof will be described later. [0065] In step S7, the high-pass filter 17 subjects the highfrequency signal component from the high-frequency signal generating circuit 16 to filtering, thereby removing noise such as aliasing components to a low frequency included in a high-frequency signal component, and supplying the highfrequency signal component thereof to the signal adder 18. [0066] In step S8, the signal adder 18 adds the low-frequency signal component from the delay circuit 12 and the highfrequency signal component from the high-pass filter 17 to supply this as an output signal. [0067] - 29 - SP313141 According to the above-mentioned processing, the frequency band may be expanded as to a low-frequency signal component after decoding. [0068] Next, details of each process in steps S3 to S6 in the flowchart in Fig. 4 will be described. [0069] [Details of Processing by Band Pass Filter] First, details of processing by the band pass filters 13 in step S3 in the flowchart in Fig. 4 will be described. [0070] Note that, for convenience of description, hereinafter, the number N of the band pass filters 13 will be taken as N = 4. [0071] For example, one of the 16 subbands obtained by equally dividing a Nyquist frequency of the input signal into 16 is taken as the expanding start band, four subbands of the 16 subbands of which the frequencies are lower than the expanding start band are taken as the passbands of the band pass filters 13-1 to 13-4, respectively. [0072] Fig. 5 illustrates locations on the frequency axis of the passbands of the band pass filters 13-1 to 13-4, respectively. - 30 - SP313141 [0073] As illustrated in Fig. 5, if we say that of frequencybands (subbands) which are lower than the expanding start band, the index of the first subband from the high-frequency is sb, the index of the second subband is sb-1, and the index of the first subband is sb - (I - 1), the band pass filters 13-1 to 13-4, assign of the subbands having a lower frequency than the expanding start band, the subbands of which the indexes are sb to sb-3, as passbands, respectively. [0074] Note that, with the present embodiment, the passbands of the band pass filters 13-1 to 13-4 are predetermined four subbands of 16 subbands obtained by equally dividing the Nyquist frequency of the input signal into 16, respectively, but not restricted to this, and may be predetermined four subbands of 256 subbands obtained by equally dividing the Nyquist frequency of the input signal into 256, respectively. Also, the bandwidths of the band pass filters 13-1 to 13-4 may differ. [0075] [Details of Processing by Feature Amount Calculating Circuit] Next, description will be made regarding details of processing by the feature amount calculating circuit 14 in step S4 in the flowchart in Fig. 4. m - 31 - SP313141 [0076] The feature amount calculating circuit 14 calculates a single or multiple feature amounts to be used for the highfrequency subband power estimating circuit 15 calculating a high-frequency subband power estimated value, using at least any one of the multiple subband signals from the band pass filters 13 and the input signal. [0077] More specifically, the feature amount calculating circuit 14 calculates, from four subband signals from the band pass filters 13, subband signal power (subband power (hereinafter, also referred to as low-frequency subband power)) for each subband as a feature amount to supply to the high-frequency subband power estimating circuit 15. [0078] Specifically, the feature amount calculating circuit 14 obtains low-frequency subband power power(ib, J) in a certain predetermined time frame J from four subband signals x(ib, n) supplied from the band pass filters 13, using the following Expression (1). Here, ib represents an index of a subband, and n represents an index of discrete time. Now, let us say that the number of samples in one frame is FSIZE, and power is represented by decibel. [0079] [Mathematical Expression 1] - 32 - SP313141 |7(J+1)FSIZE-1 \ "] power (ib, J) =10log10^ Z x( ib, n)2 /FSIZE [ \\ n=J*FSIZE / J (sb-3 standard deviation of the subband powers is powerstd/ a mean value of the dip is dipaVef and standard deviation of the dip is dipstd- [0137] The high-frequency subband power estimating circuit 15 converts the value dip(J) of the dip using these values such as the following Expression (12) to obtain a dip dips(J) after conversation. [0138] - 49 - SP313141 [Mathematical Expression 12] A- f i\ dip(J)-dipave d i p s ( J ) " .. powerstd+powerave a i Pstd • • • ( 1 2) [0139] According to conversion indicated in Expression (12) being performed, the high-frequency subband power estimating circuit 15 may convert the dip value dip(J) into a variable (dip) dips(J) statistically equal to the average and dispersion of the low-frequency subband powers, and accordingly, an average of a value that the dip has may be set generally equal to a range of a value that the subband powers have. [0140] With the frequency expanding band, an estimated value powerest (ib, J) of a subband power of which the index is ib is represented by the following Expression (13) using linear coupling between the four low-frequency subband powers power(id, J) from the feature amount calculating circuit 14, and the dip dips(J) indicated in Expression (12), for example. [0141] [Mathematical Expression 13] - 50 - SP313141 powerest(ib,J) = ( I {Cib(kb) power(kb,J)}|+Dibdips(J)+Eib \ kb=sb-3 / (J*FSIZE< n < (J+1) FSIZE-1, sb+1 < i b With the second embodiment, the input signal is subjected to encoding processing and decoding processing in the high-frequency characteristic encoding technique by an encoding device and a decoding device. [0175] [Functional Configuration Example of Encoding Device] Fig. 11 illustrates a functional configuration example of an encoding device to which the present invention has been applied. [0176] An encoding device 30 is configured of a low-pass filter 31/ a low-frequency encoding circuit 32, a subband dividing circuit 33, a feature amount calculating circuit 34, a pseudo high-frequency subband power calculating circuit 35, a pseudo high-frequency subband power difference calculating circuit 36, a high-frequency encoding circuit 37, a multiplexing circuit 38, and a low-frequency decoding circuit 39. [0177] # - 63 - SP313141 The low-pass filter 31 subjects an input signal to filtering with a predetermined cutoff frequency, and supplies a lower frequency signal (hereinafter, referred to as low-frequency signal) than the cutoff frequency to the low-frequency encoding circuit 32, subband dividing circuit 33 and feature amount calculating circuit 34 as a signal after filtering. [0178] The low-frequency encoding circuit 32 encodes the lowfrequency signal from the low-pass filter 31, and supplies low-frequency encoded data obtained as a result thereof to the multiplexing circuit 38 and low-frequency decoding circuit 39. [0179] The subband dividing circuit 33 equally divides the input signal and the low-frequency signal from the low-pass filter 31 into multiple subband signals having predetermined bandwidth to supply to the feature amount calculating circuit 34 or pseudo high-frequency subband power difference calculating circuit 36. More specifically, the subband dividing circuit 33 supplies multiple subband signals (hereinafter, referred to as low-frequency subband signals) obtained with the low-frequency signals as input to the feature amount calculating circuit 34. Also, the subband dividing circuit 33 supplies, of multiple subband signals - 64 - SP313141 obtained with the input signal as input, higher frequency subband signals (hereinafter, refereed to as high-frequency subband signals) than a cutoff frequency set at the low-pass filter 31 to the pseudo high-frequency subband power difference calculating circuit 36. [0180] The feature amount calculating circuit 34 calculates one or multiple feature amounts using at least any one of the multiple subband signals of the low-frequency subband signals from the subband dividing circuit 33, and the lowfrequency signal from the low-pass filter 31 to supply to the pseudo high-frequency subband power calculating circuit 35. [0181] The pseudo high-frequency subband power calculating circuit 35 generates a pseudo high-frequency subband power based on the one or multiple feature amounts from the feature amount calculating circuit 34 to supply to the pseudo high-frequency subband power difference calculating circuit 36. [0182] The pseudo high-frequency subband power difference calculating circuit 36 calculates later-described pseudo high-frequency subband power difference based on the highfrequency subband signal from the subband dividing circuit - 65 - SP313141 33, and the pseudo high-frequency subband power from the pseudo high-frequency subband power calculating circuit 35 to supply to the high-frequency encoding circuit 37. [0183] The high-frequency encoding circuit 37 encodes the pseudo high-frequency subband power difference from the pseudo high-frequency subband power difference calculating circuit 3 6 to supply high-frequency encoded data obtained as a result thereof to the multiplexing circuit 38. [0184] The multiplexing circuit 38 multiplexes the lowfrequency encoded data from the low-frequency encoding circuit 32, and the high-frequency encoded data from the high-frequency encoding circuit 37 to output as an output code string. [0185] The low-frequency decoding circuit 39 decodes the lowfrequency encoded data from the low-frequency encoding circuit 32 as appropriate to supply decoded data obtained as a result thereof to the subband dividing circuit 33 and feature amount calculating circuit 34. CLAIMS [Claim 1] An encoding device comprising: subband diving means configured to divide an input signal into a plurality of subbands, and to generate a lowfrequency subband signal made up of a plurality of subbands on the low-frequency side, and a high-frequency subband signal made up of a plurality of subbands on the highfrequency side; feature amount calculating means configured to calculate feature amount that represents features of the input signal based on at least any one of the low-frequency subband signal and the input signal; smoothing means configured to subject the feature amount smoothing; pseudo high-frequency subband power calculating means configured to calculate pseudo high-frequency subband power that is an estimated value of power of the high-frequency subband signal based on the smoothed feature amount and a predetermined coefficient; selecting means configured to calculate high-frequency subband power that is power of the high-frequency subband signal from the high-frequency subband signal, and to compare the high-frequency subband power and the pseudo high-frequency subband power to select any of a plurality of the coefficients; high-frequency encoding means configured to encode coefficient information for obtaining the selected coefficient, and smoothing information relating to the smoothing to generate high-frequency encoded data; low-frequency encoding means configured to encode a low-frequency signal that is a low-frequency signal of the input signal to generate low-frequency encoded data; and multiplexing means configured to multiplex the lowfrequency encoded data and the high-frequency encoded data to obtain an output code string. [Claim 2] The encoding device according to Claim 1, wherein the smoothing means subjects the feature amount to smoothing by performing weighted averaging for the feature amount of a predetermined number of continuous frames of the input signal. [Claim 3] The encoding device according to Claim 2, wherein the smoothing information is information that indicates at least one of the number of the frames used for the weighted averaging, or weight used for the weighted averaging. [Claim 4] The encoding device according to Claim 3, further comprising: parameter determining means configured to determine at least one of one of the number of the frames used for the weighted averaging, or weight used for the weighted averaging based on the high-frequency subband signal. [Claim 5] The encoding device according to Claim 1, wherein the coefficient is generated by learning with the feature amount and the high-frequency subband power obtained from a broadband supervisory signal as an explanatory variable and an explained variable. [Claim 6] The encoding device according to Claim 5, wherein the broadband supervisory signal is a signal obtained by encoding a predetermined signal in accordance with an encoding method and encoding algorithm and decoding the encoded predetermined signal; and wherein the coefficient is generated by the learning using the broadband supervisory signal for each of a plurality of different encoding methods and encoding algorithms. [Claim 7] An encoding method comprising the steps of: dividing an input signal into a plurality of subbands, and generating a low-frequency subband signal made up of a plurality of subbands on the low-frequency side, and a highL frequency subband signal made up of a plurality of subbands on the high-frequency side; calculating feature amount that represents features of the input signal based on at least any one of the lowfrequency subband signal and the input signal; subjecting the feature amount smoothing; calculating pseudo high-frequency subband power that is an estimated value of power of the high-frequency subband signal based on the smoothed feature amount and a predetermined coefficient; calculating high-frequency subband power that is power of the high-frequency subband signal from the high-frequency subband signal, and comparing the high-frequency subband power and the pseudo high-frequency subband power to select any of a plurality of the coefficients; encoding coefficient information for obtaining the selected coefficient, and smoothing information relating to the smoothing to generate high-frequency encoded data; encoding a low-frequency signal that is a low-frequency signal of the input signal to generate low-frequency encoded data; and multiplexing the low-frequency encoded data and the high-frequency encoded data to obtain an output code string. [Claim 8] A program causing a computer to execute processing comprising the steps of: dividing an input signal into a plurality of subbands, and generating a low-frequency subband signal made up of a plurality of subbands on the low-frequency side, and a highfrequency subband signal made up of a plurality of subbands on the high-frequency side; calculating feature amount that represents features of the input signal based on at least any one of the lowfrequency subband signal and the input signal; subjecting the feature amount smoothing; calculating pseudo high-frequency subband power that is an estimated value of power of the high-frequency subband signal based on the smoothed feature amount and a predetermined coefficient; calculating high-frequency subband power that is power of the high-frequency subband signal from the high-frequency subband signal, and comparing the high-frequency subband power and the pseudo high-frequency subband power to select any of a plurality of the coefficients; encoding coefficient information for obtaining the selected coefficient, and smoothing information relating to the smoothing to generate high-frequency encoded data; encoding a low-frequency signal that is a low-frequency signal of the input signal to generate low-frequency encoded data; and multiplexing the low-frequency encoded data and the high-frequency encoded data to obtain an output code string. [Claim 9] A decoding device comprising: demultiplexing means configured to demultiplex input encoded data into low-frequency encoded data, coefficient information for obtaining a coefficient, and smoothing information relating to smoothing; low-frequency decoding means configured to decode the low-frequency encoded data to generate a low-frequency signal; subband dividing means configured to divide the lowfrequency signal into a plurality of subbands to generate a low-frequency subband signal for each of the subbands; feature amount calculating means configured to calculate feature amount based on the low-frequency subband signals; smoothing means configured to subject the feature amount to smoothing based on the smoothing information; and generating means configured to generate a highfrequency signal based on the coefficient obtained from the coefficient information, the feature amount subjected to smoothing, and the low-frequency subband signals. [Claim 10] The decoding device according to Claim 9, wherein the smoothing means subjects the feature amount to smoothing by performing weighted averaging on the feature amount of a predetermined number of continuous frames of the lowfrequency signal. [Claim 11] The decoding device according to Claim 10, wherein the smoothing information is information indicating at least one of the number of frames used for the weighted averaging, or weight used for the weighted averaging. [Claim 12] The decoding device according to Claim 9, wherein the generating means include decoded high-frequency subband power calculating means configured to calculate decoded high-frequency subband power that is an estimated value of subband power making up the high-frequency signal based on the smoothed feature amount and the coefficient, and high-frequency signal generating means configured to generate the high-frequency signal based on the decoded high-frequency subband power and the low-frequency subband signal. [Claim 13] The decoding device according to Claim 9, wherein the coefficient is generated by learning with the feature amount obtained from a broadband supervisory signal, and power of the same subband as a subband making up the high-frequency signal of the broadband supervisory signal, as an explanatory variable and an explained variable. [Claim 14] The decoding device according to Claim 13, wherein the broadband supervisory signal is to be a signal obtained by encoding a predetermined signal in accordance with a predetermined encoding method and encoding algorithm and decoding the encoded predetermined signal; and wherein the coefficient is generated by the learning using the broadband supervisory signal for each of a plurality of different encoding methods and encoding algorithms. [Claim 15] A decoding method comprising the steps of: demultiplexing input encoded data into low-frequency encoded data, coefficient information for obtaining a coefficient, and smoothing information relating to smoothing; decoding the low-frequency encoded data to generate a low-frequency signal; dividing the low-frequency signal into a plurality of subbands to generate a low-frequency subband signal for each of the subbands; calculating feature amount based on the low-frequency subband signals; subjecting the feature amount to smoothing based on the smoothing information; and generating a high-frequency signal based on the coefficient obtained from the coefficient information, the feature amount subjected to smoothing, and the low-frequency subband signals. [Claim 16] A program causing a computer to execute processing comprising the steps of: demultiplexing input encoded data into low-frequency encoded data, coefficient information for obtaining a coefficient, and smoothing information relating to smoothing; decoding the low-frequency encoded data to generate a low-frequency signal; dividing the low-frequency signal into a plurality of subbands to generate a low-frequency subband signal for each of the subbands; calculating feature amount based on the low-frequency subband signals; subjecting the feature amount to smoothing based on the smoothing information; and generating a high-frequency signal based on the coefficient obtained from the coefficient information, the SP313141 feature amount subjected t o smoothing, and the low-frequency subband signals .

Documents

Application Documents

# Name Date
1 3076-DELNP-2013.pdf 2013-04-17
2 3076-delnp-2013-GPA.pdf 2013-08-20
3 3076-delnp-2013-Form-5.pdf 2013-08-20
4 3076-delnp-2013-Form-3.pdf 2013-08-20
5 3076-delnp-2013-Form-2.pdf 2013-08-20
6 3076-delnp-2013-Form-1.pdf 2013-08-20
7 3076-delnp-2013-Drawings.pdf 2013-08-20
8 3076-delnp-2013-Description(Complete).pdf 2013-08-20
9 3076-delnp-2013-Correspondence-others.pdf 2013-08-20
10 3076-delnp-2013-Claims.pdf 2013-08-20
11 3076-delnp-2013-Abstract.pdf 2013-08-20
12 3076-delnp-2013-Form-3-(02-09-2013).pdf 2013-09-02
13 3076-delnp-2013-Correspondence-Others-(02-09-2013).pdf 2013-09-02
14 3076-DELNP-2013-FER.pdf 2018-07-05
15 3076-DELNP-2013-OTHERS [03-01-2019(online)].pdf 2019-01-03
16 3076-DELNP-2013-FER_SER_REPLY [03-01-2019(online)].pdf 2019-01-03
17 3076-DELNP-2013-CORRESPONDENCE [03-01-2019(online)].pdf 2019-01-03
18 3076-DELNP-2013-COMPLETE SPECIFICATION [03-01-2019(online)].pdf 2019-01-03
19 3076-DELNP-2013-CLAIMS [03-01-2019(online)].pdf 2019-01-03
20 3076-DELNP-2013-PETITION UNDER RULE 137 [05-01-2019(online)].pdf 2019-01-05
21 3076-DELNP-2013-Power of Attorney-080119.pdf 2019-01-12
22 3076-DELNP-2013-OTHERS-080119.pdf 2019-01-12
23 3076-DELNP-2013-Correspondence-080119.pdf 2019-01-12
24 3076-DELNP-2013-FORM-26 [01-06-2021(online)].pdf 2021-06-01
25 3076-DELNP-2013-Correspondence to notify the Controller [01-06-2021(online)].pdf 2021-06-01
26 3076-DELNP-2013-Written submissions and relevant documents [18-06-2021(online)].pdf 2021-06-18
27 3076-DELNP-2013-PETITION UNDER RULE 137 [18-06-2021(online)].pdf 2021-06-18
28 3076-DELNP-2013-PETITION UNDER RULE 137 [18-06-2021(online)]-1.pdf 2021-06-18
29 3076-DELNP-2013-Annexure [18-06-2021(online)].pdf 2021-06-18
30 3076-DELNP-2013-PatentCertificate20-07-2021.pdf 2021-07-20
31 3076-DELNP-2013-IntimationOfGrant20-07-2021.pdf 2021-07-20
32 3076-DELNP-2013-US(14)-HearingNotice-(HearingDate-03-06-2021).pdf 2021-10-17
33 3076-DELNP-2013-RELEVANT DOCUMENTS [13-09-2023(online)].pdf 2023-09-13

Search Strategy

1 Searchstandard_14-06-2018.pdf

ERegister / Renewals

3rd: 14 Oct 2021

From 05/10/2013 - To 05/10/2014

4th: 14 Oct 2021

From 05/10/2014 - To 05/10/2015

5th: 14 Oct 2021

From 05/10/2015 - To 05/10/2016

6th: 14 Oct 2021

From 05/10/2016 - To 05/10/2017

7th: 14 Oct 2021

From 05/10/2017 - To 05/10/2018

8th: 14 Oct 2021

From 05/10/2018 - To 05/10/2019

9th: 14 Oct 2021

From 05/10/2019 - To 05/10/2020

10th: 14 Oct 2021

From 05/10/2020 - To 05/10/2021

11th: 14 Oct 2021

From 05/10/2021 - To 05/10/2022

12th: 01 Oct 2022

From 05/10/2022 - To 05/10/2023

13th: 30 Sep 2023

From 05/10/2023 - To 05/10/2024

14th: 30 Sep 2024

From 05/10/2024 - To 05/10/2025

15th: 25 Sep 2025

From 05/10/2025 - To 05/10/2026