Technical field
[0001]
　This technology coding apparatus and method, a decoding apparatus and method, and a program, the encoding apparatus and method capable of reducing the computational complexity of the decoding of the audio signal, the decoding apparatus and method, and a program .
Background technique
[0002]
　For example, as a method for encoding an audio signal, which is an international standard MPEG (Moving Picture Experts Group) -2 AAC (Advanced Audio Coding) standard, multi-channel coding of MPEG-4 AAC standard and the MPEG-D USAC standard knowledge are (see, for example, non-Patent documents 1 and 2).
CITATION
Non-patent literature
[0003]
非特許文献1 : INTERNATIONAL STANDARD ISO/IEC 14496-3 Fourth edition 2009-09-01 Information technology-coding of audio-visual objects-part3:Audio
非特許文献2 : INTERNATIONAL STANDARD ISO/IEC 23003-3 Frist edition 2012-04-01 Information technology-coding of audio-visual objects-part3:Unified speech and audio coding
Summary of the Invention
Problems that the Invention is to Solve
[0004]
　Meanwhile, over conventional 5.1 channel surround playback, more playback and high realistic sensation, in order to transmit multiple voice (dialog), it is necessary coding technique using more audio channels.
[0005]
　For example, consider an audio signal of 22 channel, English, French, and transmitted in encoded audio signals of a plurality of dialog sound sources, such as German, the case of performing the decoding.
[0006]
　In this case, encoded data obtained by encoding, the bit string of the sound source of the encoded data of 22 channels, consists of a bit string of encoded data of a plurality of dialog sound sources, the one being their bit string binding It is transmitted as a sequence of bits of the encoded data.
[0007]
　Further, the decoding of one of the sound source of the encoded data of 22 channel bit string of the encoded data in the decoding side, decoding of the encoded data of a plurality of dialog sound is performed. Thus, the decoded data of 22 channels of the sound source, is obtained and the decoded data of a plurality of dialog sound sources.
[0008]
　Then, in the decoding side, only the decoded data of a desired dialog sound from the decoded data of a plurality of dialog sound sources is selected, decoded data of the dialog channels in 22 channel sound source sound source, decoded data of a desired dialog sound source is selected It is replaced by the.
[0009]
　On the other hand, since the encoded data is transmitted as one bit string, the decoding side, only the desired dialog sound despite ultimately required for, decodes all encoded data of a plurality of dialog sound it becomes necessary, processing for decoding of finally not play dialog sound source is wasted.
[0010]
　The audio codec, such as current AAC and USAC, it is necessary to decode all channels and all dialogs, it is difficult to reduce the computational complexity of the decoding.
[0011]
　This technology has been made in view of such circumstances, it is desirable to make it possible to reduce the computational complexity of the decoding.
Means for Solving the Problems
[0012]
　Encoding apparatus of the first embodiment of the present technology, an audio signal of a plurality of channels sound sources including dialog sound source coding, channel excitation coding unit to generate encoded data, different additional dialog sound source and the dialog source the audio signal encoding, an additional dialog excitation coding unit to generate encoded data, dialog information including information on the additional dialog sound source, the plurality of channel excitation coded data, and the coding of the additional dialog source data and a multiplexer for multiplexing.
[0013]
　The encoded data and the dialog information of the additional dialog sound source can be stored in the user data area of ​​a bit stream obtained by the multiplexing.
[0014]
　The user data area can be a DSE defined in MPEG AAC or MPEG-D USAC.
[0015]
　The dialog information may be so contained information on the dialog sound source.
[0016]
　Wherein the dialog information may be as contains the information indicating the type of additional dialog sound source, and information indicating the type of the dialog sound.
[0017]
　Wherein the dialog information may be made to the information indicating the channel of the dialog sound of the channels of the audio signals of the plurality of channels source is a multi-channel configuration is included.
[0018]
　Wherein the dialog information may be an audio signal of the addition dialog sound so it contains gain information for gain correction.
[0019]
　Wherein the dialog information may be so contains correction gain information for each plurality of said additional dialog sound source, that their multiple audio signals of the additional dialog sound source gain correction.
[0020]
　Coding method or program according to the first embodiment of the present technology, an audio signal of a plurality of channels sound sources including dialog sound is encoded to generate encoded data and the audio signals of different additional dialog sound source and the dialog source It encodes generate encoded data, comprising the step of multiplexing the dialog information, the plurality of channel excitation coded data, and the encoded data of the additional dialog sound source including information about the additional dialog sound.
[0021]
　In the first aspect of the present technology, audio signals of a plurality of channels sound sources including the dialog source is in encoded data is generated encoded audio signals of different additional dialog sound source and the dialog sound is coded encoded data is generated, the dialog information including information regarding the additional dialog sound source, the plurality of channel excitation coded data, and coded data of the additional dialog sound source are multiplexed.
[0022]
　Decoding apparatus of the second embodiment of the present technology, a coded bit stream, encoded data of a plurality of channels sound sources including dialog sound source, different one or more additional dialog sound source and the dialog excitation coding data, and a separation unit for separating the dialog information including information regarding the additional dialog sound source, additional dialog sound source decoding the selected coded data of the additional dialog source was among the coded data of one or more of said additional dialog source and a decoding unit.
[0023]
　The decoding apparatus, a channel sound source decoding section that decodes encoded data of the plurality of channel sound sources may be further provided.
[0024]
　The decoding device, a dialog said encoded data audio signal obtained by decoding the dialog sound, and outputs the replaced audio signal obtained by decoding the encoded data of the additional dialog source said selected It may further include selecting section.
[0025]
　Wherein the additional dialog sound source decoding unit, it is possible to decode the encoded data of the additional dialog sound source is selected in response to presentation of the dialog information.
[0026]
　Decoding method or a program according to the second aspect of the present technique, a coded bit stream, encoded data of a plurality of channels sound sources including dialog sound source, different one or more additional dialog sound source and the dialog excitation coding data , and the separated dialog information including information about the additional dialog sound source, including the selected steps of decoding the encoded data of the additional dialog sound source of the encoded data of one or more of the additional dialog sound.
[0027]
　In the second aspect of the present technology, the coded bit stream, a plurality of channel excitation coded data including a dialog source, different one or more additional dialog sound source and the dialog excitation coding data, and the additional is separated in the dialog information including information on dialog excitation, the encoded data of the selected said additional dialog sound source of the encoded data of one or more of the additional dialog sound source is decoded.
Effect of the Invention
[0028]
　According to the first aspect and the second aspect of the present technology, it is possible to reduce the computational complexity of the decoding.
[0029]
　Here, the advantages described in the present invention is not necessarily limited, it may be any of the effects described in the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
[0030]
FIG. 1 is a diagram illustrating a 22-channel sound source corresponding reproducing system.
Is a diagram illustrating a configuration example of FIG. 2 encoder.
Is a diagram illustrating an example of a bit stream syntax of FIG. 3 dialog information.
4 is a diagram showing an example of a bit stream syntax of the additional dialog excitation encoded data.
Is a flowchart illustrating a FIG. 5 encoding process.
It shows the configuration example of FIG. 6 decoder.
Is a flow chart illustrating the FIG. 7] decoding process.
Is a diagram illustrating a configuration example of FIG. 8 computer.
DESCRIPTION OF THE INVENTION
[0031]
　Hereinafter, with reference to the accompanying drawings, a description will be given of an embodiment according to the present technology.
[0032]

　The present technique, the bit string of the sound source of the encoded data of a plurality of channels, one encoding by combining the bit sequence of the encoded data of a plurality of dialog sound sources when transmitting a bit string of data, and transmit also added information dialog into a bit string.
[0033]
　This makes it possible to perform decoding of only the dialog sound source to be reproduced as a dialog channel, it is possible to reduce the computational complexity of the decoding.
[0034]
　In this case, the decoding side, the number of additional dialog sound source to the viewer, an additional dialog presents information of the sound source, to receive an indication of whether replacing sound source of the dialog channel dialog sound source selected by the viewer from the viewer if the, it is possible to perform decoding of only the dialog sound source to be reproduced as a dialog channel.
[0035]
　Specifically, the number of additional dialog excitation at the encoding side in such present technology, information additional dialog sound source, the position of the dialog channels, and additional dialogs sound source gain (gain) is encoded as dialog information. Then, the coded data of the dialog information, encoded data and multiplexing the coded data and 22 channel sound source additional dialog sound source, obtained bit stream is output.
[0036]
　Further, the coded data of the dialog information in the decoding side, additional dialog excitation encoded data, and 22-channel excitation coded data is separated. Furthermore, the number of additional dialog sound source to the viewer, the information of the additional dialog sound presentation, the viewer instructs whether replacing sound source of the dialog channel dialog sound source selected by the viewer is made.
[0037]
　When the instruction from such viewers is made, on the decoding side in accordance with an instruction from the viewer, the decoding of only the dialog sound source to be reproduced as a dialog channel been conducted by replacing the dialog sound is made, 22 channel sound source playback of is carried out.
[0038]

　There will be described specific embodiments than the present technology. Here, an explanation as an example a case where a signal of 22-channel audio signals to be reproduced is a multi-channel configuration, the audio signal to be reproduced may be what channel signal.
[0039]
　1 is capable of reproducing 22-channel audio signals of a multi-channel configuration obtained by the decoding is a diagram showing a 22-channel sound source corresponding reproducing system. Video content in this embodiment, the audio signals of 22 channels accompanying the video is played.
[0040]
　In Figure 1, a screen SC11 is provided an image is displayed on the front of the viewer US11, 9 single loudspeakers SP1 to speaker SP9 is disposed on the front.
[0041]
　In other words, the front middle as viewed from the viewer US11, central is arranged a speaker SP1, a speaker SP2, and the speaker SP3 is arranged on the left and right of the speaker SP1. Further, in the figure in the middle, the upper layer on the upper side, the center is disposed a speaker SP4, a speaker SP5, and a speaker SP6 are located on the left and right of the speaker SP4.
[0042]
　In the figure in the middle as well, the lower layer located on the lower side, the center and the speaker SP7 is located on the speaker SP8 and speaker SP9 are disposed on the left and right of the speaker SP7. In the drawing viewer US11, upper, i.e. the ceiling are arranged speaker SP10.
[0043]
　Further in the drawing as viewed from the viewer US11, on the left side located on the left side are arranged six loudspeakers SP11 to speaker SP16. That is, the left side middle layer are arranged speakers SP11 and the speaker SP 12, on the left side surface upper layer are arranged speakers SP13 and the speaker SP14, on the left side surface lower are arranged speakers SP15 and the speaker SP16.
[0044]
　Figure viewed from Similarly viewer US11, 6 single speaker SP17 to speaker SP22 is disposed on the right side to the right. That is, the right side middle is disposed a speaker SP17 and the speaker SP18, the right side upper is arranged a loudspeaker SP19 and the speaker SP20, it is arranged speakers SP21 and the speaker SP22 are on the right side lower.
[0045]
　Such a 22 speakers SP1 to speaker SP22, coding for the 22-channel sound source corresponding reproducing system having a not shown decoder, channel excitation coded data, the additional dialog excitation coding data, and dialog information data is input.
[0046]
　Here, the channel excitation coded data, additional dialog excitation encoded data, and the encoded data of the dialog information will be described.
[0047]
　Encoded data of channel sound source, corresponding to each of the 22 speakers SP1 to speaker SP22, a data audio signal of each channel obtained by encoding constituting the multichannel. Hereinafter, it is assumed that referred to as channel source audio that is reproduced by the audio signal of each channel.
[0048]
　Moreover, Some of channel sound sources corresponding to each channel, also includes dialog source is dialog speech. Here, the dialog sound source contained in channel source is described embodiment is one, the number of dialogs sound source may be any number. Furthermore, in the following, a channel of the audio signal to reproduce the dialog sound source, and also be referred to as dialog channel.
[0049]
　Additional dialog sound source encoded data is data obtained audio signal additional dialog sound source is the added dialog speech as a candidate replacement for the dialog sound source encoded. The 22-channel sound source corresponding reproducing system, in reproducing channel sound source, a dialog source contained in channel sound source, it is possible to reproduce replaced with additional dialog source.
[0050]
　Coded data in the dialog information is data obtained dialog information includes information about dialog instruments and additional dialog sound is encoded.
[0051]
　The 22-channel sound source corresponding reproducing system, encoded data of channel sound source described above, the additional dialog excitation encoded data, and dialog information of a bit stream coded data is included supplied, those of the encoded data There are decoded properly, channel sound is reproduced.
[0052]
　For example, first, the dialog information obtained by the decoding is presented to the viewer US11. Then, the viewer US11 is, as appropriate, to indicate the replacement of the dialog sound source. In other words, a dialog source, from among the one or more additional dialog sound, dialog of the sound source to be reproduced is selected.
[0053]
　Here, for example, if the dialog sound source selected by the viewer US11 only encoded data of channel sound source, including the dialog sound source is decoded. Then, the audio signal of each channel sound obtained by decoding, is that is the audio signal of each channel is supplied to the speaker corresponding to these channels, channel sound is reproduced.
[0054]
　In this case, used as a speaker for one speaker of the speakers SP1 to speaker SP22 to reproduce the dialog source. In this example, the speakers SP1 in the middle (center) position of the front middle of the viewer US11, dialog sound source is played.
[0055]
　In encoding side, it is possible to specify any speaker as a speaker for reproducing a dialog source, where the speaker for reproducing the dialog sound source and that describes an example a speaker SP1.
[0056]
　On the other hand, if the additional dialog sound as a sound source of the dialog to be reproduced is selected, along with the encoded data is decoded in the channel excitation coded data of the additional dialog sound source is selected also decoded. Of the audio signals of the channel sound obtained by decoding, the audio signal of the dialog sound source, obtained by decoding, channel sound is reproduced replaced by the audio signal additional dialog sound source is selected.
[0057]
　Therefore, in this case, additional dialog sound source is selected in the speaker SP1 is reproduced, the remaining speakers SP2 to the speaker SP22, the channel tone corresponding to those of the speaker is reproduced. In this case, encoded data of other additional dialog sound source has not been selected will not be decoded.
[0058]
　Here, the sound source dialog sound source replaced ones of the channel sound source, that is, it will be described as an example where a dialog speech, other, may be such as object sound source, what sound is replaced.
[0059]

　Subsequently, a coding apparatus for generating a bit stream to be inputted to 22 channel sound corresponding reproducing system described in the above, constitutes a 22-channel sound source corresponding reproducing system, the output from the encoding device decoding apparatus will be described for decoding the bit stream.
[0060]
　It will be described first coding device. Figure 2 is a diagram showing a configuration example of an embodiment of a coding apparatus to which the present technology is applied.
[0061]
　Encoding device 11 of FIG. 2, channel excitation coding section 21, and has an additional dialog excitation coding section 22, the dialog information encoding unit 23, and the multiplexer 24.
[0062]
　Channel excitation coding unit 21, the audio signals of each channel sound sources of the supplied 22-channel configuration and coding, and supplies the resulting encoded data to multiplexing section 24. Add dialog excitation coding unit 22, the audio signal of the supplied added dialog excitation codes, and supplies the resulting encoded data to multiplexing section 24.
[0063]
　Dialog information encoding unit 23 encodes the supplied dialog information, and supplies the resulting encoded data to multiplexing section 24. Multiplexer 24, the channel excitation coding unit 21, generates a bit stream by multiplexing the encoded data supplied from each of the additional dialog excitation coding unit 22, and the dialog information encoding unit 23 and outputs.
[0064]
　In the coding device 11, for example, AAC (MPEG AAC) standard or USAC (MPEG-D USAC) channel sound source according to the standard, additional dialog sound source, and dialog information are encoded.
[0065]

　Incidentally, the bit stream outputted from the multiplexing unit 24, for example, a coded bit stream conforming to the AAC standard or the USAC standard. In this bit stream, for example, following a channel excitation coded data is coded data arrangement of dialog information are further encoded data arranged in each additional dialog sound sources behind them.
[0066]
　Further, the coded data of the dialog information, for example defined by AAC standard and USAC standard, the user called DSE (Data Stream Element) of the bit stream is stored in freely definable user data area. Similarly coded data for each additional dialog sound sources, DSE encoded data in the dialog information is stored (hereinafter, appropriately, DSE () and also referred) followed are stored in the number portion of DSE additional dialog sound. That is, one of the additional dialog excitation coding data into a single DSE is stored.
[0067]
　Here, a specific example of the bit stream syntax of the encoded data of the additional dialog sound source and the encoded data of the dialog information.
[0068]
　Figure 3 is a diagram illustrating a bit stream syntax of the encoded data of the dialog information.
[0069]
　In this example, as encoded data of the dialog information, the head of the DSE, Dialogue_info_sync it is disposed a synchronization code indicating the presence of encoded dialog information.
[0070]
　Moreover, following the synchronization code Dialogue_info_sync, information on the dialog source contained in channel sound main_dialogue_info is arranged to (hereinafter, referred to as main dialog information). For example, the main dialog information main_dialogue_info is and the main voice of the Japanese, narration voice, etc., are such as information indicating whether the sound source of any type of dialog sound source (type).
[0071]
　dialogue_src_index the channel of the audio signal of the dialog sound source contained in channel sound source, that is, the dialog position information indicating the speaker position the dialog sound source is played. Therefore, the speaker identified by the dialog location information dialogue_src_index of the speakers SP1 to speaker SP22 described above, the dialog source or additional dialog sound is reproduced.
[0072]
　dialogue_gain the gain value of the additional dialog source during replacement dialog, that is, the gain information for the gain correction when the additional dialog music playback. num_additional_dialogue is an additional dialog number information indicating the number of additional dialog sound source.
[0073]
　Further, after the additional dialog number information Num_additional_dialogue are as many additional_dialogue_info [i] and additional_dialogue_gain [i] is located as indicated by the additional dialog number information Num_additional_dialogue.
[0074]
　additional_dialogue_info [i] is information about additional dialog sound source disposed in the i-th (hereinafter referred to as additional dialog information).
[0075]
　This additional dialog information additional_dialogue_info [i], as well as the main dialog information, French or secondary audio, audio commentary of the contents, narration audio or the like which is reading at a low speed, what additional dialog sound source type (Type) is such information indicating which of the sound source.
[0076]
　additional_dialogue_gain [i] represents the correction gain value for additional dialog sound source are arranged in the i-th. The correction gain value additional_dialogue_gain [i] is the gain information for correcting the variation of the volume between each additional dialog source.
[0077]
　Above the so dialog information as at least the main dialog information, dialog location information, the gain value of the additional dialog source, additional dialog number information includes the correction gain additional dialog information and additional dialog sound source.
[0078]
　Also, the bit stream syntax of the coded data for each additional dialog sound source, for example, as shown in FIG.
[0079]
　In this example, it added as a dialog source encoded data, the head of the DSE, Additional_dialogue_data_sync a synchronization code indicating the presence of audio signals of the additional dialog sound encoded is located.
[0080]
　Also, Additional_dialogue_index disposed following the synchronization code additional_dialogue_data_sync indicates an index that identifies the audio signal additional dialog sound source stored in the DSE (coded data). Furthermore, Single_channel_element disposed subsequent to the index (), the single-channel encoded data defined by the AAC and USAC, i.e. here shows an audio signal encoded additional dialog sound.
[0081]

　Next, the operation of the encoding device 11.
[0082]
　Encoder 11, the audio signal of each frame of the multi-channel configuration to be encoded is supplied, and starts the encoding process, and outputs a bit stream obtained by the encoding. Hereinafter, with reference to the flowchart of FIG. 5 will be described encoding process by the encoding device 11.
[0083]
　In step S11, the encoding device 11 still determines whether there is one frame of data that has not been encoded.
[0084]
　If in step S11 it is determined that there is one frame of encoded data, in step S12, the processing target frame channel excitation coding unit 21 to be processed, the encoding of the audio signal of the channel sound source, including a dialog channel I do. That is, the channel excitation coding unit 21, the audio signals of each channel sound sources of the supplied 22-channel configuration and coding, and supplies the resulting encoded data to multiplexing section 24.
[0085]
　In step S13, the dialog information encoding unit 23 determines whether there is dialog information. For example, if the dialog information of the frame to be processed from the outside is supplied, it is determined that there is dialog information.
[0086]
　If it is determined that there is no dialog information in step S13, processing in step S14 to step S26 is not performed, the process proceeds to step S27. In this case, since there is no additional dialog sound, only the encoded data of channel sound source is stored in the bit stream.
[0087]
　In step S13 the contrary, if it is determined that there is dialog information, the process proceeds to step S14.
[0088]
　In step S14, the dialog information coding unit 23, based on the supplied dialog information, generates a synchronization code dialogue_info_sync and the main dialog information main_dialogue_info the dialog information.
[0089]
　In step S15, the dialog information encoding unit 23, based on the dialog information, and generates the dialog location information Dialogue_src_index.
[0090]
　In step S16, the dialog information encoding unit 23, based on the dialog information, and generates a gain value dialogue_gain additional dialog source during replacement dialog.
[0091]
　In step S17, the dialog information encoding unit 23, based on the dialog information, and generates additional dialog number information num_additional_dialogue indicating the number of additional dialog sound.
[0092]
　In step S18, the number dialog information encoding unit 23, based on the dialog information, the additional dialog information additional_dialogue_info for additional dialog source [i] and the correction gain value Additional_dialogue_gain [i], denoted by additional dialog number information num_additional_dialogue to produce only minute. Namely i = 0 to num_additional_dialogue-1, additional dialog information additional_dialogue_info [i] and the correction gain value additional_dialogue_gain [i] is generated. Thus, the correction gain value is obtained and additional dialog information encoded in each additional dialog source. The number of additional dialog sound source may be one or may be plural.
[0093]
　In step S19, the dialog information encoding unit 23 stores the data generated in step S14 to step S18 in the region of one DSE ().
[0094]
　That synchronization code Dialogue_info_sync, the main dialog information Main_dialogue_info, dialog location information Dialogue_src_index, gain values ​​Dialogue_gain, additional dialog number information Num_additional_dialogue, additional dialog information additional_dialogue_info [i], and the correction gain value additional_dialogue_gain [i] is stored in the DSE. Thus, for example, encoded data of dialog information according to the bitstream syntax shown in FIG. 3 will have been produced.
[0095]
　Dialog information encoding unit 23 supplies the encoded data in the dialog information obtained in this way to the multiplexing unit 24.
[0096]
　In step S20, the additional dialog excitation coding unit 22, the value of the index i indicating the additional dialog sound source to be processed and i = 0. Here, additional dialog sound source specified by the index i indicates that the i-th additional dialog sound source to be processed. Here, the number of additional dialog sound source is only Num_additional_dialogue, it is sufficient additional dialog sound source processed for the index i = 0 to num_additional_dialogue-1.
[0097]
　In step S21, additional dialog excitation coding unit 22 determines whether or not the value of the index i is i
　Next, an input bit stream outputted from the encoding device 11 will be described decoding apparatus for decoding encoded data included in the bit stream. Such decoding device is configured as shown in FIG. 6, for example. Note that portions corresponding to the case in FIG. 1 in FIG. 6 are denoted with the same reference numerals, and description thereof will be omitted as appropriate.
[0112]
　Decoding device 71 shown in FIG. 6, the separation unit 81, the channel sound source decoding unit 82, an additional dialog sound source decoding unit 83, dialog information decoding unit 84, presentation unit 85, input unit 86, gain correction unit 87, a dialog selection unit 88, gain correction unit 89, and has an additional dialog selection unit 90.
[0113]
　Separation unit 81, encoded data of channel sound source input bit stream, is separated into the coded data of the additional dialog excitation encoded data, and dialog information. Separation unit 81 supplies the encoded data channel sound source channel sound source decoding unit 82 supplies the encoded data of the additional dialog sound source additional dialog sound source decoding unit 83, dialog information decoding unit encoded data in the dialog information It supplies it to the 84.
[0114]
　Channel sound source decoding unit 82 decodes the encoded data of each channel sound source supplied from the separation section 81 supplies the resulting dialog channel add an audio signal dialog selecting section 90, the other channels sound audio signals, supplied to the speaker SP2 or speaker SP22 corresponding to those channels sound.
[0115]
　Add dialog sound source decoding unit 83, among the coded data of the additional dialog sound supplied from the separation unit 81 decodes only the coded data of the additional dialog sound source indicated by the supplied selection instruction from the input unit 86, the gain It is supplied to the correcting unit 87.
[0116]
　Dialog information decoder 84 decodes the encoded data of the supplied dialog information from the separation unit 81, and supplies the presentation unit 85 the resulting dialog information. Also, dialog information decoding unit 84 supplies the gain values ​​dialogue_gain dialog information obtained by decoding is supplied to the gain correction unit 89, a correction gain value additional_dialogue_gain of dialog information [i] to the gain correction unit 87.
[0117]
　Presentation section 84 presents the dialog information supplied from the dialog information decoder 84 to the viewer US11. Input unit 86, the signal corresponding to the input operation of the viewer US11, i.e. a selecting instruction indicating a dialog source or additional dialog sound source selected by the viewer US11, additional dialog sound source decoding section 83, the dialog selection unit 88, and additional supplied to the dialog selection unit 90.
[0118]
　Gain correction unit 87 based on the correction gain value additional_dialogue_gain supplied from the dialog information decoder 84 [i], performs gain correction for the audio signal of the addition dialog sound supplied from the additional dialog sound source decoding section 83, the dialog selection supplied to the part 88. More specifically, the gain correcting unit 87 has an amplifier for each additional dialog sound source, the audio signal of the addition dialog sound each amplifier supplied from the additional dialog sound source decoding unit 83, those additional dialog It outputs the result correction gain value corresponding to the sound source.
[0119]
　Dialog selection unit 88 based on the supplied selection instruction from the input unit 86, selects one of the audio signals of each additional dialog sound supplied from the gain correction unit 87, and supplies the gain correction unit 89 . More specifically, the dialog selection unit 88 comprises a switch for example, according to a selection instruction from the input unit 86, one of the output of the amplifier to the corresponding output terminal of the switch in each additional dialog source of gain correction unit 87 to connect to. Thus, only the audio signal of the addition dialog sound source indicated by the selection instruction is output from the output terminal of the switch to the gain correction unit 89.
[0120]
　Gain correction unit 89, based on the dialog information decoder 84 to the supplied gain value Dialogue_gain, performs gain correction for the audio signal of the addition dialog sound supplied from the dialog selection unit 88, and supplies the addition dialog selection section 90 . Add dialog selection unit 90 comprises a switch for example, based on the supplied selection instruction from the input unit 86, an audio signal supplied dialog sound from the channel source decoding unit 82 or the gain correction unit 89 adds dialog supplied from, selecting one of the sound source of the audio signal, supplied to the speaker SP1.
[0121]
　Here, the decoding apparatus 71 will be described an example with a separation unit 81 to add dialog selecting section 90, but only the separation unit 81 to dialog information decoder 84 is provided to the decoding apparatus 71, the other presenting part 85 to add dialog selection unit 90 may be provided outside the decoding apparatus 71.
[0122]

　Subsequently, the operation of the decoding apparatus 71.
[0123]
　Decoder 71, the bit stream has been transmitted from the encoding device 11 is supplied to start the decoding process to reproduce the channel sound obtained by decoding. Hereinafter, with reference to the flowchart of FIG. 7 will be described decoding processing by the decoding apparatus 71.
[0124]
　In step S61, the separation unit 81 determines the supplied bit stream, whether or not there is still unprocessed data for one frame.
[0125]
　Step S61 If one frame of data is determined to be in, in step S62, the separation unit 81 determines whether contains dialog information in the bit stream of one frame.
[0126]
　For example, among the DSE () that constitute the bit stream, when the synchronization code dialogue_info_sync there is DSE () stored, it is determined to contain a dialog information.
[0127]
　If it is determined not to contain dialog information in step S62, the dialog information is not, the processing of step S63 and step S64 is not performed, the process proceeds to step S65. In this case, the separation section 81, to separate the coded data channel sound from the bit stream, and supplies to the channel sound source decoding unit 82.
[0128]
　In contrast, if it is determined to contain a dialog information in step S62, the process proceeds to step S63. At this time, supplied from the separation unit 81 is a bit stream to separate the encoded channel data source supplies to the channel source decoding unit 82, in the dialog information decoding unit 84 to separate the encoded data in the dialog information from the bit stream to.
[0129]
　In step S63, the dialog information decoding unit 84, the main dialog information main_dialogue_info from supplied from the separation section 81 the encoded data, dialog location information Dialogue_src_index, obtains gain values ​​Dialogue_gain, and additional dialog number information Num_additional_dialogue. Also, dialog information decoding unit 84 supplies the acquired gain value dialogue_gain the gain correction unit 89.
[0130]
　In step S64, the dialog information decoding unit 84, by the amount of the number indicated by the additional dialog number information num_additional_dialogue from the supplied encoded data from the separation unit 81, additional dialog information additional_dialogue_info [i] and the correction gain value additional_dialogue_gain [i] to get. That is, for index i = 0 to num_additional_dialogue-1, additional dialog information additional_dialogue_info [i] and the correction gain value additional_dialogue_gain [i] is obtained.
[0131]
　Dialog information decoding unit 84 supplies the respective correction gain additional_dialogue_gain obtained [i] to the gain correction unit 87, the process proceeds to step S65.
[0132]
　The process of step S63 and step S64 described above, so that the dialog information is decoded according to the bit stream syntax shown in FIG. 3, for example.
[0133]
　Or it is determined not to contain dialog information in step S62, or when the additional dialog information and the correction gain value is obtained in step S64, processing in step S65 is performed.
[0134]
　In step S65, the channel sound source decoding unit 82 performs decoding of each channel channel sound source, including the dialog channel. That is, the channel sound source decoding unit 82 decodes the encoded data of channel sound source supplied from the separation unit 81, and outputs the audio signal of each channel sound obtained as a result. In this case, the audio signal of the dialog channel, i.e. dialogue sound source is supplied to the additional dialog selection unit 90, the other channels, the audio signal of the channel source not That dialog source is supplied to the speaker corresponding to those channels sound .
[0135]
　In step S66, the dialog information decoding unit 84 determines whether there is a dialog information. For example if there is a DSE () synchronization code dialogue_info_sync Some bitstream is stored, that is, when the decoding of the dialog information is performed in step S63 and step S64, it is determined that there is dialog information.
[0136]
　If it is determined that there is no dialog information in step S66, the processing of steps S67 to step S69 is not performed, the processing advances to step S70.
[0137]
　In contrast, if it is determined that there is dialog information in step S66, the dialog information decoding unit 84 is supplied to the presentation unit 85 the dialog information obtained by the decoding, the process proceeds to step S67.
[0138]
　In step S67, the presenting unit 85 presents a dialog information supplied from the dialog information decoder 84 to the viewer US11.
[0139]
　For example of the dialog information, at least the main dialog information, additional dialog number information, and additional dialog information is presented. Viewers US11 confirms the presented dialog information, to select one of the dialog to be reproduced from among the dialog sound source and some additional dialog sound source. Then, the viewer US11 operates the input unit 86 according to the own choice, make a selection the instructions in the dialog.
[0140]
　In step S68, the input section 86 acquires a dialog selection instruction of the viewer US11. The input unit 86 supplies the selection instruction according to the operation of the viewer US11 additional dialog sound source decoding section 83, the dialog selection unit 88, and the addition dialog selection unit 90.
[0141]
　In step S69, additional dialog sound source decoding unit 83, dialogue selection unit 88 and the additional dialog selecting section 90, based on the supplied selection instruction from the input unit 86, the selected dialog viewers US11 is included in the channel source It determines whether or not the dialog sound source of the dialog channel.
[0142]
　In step S69, if it is determined that the dialogue sound dialog channel included in the channel sound source, that is, when the switching to the additional dialog sound not instructed, the process proceeds to step S70. At this time, in addition dialog sound source decoding unit 83, decoding of the additional dialog sound is not performed.
[0143]
　If it is determined that there is no dialog information in or step S66, the is determined that the dialogue sound dialog channels included in the channel tone in step S69, processing in step S70 is performed.
[0144]
　In step S70, the decoder 71 outputs a respective channel sound source including a dialog source dialog channel.
[0145]
　That is, addition dialog selection unit 90 based on the supplied selection instruction from the input unit 86, an audio signal supplied dialogue channel from the channel source decoding unit 82 is supplied to the speaker SP1, to reproduce the dialog source. The speaker SP2 or speaker SP22, based on the supplied audio signal from the channel source decoding unit 82, reproduces the respective channel sound.
[0146]
　Thus is the channel-sound source corresponding to one frame is reproduced, the process returns to step S61, the process described above is repeated.
[0147]
　In contrast, if it is determined not to be the dialog source dialog channels included in the channel tone in step S69, if the words are determined to be added dialog sound source, the process proceeds to step S71.
[0148]
　In step S71, the additional dialog sound source decoding unit 83 based on the supplied selection instruction from the input unit 86, acquires the DSE () encoded data of the additional dialog source selected is stored from the separation unit 81 decodes the additional dialog sound source according to the bitstream syntax of the encoded data of the additional dialog sound source shown in FIG. 4, for example.
[0149]
　This process, only the coded data of the additional dialog sound source indicated by the selection instruction is decoded. Add dialog sound source decoding unit 83 supplies the audio signal of the addition dialog sound obtained by decoding the gain correction unit 87.
[0150]
　In step S72, the gain correction unit 87, supplied from the dialog information decoder 84, a correction gain value additional_dialogue_gain additional dialog sound source indicated by the selection instruction [i], additional dialog supplied from the additional dialog sound source decoding unit 83 multiplies the sound source audio signal, it performs a gain correction.
[0151]
　Gain correction unit 87 supplies the audio signal of the addition dialog sound whose gain is corrected in the dialog selection unit 88. Further, the dialog selection unit 88 switches the switch of the connection destination based on the supplied selection instruction from the input unit 86. Thus, supplied from the gain correction unit 87, the audio signal of the addition dialog sound source indicated by the selected instruction is supplied to the gain correction unit 89.
[0152]
　In step S73, gain correction unit 89 performs gain correction by multiplying the gain value dialogue_gain supplied from the dialog information decoder 84, the audio signal of the addition dialog sound supplied from the dialog selection unit 88, an additional dialog selection supplied to the part 90.
[0153]
　In step S74, the additional dialog selection unit 90 based on the supplied selection instruction from the input unit 86, the dialog channels supplied from the channel source decoding unit 82, an audio signal that is dialog sound source, supplied from the gain correction unit 89 replaced by the audio signal of additional dialog sound source which is to be output.
[0154]
　In this case, since the selection instruction indicates an additional dialog sound source is selected, additional dialog selecting unit 90 supplies the audio signal of the addition dialog sound supplied from the gain correction unit 89 to the speaker SP1, reproduction additional dialog source make. The speaker SP2 or speaker SP22, based on the supplied audio signal from the channel source decoding unit 82, reproduces the respective channel sound.
[0155]
　Thus, channel sound is reproduced by the speaker SP2 to speaker SP22, instead of dialog sound as channel sound in the speaker SP1, additional dialog sound source is reproduced.
[0156]
　Thus is the channel-sound source corresponding to one frame is reproduced, the process returns to step S61, the process described above is repeated.
[0157]
　Also, after the channel sound is reproduced in step S70 or step S74, the it is determined that there is no data for one frame in step S61, the decoding process ends.
[0158]
　Decoding device 71 as described above, and decodes the acquired encoded data dialog information from the bitstream, as well as presenting the dialog information, in accordance with the selection instruction of the viewer US11, and channel sound source, require additional to decode the dialog sound source.
[0159]
　By thus decoding the dialog information, it can be presented a dialog information, and depending on the selection instruction has been made in accordance with the presentation of the dialog information, by decoding only the additional dialog sound necessary, decoding it is possible to reduce the calculation amount.
[0160]
　Here, channels are replaced object, that speaker positions the dialog sound source is reproduced by an audio signal in the dialog channel is described an example a speaker SP1. However, the dialog information, because it contains dialog location information Dialogue_src_index, it is possible to specify for each frame an arbitrary speaker position as the position of the speaker for reproducing a dialog source.
[0161]
　In such a case, based on the dialog location information Dialogue_src_index, speaker positions to be replaced interest, ie, replace the target channel sound source is identified. Then, the channel sound source is identified, in accordance with the selection instruction of the viewer US11, or the audio signal of the channel source is output as it is, or the audio signal of the channel sound source, replacing the audio signal of the additional sound source is selected It is or is selected.
[0162]
　The series of processes described above can be executed by hardware or can be executed by software. When executing the series of processing by software, a program constituting the software is installed into a computer. Here, the computer includes a computer incorporated in dedicated hardware, by installing various programs, which can execute various functions include, for example, such as a general-purpose personal computer.
[0163]
　Figure 8 is a block diagram showing a configuration example of hardware of a computer that executes the series of processes described above.
[0164]
　In the computer, CPU (Central Processing Unit) 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503 are connected to each other via a bus 504.
[0165]
　The bus 504 is further output interface 505 is connected. Output interface 505, an input unit 506, output unit 507, recording unit 508, a communication unit 509, and a drive 510 are connected.
[0166]
　Input unit 506 includes a keyboard, a mouse, a microphone, made of an imaging device. The output unit 507 includes a display and a speaker. Recording unit 508, a hard disk and a nonvolatile memory. Communication unit 509 including a network interface. Drive 510 drives a magnetic disk, an optical disk, a magneto-optical disk, or a removable medium 511 such as a semiconductor memory.
[0167]
　Series In the computer configured as described above, CPU 501 is, for example, a program recorded in the recording unit 508 via the input-output interface 505 and the bus 504 and executes the loaded into RAM 503, the above-mentioned processing of is performed.
[0168]
　Program computer (CPU 501) is executed, for example, can be provided by being recorded on the removable medium 511 as a package medium or the like. Further, the program may be provided via a local area network, the Internet, or digital satellite broadcasting, a wired or wireless transmission medium.
[0169]
　In the computer, by mounting the removable medium 511 into the drive 510, it can be through the input-output interface 505, installed in the recording unit 508. The program via a wired or wireless transmission medium and received by the communication unit 509, can be installed in the recording unit 508. Alternatively, the program may be in the ROM502 and the recording unit 508 installed in advance.
[0170]
　The program which the computer executes may be a program in which processes are performed in time series in the order described herein, at a necessary timing such as when the parallel or call was made processing may be a program to be carried out.
[0171]
　Further, embodiments of the present technology is not limited to the embodiments described above, but various modifications are possible without departing from the scope of the present disclosure.
[0172]
　For example, the present technology, sharing one function by a plurality of devices via a network, it is possible to adopt a configuration of cloud computing which processes jointly.
[0173]
　Further, each step described in the above flowcharts may be executed by one device, it can be performed by allocating a plurality of apparatuses.
[0174]
　Further, when a plurality of processes are included in one step, the plurality of processes included in the one step may be executed by one device, it can be performed by allocating a plurality of apparatuses.
[0175]
　Additionally, the present technology may also be configured as follows.
[0176]
[1]
　encodes audio signals of a plurality of channels sound sources including dialog sound source, and a channel excitation coding unit to generate encoded data,
　encodes the audio signal in different adding dialog sound source and the dialog sound source encoded data an additional dialog excitation coding unit that generates,
　dialog information including information on the additional dialog sound source, the plurality of channels excitation coding data, and a multiplexer for multiplexing the coded data of the additional dialog sound
　a encoding apparatus comprising.
[2]
　encoded data and the dialog information of the additional dialog sound source is stored in the user data area of the resulting bit stream by the multiplexer
　coding apparatus according to [1].
[3]
　The user data area is a DSE defined in MPEG AAC or MPEG-D USAC
　encoding apparatus according to [2].
[4]
　The dialog information, containing information regarding the dialog sound
　coding apparatus according to any one of [1] to [3].
[5]
　The dialog information, the information indicating the type of additional dialog sound source, and the dialog information indicating the type of the sound source contains
　encoding apparatus according to [4].
[6]
　in the dialog information, information indicating the channel of the dialog sound of the channels of the audio signals of the plurality of channels source is a multi-channel configuration is included
　according to [4] or [5] encoding device.
[7]
　the dialog information, the have the audio signals of the additional dialog source contains gain information for the gain correction
　coding apparatus according to any one of [1] to [6].
[8]
　in the dialog information, for each of a plurality of said additional dialog sound source correction gain information for gain correction audio signals of the plurality of said additional dialog source contains
　[1] to [7] encoding apparatus according to any one of.
[9]
　The audio signals of a plurality of channels sound sources including dialog sound is encoded to generate encoded data and
　generates encoded data by encoding the audio signals of different additional dialog sound source and the dialog sound source,
　the additional dialog information including information on dialog source, the plurality of channel excitation coded data, and multiplexes the encoded data of the additional dialog excitation
　coding method comprising the steps.
[10]
　The audio signals of a plurality of channels sound sources including dialog sound is encoded to generate encoded data and
　generates encoded data by encoding the audio signals of different additional dialog sound source and the dialog sound source,
　the additional dialog information including information on dialog source, the plurality of channels excitation coding data, and multiplexes the encoded data of the additional dialog sound source
　program for executing the processing including a step in the computer.
[11]
　The coded bit stream, encoded data of a plurality of channels sound sources including dialog source, the dialog sound different one or more additional dialogs sound source encoded data, and a dialog containing information about the additional dialog source a separation unit for separating the information,
　the additional dialog sound source decoding unit for decoding the selected coded data of the additional dialog source was among the coded data of one or more of said additional dialog sound
　decoding apparatus comprising a.
[12]
　further comprising a channel sound source decoding section that decodes encoded data of the plurality of channel sound
　decoding apparatus according to [11].
[13]
　The dialog encoded data audio signal obtained by decoding the sound source, the selected the additional dialog sound dialog selection unit that is replaced with the audio signal obtained by decoding the encoded data further comprising a
　decoding device according to [11] or [12].
[14]
　The additional dialog sound source decoding unit, wherein decodes encoded data of the additional dialog sound selected in accordance with the presentation of the dialog information
　decoding apparatus according to any one of [11] to [13] .
[15]
　The coded bit stream, encoded data of a plurality of channels sound sources including dialog source, the dialog sound different one or more additional dialogs sound source encoded data, and a dialog containing information about the additional dialog source allowed to separate into information,
　selected to decode the encoded data of the additional dialog sound source of the encoded data of one or more of said additional dialog sound source
　decoding method comprising the steps.
[16]
　The coded bit stream, encoded data of a plurality of channels sound sources including dialog source, the dialog sound different one or more additional dialogs sound source encoded data, and a dialog containing information about the additional dialog source allowed to separate into information,
　the one or more of the additional dialog sound source selected the decodes encoded data of additional dialog sound of coded data of
　a program to be executed comprising the steps through the computer.
DESCRIPTION OF SYMBOLS
[0177]
　11 encoder, 21 channel excitation coding unit, 22 additional dialog excitation coding unit, 23 dialog information encoding unit, 24 multiplexer, 71 decoder, 81 separation section, 82 channel sound source decoding unit, 83 additional dialog source decoder, 84 dialog information decoding unit, 85 presentation unit, 86 input unit, 87 a gain correction unit, 88 dialog selecting unit, 89 a gain correction unit, 90 additional dialog selector
The scope of the claims

[Claim 1]
　The audio signals of a plurality of channels sound sources including dialog sound source coding, channel excitation coding unit to generate encoded data,
　the audio signals of different additional dialog sound source and the dialog source encoding to generate encoded data an additional dialog excitation coding unit,
　the additional dialog sound dialog information including information on the plurality of channels excitation coding data, and a multiplexer for multiplexing the coded data of the additional dialog excitation
　coding with the apparatus.
[Claim 2]
　Encoded data and the dialog information of the additional dialog sound source is stored in the user data area of a bit stream obtained by the multiplexed
　encoding apparatus according to claim 1.
[Claim 3]
　The user data area is a DSE defined in MPEG AAC or MPEG-D USAC
　encoding apparatus according to claim 2.
[Claim 4]
　Wherein the dialog information includes information on the dialog sound source
　encoding apparatus according to claim 1.
[Claim 5]
　Wherein the dialog information includes information indicating a type of the additional dialog sound source, and information indicating the type of the dialogue sound source
　encoding apparatus of claim 4.
[Claim 6]
　Wherein the dialog information, information indicating the channel of the dialog sound of the channels of the audio signals of the plurality of channels source is a multi-channel configuration is included
　coding apparatus according to claim 4.
[Claim 7]
　Wherein the dialog information, the audio signal of the addition dialog sound source gain information is included for gain correction
　encoding apparatus according to claim 1.
[8.]
　Wherein the dialog information, for each of a plurality of said additional dialog sound source correction gain information is included for gain correction audio signals of the plurality of said additional dialog sound
　coding apparatus according to claim 1.
[Claim 9]
　The audio signals of a plurality of channels sound sources including dialog sound is encoded to generate encoded data and
　generates encoded data by encoding the audio signals of different additional dialog sound source and the dialog sound source
　regarding the additional dialog source dialog information containing information, said plurality of channels excitation encoded data, and multiplexes the encoded data of the additional dialog excitation
　coding method comprising the steps.
[Claim 10]
　The audio signals of a plurality of channels sound sources including dialog sound is encoded to generate encoded data and
　generates encoded data by encoding the audio signals of different additional dialog sound source and the dialog sound source
　regarding the additional dialog source dialog information containing information, said plurality of channels excitation coding data, and multiplexes the encoded data of the additional dialog sound source
　program for executing the processing including a step in the computer.
[Claim 11]
　The coded bit stream, encoded data of a plurality of channels sound sources including dialog source, the dialog sound source and one or more additional dialog excitation encoded data which is different from, and in the dialog information including information regarding the additional dialog source separation a separation unit for,
　an additional dialog sound source decoding unit for decoding the selected coded data of the additional dialog source was among the coded data of one or more of said additional dialog sound
　decoding apparatus comprising a.
[Claim 12]
　Further comprising a channel sound source decoding section that decodes encoded data of the plurality of channel sound
　decoding apparatus according to claim 11.
[Claim 13]
　Further comprising the audio signal obtained by decoding the dialog sound source encoded data, the selected dialog selection unit that is replaced with the audio signal obtained by decoding the encoded data of the additional dialog source
　the decoding apparatus according to claim 11.
[Claim 14]
　The addition dialog sound source decoding unit decodes the encoded data of the additional dialog sound source is selected in response to presentation of the dialog information
　decoding apparatus according to claim 11.
[Claim 15]
　The coded bit stream, encoded data of a plurality of channels sound sources including dialog source, the dialog sound source and one or more additional dialog excitation encoded data which is different from, and in the dialog information including information regarding the additional dialog source separation is allowed,
　the selected decoding the encoded data of the additional dialog sound source of the encoded data of one or more of said additional dialog sound source
　decoding method comprising the steps.
[Claim 16]
　The coded bit stream, encoded data of a plurality of channels sound sources including dialog source, the dialog sound source and one or more additional dialog excitation encoded data which is different from, and in the dialog information including information regarding the additional dialog source separation It is allowed,
　decrypting the selected encoded data of the additional dialog source was among the coded data of one or more of the additional dialog sound source
　program for executing the processing including a step in the computer.