Technical field
[0001]
　This technique is sound processing apparatus and method, and a program, sound processing apparatus and method capable of adjusting more easily acoustic properties, and a program.
BACKGROUND
[0002]
　In recent years, the object audio technology has been used in movies and games, etc., it has also been developed coding system that can handle the object audio. For example, as a standard for coding of object audio, the international standard MPEG (Moving Picture Experts Group) -H Part 3: such 3D audio standards are known (e.g., see Non-Patent Document 1).
[0003]
　In such a coding method, and conventional two-channel stereo system, with a multi-channel stereo system, such as a 5.1 channel is treated as audio objects independent moving sound source or the like, the position of the audio object with the signal data of the audio objects it is possible to encode information as metadata. By doing so, in the conventional coding method it has been difficult, can be easily processed for a particular sound source at the time of reproduction. Specifically, for example, as processing of a particular sound source, it is possible to perform such additional volume control and effects for each audio object.
CITATION
Non-patent literature
[0004]
非特許文献1 : INTERNATIONAL STANDARD ISO/IEC 23008-3 First edition 2015-10-15 Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 3: 3D audio
Summary of the Invention
Problems that the Invention is to Solve
[0005]
　However, when reproducing an image comprising encoded audio object bitstreams such an object audio encoding techniques include the volume adjustment of audio objects is difficult.
[0006]
　Specifically, from among a plurality of audio objects, when performing such selection to volume control of the desired audio objects, just listen to the audio output, very difficult to choose the correct audio objects of interest it is.
[0007]
　This technology has been made in view of such circumstances, it is desirable to make it possible to adjust more easily acoustic characteristics.
Means for Solving the Problems
[0008]
　Sound processing apparatus of an embodiment of the present technology, on the basis of the object position information of the audio object, a display control unit for displaying the audio object information image representing the position of the audio object on the display unit, one or more of the audio objects from among, and a selector for selecting predetermined of said audio objects.
[0009]
　The sound processing apparatus, a parameter setting unit for setting parameters relating to sound of the selected the audio object by the selection unit may be further provided.
[0010]
　The sound processing apparatus, based on said parameters, audio object signal of the audio objects, and with respect to at least one of the background sound signals of the background sound, the process for adjusting the acoustic characteristics of the voice of the audio objects It may further signal adjusting section for performing the.
[0011]
　The parameter may be a parameter for volume control or tone control.
[0012]
　The sound processing apparatus, the rendering processing unit that performs rendering processing of the audio object signal of the audio objects may be further provided.
[0013]
　The parameters, a parameter that specifies the position of the audio object, the rendering processing unit is able to perform the rendering processing based on the parameter.
[0014]
　Wherein the display control unit, are displayed on the display unit, the sound of the audio object can be superimposed on the audio object information image position determined by the object position information on the associated video.
[0015]
　Wherein the display control unit, if the position determined by the object position information is in the display outside of the screen of the display unit can display the audio object information image to the edge portion of the display screen.
[0016]
　Wherein the selection unit may, depending on the specified operation on the position of the audio object information image by the user, to select the audio object.
[0017]
　The sound processing apparatus decodes the audio object bit stream, and the audio object signal of the audio objects, an audio object decoder to obtain said object position information may be further provided.
[0018]
　Sound processing method or a program according to an embodiment of the present technology, on the basis of the object position information of the audio object, to display the audio object information image representing the position of the audio object on the display unit, among one or more of the audio objects from comprises selecting the predetermined the audio object.
[0019]
　In one aspect of the present technology, on the basis of the object position information of the audio objects, an audio object information image representing the position of the audio object is displayed on the display unit, from among the one or more of the audio objects, given the audio object is selected.
Effect of the invention
[0020]
　According to the embodiments of the present technology, it is possible to adjust more easily acoustic characteristics.
[0021]
　Here, the advantages described in the present invention is not necessarily limited, it may be any of the effects described in the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
[0022]
FIG. 1 is a diagram showing an example of the configuration of a video sound processing apparatus.
Is a flow chart illustrating the FIG. 2] content reproduction process.
3 is a diagram for explaining the audio object information.
Is a diagram illustrating FIG. 4 the coordinate system of the object position information.
5 is a diagram illustrating the relationship between the display screen angle information of the image display unit.
Is a diagram for describing the adjustment of acoustic characteristics of FIG. 6 audio object.
7 is a diagram showing a configuration example of the sound processing apparatus.
8 is a diagram illustrating a display of the audio object information image.
Is a flowchart illustrating a FIG. 9 content reproduction process.
It is a diagram illustrating a configuration example of FIG. 10 computer.
DESCRIPTION OF THE INVENTION
[0023]
　Hereinafter, with reference to the accompanying drawings, a description will be given of an embodiment according to the present technology.
[0024]

　This technique is based on the object position information in the audio object bit stream, there is an audio object in the corresponding position on the display screen of the display device by that superimpose images of the rectangular frame or the like that is obtained by the position information of the audio object to be visualized. Further, in this technology, if the audio object is outside the display range of the display screen, by superimpose images together with information indicating the range in the corresponding direction of the display screen outer frame, the audio objects the position information so as to visualize. Thus, the device user, and selects the audio object based on the displayed information, it is possible to easily operate the volume control or the like.
[0025]
　Figure 1 is a diagram showing a configuration example of an embodiment of the audiovisual processing apparatus according to the present technology.
[0026]
　Audiovisual processing apparatus 11 shown in FIG. 1, the demultiplexing unit 21, video decoding unit 22, image display unit 23, an audio object decoder 24, the audio object information display control unit 25, operation unit 26, the signal adjuster 27, background sound decoding unit 28, and a signal adjusting section 29 and the rendering processor 30,.
[0027]
　This video sound processing apparatus 11, an input bit stream for reproducing the content consisting of video and audio is supplied. More particularly, the content obtained from the input bit stream is assumed to consist of a video and audio and the background sound of the audio objects associated with the video.
[0028]
　Demultiplexing unit 21, an input bit stream supplied from the outside, and a video bit stream, and an audio object bit stream, demultiplexes a background sound bit stream.
[0029]
　Here, the video bit stream is a bit stream that contains video signals for reproducing a video (image) of the content, the demultiplexing unit 21, the image of the video bit stream obtained by demultiplexing and it supplies the decoding section 22.
[0030]
　The audio object bit stream, of the audio signal for reproducing sound associated with the video content, and audio object signal for reproducing the audio of audio objects, an audio object information is meta data of the audio objects a bit stream that contains and.
[0031]
　Demultiplexing unit 21, the audio object bit stream obtained by demultiplexing, to the audio object decoding unit 24.
[0032]
　Furthermore, the bit background sound bit stream, of the audio signal for reproducing sound associated with the video content, audio other than audio of audio objects, i.e. a background sound signal for reproducing the background sound is included it is a stream. Demultiplexing unit 21 supplies the background sound bit stream obtained by demultiplexing the background sound decoding unit 28.
[0033]
　Video decoder 22 decodes the video bit stream supplied from the demultiplexing unit 21, and supplies the resulting video signal to the video display unit 23.
[0034]
　Video display unit 23, for example, a display device such as a liquid crystal display panel, based on the video signal supplied from the video decoding unit 22 displays an image (picture) of the content.
[0035]
　Audio object decoder 24 decodes the audio object bit stream supplied from the demultiplexing unit 21 to obtain the audio object information and audio object signal.
[0036]
　Audio object decoding unit 24 supplies the audio object information obtained by decoding is supplied to the audio object information display control unit 25 and the rendering processor 30, the audio object signal obtained by the decoding to the signal conditioning unit 27.
[0037]
　Audio object information display control unit 25, based on the supplied audio object information from the audio object decoding unit 24 generates the audio object information image which is image information indicating the position of the audio object, and supplies the video display unit 23 . Video display unit 23, the image of the content being displayed based on the video signal supplied from the video decoding unit 22, by superimpose audio object information image supplied from the audio object information display control unit 25, visually presenting the position of the audio object to the device user.
[0038]
　Operation unit 26 includes, for example receiver or for receiving a signal from a remote controller, a touch panel provided so as to overlap the image display unit 23, a button, a mouse, a keyboard or the like, receives an operation of the user, the user and it outputs a signal corresponding to the operation.
[0039]
　Specifically, the device user operates the operation section 26 while viewing the audio object information image displayed on the image display unit 23, selects the audio object or, such as audio volume control of the selected audio objects or the adjustment operation of the acoustic characteristics of. Operation unit 26 receives the operation for adjusting the acoustic characteristics of the user, generates a signal adjustment information for adjusting the acoustic characteristics in response to the operation, and supplies the signal conditioning unit 27 or the signal conditioning unit 29.
[0040]
　In the following, the operation unit 26 is continuously described as having a touch panel provided so as to overlap with provided integrally with the image display unit 23, i.e. on the display screen of the image display unit 23.
[0041]
　Signal conditioning unit 27, based on a signal supplied adjustment information from the operation unit 26, the acoustic characteristics such as sound volume adjustment and tone adjustment by adjusting the amplitude or the like of the audio object signals supplied from the audio object decoding unit 24 make adjustments, and supplies the resulting audio object signal to the rendering processor 30.
[0042]
　For example, when adjusting the volume of the acoustic characteristics, amplitude adjustment of the audio object signal. Also, when adjusting the sound quality of the acoustic characteristics, for example, by adjusting the gain by the filter processing using the filter coefficient for each frequency band (band) of the audio object signal, the effect on the sound based on the audio object signal It is added.
[0043]
　Background sound decoding unit 28 decodes the background sound bit stream supplied from the demultiplexing unit 21 supplies the background sound signal obtained as a result to the signal conditioning unit 29.
[0044]
　The signal conditioning unit 29, based on a signal supplied adjustment information from the operation unit 26, the acoustic characteristics such as sound volume adjustment and tone adjustment by adjusting the amplitude or the like of the supplied background sound signal from the background sound decoding unit 28 to adjust, for supplying a background sound signal obtained as a result to the rendering processor 30.
[0045]
　In the video sound processing apparatus 11, the signal adjusting unit consisting of the signal adjustment unit 27 and the signal adjuster 29, with respect to at least one audio object signal and the background sound signals, for adjusting the acoustic characteristics such as sound volume or sound quality processing of is performed. Thereby, acoustic characteristics of the voice of the audio object is adjusted.
[0046]
　When adjusting the acoustic characteristics of the voice of the audio objects, for example by reducing the volume of the background sound, such as increasing the volume of the sound of relatively audio objects, as appropriate, a process for the audio object signal, the background sound signal process and are combined for, acoustic characteristic adjustment of the sound of audio objects is realized.
[0047]
　Rendering processing unit 30 based on the audio object information supplied from the audio object decoding unit 24 performs rendering processing on the supplied audio object signal from the signal conditioning unit 27.
[0048]
　Further, the rendering processing unit 30 performs the audio object signal obtained by the rendering process, a mixing process for combining the background sound signal supplied from the signal adjustment unit 29, and outputs an output audio signal obtained as a result . Speaker supplied with the output audio signal based on the output audio signal, to reproduce the sound of the content. At this time, the voice and the background sound of the audio object is reproduced as a sound of the content.
[0049]

　Next, the operation of the audiovisual processing apparatus 11. That is, below with reference to the flowchart of FIG. 2 will be described content reproduction process performed by the video sound processing apparatus 11.
[0050]
　In step S11, the demultiplexing unit 21 demultiplexes the input bit stream supplied from the outside, obtaining video bit stream, audio objects bitstream, and the background sound bit stream.
[0051]
　Demultiplexing unit 21 supplies the video bit stream obtained by demultiplexing, audio objects bitstream, and the background sound bit stream, each video decoding unit 22, the audio object decoding unit 24 and the background sound decoding unit 28, to.
[0052]
　In step S12, the video decoder 22 decodes the video bit stream supplied from the demultiplexing unit 21, and supplies the resulting video signal to the video display unit 23. Video display unit 23, based on the video signal supplied from the video decoding unit 22, and displays an image (video) content. That is to play the video of the content.
[0053]
　In step S13, the background sound decoding unit 28 decodes the background sound bit stream supplied from the demultiplexing unit 21 supplies the background sound signal obtained as a result to the signal conditioning unit 29.
[0054]
　In step S14, the audio object decoding unit 24 decodes the audio object bit stream supplied from the demultiplexing unit 21 to obtain the audio object information and audio object signal.
[0055]
　Here, the audio object signal is a waveform signal of the sound of the audio objects, the decoding of audio objects bitstream, audio object signal is obtained for each one or a plurality of audio objects. For example audio object signal is a like PCM (Pulse Code Modulation) signal.
[0056]
　On the other hand, the audio object information, the audio object is a meta data including information indicating whether present in any position in space, are encoded in the format shown in FIG. 3 for example, the sound source.
[0057]
　In audio object information shown in FIG. 3, "num_objects" indicates the number of audio objects included in the audio object bitstream.
[0058]
　Further, "tcimsbf" indicates approximately a is, the complement of 2 code bits beginning of the "Two's complement integer, most significant (sign) bit first". "Uimsbf" is "Unsigned integer, most significant bit first" is an abbreviation of the most significant bit is an integer without leading sign.
[0059]
　Furthermore, "gain_factor [i]" indicates a gain of the i-th audio object included in the audio object bitstream.
[0060]
　"Position_azimuth [i]", "position_elevation [i]", and "position_radius [i]" indicates the position information of the i-th audio object included in the audio object bit stream, respectively.
[0061]
　Specifically, "position_azimuth [i]" indicates the azimuthal position of the audio object in the spherical coordinate system, "position_elevation [i]" indicates the angle of elevation of the position of the audio object in the spherical coordinate system. Further, "position_radius [i]" indicates the distance to the position of the audio object in the spherical coordinate system, i.e. the radius.
[0062]
　In the following, "position_azimuth [i]" is included in the audio object information, consisting of "position_elevation [i]", and "position_radius [i]", information indicating the position of the audio object, and be referred to as object position information .
[0063]
　Further, hereinafter, information indicating the gain of the audio object is a "gain_factor [i]" included in the audio object information is referred to both gain information.
[0064]
　Audio object information contained object position information and gain information for each such audio object is metadata of audio objects.
[0065]
　Here the relationship between the spherical coordinate system and the three-dimensional orthogonal coordinate system has a relationship shown in FIG.
[0066]
　In Figure 4, passing through the origin O, which is mutually perpendicular X-axis, Y-axis, and Z-axis and the axis of the three-dimensional orthogonal coordinate system. For example, in three-dimensional orthogonal coordinate system, the position of the audio object OB11 in space is the X-coordinate indicating the position of the X-axis direction X1, Y-axis is the Y-coordinate that indicates the direction of the position Y1, and the position of the Z-axis direction Z1 is used a Z-coordinate showing the denoted (X1, Y1, Z1).
[0067]
　In contrast spherical coordinate system, the azimuth angle Position_azimuth, elevation Position_elevation, and radius position_radius is used the position of the audio object OB11 in space represented.
[0068]
　Now, the origin O, a straight line r a straight line connecting the position of the audio object OB11 in space, to a straight line obtained by projecting the straight line r on the XY plane and straight line L.
[0069]
　In this case, the angle between the X axis and the straight line L theta is the azimuth angle position_azimuth indicating the position of the audio object OB11. Further, the angle between the straight line r and the XY plane φ is the elevation position_elevation indicating the position of the audio object OB11, the length of the straight line r is the radius position_radius indicating the position of the audio object OB11.
[0070]
　For example, the position of the origin O is the position of the user viewing the video (image) of the content, the positive direction of the X-direction (X-axis direction), i.e. in FIG. 4, the front direction is a front direction viewed from the user, the positive direction along the Y direction (Y axis direction), i.e. in FIG. 4, the right direction is a left direction as viewed from the user.
[0071]
　In this way, the audio object information, the position of each audio object is represented by the spherical coordinates.
[0072]
　Position and gain of the audio object indicated by such audio object information is a physical quantity that changes for each predetermined time interval. When reproducing the content, in response to changes in the audio object information, it is possible to move the sound image localization position of the audio object.
[0073]
　Returning to the flowchart of FIG. 2, the audio object decoding section 24, by decoding the audio objects bitstream to obtain audio object information and audio object signal.
[0074]
　Audio object decoding unit 24 supplies the audio object information obtained by decoding is supplied to the audio object information display control unit 25 and the rendering processor 30, the audio object signal obtained by the decoding to the signal conditioning unit 27.
[0075]
　In step S15, the audio object information display control unit 25 based on the audio object information supplied from the audio object decoding unit 24 calculates the position on the display screen of the audio objects.
[0076]
　For example, "INTERNATIONAL STANDARD ISO / IEC 23008-3 First edition 2015-10-15 Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 3: 3D audio" in the standard (hereinafter, see also referred to as Document 1), If it is possible to describe the information about the screen of the reproducing apparatus picture producer side is assumed in the bit stream as information about field of view in the horizontal direction of the angle information and the vertical direction, these angle information is not described It is supposed to use the default values ​​as angle information.
[0077]
　Here, the case of calculating the position on the display screen of the audio object using the default value of the angle information as an example.
[0078]
　For example, for a video display unit 23, the horizontal direction of the video display unit 23 as viewed from the origin O of the space, that is, the angle information indicating the angle in the Y direction and Screen_azimuth, video display unit 23 as viewed from the origin O in a space vertical, which means an screen_elevation the angle information indicating the angle of view of the Z-direction.
[0079]
　In this case, the default value of the horizontal field angle information Screen_azimuth, the default value of the vertical field angle information screen_elevation is a as shown in the following equation (1).
[0080]
[Number 1]

[0081]
　Moreover, a such angle information screen_azimuth and the angle information Screen_elevation, relationship between the display screen of the image display unit 23 is as shown in FIG.
[0082]
　In this example, the center position O 'of the display screen of the image display unit 23, Zuchu the origin O is the position of the user in space, the vertical position is in the same position.
[0083]
　Further, the origin at the center position O ', in the figure, the right direction is the positive direction of the x-direction in the figure, a two-dimensional orthogonal coordinate system in which the upward and the positive direction of the y-direction as the xy coordinate system, the the position on the xy coordinate system, with x and y coordinates and represented as (x, y).
[0084]
　Furthermore, in the x direction of the display screen of the image display unit 23 width (length) and Screen_width, the y direction of the display screen of the image display unit 23 width (length) and Screen_height. Note that these screen_width and screen_height are known values.
[0085]
　At this time, in view of the display screen of the image display unit 23, the position PS12 position PS11 and the left end of the right end is located by xy coordinates, respectively PS11 = (screen_width / 2,0) and the position PS12 = (- screen_width / 2,0) and a.
[0086]
　Similarly, in view of the display screen of the image display unit 23, the position of the position PS13 and the lower end of the upper end PS14 are located by xy coordinates, respectively PS13 = (0, screen_height / 2) and the position PS14 = (0 , the -screen_height / 2).
[0087]
　Furthermore the origin O as a starting point, a vector VB31 to the center position O 'as an end point, the origin O as the starting point, the angle AG31 of the positions PS11 and vector VB32 to ending the -Screen_azimuth. Similarly the vector VB31, the origin O as the starting point, the angle AG32 of the positions PS12 and vector VB33 to ending the Screen_azimuth.
[0088]
　Further, a vector VB31, the origin O as the starting point, the angle AG33 with vector VB34 to the position PS13 and ending the Screen_elevation. Vector VB31, the origin O as the starting point, the angle AG34 with vector VB35 to the position PS14 and ending the -Screen_elevation.
[0089]
　Audio object information display control unit 25, and angle information screen_azimuth and the angle information screen_elevation the default value, and length screen_width and screen_height of the image display unit 23 is a known value, the object position information included in the audio object information following equation (2) is calculated from the calculated position of the audio object on the display screen of the image display unit 23.
[0090]
[Number 2]

[0091]
　In the equation (2), position_azimuth and position_elevation constitute object position information indicates the azimuth and elevation showing the position of the audio object.
[0092]
　In this manner, when performing the calculation of equation (2), the display screen of the image display unit 23, i.e. so that the x and y coordinates indicating the position of the audio object in the image of the content is obtained. Hereinafter, the position of the audio object in this way of the video display unit 23 which is determined by the display screen, and be referred to as object screen position.
[0093]
　Incidentally, the audio object information display control unit 25, Equation (2) shows constraints, i.e. | position_azimuth | <| screen_azimuth |, and | position_elevation | <| screen_elevation | for the audio objects that do not meet the, for example as follows determine the object screen position Te.
[0094]
　That, | position_azimuth | <| screen_azimuth | if is not satisfied, the x-coordinate of the audio object indicated by the object screen position, when Position_azimuth is a positive value is the x = -screen_width / 2, position_azimuth is negative. the sometimes are x = screen_width / 2.
[0095]
　Moreover, | position_elevation | <| screen_elevation | if is not satisfied, the y coordinate of the audio object indicated by the object screen position, when Position_elevation is a positive value is the y = screen_height / 2, position_elevation is a negative value sometimes it is y = -screen_height / 2.
[0096]
　Therefore, for the audio objects that do not satisfy the constraints shown in equation (2), the object screen position of the audio object is a position of an end portion of the display screen of the image display unit 23. That is, the object screen position is a position indicated by the angle information of the image display unit 23.
[0097]
　Audio objects that do not meet the constraints of such a formula (2) is not observed on the image content, objects located outside the image, that is, objects in the display outside of the screen of the video display unit 23.
[0098]
　Accordingly, the object screen position obtained from the object position information, the audio object to be displayed outside the screen of the image display unit 23 is closest to the object screen position, the position of the end portion of the display screen of the image display unit 23, the final It will be a specific object screen position. The other, if the object screen position is outside the display screen, a line connecting the object screen position and the center position O ', the intersection between the edge of the display screen of the image display section 23, final object screen position it may be such as to.
[0099]
　Referring back to the flowchart of FIG. 2, in step S16, the audio object information display control unit 25 controls the image display unit 23 based on the object screen position, on the image (video) content, the audio object is present superimposing displays the audio object information image showing.
[0100]
　The display position of the audio object information image object display position, i.e. are located on the display screen of the video display unit 23 which is determined by the object position information. In other words, the audio object information image is determined by the object position information, is displayed on the position on the image (video) content.
[0101]
　For example audio object information display control unit 25, based on the object screen position obtained in the process of step S15, and displays a rectangular frame image of a rectangular frame having a predetermined size centered on the object screen position image information for, generating an image information of the audio object information image. For example the size of the rectangular frame image may be a predetermined size may be a size determined by the radius position_radius as object position information.
[0102]
　However, the rectangular frame image for audio objects not meet the constraints of the above-mentioned formula (2) is different from the rectangular frame image from the rectangular frame image satisfying the constraints audio objects. Here, the different rectangular frame image, for example, the shape and size of the rectangular frame is different from the display format of the color and the like may be different.
[0103]
　Audio object information display control unit 25 supplies the way the audio object information image generated by the image display unit 23 to display by superimposing the audio object information image on the image content.
[0104]
　In this case, it does not satisfy the constraint condition of Equation (2), that is the object screen position obtained from the object position information, the audio object information image of the audio object to be displayed outside the screen of the image display unit 23 is most object screen position close, and is displayed on the position of the end portion of the display screen of the image display unit 23. That is, the audio object information image is displayed on an end portion on the image of the content.
[0105]
　When the process of step S16 is performed, for example, to the video display unit 23, an image shown in FIG. 6 is displayed.
[0106]
　In the example shown in FIG. 6, on the image of the content being displayed on the video display unit 23, three persons HM11 to persons HM13 is displayed as an audio object.
[0107]
　Further, in a portion of the area of ​​the face of the person HM11 to person HM13, rectangular frame image FR11 to rectangular frame image FR13 are superimposed as each audio object information image. Thus, the user is able to see these rectangular frame image FR11 to rectangular frame image FR13, can easily recognize the audio object.
[0108]
　The audio objects that do not satisfy the constraint 6 Equation (2), that is, the rectangular frame image FR14 indicating that there is audio objects that are outside the display screen, is displayed on the display screen edge of the image display unit 23 there.
[0109]
　In particular, in this example to indicate that the audio object corresponding to the rectangular frame image FR14 is outside the display screen, the rectangular frame image FR14 are dotted line. That is, the rectangular frame image FR14 is displayed in a different display format from the other rectangular frame image FR11 to rectangular frame image FR13.
[0110]
　In this example, the rectangular frame image FR11 and rectangular frame image FR13 are also dotted line, dotted line rectangular frame image FR14 has a different display format from the dotted line of the rectangular frame image FR11 and rectangular frame image FR13 it has been, has been made so that it can be distinguished.
[0111]
　Audio object corresponding to the rectangular frame image FR14 Since located outside the display screen, the user can not confirm the audio object on the image content. But user can view a rectangular frame image FR14, can know that there is an audio object out of the display screen. For example, the user, if you look at the rectangular frame image FR14, can recognize that there are audio objects invisible on the left side outside the display screen when viewed from its own.
[0112]
　In such a state, and a rectangular frame image FR12 the user is displayed in the portion of the face area of ​​a person HM12, for example equipment user were selected such as pressing with a finger. This selection operation, so that the person rectangular frame image FR12 is displayed HM12 is selected.
[0113]
　Then, the rectangular frame image FR12 is highlighted displayed for the person HM12 selected. In this example, the rectangular frame image FR12 is depicted by a solid line, it indicates that the rectangular frame image FR12 is highlighted. Thus, the user can visually grasp whether selecting any audio object.
[0114]
　In contrast, the rectangular frame image FR11 person that has not been selected, rectangular frame image FR13, and rectangular frame image FR14 is depicted in dotted lines, it is not highlighted, that there is a normal display it represents that. Thus the rectangular frame image FR12 is selected, a rectangular frame image FR12 from the state of normal display depicted by dotted lines, the display state is changed to the state in which the highlighted drawn in solid lines.
[0115]
　Furthermore, in this example, along with the rectangular frame image FR12 it has been selected and highlighted in the vicinity rectangular frame image FR12, adjustment instruction for adjusting the acoustic characteristics of the voice of the person HM12 selected image CT11 is displayed.
[0116]
　Here, as an example of the adjustment instruction image CT11, image for performing volume adjustment of sound of a person HM12 is displayed. Incidentally, the operation for the adjustment instruction image, as well as volume control, but can also be performed, such as adjustment of sound quality, here for simplicity of explanation, the description will be continued as an example the volume adjustment.
[0117]
　A device user user can this adjustment instruction image CT11 By performing an operation on the arrow portion shown in, for adjusting the volume of the easier and more intuitive to the audio object audio. Specifically, the user in the drawing in the arrow portion of the adjustment instruction image CT11, it is possible to raise the volume by touching the upper part, in the drawing in the arrow portion Conversely, touching the lower part it is possible to lower the volume by. Further, for example, the amount of increase or decrease the volume according to the number and touching time touching the arrow portion is determined.
[0118]
　Further, the user adjusts a state where instruction image CT11 is displayed again, the rectangular frame image FR12 deselect person HM12 by such as pressing with a finger, in a state where adjustment instruction image CT11 is not displayed it is possible to return the display.
[0119]
　Returning to the flowchart of FIG. 2, in step S17, the operation unit 26 in response to operation by the user is a device user selects an audio object to adjust the acoustic characteristics.
[0120]
　For example the selection of an audio object by a user, the rectangular frame image displayed for the audio object, that is, the audio object information image user performs by specifying. At this time, the user from among the one or more audio objects, can either be adjusted acoustic properties by selecting only one audio object, adjusting the acoustic characteristics by selecting a plurality of audio objects in the order it is also possible.
[0121]
　Operation unit 26, in response to the designation operation of the audio object information image by the user, selects the audio object.
[0122]
　Specifically, in the example of FIG. 6, for example, when the user performs an operation of touching with a finger in a rectangular frame image FR12, the operation unit 26 based on the signal generated in response to the operation on the operation unit 26 of the user, a person HM12 corresponding to the rectangular frame image FR12, is selected as the audio object to adjust the acoustic characteristics.
[0123]
　In this way, the operating unit 26 to select the person corresponding to the rectangular frame image can be said to function as an audio object selecting unit that selects an audio object in accordance with a user operation.
[0124]
　The operation unit 26 by selecting the audio object for adjusting the acoustic characteristics, and controls the image display unit 23, causes highlight the rectangular frame image corresponding to the selected audio objects (audio object information image), the displaying the adjustment instruction image near rectangular frame image. Thus, in the example of FIG. 6, the rectangular frame image FR12 is highlighted, adjustment instruction image CT11 is displayed.
[0125]
　Then, the user is a device user performs an operation on the adjustment instruction image for instructing the adjustment of the acoustic characteristics of the voice of the audio objects. Incidentally, not only audio of the audio object may be able to be adjusted acoustic characteristics of the background noise.
[0126]
　In step S18, the operation unit 26 generates the signal adjustment information for on the basis of a signal generated in response to the operation on the adjustment instruction image of the user, adjusting the acoustic characteristics of the voice of the audio object selected.
[0127]
　For example, an operation unit 26, if the volume control of the sound of the audio object is instructed to generate the signal adjustment information for instructing to decrease the volume only the instructed amount, or raised. In this case, for example, the signal adjustment information, the amount to increase or decrease the volume, that is, information indicating the amount of adjustment of the sound volume will be included as a parameter.
[0128]
　When, for example, the operation unit 26 of the sound quality adjustment of the sound of audio objects is instructed to select the filter coefficient used in the filtering process for adding an effect corresponding to the instruction, the information indicating the selected filter coefficient parameter generating a signal adjustment information including a.
[0129]
　Signal adjustment information generated in this manner, information indicating the amount of adjustment of the volume, such as information indicating the filter coefficients, parameters related to the acoustic, that is, those containing a parameter indicating the degree of adjustment when adjusting the acoustic characteristics. Thus, the operation unit 26 according to a user's operation, sets a parameter for adjusting the acoustic characteristics, it can be said that also functions as a parameter setting unit for generating a signal adjustment information including the set parameters.
[0130]
　Operation unit 26, the generated signal adjustment information as described above, and supplies the signal conditioning unit 27, the signal adjusting section 29 or the signal conditioning unit 27 and the signal adjuster 29,.
[0131]
　In step S19, the signal conditioning unit 27 or the signal adjuster 29 adjusts the sound characteristics based on signal adjustment information supplied from the operation unit 26.
[0132]
　For example, when only the signal adjustment information signal adjustment unit 27 is supplied, the signal adjusting section 27 based on the supplied signal adjustment information from the operation unit 26, with respect to an audio object signal supplied from the audio object decoding unit 24 the adjustment of the acoustic characteristics such as volume adjustment and sound quality adjustment Te. The signal adjusting section 27 supplies the audio object signals acoustic characteristic is adjusted to the rendering processor 30. The signal adjusting unit 29, supplies the rendering processing unit 30 of the background sound signal supplied from the background sound decoding unit 28.
[0133]
　Specifically, for example, signal conditioning unit 27 based on the signal adjustment information, performs the sound volume adjustment by amplifying or attenuating the amplitude of the audio object signals. Further, for example, the signal adjusting unit 27 uses the filter coefficients indicated by the signal adjustment information, performs the sound quality adjustment by applying filtering processing to the audio object signal, adds effects to the audio.
[0134]
　If this respect, for example, only the signal adjustment information signal adjustment unit 29 is supplied, the signal adjusting section 29 based on the signal adjustment information supplied from the operation unit 26, supplied from the background sound decoding unit 28 the adjustment of the acoustic characteristics such as volume adjustment and sound quality adjustment against the background sound signal. The signal conditioning unit 29 supplies the background sound signal acoustic characteristics is adjusted to the rendering processor 30. The signal adjusting unit 27 is directly supplied to the rendering processor 30 to the audio object signal supplied from the audio object decoding unit 24.
[0135]
　Further, for example, when the signal adjustment information in both the signal conditioning unit 27 and the signal adjuster 29 is supplied, the acoustic characteristics in the signal adjusting section 27 and the signal adjuster 29, for each audio object signals and background sound signals is of the adjustments are made. The audio object signals and background sound signals acoustic characteristic is adjusted is supplied to the rendering processor 30.
[0136]
　Here, a method of adjusting the acoustic characteristics There are various ways, if it is implemented to adjust the acoustic characteristics of the sound of the specified audio object by a user, by any method to adjust the acoustic characteristics may be performed . For example, by reducing the amplitude of all of the audio object signals and background sound signals other than audio object signal of an audio object selected, it may be caused to relatively increase the volume of the sound of the audio object selected .
[0137]
　Also, rather than adjusting the amplitude or the like of the audio object signals and background sound signals directly, by changing the gain information gain_factor [i] included in the audio object information shown in FIG. 3, the acoustic characteristics in the rendering processing unit 30 it may be the adjustment is performed.
[0138]
　In such a case, the operation unit 26 generates the signal adjustment information including information indicating the change amount of the gain information gain_factor [i] as a parameter, and supplies the rendering processing unit 30. Information indicating the change amount of such gain information, because the information for adjusting the volume of the sound, can be said to be a parameter relating to sound of audio objects.
[0139]
　Rendering processing unit 30 based on the signal adjustment information from the operation unit 26 changes the gain information included in the supplied audio object information from the audio object decoding unit 24, using the gain information after the change will be described later processing of step S20 perform.
[0140]
　In step S20, the rendering processing unit 30 based on the audio object information supplied from the audio object decoding unit 24 performs rendering processing of the supplied audio object signal from the signal conditioning unit 27.
[0141]
　Further, the rendering processing unit 30 performs the audio object signal obtained by the rendering process, a mixing process for combining the background sound signal supplied from the signal adjustment unit 29, and outputs an output audio signal obtained as a result Te, the content reproduction process is ended.
[0142]
　For example, in the audiovisual processing apparatus 11, for background sound signal, reproduction is performed in a so-called multi-channel stereo system, such as a conventional 2-channel and 5.1-channel.
[0143]
　For audio object signal, on the other hand, the rendering system of the audio objects in reference 1 has been described, the rendering by the rendering processing unit 30 by the rendering scheme is reproduced is performed. Specifically, the audio object signal to the speaker of the reproduction environment in a manner called VBAP (Vector Base Amplitude Panning) is reproduced is mapped.
[0144]
　That is, in the rendering processing unit 30, the gain information included in the audio object information shown in FIG. 3 is multiplied to the audio object signals is performed gain adjustment, in VBAP based on audio object signal gain adjustment is performed processing is carried out.
[0145]
　In VBAP, indicated by the object position information included in the audio object information shown in FIG. 3, the closest three speakers in a position of an audio object in the space, the audio object signals are mapped in gain set for each speaker that.
[0146]
　Thus VBAP is indicated by the object position information, using the output of the three speakers in the position closest to the position of the audio object in the space, in technology of localizing the sound location in space of the audio objects is there.
[0147]
　The VBAP, for example, "Virtual Sound Source Positioning Using Vector Base Amplitude Panning, AES Volume 45 Issue 6 pp.456-266, June 1997" (hereinafter, also referred to as reference 2) are described in detail in. In reference 1 or reference document 2, the number of speakers is also of course possible to localize a sound three at a but the number four or more speakers.
[0148]
　Further, in the above example it has been described background sound signal to be encoded and decoded in a multi-channel stereo system, viewer space in the vicinity, called the reference described in the standard literature 1 HOA (Higher Order Ambisonic) and it may be used such a manner as to express the orthogonal base of spherical harmonics.
[0149]
　Audiovisual processing apparatus 11 as described above, generates an audio object information image on the basis of the audio object information, as well as superimposed on the image of the content, it generates a signal adjustment information in response to operation of the user, the voice the adjustment of the acoustic characteristics.
[0150]
　The image of the thus content, by superimposing display the audio object information image obtained by using the audio object information, the user selects the easier and more intuitive to audio objects, the adjustment of acoustic characteristics of the sound volume adjustment, It can be carried out.
[0151]

　Now, in the first embodiment described above, the audio object information obtained by using the object position information of the audio objects in the image (video) content It has been described to superimpose images. However, this technique is applicable even when not accompanied by a video as a content.
[0152]
　In the second embodiment, not contain a video bit stream in an input bit stream, a case that is contains only the input bit stream to the audio object bitstream and a background sound bit stream.
[0153]
　In such a case, the sound processing apparatus to which the present technology is applied, is configured as shown in FIG. 7, for example. In FIG. 7, the portions corresponding to the case in FIG. 1 are given the same reference numerals, and description thereof will be omitted as appropriate.
[0154]
　Sound processing apparatus 81 shown in FIG. 7, the demultiplexing unit 21, image display unit 23, an audio object decoder 24, the audio object information display control unit 25, operation unit 26, the signal adjusting unit 27, the background sound decoding unit 28, and a signal adjusting section 29 and the rendering processor 30,.
[0155]
　The configuration of the sound processing apparatus 81 is different from the configuration of the audiovisual processing apparatus 11 in that the video decoding section 22 is not provided, but otherwise has the same construction as that of the audiovisual processing apparatus 11.
[0156]
　However, the sound processing apparatus 81, the audio object information obtained by the audio object decoding unit 24 is also supplied to the operation unit 26. The operation unit 26, in response to user's operation is an apparatus user, as appropriate, to change the object position information of the audio object, and supplies the object position information after the change to the rendering processor 30.
[0157]
　For example, when reproducing the contents of only pure voice without video, it is possible to change the position of the audio object at an arbitrary position. This means that when contains video and the content is moved to the position of the audio object, the position of the audio object, but shifted to a position of the video object corresponding to the audio object occurs in the content of audio-only such a thing is because not occur.
[0158]
　In this case, the audio object bit stream, because it contains audio object information, it is possible to display the audio object information image on the video display unit 23. Thus, the user is a device user, by viewing the audio object information image, while confirming the position of the audio object visually, it is possible to perform processing and editing content. Such embodiment is preferred when for example studio that edits the work content consisting of audio only.
[0159]
　In the sound processing apparatus 81, the display of the audio object information image is, for example, as shown in FIG.
[0160]
　In the example shown in FIG. 8, on the display screen of the image display unit 23, the object position display region R11, the object metadata display area R12, and the object position time transient display region R13 is provided.
[0161]
　The object position display region R11, the audio object information image showing the position of the audio object is displayed. In this embodiment, the audio object information image is displayed at a position indicated by the object position information.
[0162]
　In this example, the object position display region R11, together with the respective axes of the three-dimensional orthogonal coordinate system shown in an arrow A11 are displayed, the audio object information image indicating the respective positions of the two audio objects FR31 and audio object information image FR32 is displayed. Here, three-dimensional orthogonal coordinate system shown in an arrow A11 is, X axis shown in FIG. 4, a Y-axis, and three-dimensional orthogonal coordinate system with the axis Z-axis.
[0163]
　Further, in this example, whereas the audio object information image FR31 is depicted by a dotted line, the audio object information image FR32 is depicted in solid lines, highlighted audio object information image FR32 is the selected state state being is represented. That is, each audio object information image is displayed in a different display format and when it is the selected state, and otherwise. Further, in FIG. 8, it is represented how the audio object information image FR32 is moved.
[0164]
　User a device user, by looking at the audio object information image displayed on the object position display region R11, it is possible to confirm the position of the audio object in the space visually.
[0165]
　The object metadata display area R12, extracted from audio objects bitstream, metadata of the audio object in the selected state, that is, information included in the audio object information is displayed. For example the information contained in the audio object information, the object position information and gain information are displayed.
[0166]
　The object position time transient display region R13, audio object information image that is the selected state, that is, the position in space at each time of the audio objects in the selected state are displayed.
[0167]
　More specifically, the object position time transient display region R13, X coordinate display area R21, Y coordinate display area R22, and Z coordinate display area R23 are provided, their X coordinate display area R21 to Z coordinate display in the figure in the region R23, the horizontal direction indicates the time direction.
[0168]
　The X coordinate display area R21, out of the audio object corresponding to the audio object information image displayed on the object position display region R11, the position of the X-axis direction in space at each time of the audio objects that are in the selected state position transition information PL11 indicating the X coordinate is is displayed. In other words, the position transition information PL11 is information indicating the time transition of the X-coordinate of the audio objects.
[0169]
　Similarly, the Y coordinate display area R22, is displayed positional transition information PL12 indicating the Y-coordinate is the position of the Y-axis direction in space at each time of the audio object is selected. The Z coordinate display area R23, is displayed positional transition information PL13 indicating a Z coordinate is the position of the Z-axis direction in space at each time of the audio object is selected.
[0170]
　Further, in the first time position on the time axis in these X-coordinate display area R21 to Z coordinate display area R23, the cursor CR11 is displayed.
[0171]
　In this example, by operating the user operation unit 26 is a device user selects a desired audio object information image displayed on the object position display region R11, each audio object in the audio object information image position transition information indicating the position at time PL11 to position transition information PL13 is displayed. In the example of FIG. 8, the audio object is in the selected state corresponding to the audio object information image FR32.
[0172]
　The user, by moving the cursor CR11 to a desired position in the time axis direction, it is possible to specify a given time. When time is designated by the cursor CR11, the object position display region R11, the spatial position of each audio object in the time indicated by the cursor CR11, audio object information image of those audio object is displayed.
[0173]
　Therefore, in this embodiments, X-coordinate of the time that the cursor CR11 in the position transition information PL11 to position transition information PL13 are positioned, Y coordinates, and the spatial position indicated by Z-coordinate, audio of the audio objects in the selected state object information image FR32 is displayed.
[0174]
　In this state, as shown in Figure 8, moving the audio object information image FR32 the user is in the selected state, and positions the cursor CR11 in the position transition information PL11 to position transition information PL13 time X-coordinate of who is, Y and Z coordinates, are changed. That is, the moving operation of the audio object information image FR32 by the user is reflected to the location transition information PL11 to position transition information PL13.
[0175]
　The audio user audio object information image to be selected, changing the audio object information image FR31, display object metadata display region R12 and the object position time transient display region R13 also which is newly selected It is updated to that of the object information image FR31.
[0176]
　Furthermore, in this example, so as to be able to change operation of the spatial position of the audio object easily, or to the user rotates the three-dimensional orthogonal coordinate system itself indicated by the arrow A11, also or to scale It has been made so that it can be.
[0177]
　As described above, according to the sound processing apparatus 81 can easily perform it while visually confirming the work processing and editing of audio objects included in the input bitstream.
[0178]
　Further, in the example shown in FIG. 8, similarly to the case described with reference to FIG. 6, to display the adjustment instruction image such as by selecting an audio object, for the selected audio object, such as volume adjustment and tone adjustment it is also possible to adjust the acoustic characteristics.
[0179]

　Next, an operation of the sound processing apparatus 81. That is, below with reference to the flowchart of FIG. 9 will be described content reproduction processing performed by the sound processing apparatus 81.
[0180]
　When the content reproduction processing is started, the processing of step S51 is executed, this processing is the same as the processing of step S11 in FIG. 2, a description thereof will be omitted. However, in step S51, the input bit stream is de-multiplexed to the audio object bitstream and a background sound bit stream.
[0181]
　Further, the input bit stream is de-multiplexed, the processing of step S52 and step S53 are performed, since these processes are the same as those in steps S13 and S14 in FIG. 2, description thereof will be omitted . However, in step S53, the audio object information obtained by the decoding of the audio object bit stream is supplied to the audio object information display control unit 25, operation unit 26 and the rendering processor 30,.
[0182]
　In step S54, the audio object information display control unit 25 based on the audio object information supplied from the audio object decoding unit 24, and controls the image display unit 23 to display the audio object information image.
[0183]
　That is, the audio object information display control unit 25 generates an audio object information image on the basis of the audio object information, and displays and supplies the audio object information image on the video display unit 23.
[0184]
　Thus, the image display unit 23, for example, the screen shown in FIG. 8 is displayed. That is, the process of step S54, the image display unit 23, together with the audio object information image is displayed at a position indicated by the object position information included in the audio object information, the metadata and position transition information of audio objects displayed It is.
[0185]
　Thus audio object information image is displayed in the, the user is a device user operates the operating unit 26 to change the position of the audio object, or perform volume adjustment and sound quality adjustment.
[0186]
　In step S55, the operation unit 26, in response to operation of the user, it changes the object position information of the audio objects.
[0187]
　For example, in the example shown in FIG. 8, when the user moves the audio object information image FR32, the operation unit 26, in accordance with the movement of the audio object information image FR32, changes the object position information of the corresponding audio object .
[0188]
　Object position information is used for rendering, the position of the audio object in the space, that is, information that specifies the localization position of the sound image of the audio objects in the space. Therefore, processing for changing the object position information, it can be said that a process of setting the parameters relating to sound of audio objects.
[0189]
　In step S56, the operation unit 26, in accordance with a user operation, generates a signal adjustment information. In step S56, processing similar to step S18 of FIG. 2 are performed. In step S56, in accordance with the movement of the position of the audio object information image, it is set parameters for the adjustment of acoustic characteristics, may be the signal adjustment information including the parameters is generated.
[0190]
　Operation unit 26, the generated signal adjustment information as described above, and supplies the signal conditioning unit 27, the signal adjusting section 29 or the signal conditioning unit 27 and the signal adjuster 29,. The operation unit 26 is obtained by the processing in step S55, it supplies the object position information after the change to the rendering processor 30.
[0191]
　When the signal adjustment information is generated, then, although the process is performed the content reproduction processing in step S57 and step S58 ends, since these processes are the same as those in step S19 and step S20 in FIG. 2, and a description thereof will be omitted.
[0192]
　However, in step S58, the rendering processing unit 30 is supplied from the operation unit 26, by using the object position information after the change, and gain information included in the audio object information supplied from the audio object decoding unit 24 Rendering processing is carried out.
[0193]
　As described above, the sound processing apparatus 81 based on the audio object information, and displays to generate an audio object information image, the adjustment of acoustic characteristics of the voice to generate the signal adjustment information in accordance with a user operation the and go, or to change the object position information. This allows the user to select more easily and intuitively audio object, or perform adjustment of acoustic characteristics, it is possible to move the position of the audio object. That can be easily performed while confirming the work of processing and editing of audio objects visually.
[0194]
　The series of processes described above can be executed by hardware or can be executed by software. When executing the series of processing by software, a program constituting the software is installed into a computer. Here, the computer includes a computer incorporated in dedicated hardware, by installing various programs, which can execute various functions include, for example, such as a general-purpose personal computer.
[0195]
　Figure 10 is a block diagram showing a configuration example of hardware of a computer that executes the series of processes described above.
[0196]
　In the computer, CPU (Central Processing Unit) 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503 are connected to each other via a bus 504.
[0197]
　The bus 504 is further output interface 505 is connected. Output interface 505, an input unit 506, output unit 507, recording unit 508, a communication unit 509, and a drive 510 are connected.
[0198]
　Input unit 506 includes a keyboard, a mouse, a microphone, made of an imaging device. The output unit 507 includes a display and a speaker. Recording unit 508, a hard disk and a nonvolatile memory. Communication unit 509 including a network interface. Drive 510 drives a magnetic disk, an optical disk, a magneto-optical disk, or a removable recording medium 511 such as a semiconductor memory.
[0199]
　Series In the computer configured as described above, CPU 501 is, for example, a program recorded in the recording unit 508 via the input-output interface 505 and the bus 504 and executes the loaded into RAM 503, the above-mentioned processing of is performed.
[0200]
　Program computer (CPU 501) is executed, for example, can be provided by being recorded in a removable recording medium 511 as a package medium or the like. Further, the program may be provided via a local area network, the Internet, or digital satellite broadcasting, a wired or wireless transmission medium.
[0201]
　In the computer, by mounting the removable recording medium 511 into the drive 510, it can be through the input-output interface 505, installed in the recording unit 508. The program via a wired or wireless transmission medium and received by the communication unit 509, can be installed in the recording unit 508. Alternatively, the program may be in the ROM502 and the recording unit 508 installed in advance.
[0202]
　The program which the computer executes may be a program in which processes are performed in time series in the order described herein, at a necessary timing such as when the parallel or call was made processing may be a program to be carried out.
[0203]
　Further, embodiments of the present technology is not limited to the embodiments described above, but various modifications are possible without departing from the scope of the present disclosure.
[0204]
　For example, the present technology, sharing one function by a plurality of devices via a network, it is possible to adopt a configuration of cloud computing which processes jointly.
[0205]
　Further, each step described in the above flowcharts may be executed by one device, it can be performed by allocating a plurality of apparatuses.
[0206]
　Further, when a plurality of processes are included in one step, the plurality of processes included in the one step may be executed by one device, it can be performed by allocating a plurality of apparatuses.
[0207]
　Additionally, the present technology may also be configured as follows.
[0208]
(1)
　on the basis of the object position information of the audio object, a display control unit for displaying the audio object information image representing the position of the audio object on the display unit,
　from among the one or more of the audio objects, given the audio a selection unit that selects an object
　sound processing apparatus comprising a.
(2)
　further comprises a parameter setting unit for setting parameters relating to sound of the selected the audio object by the selection unit
　sound processing apparatus according to (1).
(3)
　based on said parameter, audio object signal of the audio objects, and with respect to at least one of the background sound signals of the background sound, performs processing for adjusting the acoustic characteristics of the voice of the audio object signal further comprising an adjustment unit
　sound processing apparatus according to (2).
(4)
　the parameter is a parameter for volume control or tone control
　sound processing apparatus according to (3).
(5)
　further comprising a rendering processing unit which performs a rendering process of the audio object signal of an audio object
　sound processing apparatus according to any one of (2) to (4).
(6)
　The parameter is a parameter that specifies the position of the audio object,
　the rendering processing unit performs the rendering processing based on the parameter
　sound processing apparatus according to (5).
(7)
　The display control unit is configured is displayed on the display unit, wherein the position determined by the object position information in the video on the accompanying audio of audio objects to superimpose audio object information image
　(1) to sound processing apparatus according to any one of (6).
(8)
　The display control unit, when the position determined by the object position information is in the display outside of the screen of the display unit to display the audio object information image to the edge portion of the display screen
　sound according to (7) processing apparatus.
(9)
　the selection unit in accordance with the specified operation on the position of the audio object information image by the user, selects the audio object
　sound processing apparatus according to (7) or (8).
(10)
　decodes the audio object bit stream, and the audio object signal of the audio objects, further comprising an audio object decoder for obtaining the object position information
　according to any one of (1) to (9) sound processing apparatus.
(11)
　Based on the object position information of the audio object, to display the audio object information image representing the position of the audio object on the display unit,
　from among the one or more of the audio objects, selecting a predetermined said audio object
　comprising sound processing method.
(12)
　on the basis of the object position information of the audio objects, the is displayed on the display unit of the audio object information image representing the position of the audio object,
　from among the one or more of the audio objects, selecting a predetermined said audio object
　program for executing the processing including a step in the computer.
DESCRIPTION OF SYMBOLS
[0209]
　11 audiovisual processing apparatus, 21 demultiplexing unit, 23 image display unit, 24 an audio object decoding unit, 25 audio object information display control unit, 26 operation unit, 27 signal adjuster, 28 background sound decoding unit, 29 signal adjuster , 30 rendering processing unit

claims
[Requested item 1]
　Based on the object position information of the audio object, a display control unit for displaying the audio object information image representing the position of the audio object on the display unit,
　selected from among one or more of the audio object, the predetermined said audio object a selection unit for
　sound processing apparatus comprising a.
[Requested item 2]
　Further comprising a parameter setting unit for setting parameters relating to sound of the selected the audio object by the selection unit
　sound processing apparatus according to claim 1.
[Requested item 3]
　Based on the parameters, audio object signal of the audio objects, and with respect to at least one of the background sound signals of the background sound, the signal adjusting portion performs a process for adjusting the acoustic characteristics of the voice of the audio objects provided further
　sound processing apparatus according to claim 2.
[Requested item 4]
　It said parameter is a parameter for volume control or tone control
　sound processing apparatus according to claim 3.
[Requested item 5]
　Further comprising a rendering processing unit which performs a rendering process of the audio object signal of the audio object
　sound processing apparatus according to claim 2.
[Requested item 6]
　The parameter is a parameter that specifies the position of the audio object,
　the rendering processing unit performs the rendering processing based on the parameter
　sound processing apparatus according to claim 5.
[Requested item 7]
　The display controller, the is displayed on the display unit, the sound of the audio objects to superimpose the audio object information image position determined by the object position information on the accompanying video
　sound according to claim 1 processing apparatus.
[Requested item 8]
　Wherein the display control unit, when the position determined by the object position information is in the display outside of the screen of the display unit to display the audio object information image to the edge portion of the display screen
　sound processing apparatus according to claim 7.
[Requested item 9]
　The selection unit in accordance with the specified operation on the position of the audio object information image by the user, selects the audio object
　sound processing apparatus according to claim 7.
[Requested item 10]
　Decoding the audio objects bitstream, the audio object signal of the audio objects, further comprising an audio object decoding unit to obtain said object position information
　sound processing apparatus according to claim 1.
[Requested item 11]
　Based on the object position information of the audio object, to display the audio object information image representing the position of the audio object on the display unit,
　from among the one or more of the audio objects, selecting a predetermined said audio object
　comprising sound processing method.
[Requested item 12]
　Based on the object position information of the audio object, to display the audio object information image representing the position of the audio object on the display unit,
　from among the one or more of the audio objects, selecting a predetermined said audio object
　comprising program for executing the processing to the computer.