The present technology relates to information processing devices and methods, and programs, and more particularly to information processing devices, methods, and programs that enable a high sense of presence to be obtained with a small amount of calculation.
Background technology
[0002]
　Conventionally, object audio technology has been used in movies and games, and coding methods that can handle object audio have also been developed. Specifically, for example, the international standard MPEG (Moving Picture Experts Group) -H Part 3: 3D audio standard is known (see, for example, Non-Patent Document 1).
[0003]
　In such a coding method, in addition to the conventional 2-channel stereo method and multi-channel stereo method such as 5.1 channel, a moving sound source or the like is treated as an independent audio object, and the position information of the object is treated together with the signal data of the audio object. It can be encoded as metadata.
[0004]
　By doing so, playback can be performed in various viewing environments with different numbers and arrangements of speakers. In addition, it is possible to easily process the sound of a specific sound source at the time of reproduction, such as adjusting the volume of the sound of a specific sound source and adding an effect to the sound of the specific sound source, which was difficult with the conventional coding method.
[0005]
　For example, in the standard of Non-Patent Document 1, a method called three-dimensional VBAP (Vector Based Amplitude Panning) (hereinafter, simply referred to as VBAP) is used for rendering processing.
[0006]
　This is one of the rendering methods generally called panning, and among the speakers existing on the surface of the sphere whose origin is the user position, the gain is obtained for the three speakers closest to the audio object also existing on the surface of the sphere. It is a method of rendering by distributing.
[0007]
　In addition to VBAP, for example, rendering processing by a panning method called Speaker-anchored coordinates panner that distributes gain to each of the x-axis, y-axis, and z-axis is also known (for example, Non-Patent Document 2). reference).
Prior art literature
Non-patent literature
[0008]
Non-Patent Document 1: INTERNATIONAL STANDARD ISO / IEC 23008-3 First edition 2015-10-15 Information technology --High efficiency coding and media delivery in heterogeneous environments
--Part 3: 3D audio Non-Patent Document 2: ETSI TS 103 448 v1.1.1 (2016-09)
Outline of the invention
Problems to be solved by the invention
[0009]
　By the way, in the rendering method described above, the object signals of a plurality of audio objects are rendered for each individual audio object, and the change in sound due to the relative positional relationship between the audio objects is not considered at all. Therefore, it was not possible to obtain a high sense of presence during audio reproduction.
[0010]
　For example, suppose sound is emitted from another second audio object behind one first audio object when viewed from the listener's position. In such a case, with respect to the sound of the second audio object, the attenuation effect caused by the reflection, diffraction, and absorption of the sound generated by the first audio object is completely ignored.
[0011]
　In the rendering method described above, since the user position is fixed, it is possible to adjust the level of the object signal in advance depending on, for example, the positional relationship between the user position and a plurality of audio objects.
[0012]
　Such level adjustment makes it possible to express changes in sound due to relative positional relationships between audio objects. Therefore, for example, if the attenuation effect caused by sound reflection, diffraction, and absorption in an audio object is calculated based on the laws of physics, and the level of the object signal of the audio object is adjusted in advance based on the calculation result, a high sense of presence is achieved. Can be obtained.
[0013]
　However, if the attenuation effect caused by such sound reflection, diffraction, and absorption is calculated based on the laws of physics, it is not realistic because the amount of calculation becomes large when a large number of audio objects exist.
[0014]
　Moreover, in the fixed viewpoint where the user position is fixed, the object signal can be generated in consideration of sound reflection and diffraction by adjusting the level in advance, but in the free viewpoint where the user position can be moved. , Such advance level adjustments make no sense at all.
[0015]
　This technology was made in view of such a situation, and makes it possible to obtain a high sense of presence with a small amount of calculation.
Means to solve problems
[0016]
　The information processing device of one aspect of the present technology determines the amount of attenuation based on the positional relationship between a predetermined object and another object, and determines the gain of the signal of the predetermined object based on the amount of attenuation. It has a part.
[0017]
　The information processing method or program of one aspect of the present technology determines the amount of attenuation based on the positional relationship between a predetermined object and another object, and determines the gain of the signal of the predetermined object based on the amount of attenuation. Including steps.
[0018]
　In one aspect of the present technology, the amount of attenuation is determined based on the positional relationship between the predetermined object and another object, and the gain of the signal of the predetermined object is determined based on the amount of attenuation.
The invention's effect
[0019]
　According to one aspect of the present technology, a high sense of presence can be obtained with a small amount of calculation.
[0020]
　The effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.
A brief description of the drawing
[0021]
[Fig. 1] Fig. 1 is a diagram illustrating VBAP.
FIG. 2 is a diagram showing a configuration example of a signal processing device.
[Fig. 3] Fig. 3 is a diagram illustrating coordinate transformation.
[Fig. 4] Fig. 4 is a diagram illustrating coordinate transformation.
[Fig. 5] Fig. 5 is a diagram illustrating a coordinate system.
[Fig. 6] Fig. 6 is a diagram illustrating a damping distance and a radius ratio.
[Fig. 7] Fig. 7 is a diagram illustrating metadata.
[Fig. 8] Fig. 8 is a diagram illustrating an attenuation table.
[Fig. 9] Fig. 9 is a diagram illustrating a correction table.
[Fig. 10] Fig. 10 is a flowchart illustrating an audio output process.
[Fig. 11] Fig. 11 is a diagram showing a configuration example of a computer.
Mode for carrying out the invention
[0022]
　Hereinafter, embodiments to which the present technology is applied will be described with reference to the drawings.
[0023]

In the
　present technology, when rendering an audio object, the gain information of the audio object is determined based on the positional relationship of a plurality of audio objects in space. It makes it possible to obtain a sufficiently high sense of presence even with a small amount of calculation.
[0024]
　Note that this technique is applicable not only to rendering audio objects but also to adjusting parameters related to a plurality of objects existing in space according to the positional relationship between the objects. For example, the present technology can be applied to the case of determining the adjustment amount of parameters such as the brightness (light amount) related to the image signal of the object according to the positional relationship between the objects.
[0025]
　In the following, the case of rendering an audio object will be described as a specific example. In the following, an audio object will also be simply referred to as an object.
[0026]
　For example, at the time of rendering, a predetermined method of rendering such as VBAP described above is performed. In VBAP, among the speakers existing on the surface of the sphere whose origin is the user position in space, the gain is distributed to the three speakers closest to the object also existing on the surface of the sphere.
[0027]
　For example, as shown in FIG. 1, it is assumed that there is a user U11 who is a listener in a three-dimensional space, and three speakers SP1 to SP3 are arranged in front of the user U11.
[0028]
　Further, it is assumed that the position of the head of the user U11 is the origin O, and the speakers SP1 to SP3 are located on the surface of the sphere centered on the origin O.
[0029]
　Now, suppose that an object exists in the region TR11 surrounded by the speakers SP1 and the speaker SP3 on the surface of the sphere, and the sound image is localized at the position VSP1 of the object.
[0030]
　In such a case, VBAP distributes the gain of the object to the speakers SP1 to SP3 around the position VSP1.
[0031]
　Specifically, in a three-dimensional coordinate system with the origin O as a reference (origin), the position VSP1 is represented by a three-dimensional vector P having the origin O as a start point and a position VSP1 as an end point.
[0032]
　Further, assuming that the three-dimensional vectors having the origin O as the start point and the positions of the speakers SP1 to the speaker SP3 as the end points are the vectors L 1 to the vector L 3 , the vector P is the vector L as shown in the following equation (1). It can be represented by the linear sum of 1 to the vector L 3 .
[0033]
[Number 1]

[0034]
　Here, vector L in the formula (1) 1 to the vector L 3 coefficients g are multiplied by 1 to coefficient g 3 is calculated and the coefficients g 1 through coefficient g 3 a, from each of the speakers SP1 to speaker SP3 If the gain of the output sound is used, the sound image can be localized at the position VSP1.
[0035]
　For example , a vector having a coefficient g 1 to a coefficient g 3 as an element is g 123 = [g 1 , g 2 , g 3 ], and a vector having a vector L 1 to a vector L 3 as an element is L 123 = [L 1 , L. 2 , L 3 ], the following equation (2) can be obtained by modifying the above equation (1).
[0036]
[Number 2]

[0037]
　By using the coefficients g 1 to g 3 obtained by calculating the equation (2) as gains and outputting the object signal, which is the sound signal of the object, to each speaker SP1 to speaker SP3, the position VSP1 The sound image can be localized.
[0038]
　Since the placement positions of the speakers SP1 to SP3 are fixed and the information indicating the positions of those speakers is known information, the inverse matrix L 123 -1 can be obtained in advance. .. Therefore, with VBAP, it is possible to perform rendering with relatively easy calculation, that is, with a small amount of calculation.
[0039]
　However, as described above, when there are a plurality of objects in the space in rendering by VBAP or the like, the change in sound due to the relative positional relationship between the objects is not considered at all, so that a high sense of presence is achieved during audio reproduction. Could not be obtained.
[0040]
　It is also conceivable to adjust the level of the object signal in advance, but it is not realistic to calculate the attenuation effect for level adjustment based on the laws of physics because it requires a large amount of calculation. Further, since the position of the user changes from the free viewpoint, it makes no sense to adjust the level in advance.
[0041]
　Therefore, in this technology, the level of the object signal is adjusted on the sound reproduction side by using the information on the attenuation of the object, so that a high sense of presence can be obtained with a small amount of calculation.
[0042]
　In particular, in this technology, by determining the gain information for adjusting the level of the object signal based on the relative positional relationship between the objects, the attenuation effect caused by sound reflection, diffraction, and absorption even with a small amount of calculation, That is, it is possible to cause a change in sound. As a result, a high sense of presence can be obtained.
[0043]

　Next, a configuration example of a signal processing device to which the present technology is applied will be described.
[0044]
　FIG. 2 is a diagram showing a configuration example of an embodiment of a signal processing device to which the present technology is applied.
[0045]
　The signal processing device 11 shown in FIG. 2 includes a decoding processing unit 21, a coordinate conversion processing unit 22, an object attenuation processing unit 23, and a rendering processing unit 24.
[0046]
　The decoding processing unit 21 receives the transmitted input bit stream, decodes it, and outputs the resulting object metadata and object signal.
[0047]
　Here, the object signal is an audio signal for reproducing the sound of the object. In addition, the metadata includes object position information, object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information for each object.
[0048]
　The object position information is information indicating the absolute position of the object in the space in which the object exists (hereinafter, also referred to as a listening space).
[0049]
　For example, the object position information is a coordinate information indicating the position of an object represented by a three-dimensional Cartesian coordinate system having a predetermined position as an origin, that is, the x-coordinate, the y-coordinate, and the z-coordinate of the xyz coordinate system.
[0050]
　The object outer diameter information is information indicating the outer diameter of the object. For example, here, it is assumed that the object has a sphere shape, and the radius of the sphere is the object outer diameter information indicating the outer diameter of the object.
[0051]
　In the following description, it is assumed that the object is spherical, but the object may have any shape. For example, it is assumed that the object has a shape having diameters in each of the x-axis, y-axis, and z-axis directions, and information indicating the radius of the object in each of those axis directions may be used as object outer diameter information.
[0052]
　Further, the outer diameter information for spread may be used as the object outer diameter information. For example, in the MPEG-H Part 3: 3D audio standard, a technology called spread is adopted as a technology to expand the size of the sound source, and it becomes a format that can record the outer diameter information of each object in order to expand the size of the sound source. ing. Therefore, the outer diameter information for such spread may be used as the object outer diameter information.
[0053]
　Object attenuation information is information regarding the amount of sound attenuation when sound from another object is attenuated due to an object. By using the object attenuation information, it is possible to obtain the attenuation amount of the object signal of another object in a predetermined object according to the positional relationship between the objects.
[0054]
　The object attenuation invalid information is information indicating whether or not the sound of the object, that is, the object signal is attenuated, that is, whether or not the object signal is attenuated.
[0055]
　For example, when the value of the object attenuation invalid information is 1, the attenuation process for the object signal is invalid. That is, when the value of the object attenuation invalid information is 1, the object signal is not attenuated.
[0056]
　For example, if the intention of the sound source creator is that an object is important and you do not want the sound of that object to have an attenuation effect due to its positional relationship with other objects, object attenuation is disabled. The value of the information is set to 1. In the following, an object in which the value of the object attenuation invalid information is 1 will also be referred to as an attenuation invalid object.
[0057]
　On the other hand, when the value of the object attenuation invalid information is 0, the object signal is attenuated according to the positional relationship between the object and another object. In the following, an object whose value of the object attenuation invalid information is 0 and which can be the target of attenuation processing will also be referred to as an attenuation processing object.
[0058]
　The object gain information is information that is predetermined by the sound source creator and indicates the gain for adjusting the level of the object signal. For example, the object gain information is a decibel value indicating the gain.
[0059]
　When the object signal and metadata of each object are obtained by decoding in the decoding processing unit 21, the decoding processing unit 21 supplies the obtained object signal to the rendering processing unit 24.
[0060]
　Further, the decoding processing unit 21 supplies the object position information of the metadata obtained by the decoding to the coordinate conversion processing unit 22. Further, the decoding processing unit 21 supplies the object outer diameter information, the object attenuation information, the object attenuation invalid information, and the object gain information of the metadata obtained by the decoding to the object attenuation processing unit 23.
[0061]
　The coordinate conversion processing unit 22 generates object spherical coordinate position information based on the object position information supplied from the decoding processing unit 21 and the user position information supplied from the outside, and supplies the object spherical coordinate position information to the object attenuation processing unit 23. In other words, the coordinate conversion processing unit 22 converts the object position information into the object spherical coordinate position information.
[0062]
　Here, the user position information is information indicating the absolute position of the user who is the listener in the listening space where the object exists, that is, the absolute position of the listening point desired by the user, and is x in the xyz coordinate system. It is coordinate information represented by coordinates, y-coordinates, and z-coordinates.
[0063]
　This user position information is not information included in the input bit stream, but information supplied from, for example, an external user interface connected to the signal processing device 11.
[0064]
　Further, the object spherical coordinate position information is information indicating the relative position of the object as seen by the user in the listening space, which is represented by the coordinates of the spherical coordinate system, that is, the spherical coordinates.
[0065]
　The object attenuation processing unit 23 includes object spherical coordinate position information supplied from the coordinate conversion processing unit 22, object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information supplied from the decoding processing unit 21. Based on the above, the corrected object gain information obtained by appropriately correcting the object gain information is obtained.
[0066]
　In other words, the object attenuation processing unit 23 functions as a gain determination unit that determines the correction object gain information based on the object spherical coordinate position information, the object outer diameter information, the object attenuation information, the object attenuation invalid information, and the object gain information. ..
[0067]
　Here, the gain value indicated by the corrected object gain information is obtained by appropriately correcting the gain value indicated by the object gain information in consideration of the positional relationship of the objects.
[0068]
　Such corrected object gain information is used to realize level adjustment of the object signal in consideration of the attenuation caused by the reflection, diffraction, and absorption of the sound generated by the object due to the positional relationship of the object, that is, the change in acoustics. It is a thing.
[0069]
　In the rendering processing unit 24, a process of adjusting the level of the object signal based on the corrected object gain information at the time of rendering is performed as an attenuation process. It can be said that such an attenuation process is a process of attenuating the level of the object signal according to the reflection, diffraction, and absorption of sound.
[0070]
　The object attenuation processing unit 23 supplies the object spherical coordinate position information and the corrected object gain information to the rendering processing unit 24.
[0071]
　In the signal processing device 11, the coordinate conversion processing unit 22 and the object attenuation processing unit 23 determine, for each object, correction object gain information for adjusting the level of the object signal according to the positional relationship with other objects. Functions as a device.
[0072]
　The rendering processing unit 24 generates an output audio signal based on the object signal supplied from the decoding processing unit 21 and the object spherical coordinate position information and the corrected object gain information supplied from the object attenuation processing unit 23, and generates an output audio signal in the subsequent stage. It supplies speakers, headphones, recording units, etc.
[0073]
　Specifically, the rendering processing unit 24 performs a panning process such as VBAP as a rendering process to generate an output audio signal.
[0074]
　For example, when VBAP is performed as a panning process, the same calculation as in the above equation (2) is performed based on the object spherical coordinate position information and the arrangement information of each speaker, and the gain information for each speaker is obtained. Then, the rendering processing unit 24 adjusts the level of the object signal of the channel corresponding to each speaker based on the obtained gain information and the corrected object gain information, so that the output audio signal composed of the signals of the plurality of channels To generate. If there are multiple objects, the signals of the same channel for each of those objects are added together to form the final output audio signal.
[0075]
　The rendering process performed by the rendering process unit 24 is, for example, VBAP adopted in the MPEG-H Part 3: 3D audio standard or processing by a panning method called Speaker-anchored coordinates panner. You may.
[0076]
　In addition, in the rendering process by VBAP, the object spherical coordinate position information which is the position information of the spherical coordinate system is used, but in the rendering process by the Speaker-anchored coordinates panner, the position information of the Cartesian coordinate system is used and the direct rendering is performed. It is said. Therefore, when rendering using the Cartesian coordinate system, the coordinate conversion processing unit 22 can obtain the position information of the Cartesian coordinate system indicating the position of each object as seen from the user's position by the coordinate conversion. good.
[0077]

　Subsequently, the coordinate transformation performed by the coordinate transformation processing unit 22 and the processing performed by the object attenuation processing unit 23 will be described in more detail.
[0078]
　In the coordinate conversion processing unit 22, the object position information and the user position information are input, the coordinate conversion is performed, and the object spherical coordinate position information is output.
[0079]
　Here, the object position information and the user position information that are input for the coordinate conversion are, for example, the coordinates of a three-dimensional Cartesian coordinate system using the x-axis, y-axis, and z-axis as shown in FIG. 3, that is, the coordinates of the xyz coordinate system. It is represented by.
[0080]
　In FIG. 3, the coordinates indicating the position of the user LP11 as seen from the origin O of the xyz coordinate system are used as the user position information. Further, the coordinates indicating the position of the object OBJ1 as seen from the origin O of the xyz coordinate system are used as the object position information of the object OBJ1, and the coordinates indicating the position of the object OBJ2 as seen from the origin O of the xyz coordinate system are the objects. It is used as the object position information of OBJ2.
[0081]
　At the time of coordinate conversion, the coordinate conversion processing unit 22 performs parallel movement of all objects in the listening space so that the position of the user LP11 becomes the position of the origin O as shown in FIG. 4, and then all the objects. Converts the coordinates of the xyz coordinate system to the coordinates of the spherical coordinate system. In FIG. 4, the same reference numerals are given to the parts corresponding to the cases in FIG. 3, and the description thereof will be omitted as appropriate.
[0082]
　Specifically, the coordinate conversion processing unit 22 obtains a movement vector MV11 that moves the position of the user LP11 to the origin O of the xyz coordinate system based on the user position information. This movement vector MV11 is a vector whose starting point is the position of the user LP11 indicated by the user position information and whose ending point is the position of the origin O.
[0083]
　Further, the coordinate conversion processing unit 22 sets a vector having the same size (length) and direction as the movement vector MV11 and starting from the position of the object OBJ1 as the movement vector MV12. Then, the coordinate conversion processing unit 22 moves the position of the object OBJ1 by the amount indicated by the movement vector MV12 based on the object position information of the object OBJ1.
[0084]
　Similarly, the coordinate conversion processing unit 22 sets a vector having the same size and direction as the movement vector MV11 and starting from the position of the object OBJ2 as the movement vector MV13, and based on the object position information of the object OBJ2, the object OBJ2 Moves the position of by the amount shown in the movement vector MV13.
[0085]
　Further, the coordinate conversion processing unit 22 obtains the coordinates of the spherical coordinate system indicating the position of the object OBJ1 after the movement as seen from the origin O, and uses the obtained coordinates as the object spherical coordinate position information of the object OBJ1. Similarly, the coordinate conversion processing unit 22 obtains the coordinates of the spherical coordinate system indicating the position of the object OBJ2 after the movement as seen from the origin O, and uses the obtained coordinates as the object spherical coordinate position information of the object OBJ2.
[0086]
　Here, the relationship between the spherical coordinate system and the xyz coordinate system is as shown in FIG. In FIG. 5, the same reference numerals are given to the parts corresponding to the cases in FIG. 4, and the description thereof will be omitted as appropriate.
[0087]
　In FIG. 5, the x-axis, y-axis, and z-axis that pass through the origin O and are perpendicular to each other are the axes of the xyz coordinate system. For example, in the xyz coordinate system, the position of the object OBJ1 after moving by the movement vector MV12 is expressed as (X1, Y1, Z1) using X1 which is the x coordinate, Y1 which is the y coordinate, and Z1 which is the z coordinate. NS.
[0088]
　On the other hand, in the spherical coordinate system, the azimuth position_azimuth, elevation position_elevation, and radius position_radius are used to represent the position of the object OBJ1.
[0089]
　Now, let the straight line r connecting the origin O and the position of the object OBJ1 be a straight line r, and let the straight line obtained by projecting this straight line r on the xy plane be a straight line L.
[0090]
　At this time, the angle θ formed by the x-axis and the straight line L is the azimuth angle position_azimuth indicating the position of the object OBJ1. Further, the angle φ formed by the straight line r and the xy plane is defined as the elevation angle position_elevation indicating the position of the object OBJ1, and the length of the straight line r is defined as the radius position_radius indicating the position of the object OBJ1.
[0091]
　Therefore, the information of the user's position, that is, the spherical coordinates consisting of the azimuth, elevation, and radius of the object with respect to the origin O becomes the object spherical coordinate position information of the object. More specifically, for example, the positive direction of the x-axis is the direction in front of the user, and the object spherical coordinate position information is obtained.
[0092]
　Next, the processing performed by the object attenuation processing unit 23 will be described.
[0093]
　Here, for the sake of simplicity, it is assumed that only two objects, the object OBJ1 and the object OBJ2, exist in the listening space.
[0094]
　Specifically, for example, as shown in FIG. 6, the object OBJ1 and the object OBJ2 exist in the listening space, and the corrected object gain information of the object OBJ1 is determined. In FIG. 6, the same reference numerals are given to the parts corresponding to the cases in FIG. 4, and the description thereof will be omitted as appropriate.
[0095]
　In the example of FIG. 6, it is assumed that the object OBJ1 is an object that is not an attenuation invalid object, that is, an attenuation processing object in which the value of the object attenuation invalid information is 0.
[0096]
　In determining the correction object gain information of the object OBJ1, the vector OP1 indicating the position of the object OBJ1 is first obtained.
[0097]
　This vector OP1 is a vector starting from the origin O and ending at the position O11 indicated by the object spherical coordinate position information of the object OBJ1. The user located at the origin O will hear the sound radiated from the object OBJ1 at the position O11 toward the origin O. In more detail, the position O11 indicates the center position of the object OBJ1.
[0098]
　Next, an object that is closer to the origin O than the object OBJ1, that is, an object that is closer to the origin O, which is the user position than the object OBJ1, is selected as the attenuated object. The attenuated object is an object that can be a factor for attenuating the sound from the attenuation processing object because it is located between the attenuation processing object and the origin O.
[0099]
　In the example of FIG. 6, the object OBJ2 is located at the position O12 indicated by the object spherical coordinate position information, and the position O12 is located on the origin O side of the position O11 of the object OBJ1. That is, the size of the vector OP2 starting from the origin O and ending at the position O12 is smaller than the size of the vector OP1.
[0100]
　Therefore, in the example of FIG. 6, the object OBJ2 located on the origin O side of the object OBJ1 is selected as the object to be attenuated with respect to the object OBJ1. More specifically, the position O12 indicates the center position of the object OBJ2.
[0101]
　The shape of the object OBJ2 is the shape of a sphere with a radius OR2 indicated by the object outer diameter information centered on the position O12, and the object OBJ2 is not a point sound source but an object having a predetermined size.
[0102]
　Subsequently, for the object OBJ2 which is the attenuated object, the normal vector N2_1 from the object OBJ2, that is, from the position O12 to the vector OP1 is obtained.
[0103]
　Assuming that the position of the intersection of the straight line passing through the position O12 and orthogonal to the vector OP1 and the vector OP1 is the position P2_1, the vector starting from the position O12 and ending at the position P2_1 is the normal vector N2_1. In other words, the intersection of the vector OP1 and the normal vector N2_1 is at position P2_1.
[0104]
　Furthermore, the normal vector N2_1 is compared with the radius OR2 indicated by the object outer diameter information of the object OBJ2, and the magnitude of the normal vector N2_1 is 1/2 of the outer diameter of the object OBJ2 to be attenuated. It is determined whether the radius is OR2 or less.
[0105]
　This determination process is a process of determining whether or not there is an object OBJ2, which is an object to be attenuated, on the path of the sound radiated from the object OBJ1 and traveling to the origin O.
[0106]
　In other words, in this determination process, the position O12, which is the center position of the object OBJ2, is located within a predetermined distance from the straight line connecting the origin O, which is the user position, and the position O11, which is the center position of the object OBJ1. It can be said that it is a process of determining whether or not the object is used.
[0107]
　The range of the predetermined distance referred to here is a range determined by the size of the object OBJ2. Specifically, the predetermined distance is the end of the object OBJ2 on the straight line side connecting the origin O and the position O11 from the position O12. The distance to the position of, that is, the radius OR2.
[0108]
　For example, in the example of FIG. 6, the magnitude of the normal vector N2_1 is equal to or less than the radius OR2. That is, the vector OP1 intersects the object OBJ2. Therefore, the sound radiated from the object OBJ1 toward the origin O is reflected, diffracted, absorbed by the object OBJ2, attenuated, and heads toward the origin O.
[0109]
　Therefore, the object attenuation processing unit 23 determines the correction object gain information for attenuating the level of the object signal of the object OBJ1 according to the relative positional relationship between the object OBJ1 and the object OBJ2. In other words, the object gain information is corrected and used as the corrected object gain information.
[0110]
　Specifically, the correction object gain information is determined based on the attenuation distance and the radius ratio, which are information indicating the relative positional relationship between the object OBJ1 and the object OBJ2.
[0111]
　The attenuation distance is the distance between the object OBJ1 and the object OBJ2.
[0112]
　In this case, if the vector with the origin O as the start point and the position P2_1 as the end point is the vector OP2_1, the difference between the size of the vector OP1 and the size of the vector OP2_1, that is, the distance from the position P2_1 to the position O11 is the object of the object OBJ1. It is the attenuation distance for OBJ2. In other words, | OP1 |-| OP2_1 | is the attenuation distance.
[0113]
　The radius ratio in this case is the distance from the position O12, which is the center position of the object OBJ2, to the straight line connecting the origin O and the position O11, and the distance from the position O12 to the end of the object OBJ2 on the straight line side. It becomes the ratio of.
[0114]
　Here, since the shape of the object OBJ2 is a spherical shape, the radius ratio of the object OBJ2 is the ratio of the magnitude of the normal vector N2_1 to the radius OR2, that is, | N2_1 | / OR2.
[0115]
　The radius ratio is information indicating the amount of deviation of the position O12, which is the center position of the object OBJ2, from the vector OP1, that is, the amount of deviation of the position O12 from the straight line connecting the origin O and the position O11. It can be said that such a radius ratio is information indicating the positional relationship with the object OBJ1 that depends on the size of the object OBJ2.
[0116]
　Here, an example in which the radius ratio is used as information indicating the positional relationship depending on the size of the object will be described, but in addition, from the straight line connecting the origin O and the position O11, the end of the object OBJ2 on the straight line side. Information or the like indicating the distance to the position of is may be used.
[0117]
　The object attenuation processing unit 23 obtains the correction value of the object gain information of the object OBJ1 based on, for example, the attenuation table index and the correction table index as the object attenuation information of the metadata, and the attenuation distance and the radius ratio. Then, the object attenuation processing unit 23 obtains the corrected object gain information by correcting the object gain information of the object OBJ1 according to the correction value.
[0118]
　Here, the attenuation table indicated by the attenuation table index and the correction table indicated by the correction table index will be described.
[0119]
　For example, the metadata of a predetermined time frame included in the input bitstream is as shown in FIG.
[0120]
　In the example of FIG. 7, the character "object 1 position information" indicates the object position information of the object OBJ1, the character "object 1 gain information" indicates the object gain information of the object OBJ1, and the character "object 1 attenuation invalid". "Information" indicates the object attenuation invalid information of object OBJ1.
[0121]
　Further, the character "object 2 position information" indicates the object position information of the object OBJ2, the character "object 2 gain information" indicates the object gain information of the object OBJ2, and the character "object 2 attenuation invalid information" indicates the object. Shows object decay invalid information for OBJ2.
[0122]
　Further, the character "object 2 outer diameter information" indicates the object outer diameter information of the object OBJ2, and the character "object 2 decay table index" indicates the decay table index of the object OBJ2, and the character "object 2 correction table". "Index" indicates the correction table index of object OBJ2.
[0123]
　Here, the attenuation table index and the correction table index are the object attenuation information.
[0124]
　The attenuation table index is an index for identifying an attenuation table indicating the amount of attenuation of the object signal according to the attenuation distance described above.
[0125]
　The amount of sound attenuation by the attenuated object changes depending on the distance between the attenuated object and the attenuated object. In order to easily obtain an appropriate attenuation amount according to the attenuation distance with a small amount of calculation, an attenuation table in which the attenuation distance and the attenuation amount are associated with each other is used.
[0126]
　For example, since the sound absorption rate, diffraction, and reflection effects differ depending on the material of the object, a plurality of attenuation tables are prepared in advance according to the material and shape of the object, the frequency band of the object signal, and the like. The attenuation table index is an index indicating any one of the plurality of attenuation tables, and an appropriate attenuation table index is specified for each object on the sound source creator side according to the material of the object and the like.
[0127]
　Further, the correction table index is an index for identifying the correction table indicating the correction factor of the attenuation amount of the object signal according to the radius ratio described above.
[0128]
　The radius ratio indicates how much the straight line indicating the path of the sound emitted from the attenuated object deviates from the center of the attenuated object.
[0129]
　Even if the attenuation distance is the same, the actual attenuation amount changes depending on the deviation amount of the attenuated object from the path of the sound radiated from the attenuation processing object, that is, the radius ratio.
[0130]
　For example, in general, when a straight line connecting the origin O and the attenuation processed object passes through an outer portion far from the center of the attenuated object, the amount of attenuation is smaller due to the diffraction effect than when the straight line passes through the center of the attenuated object. Become. Therefore, in order to correct the attenuation amount of the object signal according to the radius ratio, a correction table in which the radius ratio and the correction factor are associated with each other is used.
[0131]
　As in the case of the attenuation table, the appropriate correction factor changes according to the radius ratio depending on the material of the object, so a plurality of correction tables are prepared in advance according to the material and shape of the object, the frequency band of the object signal, and the like. ing. The correction table index is an index indicating any one of the plurality of correction tables, and an appropriate correction table index is specified for each object on the sound source creator side according to the material of the object and the like.
[0132]
　In the example shown in FIG. 7, since the object OBJ1 is an object processed as a point sound source having no object outer diameter information, the object position information, the object gain information, and the object attenuation invalid information are used as the metadata of the object OBJ1. Only given.
[0133]
　On the other hand, the object OBJ2 has the object outer diameter information and is an object that attenuates the radiated sound from other objects. Therefore, in addition to the object position information, the object gain information, and the object attenuation invalid information, the object outer diameter information and the object attenuation information are also given as the metadata of the object OBJ2.
[0134]
　In particular, here, the attenuation table index and the correction table index are given as the object attenuation information, and these attenuation table indexes and the correction table indexes are used for calculating the correction value of the object gain information.
[0135]
　For example, the attenuation table shown by one attenuation table index is information showing the relationship between the attenuation distance and the amount of attenuation shown in FIG.
[0136]
　In FIG. 8, the vertical axis shows the decibel value of the attenuation amount, and the horizontal axis shows the distance between the objects, that is, the attenuation distance. For example, in the example shown in FIG. 6, the distance from the position P2_1 to the position O11 is the attenuation distance.
[0137]
　In the example of FIG. 8, the smaller the attenuation distance is, the larger the attenuation amount is, and the smaller the attenuation distance is, the larger the change in the attenuation amount is with respect to the change amount of the attenuation distance. From this, it can be seen that the closer the object to be attenuated is to the attenuated object, the greater the amount of sound attenuation of the attenuated object.
[0138]
　Further, for example, the correction table shown by one correction table index is information showing the relationship between the radius ratio and the correction factor shown in FIG.
[0139]
　In FIG. 9, the vertical axis shows the correction factor of the attenuation amount, and the horizontal axis shows the radius ratio. For example, in the example shown in FIG. 6, the ratio of the magnitude of the normal vector N2_1 to the radius OR2 is the radius ratio.
[0140]
　For example, when the radius ratio is 0, the sound traveling from the attenuation processing object to the origin O, that is, toward the user passes through the center of the attenuated object, and when the radius ratio is 1, the origin is from the attenuation processing object. The sound traveling toward O will pass through the boundary portion of the attenuated object.
[0141]
　In this example, the larger the radius ratio, the smaller the correction factor, and the larger the radius ratio, the larger the change in the correction factor with respect to the amount of change in the radius ratio. For example, when the correction factor is 1.0, the attenuation obtained from the attenuation table is used as it is, and when the correction factor is 0, the attenuation obtained from the attenuation table is set to 0 and the attenuation effect is 0. When the radius ratio is larger than 1, the sound traveling from the attenuation processed object toward the origin O does not pass through the region where the attenuated object is located, so that the attenuation processing is not performed.
[0142]
　When the attenuation amount and correction factor corresponding to the attenuation distance and radius ratio are obtained based on the attenuation distance and radius ratio, the correction value is obtained based on the attenuation amount and correction factor, and the object gain information is corrected. Will be done.
[0143]
　Specifically, the value obtained by multiplying the attenuation amount by the correction factor, that is, (correction factor × attenuation amount) is defined as the correction value. This correction value is the final amount of attenuation obtained by correcting the amount of attenuation with the correction factor. When the correction value is obtained, the object gain information is corrected by adding the correction value to the object gain information. Then, the corrected object gain information obtained in this way, that is, the sum of the correction value and the object gain information is used as the corrected object gain information.
[0144]
　The correction value, which is the product of the correction factor and the amount of attenuation, is the attenuation of the object signal to realize the level adjustment corresponding to the attenuation that occurs in another object of the sound of one object, which is determined based on the positional relationship between the objects. It can be said that it indicates the amount.
[0145]
　Here, an example in which the attenuation table index and the correction table index prepared in advance are included in the metadata as the object attenuation information has been described. However, if the attenuation amount and the correction factor can be obtained, for example, the change point of the polygonal line corresponding to the attenuation table and the correction table shown in FIGS. 8 and 9 is used as the object attenuation information, what kind of object attenuation information can be used? There may be.
[0146]
　In addition, for example, a plurality of attenuation functions, which are continuous functions that output the amount of attenuation with the attenuation distance as input, and a correction factor function, which is a continuous function that outputs the correction factor with the radius ratio as input, are prepared, and the plurality of attenuation functions are prepared. An index indicating any of the above and an index indicating any of a plurality of correction factor functions may be used as the object attenuation information. Further, a plurality of continuous functions that output a correction value by inputting an attenuation amount and a radius ratio may be prepared in advance, and an index indicating any of these functions may be used as object attenuation information.
[0147]

　Next, a specific operation of the signal processing device 11 will be described. That is, the audio output processing by the signal processing device 11 will be described below with reference to the flowchart of FIG.
[0148]
　In step S11, the decoding processing unit 21 decodes (decodes) the received input bit stream to obtain metadata and an object signal.
[0149]
　The decoding processing unit 21 supplies the object position information of the obtained metadata to the coordinate conversion processing unit 22, and also provides the object outer diameter information, the object attenuation information, the object attenuation invalid information, and the object gain information of the obtained metadata. Is supplied to the object attenuation processing unit 23. Further, the decoding processing unit 21 supplies the obtained object signal to the rendering processing unit 24.
[0150]
　In step S12, the coordinate conversion processing unit 22 performs coordinate conversion on each object based on the object position information supplied from the decoding processing unit 21 and the user position information supplied from the outside, and the object spherical coordinate position information. Is generated and supplied to the object attenuation processing unit 23.
[0151]
　In step S13, the object attenuation processing unit 23 performs the attenuation processing object to be processed based on the object attenuation invalid information supplied from the decoding processing unit 21 and the object spherical coordinate position information supplied from the coordinate conversion processing unit 22. Is selected, and the position vector of the attenuation processing object is obtained.
[0152]
　For example, the object attenuation processing unit 23 selects one object whose value of the object attenuation invalid information is 0, and sets that object as the attenuation processing object. Then, the object attenuation processing unit 23 calculates a vector having the origin O, that is, the position of the user as the start point and the position of the attenuation processing object as the end point, as the position vector, based on the object spherical coordinate position information of the attenuation processing object.
[0153]
　Therefore, for example, when the object OBJ1 is selected as the attenuation processing object in the example shown in FIG. 6, the vector OP1 is obtained as the position vector.
[0154]
　In step S14, the object attenuation processing unit 23 has a smaller (shorter) distance from the origin O than the attenuation processing object to be processed, based on the object spherical coordinate position information of the attenuation processing object to be processed and another object. Select an object as the object to be attenuated for that decayed object.
[0155]
　For example, when the object OBJ1 is selected as the attenuation processing object in the example of FIG. 6, the object OBJ2 located closer to the origin O than the object OBJ1 is selected as the attenuated object.
[0156]
　In step S15, the object attenuation processing unit 23 starts from the center of the attenuated object with respect to the position vector of the decay processed object based on the position vector of the decay processed object obtained in step S13 and the object spherical coordinate position information of the attenuated object. Find the normal vector of.
[0157]
　For example, in the example shown in FIG. 6, when the object OBJ1 is selected as the attenuation processing object and the object OBJ2 is selected as the attenuated object, the normal vector N2_1 is obtained.
[0158]
　In step S16, the object attenuation processing unit 23 determines whether or not the size of the normal vector is equal to or less than the radius of the attenuated object based on the normal vector obtained in step S15 and the object outer diameter information of the attenuated object. Is determined.
[0159]
　For example, in the example shown in FIG. 6, when the object OBJ1 is selected as the attenuation processing object and the object OBJ2 is selected as the attenuated object, the size of the normal vector N2_1 is half the outer diameter of the object OBJ2. It is determined whether or not the radius is OR2 or less.
[0160]
　If it is determined in step S16 that the magnitude of the normal vector is not less than or equal to the radius of the attenuated object, the attenuated object is not on the path of the sound traveling from the attenuated object to the origin O (user). The processing of S17 and step S18 is not performed, and the processing proceeds to step S19.
[0161]
　On the other hand, when it is determined in step S16 that the magnitude of the normal vector is equal to or less than the radius of the attenuated object, the attenuated object is on the path of the sound traveling from the attenuated object to the origin O (user). The process proceeds to step S17. In this case, the attenuation processed object and the attenuated object are located in substantially the same direction as viewed from the user.
[0162]
　In step S17, the object attenuation processing unit 23 obtains the attenuation distance based on the position vector of the attenuation processed object obtained in step S13 and the normal vector of the attenuated object obtained in step S15. The object attenuation processing unit 23 also obtains a radius ratio based on the object outer diameter information of the object to be attenuated and the normal vector.
[0163]
　For example, in the example shown in FIG. 6, when the object OBJ1 is selected as the attenuation processing object and the object OBJ2 is selected as the attenuated object, the distance from the position P2_1 to the position O11, that is, | OP1 |-| OP2_1 | is the attenuation distance. Is required as. Further, in this case, the ratio of the magnitude of the normal vector N2_1 to the radius OR2 | N2_1 | / OR2 is obtained as the radius ratio.
[0164]
　In step S18, the object attenuation processing unit 23 determines the correction object of the attenuation processing object based on the object gain information of the attenuation processing object, the object attenuation information of the attenuated object, and the attenuation distance and the radius ratio obtained in step S17. Obtain gain information.
[0165]
　For example, when the above-mentioned attenuation table index and correction table index are included in the metadata as object attenuation information, the object attenuation processing unit 23 holds a plurality of attenuation tables and correction tables in advance.
[0166]
　In this case, the object attenuation processing unit 23 reads out the amount of attenuation determined with respect to the attenuation distance from the attenuation table indicated by the attenuation table index as the object attenuation information of the object to be attenuated.
[0167]
　Further, the object attenuation processing unit 23 reads a correction factor determined with respect to the radius ratio from the correction table indicated by the correction table index as the object attenuation information of the object to be attenuated.
[0168]
　Then, the object attenuation processing unit 23 obtains the correction value by multiplying the read attenuation amount by the correction factor, and adds the correction value to the object gain information of the attenuation processing object to obtain the correction object gain information.
[0169]
　In the process of obtaining the corrected object gain information in this way, a correction value indicating the amount of attenuation of the object signal is determined based on the attenuation distance and the radius ratio, that is, the positional relationship between the objects, and the object signal is further based on the correction value. It can be said that this is a process of determining the correction object gain information, which is the gain for level adjustment.
[0170]
　When the correction object gain information is obtained, the process proceeds to step S19.
[0171]
　If the processing of step S18 is performed, or if it is determined in step S16 that the magnitude of the normal vector is not less than or equal to the radius, in step S19, the object attenuation processing unit 23 unprocesses the attenuation processing object to be processed. Determine if there is an object to be attenuated.
[0172]
　If it is determined in step S19 that there is still an unprocessed object to be attenuated, the process returns to step S14, and the above-described process is repeated.
[0173]
　In this case, in the process of step S18, the correction value obtained for the new attenuated object is added to the correction object gain information already obtained, and the correction object gain information is updated. Therefore, if there are a plurality of attenuated objects whose normal vector magnitude is less than or equal to the radius of the attenuated object, the correction values ​​obtained for the plurality of attenuated objects are added to the object gain information. What is obtained will be obtained as the final correction object gain information.
[0174]
　If it is determined in step S19 that there are no unprocessed objects to be attenuated, that is, all the objects to be attenuated have been processed, the process proceeds to step S20.
[0175]
　In step S20, the object attenuation processing unit 23 determines whether or not all the attenuation processing objects have been processed.
[0176]
　If it is determined in step S20 that all the attenuation processing objects have not been processed yet, the processing returns to step S13, and the above-mentioned processing is repeated.
[0177]
　On the other hand, if it is determined in step S20 that all the attenuation processing objects have been processed, the processing proceeds to step S21.
[0178]
　In this case, the object attenuation processing unit 23 uses the object gain information of the object as it is as the corrected object gain information for the object for which the processing of steps S17 and S18 has not been performed, that is, the object for which the attenuation processing has not been performed. ..
[0179]
　Further, the object attenuation processing unit 23 supplies the object ball seat target position information of all the objects supplied from the coordinate conversion processing unit 22 and the correction object gain information to the rendering processing unit 24.
[0180]
　In step S21, the rendering processing unit 24 performs rendering processing based on the object signal supplied from the decoding processing unit 21 and the object spherical coordinate position information and the corrected object gain information supplied from the object attenuation processing unit 23. Generate an output audio signal.
[0181]
　When the output audio signal is obtained in this way, the rendering processing unit 24 outputs the obtained output audio signal to the subsequent stage, and the audio output processing ends.
[0182]
　As described above, the signal processing device 11 corrects the object gain information according to the positional relationship between the objects and obtains the corrected object gain information. By doing so, it is possible to obtain a high sense of presence with a small amount of calculation.
[0183]
　That is, when there are multiple objects in the listening space in substantially the same direction as viewed from the user, the attenuation effect of the sound absorption, diffraction, reflection, etc. of the objects is not calculated based on the physical law, but the table is displayed. By a simple calculation of obtaining a correction value according to the attenuation distance and the radius ratio by using it, it is possible to obtain an effect substantially equivalent to the case of performing the calculation based on the laws of physics. Therefore, even when the user freely moves in the listening space, it is possible to give the user a highly realistic three-dimensional acoustic effect with a small amount of calculation.
[0184]
　Although the case of the free viewpoint in which the user can move to an arbitrary position in the listening space has been described here, the case of the fixed viewpoint in which the position of the user in the listening space is fixed is also the case of the free viewpoint. Similarly, a high sense of presence can be obtained with a small amount of calculation.
[0185]
　In such a case, since the user position indicated by the user position information is always the position of the origin O, the coordinate conversion process by the coordinate conversion processing unit 22 is unnecessary, and the object position information is the position information represented by spherical coordinates. Will be done. In particular, in this case, the object position information is information indicating the position of the object as seen from the origin O. Further, the processing by the object attenuation processing unit 23 may be performed on the client side that receives the content distribution, or may be performed on the server side that distributes the content.
[0186]
In
　addition, the case where the object attenuation invalid information is 0 or 1 has been described above, but the object attenuation invalid information may be any one of a plurality of values ​​of 3 or more. In such a case, for example, the value of the object attenuation invalid information is set to indicate not only whether or not the object is an attenuation invalid object, but also the correction amount of the attenuation amount. Therefore, for example, the correction value obtained from the correction factor and the attenuation amount is further corrected according to the value of the object attenuation invalid information, and is used as the final correction value.
[0187]
　Further, in the above, an example in which object attenuation invalid information indicating whether or not the attenuation processing is invalidated is defined for each object has been described, but whether or not the attenuation processing is invalidated for the area in the listening space has been described. It may be determined.
[0188]
　For example, when the intention of the sound source creator is to not cause the attenuation effect of the object in a specific spatial area in the listening space, the spatial area where the attenuation effect is not generated instead of the object attenuation invalid information. The object attenuation invalid area information indicating the above may be stored in the input bit stream.
[0189]
　In such a case, in the object attenuation processing unit 23, the object whose position indicated by the object position information is a position in the spatial area indicated by the object attenuation invalid area information is regarded as an attenuation invalid object. As a result, audio reproduction that reflects the intention of the sound source creator can be realized.
[0190]
　Further, for example, an object located substantially in front of the user is regarded as an attenuation invalid object, and an object located behind the user is regarded as an attenuation processing object, so that the positional relationship between the user and the object is also taken into consideration. good. That is, it may be determined whether or not the object is regarded as an attenuation invalid object based on the positional relationship between the user and the object.
[0191]
　In addition, the example in which the object signal is attenuated according to the relative positional relationship between the objects has been described above, but the reverberation effect should be added to the object signal according to the relative positional relationship between the objects. You may do it.
[0192]
　Since ancient times, it has been well known that the reverberation effect is caused by trees in the forest, and Kuttruff models the reverberation of the forest by treating the trees as spheres and solving the diffusion equation.
[0193]
　Therefore, for example, when a predetermined number or more of objects exist in a certain space including the position of the user and the position of the object as a sound source, a specific reverberation effect is applied to the object signal of each object in the space. It is conceivable to give it.
[0194]
　In this case, the parametric reverb coefficient for adding the reverberation effect is included in the input bitstream, and the mixing ratio of the direct sound and the reverberation sound is changed according to the relative relationship between the user position and the position of the object that is the sound source. By doing so, it becomes possible to realize the reverberation effect.
[0195]

　By the way, the series of processes described above can be executed by hardware or software. When a series of processes are executed by software, the programs that make up the software are installed on the computer. Here, the computer includes a computer embedded in dedicated hardware and, for example, a general-purpose personal computer capable of executing various functions by installing various programs.
[0196]
　FIG. 11 is a block diagram showing a configuration example of the hardware of a computer that executes the above-mentioned series of processes programmatically.
[0197]
　In a computer, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, and a RAM (Random Access Memory) 503 are connected to each other by a bus 504.
[0198]
　An input / output interface 505 is further connected to the bus 504. An input unit 506, an output unit 507, a recording unit 508, a communication unit 509, and a drive 510 are connected to the input / output interface 505.
[0199]
　The input unit 506 includes a keyboard, a mouse, a microphone, an image sensor, and the like. The output unit 507 includes a display, a speaker, and the like. The recording unit 508 includes a hard disk, a non-volatile memory, and the like. The communication unit 509 includes a network interface and the like. The drive 510 drives a removable recording medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
[0200]
　In the computer configured as described above, the CPU 501 loads the program recorded in the recording unit 508 into the RAM 503 via the input / output interface 505 and the bus 504 and executes the above-described series. Is processed.
[0201]
　The program executed by the computer (CPU 501) can be recorded and provided on a removable recording medium 511 as a package medium or the like, for example. Programs can also be provided via wired or wireless transmission media such as local area networks, the Internet, and digital satellite broadcasts.
[0202]
　In a computer, the program can be installed in the recording unit 508 via the input / output interface 505 by mounting the removable recording medium 511 in the drive 510. Further, the program can be received by the communication unit 509 and installed in the recording unit 508 via a wired or wireless transmission medium. In addition, the program can be installed in advance in the ROM 502 or the recording unit 508.
[0203]
　The program executed by the computer may be a program that is processed in chronological order according to the order described in this specification, or may be a program that is processed in parallel or at a necessary timing such as when a call is made. It may be a program in which processing is performed.
[0204]
　Further, the embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.
[0205]
　For example, the present technology can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.
[0206]
　Further, each step described in the above-mentioned flowchart can be executed by one device or can be shared and executed by a plurality of devices.
[0207]
　Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.
[0208]
　Further, the present technology can also have the following configurations.
[0209]
(1) An 　information processing device including
　a gain determining unit that determines an amount of attenuation based on the positional relationship between a predetermined object and another object, and determines the gain of a signal of the predetermined object based on the amount of attenuation
.
(2) 　The information processing device according to (1),
　wherein the other object is closer to the user position than the predetermined object
.
(3) 　The information processing device according to (1) or (2),
　wherein the other object is located within a predetermined distance from a straight line connecting a user position and the predetermined object
.
(4) 　The information processing apparatus according to (3),
　wherein the range is determined by the size of the other object
.
(5) 　The information processing apparatus according to (3) or (4),
　wherein the predetermined distance is a distance from the center of the other object to the linear end of the other object
.
(6) 　The information processing apparatus according to any one of (3) to (5),
　wherein the positional relationship is a positional relationship that depends on the size of the other object
.
(7) The
　positional relationship is the amount of deviation of the center of the other object from the straight line.
　The information processing device according to (6).
(8) The
　positional relationship is the ratio of the distance from the center of the other object to the straight line and the distance from the center of the other object to the end of the other object on the straight line side
　(6). The information processing device described in.
(9) 　The information processing apparatus according to any one of (1) to (8),
　wherein the gain determining unit determines the amount of attenuation based on the positional relationship and the attenuation information of the other object
.
(10)
　The information
　processing apparatus according to (9), wherein the attenuation information is information for obtaining an attenuation amount of the signal according to the positional relationship in the other object .
(11) 　The information processing apparatus according to any one of (1) to (10),
　wherein the positional relationship is a distance between the other object and the predetermined object
.
(12)
　the gain determination unit includes a damping invalid information indicating whether to attenuate signals of the predetermined object, said determining the amount of attenuation based on said positional relationship
　either (1) to (11) The information processing device according to item 1.
(13)
　The signal of the predetermined object is an audio signal.
　The information processing device according to any one of (1) to (11).
(14) An
　information processing method in which an information processing apparatus
　determines an amount of attenuation based on the positional relationship between a predetermined object and another object, and determines a signal gain of the predetermined object based on the amount of attenuation
　.
(15) 　A program that causes a computer to execute a process including
　a
step of determining an attenuation amount based on the positional relationship between a predetermined object and another object and determining a signal gain of the predetermined object based on the attenuation amount. ..
Code description
[0210]
　11 Signal processing unit, 21 Decoding processing unit, 22 Coordinate conversion processing unit, 23 Object attenuation processing unit, 24 Rendering processing unit
The scope of the claims
[Claim 1]
　An
　information processing device including a gain determining unit that determines an amount of attenuation based on the positional relationship between a predetermined object and another object, and determines the gain of a signal of the predetermined object based on the amount of attenuation .
[Claim 2]

　The information processing device according to claim 1, 　wherein the other object is located closer to the user position than the predetermined object .
[Claim 3]

　The information processing device according to claim 1, 　wherein the other object is located within a predetermined distance from a straight line connecting the user position and the predetermined object .
[Claim 4]

　The information processing apparatus according to claim 3, 　wherein the range is determined by the size of the other object .
[Claim 5]

　The information processing apparatus according to claim 3, 　wherein the predetermined distance is a distance from the center of the other object to the linear end of the other object .
[Claim 6]

　The information processing apparatus according to claim 3, 　wherein the positional relationship is a positional relationship that depends on the size of the other object .
[Claim 7]

　The information processing apparatus according to claim 6, 　wherein the positional relationship is an amount of deviation of the center of the other object from the straight line .
[Claim 8]
　The positional relationship according to claim 6, wherein the positional relationship is the ratio of the distance from the center of the other object to the straight line and the distance from the center of the other object to the end of the other object on the straight line side
　. Information processing device.
[Claim 9]

　The information processing device according 　to claim 1, wherein the gain determining unit determines the amount of attenuation based on the positional relationship and the attenuation information of the other object .
[Claim 10]
　The information
　processing device according to claim 9, wherein the attenuation information is information for obtaining an attenuation amount of the signal according to the positional relationship in the other object .
[Claim 11]

　The information processing apparatus according to claim 1, 　wherein the positional relationship is a distance between the other object and the predetermined object .
[Claim 12]

　The information processing device according 　to claim 1, wherein the gain determining unit determines the amount of attenuation based on the attenuation invalid information indicating whether or not the signal of the predetermined object is attenuated and the positional relationship .
[Claim 13]

　The information processing device according to claim 1, 　wherein the signal of the predetermined object is an audio signal .
[Claim 14]
　An information processing method in which an information processing device
　determines an amount of attenuation based on the positional relationship between a predetermined object and another object, and determines a signal gain of the predetermined object based on the amount of attenuation
　.
[Claim 15]

　A program that causes a computer to perform a process including 　a step of determining an attenuation amount based on the positional relationship between a predetermined object and another object and determining a signal gain of the predetermined object based on the attenuation amount .