Sign In to Follow Application
View All Documents & Correspondence

Information Processing Device And Method, And Program

Abstract: The present invention relates to an information processing device and method, and program with which it is possible to reduce the total number of objects while minimizing the impact on sound quality. The information processing device includes: a pass-through object selection unit that acquires data of L objects and selects M pass-through objects configured to output data as is from among the L objects; and an object generation unit that generates data of N new objects (N being less than L - M) on the basis of data of a plurality of non-pass-through objects that are not pass-through objects among the L objects. This invention can be applied to an information processing device.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
23 April 2021
Publication Number
03/2022
Publication Type
INA
Invention Field
ELECTRONICS
Status
Email
mahua.ray@remfry.com
Parent Application
Patent Number
Legal Status
Grant Date
2024-11-22
Renewal Date

Applicants

SONY CORPORATION
1-7-1, Konan, Minato-ku, Tokyo 1080075

Inventors

1. YAMAMOTO Yuki
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
2. CHINEN Toru
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
3. TSUJI Minoru
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075
4. OIKAWA Yoshiaki
c/o SONY CORPORATION, 1-7-1, Konan, Minato-ku, Tokyo 1080075

Specification

Title of invention: Information processing device and method, and program Technical field [0001] The present technology relates to information processing devices and methods, and programs, and particularly to information processing devices, methods, and programs that can reduce the total number of objects while suppressing the influence on sound quality. Background technology [0002] Conventionally, the MPEG (Moving Picture Experts Group) -H 3D Audio standard is known (see, for example, Non-Patent Document 1 and Non-Patent Document 2). [0003] 3D Audio, which is handled by the MPEG-H 3D Audio standard, can reproduce three-dimensional sound directions, distances, spreads, etc., enabling more realistic audio playback compared to conventional stereo playback. Become. Prior art literature Non-patent literature [0004] Non-Patent Document 1: ISO / IEC 23008-3, MPEG-H 3D Audio Non-Patent Document 2: ISO / IEC 23008-3: 2015 / AMENDMENT3, MPEG-H 3D Audio Phase 2 Outline of the invention Problems to be solved by the invention [0005] However, in 3D Audio, when the number of objects that make up the content is large, the data size of the entire content becomes large, and the amount of calculation such as data decoding processing and rendering processing of each of multiple objects also increases. Further, for example, when the upper limit of the number of objects is set in the operation or the like, it becomes impossible to handle the content of the number of objects exceeding the upper limit in the operation or the like. [0006] Therefore, it is possible to reduce the total number of objects by destroying some of the objects that make up the content. However, in such a case, the sound quality of the entire content may deteriorate due to the destruction of the object. [0007] This technology was made in view of such a situation, and it is possible to reduce the total number of objects while suppressing the influence on the sound quality. Means to solve problems [0008] The information processing device of one aspect of the present technology is a pass-through object selection unit that acquires data of L objects and selects M pass-through objects that output the data as they are from the L objects. , With an object generator that generates the data of N new objects, less than (LM), based on the data of a plurality of non-pass-through objects that are not the pass-through objects of the L objects. To prepare for. [0009] The information processing method or program of one aspect of the present technology acquires data of L objects, selects M pass-through objects that output the data as they are from the L objects, and selects the L pass-through objects. It comprises generating the data of N new objects, less than (LM), based on the data of a plurality of non-pass-through objects that are not the pass-through objects of the objects. [0010] In one aspect of the present technology, data of L objects is acquired, and M pass-through objects that output the data as they are are selected from the L objects, and the L objects of the L objects are selected. Based on the data of a plurality of non-pass-through objects that are not the pass-through objects, the data of N new objects, which is less than (LM), is generated. A brief description of the drawing [0011] [Fig. 1] Fig. 1 is a diagram illustrating determination of the position of a virtual speaker. [Fig. 2] Fig. 2 is a diagram showing a configuration example of a pre-rendering processing device. [Fig. 3] Fig. 3 is a flowchart illustrating an object output process. FIG. 4 is a diagram showing a configuration example of a coding device. FIG. 5 is a diagram showing a configuration example of a coding device. [Fig. 6] Fig. 6 is a diagram showing a configuration example of a decoding device. [Fig. 7] Fig. 7 is a diagram showing a configuration example of a computer. Embodiment for carrying out the invention [0012] Hereinafter, embodiments to which the present technology is applied will be described with reference to the drawings. [0013] This technology separates multiple objects into pass-through objects and non-pass-through objects, and creates new objects based on the non-pass-through objects, thereby reducing the total number of objects while suppressing the effect on sound quality. It is a thing. [0014] In this technology, the object may be any object such as an audio object or an image object as long as it has object data. [0015] The object data here is, for example, the object signal and metadata of the object. [0016] Specifically, for example, if the object is an audio object, the audio signal as an object signal and the metadata are the data of the audio object, and if the object is an image object, the image signal as an object signal and the meta. The data is the data of the image object. [0017] In the following, the case where the object is an audio object will be described as an example. [0018] If the object is an audio object, the object's audio signal and metadata are treated as the object's data. [0019] Here, the metadata includes, for example, position information indicating the position of the object in the three-dimensional space, priority information indicating the priority of the object, gain information of the audio signal of the object, and spread information indicating the spread of the sound image of the sound of the object. Etc. are included. [0020] Further, the position information of the object consists of, for example, a radius indicating the distance from the reference position to the object, a horizontal angle indicating the horizontal position of the object, and a vertical angle indicating the vertical position of the object. [0021] This technology is, for example, a pre-rendering processing device that inputs data of multiple objects that make up the content, more specifically data of objects, and outputs an appropriate number of objects according to the input, more specifically, data of objects. Can be applied. [0022] In the following, the number of objects at the time of input is nobj_in, and the number of objects at the time of output is nobj_out. In particular, here nobj_out Next, the pre-rendering processing device to which the present technology described above is applied will be described. Such a pre-rendering processing device is configured, for example, as shown in FIG. [0089] The pre-rendering processing device 11 shown in FIG. 2 is an information processing device that inputs data of a plurality of objects and outputs data of objects less than the input, and is a priority calculation unit 21, a pass-through object selection unit 22, and an object. It has a generation unit 23. [0090] In this pre-rendering processing device 11, nobj_in object data, that is, object metadata and audio signals are supplied to the priority calculation unit 21. [0091] Further, the pass-through object selection unit 22 and the object generation unit 23 are supplied with the number information indicating the number of input objects nobj_in, the number of output objects nobj_out, and the number of pass-through objects nobj_dynamic. [0092] The priority calculation unit 21 calculates the priority information priority [ifrm] [iobj] of each object based on the metadata and audio signal of the supplied objects, and the priority information priority [ifrm] of each of those objects. [iobj], metadata, and audio signals are supplied to the pass-through object selection unit 22. [0093] The pass-through object selection unit 22 is supplied with object metadata, audio signals, and priority information priority [ifrm] [iobj] from the priority calculation unit 21, and is also supplied with quantity information from the outside. In other words, the pass-through object selection unit 22 acquires the object data and the priority information priority [ifrm] [iobj] from the priority calculation unit 21, and also acquires the number information from the outside. [0094] The pass-through object selection unit 22 selects a pass-through object based on the supplied number information and the priority information priority [ifrm] [iobj] supplied from the priority calculation unit 21. The pass-through object selection unit 22 outputs the metadata and audio signal of the pass-through object supplied from the priority calculation unit 21 as it is to the subsequent stage, and the metadata and audio signal of the non-pass-through object supplied from the priority calculation unit 21. Is supplied to the object generation unit 23. [0095] The object generation unit 23 generates the metadata and audio signal of a new object based on the supplied number information and the metadata and audio signal of the non-pass-through object supplied from the pass-through object selection unit 22, and the latter stage. Output to. [0096] Next, the operation of the pre-rendering processing device 11 will be described. That is, the object output processing by the pre-rendering processing apparatus 11 will be described below with reference to the flowchart of FIG. [0097] In step S11, the priority calculation unit 21 calculates the priority information priority [ifrm] [iobj] of each object based on the metadata and audio signal of each object in the supplied predetermined time frame. [0098] For example, the priority calculation unit 21 calculates the priority information priority_gen [ifrm] [iobj] based on the metadata and the audio signal for each object, and the priority information priority_raw [ifrm] [iobj] included in the metadata. ] And the calculated priority information priority_gen [ifrm] [iobj], the equation (2) is calculated, and the priority information priority [ifrm] [iobj] is calculated. [0099] The priority calculation unit 21 supplies the priority information priority [ifrm] [iobj], metadata, and audio signal of each object to the pass-through object selection unit 22. [0100] In step S12, the pass-through object selection unit 22 has nobj_dynamic objects out of nobj_in objects based on the number information supplied and the priority information priority [ifrm] [iobj] supplied from the priority calculation unit 21. Select the pass-through object for. That is, the objects are separated. [0101] Specifically, the pass-through object selection unit 22 sorts the priority information priority [ifrm] [iobj] of each object, and passes through nobj_dynamic objects having a large value of the priority information priority [ifrm] [iobj]. Select as. In this case, all the input nobj_in objects that are not pass-through objects are regarded as non-pass-through objects, but only some objects that are not pass-through objects may be regarded as non-pass-through objects. [0102] In step S13, the pass-through object selection unit 22 outputs the metadata and audio signal of the pass-through object selected in the process of step S12 among the metadata and audio signals of each object supplied from the priority calculation unit 21 to the subsequent stage. do. [0103] Further, the pass-through object selection unit 22 supplies the metadata and audio signals of (nobj_in-nobj_dynamic) non-pass-through objects obtained by sorting the objects to the object generation unit 23. [0104] Although an example in which objects are sorted based on priority information will be described here, a pass-through object may be selected based on the degree of concentration of object positions as described above. [0105] In step S14, the object generation unit 23 determines the positions of (nobj_out-nobj_dynamic) virtual speakers based on the metadata and audio signals of the non-pass-through object supplied from the pass-through object selection unit 22 and the supplied number information. decide. [0106] For example, the object generation unit 23 clusters the position information of non-pass-through objects by the k-means method, and sets the position of the center of gravity of each cluster obtained as a result (nobj_out-nobj_dynamic) to the virtual speaker corresponding to those clusters. The position of. [0107] The method for determining the position of the virtual speaker is not limited to the k-means method, and may be determined by another method, or a predetermined fixed position may be the position of the virtual speaker. [0108] In step S15, the object generation unit 23 is supplied from the pass-through object selection unit 22. The rendering process is performed based on the metadata and audio signal of the non-pass-through object obtained and the position of the virtual speaker obtained in step S14. [0109] For example, the object generation unit 23 obtains the gain gain [ifrm] [iobj] [spk] of each virtual speaker by performing VBAP as a rendering process. Further, the object generation unit 23 obtains the sum of the audio signals sig [ifrm] [iobj] of the non-pass-through object multiplied by the gain gain [ifrm] [iobj] [spk] for each virtual speaker, and the audio obtained as a result. Let the signal be the audio signal of a new object corresponding to the virtual speaker. [0110] Further, the object generation unit 23 generates metadata of a new object based on the result of clustering obtained at the time of determining the position of the virtual speaker and the metadata of the non-pass-through object. [0111] This gives metadata and audio signals for (nobj_out-nobj_dynamic) new objects. The audio signal generation method for the new object may be rendering processing other than VBAP. [0112] In step S16, the object generation unit 23 outputs the metadata and audio signals of the (nobj_out-nobj_dynamic) new objects obtained in the process of step S15 to the subsequent stage. [0113] As a result, for one time frame, the metadata and audio signals of nobj_dynamic pass-through objects and the metadata and audio signals of (nobj_out-nobj_dynamic) new objects are output. [0114] That is, a total of nobj_out object metadata and audio signals are output as object metadata and audio signals after pre-rendering processing. [0115] In step S17, the pre-rendering processing device 11 determines whether or not processing has been performed for all time frames. [0116] If it is determined in step S17 that the processing has not yet been performed for the entire time frame, the processing returns to step S11, and the above-mentioned processing is repeated. That is, processing is performed for the next time frame. [0117] On the other hand, when it is determined in step S17 that the processing has been performed for the entire time frame, each part of the pre-rendering processing device 11 stops the processing being performed, and the object output processing ends. [0118] As described above, the pre-rendering processing device 11 separates objects based on the priority information, outputs metadata and audio signals as they are for high-priority pass-through objects, and performs rendering processing for non-pass-through objects. Go to generate and output new object metadata and audio signals. [0119] Therefore, metadata and audio signals are output as they are for objects with high priority information that have a large effect on the sound quality of the content, and for other objects, new objects are generated by the rendering process, which affects the sound quality. Is suppressed and the total number of objects is reduced. [0120] Although the example in which the objects are separated for each time frame has been described above, the same object may always be regarded as a pass-through object regardless of the time frame. [0121] In such a case, for example, the priority calculation unit 21 obtains the priority information priority [ifrm] [iobj] of all time frames for the object, and the priority information priority [ifrm] [iobj] obtained for those all time frames. ] Is the object priority information priority [iobj]. Then, the priority calculation unit 21 sorts the priority information priority [iobj] of each object, and selects the upper nobj_dynamic objects having a large value of the priority information priority [iobj] as pass-through objects. [0122] In addition, objects may be sorted for each section consisting of a plurality of consecutive time frames. Even in such a case, the priority information of each object for each section may be obtained in the same manner as the priority information priority [iobj]. [0123] By the way, the present technology described above can be applied to a coding device having a 3D Audio coding unit that encodes 3D Audio. Such a coding device is configured, for example, as shown in FIG. [0124] The coding device 51 shown in FIG. 4 has a pre-rendering processing unit 61 and a 3D Audio coding unit 62. [0125] The pre-rendering processing unit 61 corresponds to the pre-rendering processing device 11 shown in FIG. 2 and has the same configuration as the pre-rendering processing device 11. That is, the pre-rendering processing unit 61 has the above-mentioned priority calculation unit 21, a pass-through object selection unit 22, and an object generation unit 23. [0126] The pre-rendering processing unit 61 is supplied with metadata and audio signals of a plurality of objects. The pre-rendering processing unit 61 performs pre-rendering processing to reduce the total number of objects, and supplies the metadata and audio signal of each reduced object to the 3D Audio coding unit 62. [0127] The 3D Audio coding unit 62 encodes the metadata and audio signal of the object supplied from the pre-rendering processing unit 61, and outputs the resulting 3D Audio code string. [0128] For example, it is assumed that the metadata and audio signals of nobj_in objects are supplied to the pre-rendering processing unit 61. [0129] In this case, the pre-rendering processing unit 61 performs the same processing as the object output processing described with reference to FIG. 3, and includes metadata and audio signals of nobj_dynamic pass-through objects and (nobj_out-nobj_dynamic) new objects. The metadata of the object and the audio signal are supplied to the 3D Audio coding unit 62. [0130] Therefore, in this example, in the 3D Audio coding unit 62, the metadata and audio signals of a total of nobj_out objects are encoded and output. [0131] In this way, the coding device 51 reduces the total number of objects, and the reduced objects are coded. Therefore, the size (code amount) of the output 3D Audio code string can be reduced, and the calculation amount and memory amount of the coding process can also be reduced. Further, on the decoding side of the 3D Audio code string, it is possible to reduce the amount of calculation and the amount of memory in the 3D Audio decoding unit that decodes the 3D Audio code string and the subsequent rendering processing unit. [0132] Here, an example in which the pre-rendering processing unit 61 is arranged inside the coding device 51 has been described. However, the present invention is not limited to this, and the pre-rendering processing unit 61 may be arranged outside the coding device 51, that is, in the front stage of the coding device 51, or may be arranged in the front stage inside the 3D Audio coding unit 62. You may do it. [0133] Further, when the present technology is applied to a coding device, a pre-rendering processing flag indicating whether the object is a pass-through object or a newly generated object may be included in the 3D Audio code string. .. [0134] In such a case, the coding device is configured as shown in FIG. 5, for example. In FIG. 5, the parts corresponding to the case in FIG. 4 are designated by the same reference numerals, and the description thereof will be omitted as appropriate. [0135] The coding device 91 shown in FIG. 5 has a pre-rendering processing unit 101 and a 3D Audio coding unit 62. [0136] The pre-rendering processing unit 101 corresponds to the pre-rendering processing device 11 shown in FIG. 2 and has the same configuration as the pre-rendering processing device 11. That is, the pre-rendering processing unit 101 has the priority calculation unit 21, the pass-through object selection unit 22, and the object generation unit 23 described above. [0137] However, in the pre-rendering processing unit 101, the pass-through object selection unit 22 and the object generation unit 23 generate a pre-rendering processing flag for each object, and output metadata, an audio signal, and a pre-rendering processing flag for each object. .. [0138] The pre-rendering process flag is flag information indicating whether the object is a pass-through object or a newly generated object, that is, whether the object has been pre-rendered. [0139] For example, if the object is a pass-through object, the value of the pre-rendering processing flag of that object is set to 0. On the other hand, when the object is a newly created object, the value of the pre-rendering processing flag of the object is set to 1. [0140] Therefore, for example, the pre-rendering processing unit 101 performs the same processing as the object output processing described with reference to FIG. 3 to reduce the total number of objects, and generates a pre-rendering processing flag for each object after the total number is reduced. .. [0141] Then, the pre-rendering processing unit 101 supplies metadata, an audio signal, and a pre-rendering processing flag having a value of 0 to the 3D Audio coding unit 62 for nobj_dynamic pass-through objects. [0142] On the other hand, the pre-rendering processing unit 101 transfers the metadata, the audio signal, and the pre-rendering processing flag having a value of 1 to the 3D Audio coding unit 62 for (nobj_out-nobj_dynamic) new objects. Supply. [0143] The 3D Audio coding unit 62 encodes the metadata, audio signals, and pre-rendering processing flags of a total of nobj_out objects supplied from the pre-rendering processing unit 101, and outputs the resulting 3D Audio coding string. .. [0144] Further, the decoding device that decodes by inputting the 3D Audio code string including the pre-rendering processing flag output from the coding device 91 is configured as shown in FIG. 6, for example. [0145] The decoding device 131 shown in FIG. 6 has a 3D Audio decoding unit 141 and a rendering processing unit 142. [0146] The 3D Audio decoding unit 141 acquires the 3D Audio code string output from the encoding device 91 by reception or the like, decodes the acquired 3D Audio code string, and obtains the object metadata, audio signal, and the like. And the pre-rendering processing flag is supplied to the rendering processing unit 142. [0147] The rendering processing unit 142 performs rendering processing based on the metadata, audio signal, and pre-rendering processing flag supplied from the 3D Audio decoding unit 141, and generates a speaker drive signal for each speaker used for reproducing the content. Output. This speaker drive signal constitutes the content. It is a signal for reproducing the sound of each object by a speaker. [0148] In the decoding device 131 having such a configuration, by using the pre-rendering processing flag, it is possible to reduce the amount of processing calculation and the amount of memory in the 3D Audio decoding unit 141 and the rendering processing unit 142. In particular, in this example, the amount of calculation and the amount of memory at the time of decoding can be further reduced as compared with the case of the coding apparatus 51 shown in FIG. [0149] Here, a specific example of using the pre-rendering processing flag in the 3D Audio decoding unit 141 and the rendering processing unit 142 will be described. [0150] First, an example of using the pre-rendering processing flag in the 3D Audio decoding unit 141 will be described. [0151] The 3D Audio code string contains object metadata, audio signals, and pre-rendering processing flags. As described above, the metadata includes priority information and the like, but in some cases, the metadata may not include priority information. The priority information referred to here is the above-mentioned priority information priority_raw [ifrm] [iobj]. [0152] The value of the pre-rendering processing flag is set based on the priority information priority [ifrm] [iobj] calculated in the pre-rendering processing unit 101 in the previous stage of the 3D Audio coding unit 62. Therefore, for example, a pass-through object having a pre-rendering processing flag value of 0 can be said to be a high-priority object, and a newly created object having a pre-rendering processing flag value of 1 has a high priority. It can be said that it is a low object. [0153] Therefore, in the 3D Audio decoding unit 141, when the metadata does not include the priority information, the pre-rendering processing flag can be used instead of the priority information. [0154] Specifically, for example, it is assumed that only the object having a high priority is decoded in the 3D Audio decoding unit 141. [0155] At this time, for example, the 3D Audio decoding unit 141 assumes that when the value of the pre-rendering processing flag of the object is 1, the value of the priority information of the object is 0, and the object is included in the 3D Audio code string. Decoding of the audio signal etc. is not performed. [0156] On the other hand, the 3D Audio decoding unit 141 assumes that when the value of the pre-rendering processing flag of the object is 0, the value of the priority information of the object is 1, and the object is included in the 3D Audio code string. Decodes the existing metadata and audio signals. [0157] By doing so, the amount of decoding calculation and the amount of memory can be reduced by the amount of the object for which the decoding process is omitted. The pre-rendering processing unit 101 of the coding apparatus 91 may generate metadata priority information based on the pre-rendering processing flag, that is, the selection result of the pass-through object. [0158] Next, an example of using the pre-rendering processing flag in the rendering processing unit 142 will be described. [0159] In the rendering processing unit 142, spread processing may be performed based on the spread information included in the metadata. [0160] Here, the spread process is a process of expanding the sound image of the sound of the object based on the value of the spread information included in the metadata for each object, and is used to enhance the sense of presence. [0161] On the other hand, the object in which the value of the pre-rendering processing flag is 1 is an object newly generated in the pre-rendering processing unit 101 of the encoding device 91, that is, an object in which a plurality of objects regarded as non-pass-through objects are mixed. ing. The value of the spread information of such a newly generated object is one value obtained by the average value of the spread information of a plurality of non-pass-through objects. [0162] Therefore, if spread processing is performed on an object whose pre-rendering processing flag value is 1, the spread processing is performed based on one spread information that is not always appropriate for an object that was originally plural. It will be done, and the sense of presence may be low. [0163] Therefore, in the rendering processing unit 142, the spread processing based on the spread information is performed for the object whose pre-rendering processing flag value is 0, and the spread processing is not performed for the object whose pre-rendering processing flag value is 1. can do. By doing so, it is possible to prevent the sense of presence from being lowered, and to reduce the amount of calculation and the amount of memory by that amount without performing unnecessary spread processing. [0164] In addition, the pre-rendering processing device to which this technology is applied may be provided in a device for playing or editing content composed of a plurality of objects, a device on the decoding side, or the like. For example, in an application program that edits tracks corresponding to objects, editing becomes complicated if the number of tracks is too large, so it is effective to apply this technology that can reduce the number of tracks, that is, the number of objects at the time of editing. [0165] By the way, the series of processes described above can be executed by hardware or software. When a series of processes is executed by software, the programs constituting the software are installed on the computer. Here, the computer includes a computer embedded in dedicated hardware and, for example, a general-purpose personal computer capable of executing various functions by installing various programs. [0166] FIG. 7 is a block diagram showing a configuration example of computer hardware that executes the above-mentioned series of processes programmatically. [0167] In a computer, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, and a RAM (Random Access Memory) 503 are connected to each other by a bus 504. [0168] An input / output interface 505 is further connected to the bus 504. An input unit 506, an output unit 507, a recording unit 508, a communication unit 509, and a drive 510 are connected to the input / output interface 505. [0169] The input unit 506 includes a keyboard, a mouse, a microphone, an image pickup device, and the like. The output unit 507 includes a display, a speaker, and the like. The recording unit 508 includes a hard disk, a non-volatile memory, and the like. The communication unit 509 includes a network interface and the like. The drive 510 drives a removable recording medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory. [0170] In the computer configured as described above, the CPU 501 loads the program recorded in the recording unit 508 into the RAM 503 via the input / output interface 505 and the bus 504 and executes the above-mentioned series. Is processed. [0171] The program executed by the computer (CPU501) can be recorded and provided on a removable recording medium 511 as a package medium or the like, for example. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. [0172] In the computer, the program can be installed in the recording unit 508 via the input / output interface 505 by mounting the removable recording medium 511 in the drive 510. Further, the program can be received by the communication unit 509 and installed in the recording unit 508 via a wired or wireless transmission medium. In addition, the program can be pre-installed in the ROM 502 or the recording unit 508. [0173] The program executed by the computer may be a program in which processing is performed in chronological order according to the order described in the present specification, in parallel, or at a necessary timing such as when a call is made. It may be a program in which processing is performed. [0174] Further, the embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology. [0175] For example, this technology can take a cloud computing configuration in which one function is shared by multiple devices via a network and processed jointly. [0176] In addition, each step described in the above flowchart can be executed by one device or shared by a plurality of devices. [0177] Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices. [0178] Furthermore, this technology can also have the following configurations. [0179] (1) A pass-through object selection unit that acquires data of L objects and selects M pass-through objects that output the data as they are from the L objects. With an object generator that generates the data of N new objects less than (L-M) based on the data of a plurality of non-pass-through objects that are not the pass-through objects among the L objects. Information processing device equipped with. (2) The object generation unit generates the data of the new object based on the data of (L-M) non-pass-through objects. The information processing device according to (1). (3) The object generation unit generates the data of the N new objects arranged at different positions by rendering processing based on the data of the plurality of non-pass-through objects. The information processing device according to (1) or (2). (4) The object generation unit determines the positions of the N new objects based on the position information included in the data of the plurality of non-pass-through objects. Information processing device according to (3). (5) The object generation unit determines the positions of the N new objects by the k-means method based on the position information. The information processing device according to (4). (6) The positions of the N new objects are set to predetermined positions. Information processing device according to (3). (7) The data is the object signal and metadata of the object. The information processing device according to any one of (3) to (6). (8) The object is an audio object The information processing device according to (7). (9) The object generation unit performs VBAP as the rendering process. The information processing device according to (8). (10) The pass-through object selection unit selects the M pass-through objects based on the priority information of the L objects. The information processing device according to any one of (1) to (9). (11) The pass-through object selection unit selects the M pass-through objects based on the degree of concentration of the L objects in space. The information processing device according to any one of (1) to (9). (12) The pass-through -Number of objects M is the specified number The information processing device according to any one of (1) to (11). (13) The pass-through object selection unit determines the number M of the pass-through objects based on the total data size of the data of the pass-through object and the data of the new object. The information processing device according to any one of (1) to (11). (14) The pass-through object selection unit determines the number M of the pass-through objects based on the calculation amount of the data of the pass-through object and the processing at the time of decoding the data of the new object. The information processing device according to any one of (1) to (11). (15) Information processing equipment Get the data of L objects and Select M pass-through objects that output the data as they are from the L objects. Generate the data of N new objects less than (L-M) based on the data of a plurality of non-pass-through objects that are not the pass-through objects among the L objects. Information processing method. (16) Get the data of L objects and Select M pass-through objects that output the data as they are from the L objects. Generate the data of N new objects less than (L-M) based on the data of a plurality of non-pass-through objects that are not the pass-through objects among the L objects. A program that causes a computer to execute processing including steps. Description of the sign [0180] 11 pre-rendering processing device, 21 priority calculation unit, 22 pass-through object selection unit, 23 object generation unit The scope of the claims [Claim 1] A pass-through object selection unit that acquires data of L objects and selects M pass-through objects that output the data as they are from the L objects. With an object generator that generates the data of N new objects less than (L-M) based on the data of a plurality of non-pass-through objects that are not the pass-through objects among the L objects. Information processing device equipped with. [Claim 2] The object generation unit generates the data of the new object based on the data of (L-M) non-pass-through objects. The information processing device according to claim 1. [Claim 3] The object generation unit generates the data of the N new objects arranged at different positions by rendering processing based on the data of the plurality of non-pass-through objects. The information processing device according to claim 1. [Claim 4] The object generation unit determines the positions of the N new objects based on the position information included in the data of the plurality of non-pass-through objects. The information processing device according to claim 3. [Claim 5] The object generation unit determines the positions of the N new objects by the k-means method based on the position information. The information processing device according to claim 4. [Claim 6] The positions of the N new objects are set to predetermined positions. The information processing device according to claim 3. [Claim 7] The data is the object signal and metadata of the object. The information processing device according to claim 3. [Claim 8] The object is an audio object The information processing device according to claim 7. [Claim 9] The object generation unit performs VBAP as the rendering process. The information processing device according to claim 8. [Claim 10] The pass-through object selection unit selects the M pass-through objects based on the priority information of the L objects. The information processing device according to claim 1. [Claim 11] The pass-through object selection unit selects the M pass-through objects based on the degree of concentration of the L objects in space. The information processing device according to claim 1. [Claim 12] The number M of the pass-through objects is the specified number. The information processing device according to claim 1. [Claim 13] The pass-through object selection unit determines the number M of the pass-through objects based on the total data size of the data of the pass-through object and the data of the new object. The information processing device according to claim 1. [Claim 14] The pass-through object selection unit determines the number M of the pass-through objects based on the calculation amount of the data of the pass-through object and the processing at the time of decoding the data of the new object. The information processing device according to claim 1. [Claim 15] Information processing equipment Get the data of L objects and Select M pass-through objects that output the data as they are from the L objects. Generate the data of N new objects less than (L-M) based on the data of a plurality of non-pass-through objects that are not the pass-through objects among the L objects. Information processing method. [Claim 16] Get the data of L objects and Select M pass-through objects that output the data as they are from the L objects. Generate the data of N new objects less than (L-M) based on the data of a plurality of non-pass-through objects that are not the pass-through objects among the L objects. A program that causes a computer to execute processing including steps.

Documents

Application Documents

# Name Date
1 202117018885-Others-260623.pdf 2023-09-27
1 202117018885-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [23-04-2021(online)].pdf 2021-04-23
2 202117018885-Correspondence-260623.pdf 2023-08-03
2 202117018885-STATEMENT OF UNDERTAKING (FORM 3) [23-04-2021(online)].pdf 2021-04-23
3 202117018885-PRIORITY DOCUMENTS [23-04-2021(online)].pdf 2021-04-23
3 202117018885-Form-5-260623.pdf 2023-08-03
4 202117018885-POWER OF AUTHORITY [23-04-2021(online)].pdf 2021-04-23
4 202117018885-ABSTRACT [23-06-2023(online)].pdf 2023-06-23
5 202117018885-FORM 1 [23-04-2021(online)].pdf 2021-04-23
5 202117018885-CLAIMS [23-06-2023(online)].pdf 2023-06-23
6 202117018885-DRAWINGS [23-04-2021(online)].pdf 2021-04-23
6 202117018885-COMPLETE SPECIFICATION [23-06-2023(online)].pdf 2023-06-23
7 202117018885-DECLARATION OF INVENTORSHIP (FORM 5) [23-04-2021(online)].pdf 2021-04-23
7 202117018885-CORRESPONDENCE [23-06-2023(online)].pdf 2023-06-23
8 202117018885-DRAWING [23-06-2023(online)].pdf 2023-06-23
8 202117018885-COMPLETE SPECIFICATION [23-04-2021(online)].pdf 2021-04-23
9 202117018885-FER_SER_REPLY [23-06-2023(online)].pdf 2023-06-23
9 202117018885-Proof of Right [17-05-2021(online)].pdf 2021-05-17
10 202117018885-OTHERS [23-06-2023(online)].pdf 2023-06-23
10 202117018885-Proof of Right [24-05-2021(online)].pdf 2021-05-24
11 202117018885-FER.pdf 2022-12-23
11 202117018885-FORM 3 [21-07-2021(online)].pdf 2021-07-21
12 202117018885-FORM 18 [20-10-2022(online)].pdf 2022-10-20
12 202117018885.pdf 2021-10-19
13 202117018885-FORM 18 [20-10-2022(online)].pdf 2022-10-20
13 202117018885.pdf 2021-10-19
14 202117018885-FER.pdf 2022-12-23
14 202117018885-FORM 3 [21-07-2021(online)].pdf 2021-07-21
15 202117018885-OTHERS [23-06-2023(online)].pdf 2023-06-23
15 202117018885-Proof of Right [24-05-2021(online)].pdf 2021-05-24
16 202117018885-FER_SER_REPLY [23-06-2023(online)].pdf 2023-06-23
16 202117018885-Proof of Right [17-05-2021(online)].pdf 2021-05-17
17 202117018885-DRAWING [23-06-2023(online)].pdf 2023-06-23
17 202117018885-COMPLETE SPECIFICATION [23-04-2021(online)].pdf 2021-04-23
18 202117018885-DECLARATION OF INVENTORSHIP (FORM 5) [23-04-2021(online)].pdf 2021-04-23
18 202117018885-CORRESPONDENCE [23-06-2023(online)].pdf 2023-06-23
19 202117018885-DRAWINGS [23-04-2021(online)].pdf 2021-04-23
19 202117018885-COMPLETE SPECIFICATION [23-06-2023(online)].pdf 2023-06-23
20 202117018885-FORM 1 [23-04-2021(online)].pdf 2021-04-23
20 202117018885-CLAIMS [23-06-2023(online)].pdf 2023-06-23
21 202117018885-POWER OF AUTHORITY [23-04-2021(online)].pdf 2021-04-23
21 202117018885-ABSTRACT [23-06-2023(online)].pdf 2023-06-23
22 202117018885-PRIORITY DOCUMENTS [23-04-2021(online)].pdf 2021-04-23
22 202117018885-Form-5-260623.pdf 2023-08-03
23 202117018885-STATEMENT OF UNDERTAKING (FORM 3) [23-04-2021(online)].pdf 2021-04-23
23 202117018885-Correspondence-260623.pdf 2023-08-03
24 202117018885-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [23-04-2021(online)].pdf 2021-04-23
24 202117018885-Others-260623.pdf 2023-09-27
25 202117018885-PatentCertificate22-11-2024.pdf 2024-11-22
26 202117018885-IntimationOfGrant22-11-2024.pdf 2024-11-22

Search Strategy

1 SearchHistoryE_22-12-2022.pdf

ERegister / Renewals

3rd: 15 Jan 2025

From 06/11/2021 - To 06/11/2022

4th: 15 Jan 2025

From 06/11/2022 - To 06/11/2023

5th: 15 Jan 2025

From 06/11/2023 - To 06/11/2024

6th: 15 Jan 2025

From 06/11/2024 - To 06/11/2025

7th: 26 Oct 2025

From 06/11/2025 - To 06/11/2026