Technical field
[0001]The present disclosure relates to an information processing apparatus and an information processing method, and a program, an information processing apparatus and an information processing method capable of signaling the area information of celestial sphere image in a more diverse projection format, and program on.
BACKGROUND
[0002]As the flow of standardization in the Internet Streaming such IPTV (Internet Protocol Television), HTTP (Hypertext Transfer Protocol) VOD (Video On Demand) streaming or by streaming, standardization scheme applied to live streaming is being performed.
[0003]
　In particular, MPEG-DASH the standardization is done in ISO / IEC / MPEG (Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP) has attracted attention (for example, see Non-Patent Document 1).
[0004]
　In addition, in the MPEG, VR standardization (MPEG-I: Coded Representation of Immersive media) is in progress. For example, the HMD commonly used in view of the celestial sphere image (Head Mounted Display), a video is not on all 360 ° are displayed at a time, and only the image of the partial region. Therefore, in the omnidirectional image to be used in VR, it is necessary to signal area information representing a portion of the area to be displayed. Also, when performing network distribution of celestial sphere image by MPEG-DASH, because of the limited bandwidth, viewport dependent Processing for the purpose of its effective use is being considered.
CITATION
Non-patent literature
[0005]
Non-Patent Document 1: ISO / IEC 23009-1: 2012 Information technology Dynamic adaptive streaming over HTTP (DASH)
Summary of the Invention
Problems that the Invention is to Solve
[0006]
　Meanwhile, conventionally, in OMAF CD (Omnidirectional Media Application Format Committee Draft), are signals spherical region coverage as CoverageInformationBox. However, there are conventional OMAF projection format can not correspond to that in CD, corresponding to a more diverse projection formats has been desired.
[0007]
　The present disclosure has been made in view of such circumstances, it is to be able to signal the area information of celestial sphere image in a more diverse projection formats.
Means for Solving the Problems
[0008]
　The information processing apparatus of the first aspect of the present disclosure, generation and signal a plurality of vertices on the sphere, and generates region information representing the region on the sphere by connecting these vertices each other at the shortest distance on the sphere It provided with a part.
[0009]
　The information processing method or a program according to the first aspect of the present disclosure is to signal a plurality of vertices on a sphere, generates area information representing an area on the sphere by connecting these vertices each other at the shortest distance on the sphere including the step of.
[0010]
　In a first aspect of the present disclosure is to signal a plurality of vertices on the sphere, area information representing an area on the spherical surface by connecting the shortest distance on the sphere of their vertices to each other is generated.
[0011]
　The information processing apparatus of the second embodiment of the present disclosure, signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, the surface of comprising a generation unit for generating area information representing an area on the sphere by the signal according to the number.
[0012]
　The information processing method or a program according to the second aspect of the present disclosure, signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, comprising the step of generating area information representing an area on the sphere by the signal depending on the number of surfaces.
[0013]
　In the second aspect of the present disclosure, signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, depending on the number of surfaces region information representing the region on the sphere by the signal Te is generated.
The invention's effect
[0014]
　According to the first and second aspects of the present disclosure, it may signal the area information of celestial sphere image in a more diverse projection formats.
BRIEF DESCRIPTION OF THE DRAWINGS
[0015]
FIG. 1 is a diagram illustrating a viewport dependent Processing.
Is a diagram illustrating a FIG. 2 spherical coordinate system for handling viewport information.
3 is a diagram showing an example of a region information defined by MPEG.
4 is a diagram showing two kinds of spherical region representation by Shape_type.
5 is a diagram showing a storage location of covi a coverage information of the content.
[6] In the conventional syntax is a diagram illustrating an example that can not be represented exactly.
7 is a diagram showing an example of a composed projection format with triangular faces.
8 is a diagram showing a first example of a signal of a spherical region according to the first embodiment.
9 is a diagram showing a second example of a signal of a spherical region according to the first embodiment.
10 is a diagram illustrating an example of application of that signal the two faces of the cube.
11 is a diagram showing an example of ISOBMFF which is extended in the first embodiment.
Only expressed by [FIG 12] point_yaw / pitch is a diagram for explaining an example of coverage is not uniquely determined.
13 is a diagram showing the definition of the parameters in the first embodiment.
14 is a diagram showing an example of signals of the three sides of the cube.
Is a diagram showing parameters in the case of signaling the three surfaces of FIG. 15 cubic.
16 is a diagram showing an example of signaling the two faces of the octahedron.
17 is a diagram showing parameters in the case of signaling the two faces of the octahedron.
18 is a diagram showing an example of a signal of the spherical region of the second embodiment.
19 is a diagram showing an example of ISOBMFF which are extended in the second embodiment.
Is a diagram illustrating FIG. 20] exclude_flag.
21 is a diagram showing the definition of the parameters in the second embodiment.
22 is a diagram showing a first example of the signal the three sides of the cube.
23 is a diagram showing a second example of signaling the three sides of the cube.
FIG. 24 is a diagram illustrating an example of signaling the two faces of the octahedron.
It is limited to [25] the triangular region representing a diagram illustrating an example of signal.
Is a diagram illustrating an example of a RegionOnSphereStruct in the example of FIG. 26 FIG. 25.
Is a diagram illustrating the definition of the parameters in the example of FIG. 27 FIG. 25.
[FIG. 28] is a diagram showing a first description example of tcov in extended ISOBMFF in the third embodiment.
Is a diagram illustrating the definition of the parameters in the example of FIG. 29 FIG. 28.
[FIG. 30] is a diagram showing a second description example of tcov in extended ISOBMFF in the third embodiment.
Is a diagram illustrating the definition of the parameters in the example of FIG. 31 FIG. 30.
[FIG. 32] is a diagram showing a third description example of tcov in extended ISOBMFF in the third embodiment.
Is a diagram illustrating the definition of the parameters in the example of FIG. 33 FIG. 32.
FIG. 34 is a diagram showing a fourth example of the description of tcov in extended ISOBMFF in the third embodiment.
It is a diagram illustrating the definition of the parameters in the example of FIG 35 FIG 34.
In the form of FIG. 36 a third embodiment, is a diagram illustrating cases with tcov only main fraction track.
In the form of [37] A third embodiment, which is a diagram for explaining all of the fraction track in cases with tcov.
[FIG. 38] is a diagram showing an example of signaling the six sides of the cube.
[39] is a diagram showing a first example of an extended DASH MPD in the fourth embodiment.
Is a diagram illustrating the definition of FIG. 40 parameters.
[FIG. 41] is a diagram showing the definition of the parameters.
[FIG. 42] is a diagram for explaining a modified example of using the syntax of the first embodiment.
[FIG 43 is a diagram showing the definition of the parameters.
[FIG. 44] is a diagram showing a second example of an extended DASH MPD in the fourth embodiment.
Is a diagram illustrating the definition of FIG. 45 parameters.
[FIG. 46] is a diagram showing the definition of the parameters.
[FIG. 47] is a diagram for explaining a modified example of using the syntax of the second embodiment.
[FIG. 48] is a diagram showing an example of signaling the eight surfaces of the octahedron.
[FIG. 49] is a diagram showing a description example of MPD a signal is described in Figure 48.
[FIG. 50] is a view for explaining a modification of the fourth embodiment.
It is a block diagram showing a configuration example of a delivery system according to the FIG. 51 the present technology.
It is a block diagram showing a configuration example of FIG. 52] generator.
[FIG. 53] is a block diagram showing a configuration example of a playback apparatus.
Is a flow chart illustrating the FIG. 54] file generating process.
It is a flow chart illustrating the FIG. 55] file acquisition processing.
[FIG. 56] is a block diagram showing a configuration example of an embodiment of a computer to which the present technology is applied.
DESCRIPTION OF THE INVENTION
[0016]
　Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.
[0017]
　
　First, with reference to FIGS. 1 to 7 to describe area information of a conventional celestial sphere image.
[0018]
　Conventionally, the celestial sphere image is divided into a plurality of areas, techniques have been utilized that viewport dependent Processing retrieve and display the image of the appropriate region in accordance with the client's viewpoint and field of view. Also, the viewport dependent Processing, there is no need to areas not displayed obtains.
[0019]
　For example, in Figure 1, omnidirectional images by equirectangular has been shown state of being planarly expanded, is divided in the region of its entirety 18, are each region a separate video stream ing. A region corresponding to the client's viewpoint and field of view are referred to with rectangular doublets, video stream is acquired in accordance with the region. In the example of FIG. 1, third, fourth, ninth, and video stream # 10 regions are obtained and used to display the area corresponding to the client's viewpoint and field of view.
[0020]
　In order to realize the viewport dependent Processing, it is necessary to signal the position information and size information of each region of the celestial sphere image. The client, on the basis of their information, it is possible to retrieve and display video area according to viewport. Each area information of celestial sphere image is the signal as the area information on the sphere (spherical coordinates).
[0021]
　For example, a client, it is envisioned that HMD. Inside the HMD, spherical coordinate system, as shown in FIG. 2 (yaw, pitch, roll), the reason viewport information is handled is common, it is possible to simplify the process by aligning the coordinate system.
[0022]
　Figure 3 shows an example of the region information is defined by MPEG is.
[0023]
　In such a region information, for example, CoverageInformationBox is signaling information of a spherical region of celestial sphere image stored in the track are displayed. Then, yaw angle region center is indicated by center_yaw, pitch angle region center is indicated by Center_pitch, the horizontal angle range indicated by Hor_range, vertical angle range indicated by Ver_range.
[0024]
　Furthermore, as shown in FIG. 4, it is possible to perform region representation on two types of spherical by Shape_type.
[0025]
　For example, shape_type = 0 shown on the left side of FIG. 4 performs domain representation on the sphere by area shape surrounded by four great circles. Further, shape_type = 1 shown on the right side in FIG. 4 performs domain representation on the sphere by area shape surrounded by two small two grate circles. Here, great circle represents the circle of cross-section having a center which coincides with the center of the sphere, small circle represents a circle otherwise. It should be noted that, as the coverage representation at the present time, only shape_type = 1 is being operated.
[0026]
　5 shows, the storage location of covi is shown a coverage information of the content.
[0027]
　Incidentally, shape_type = 0 is cube projection mapping; the surface area of ​​the (Cube Projection Mapping CMP) can signal by one side, Equirectangular projection; can a rectangular area (Equirectangular projection ERP) signaling. However, conventionally, and two faces or more regions of the cube projection mapping, has not been able corresponding to these non-projection format.
[0028]
　For example, in the upper side of FIG. 6, when expressing the coverage of two surfaces of a cube hatched gray is applied, it is impossible to accurately represent the current syntax. For example, (center_yaw, center_pitch, hor_range, ver_range) = (45,0,180,90) and the signaling, resulting in a hemispherical region surrounded by the thick lines in the lower side of FIG. Therefore, spherical surface area that can be covered by two surfaces of a cube is narrowed. That is, as surrounded by a bold line in the upper side of FIG. 6, whereas the third region of the spherical surface is covered, so as to surround a thick line on the lower side of FIG. 6, a quarter of the area of ​​the spherical surface only covered It disappears.
[0029]
　Further, conventionally, a projection format consists of a triangular surface as shown in FIG. 7 (OHP: drone projection to octa, ISP: Doron projection to icosa) in the region representation did not correspond.
[0030]
　Therefore, not covered by the prior art, two faces or more regions CMP, a is commonly used in non-ERP or CMP, domain representation of the projection format that may be adopted in the future OMAF (OHP or ISP) is possible to cope has been required to. Furthermore, not only OHP and ISP, was also required to address all projection formats using polyhedron.
[0031]
　
　with reference to FIGS. 8 to 17, as a first embodiment of the present technology, describing a first example of a region signal process of the track in ISOBMFF.
[0032]
　In the first embodiment, the coverage of the content stored in ISOBMFF track, and signal a plurality of vertices in yaw and pitch, expressed in regions formed by connecting the apexes each other at the shortest distance on the sphere.
[0033]
　For example, in FIG. 8, and the signal of three vertices, there is shown a first example of performing a region representation on the sphere by connecting the three apexes each other at the shortest distance on the sphere. Similarly, in FIG. 9, and the signal six vertices, there is shown a second example of performing domain representation on the sphere by connecting the six vertices each other at the shortest distance on the sphere.
[0034]
　At this time, a line segment on a sphere which connects each vertex become part of the great circle. Moreover, such a signal, as well as OHP and ISP as shown in Figure 7, projection format corresponding to the other of the polyhedron becomes possible.
[0035]
　Further, as shown in FIG. 9, it is possible to signal the two faces of the cube, for example, the area corresponding to the client's viewpoint and field of view, even when the across two sides of the cubes efficiently it can be streamed.
[0036]
　Referring now to FIG. 10, there will be described an application example of possible signaling the two faces of the cube.
[0037]
　For example, the cube projection mapping, cube, composed of six surfaces A as shown, surface B, surface C, surface D, surface E, and the surface F.
[0038]
　Then, filed by dividing their six faces in three every two surfaces. That is, files and consisting of two sides of the surface B and surface C, files and consisting of two planes of plane A and plane C, is filed in the file and consisting of two surfaces faces E and surface F. In this case, in each file, as shown in FIG. 9 described above, for each two surfaces respectively, is signaled to the spherical surface area by Covi.
[0039]
　Here, for example, if the region corresponding to the client's viewpoint and field of view extends over the surface B and surface C, ie, if the area being hatched in gray user tried to see in FIG. 10, the information of covi based, file consisting of two surfaces of the surface B and surface C is obtained.
[0040]
　That is, conventionally, it is not possible to signal the two sides or more regions of the cube projection mapping, if the region corresponding to the client's viewpoint and field of view extends over the plane B and plane C are able to efficiently streaming could not. In contrast, by being able to signal a plurality of surfaces, even area corresponding to the client's viewpoint and field of view have over a plurality of surfaces, by streaming file consisting of those surfaces, efficiently streaming it will be able to be performed.
[0041]
　Incidentally, the signals a plurality of vertices in yaw and pitch, in the case of performing area expressed by connecting the apexes each other at the shortest distance on the sphere, it is necessary to extend the ISOBMFF conventionally.
[0042]
　11 is an example of an extended ISOBMFF (CoverageInformationBox) and ArbitraryRegionOnSphereStruct are shown.
[0043]
　In ISOBMFF shown in FIG. 11, shape_type = 2 has been introduced. For example, Shape_type = In 2, each vertex, i = 0 and i = 1, i = 1 and i = 2, ···, i = n-1 and i = n, i = n and i = 0 Rule in is defined as each is connected by the shortest distance on the sphere.
[0044]
　Further, in ISOBMFF shown in FIG. 11, covered_yaw, covered_pitch the representative point included in the coverage yaw, pitch (for example, the center point of the region) is defined to indicate a. That, covered_yaw / pitch must signal a point inside the area represented by point_yaw / pitch. For example, when coverage of the three sides of the cube, the only representation by point_yaw / pitch, since the coverage is not uniquely determined, it is necessary to signal by covered_yaw / pitch.
[0045]
　Referring to FIG. 12, only represented by point_yaw / pitch will be described an example in which coverage is not uniquely determined.
[0046]
　As shown in FIG. 12, when dividing the cube every three surfaces is divided into a shape composed of three surfaces of the shape and the back side of three sides of the front side. In this case, when the signal of the respective shapes coverage, that is the signal becomes the same. Consequently, in order to distinguish between these two shapes, direction by covered_yaw / pitch (3 faces the front side, or three surfaces of the inner side) is required to signal a.
[0047]
　Figure 13 is shown the definition of the parameters used in the area signal process of the track in such extended ISOBMFF.
[0048]
　Next, a description will be given actual signal examples of the first embodiment.
[0049]
　For example, according to the coordinate system as shown in the lower side of FIG. 14, when a signal of the three surfaces of the front side of the cube, as shown in the upper side of FIG. 14, parameters are set as shown in FIG. 15. Further, in this coordinate system, yaw angle, -180 ° or more and less than 180 °, pitch angle, -90 ° or higher, and is at 90 ° or less, roll angle, -180 ° or more, and , are 180 ° or less.
[0050]
　Similarly, when the signal of the two surfaces of the front side of the octahedron, as shown in FIG. 16, parameters are set as shown in FIG. 17.
[0051]
　Thus, in the first embodiment, by using the extended ISOBMFF, there is a merit that than to signal a point on the sphere in yaw and pitch, manageable on implementation. For example, the client side, because it has left the viewport information itself direction and field of view and (FoV), within its viewport range, to determine whether it contains a region surrounded by points which are signals it is easy. Incidentally, in the first embodiment, the signal of the non-contiguous regions do not correspond.
[0052]
　As a modification of the first embodiment, for example, it may be used flags instead Shape_type. Also, the contents of EiarubiaitraryRegionOnSphereStruct, and signals in the RegionOnSphereStruct, may switch them Shape_type.
[0053]
　
　with reference to FIGS. 18 to 27, as a second embodiment of the present technology, a description will be given of a second example of the area signal process of the track in ISOBMFF.
[0054]
　In the second embodiment, the coverage of the content stored in ISOBMFF track, the vertex for each plane and signaling in yaw and pitch, the surface area formed by connecting the apexes each other at the shortest distance on the sphere the number of faces expressing a plurality signals.
[0055]
　For example, in FIG. 18, the region in every two faces, signal an apex thereof faces, to signal the two surfaces forming a surface region formed by connecting the apexes each other at the shortest distance on the sphere examples of performing representation is shown.
[0056]
　At this time, a line segment on a sphere which connects each vertex become part of the great circle. Moreover, such a signal, as well as OHP and ISP as shown in Figure 7, projection format corresponding to the other of the polyhedron becomes possible.
[0057]
　19 shows an example of an extended ISOBMFF (CoverageInformationBox) and ArbitraryRegionOnSphereStruct are shown.
[0058]
　In ISOBMFF shown in FIG. 11, shape_type = 2 has been introduced. For example, Shape_type = In 2, each vertex, i = 0 and i = 1, i = 1 and i = 2, ···, i = n-1 and i = n, i = n and i = 0 Rule in is defined as each is connected by the shortest distance on the sphere. Then, as shown in ISOBMFF, by turning the for loop by the number of faces, it is possible to signal a region comprising a plurality of surfaces.
[0059]
　Further, the ISOBMFF shown in FIG. 11, Exclude_flag is introduced. If exclude_flag is 1, except the signal area becomes coverage.
[0060]
　Referring to FIG. 20, described Exclude_flag. In Figure 20, an example of a coverage signal 5 worth of the cube (other than the surface of gray it is hatched) is shown.
[0061]
　For example, as shown in the upper side of FIG. 20, in the case of exclude_flag = 0, it is necessary to signal the 20 points corresponding to the plane of the 5 screen portion as coverage. In contrast, as shown in the lower part of FIG. 20, in the case of Exclude_flag = 1 may be a signal of 4 points corresponding to the surface of one plane with the exception of coverage. Thus, the use of Exclude_flag, to optimize the number of bits required for coverage signal, i.e., may be coverage fewer bits.
[0062]
　21, it is shown the definition of the parameters used in the area signal process of the track in such extended ISOBMFF.
[0063]
　Next, a description will be given actual signal examples of the second embodiment.
[0064]
　For example, in FIG. 22, when the shape_type = 0, i.e., in the manner shown on the left in FIG. 4 described above, an example of signaling the three sides of the cube are shown. In this case, the parameter is set as shown in the lower part of FIG. 22.
[0065]
　23 shows the case of Shape_type = 2, i.e., by the method described in the second embodiment, an example of signaling the three sides of the cube are shown. In this case, the parameter is set as shown in the lower part of FIG. 23.
[0066]
　FIG 24, when the Shape_type = 2, i.e., by the method described in the second embodiment, an example of signaling the two faces of the octahedron on the front side is shown. In this case, the parameter is set as shown in the lower part of FIG. 24.
[0067]
　Thus, in the second embodiment, by using the extended ISOBMFF, there is a merit that than to signal a point on the sphere in yaw and pitch, manageable on implementation. For example, the client side, because it has left the viewport information itself direction and field of view and (FoV), within its viewport range, to determine whether it contains a region surrounded by points which are signals it is easy.
[0068]
　Furthermore, in the second embodiment, it is possible to more signal areas in units of surfaces, it is possible signaling discontinuous regions. Further, by using the exclude_flag as described above, it is possible to optimize the number of vertices to signal. Incidentally, in the second embodiment, as compared with the first embodiment described above, it may overlap the vertex information is generated, sometimes the size of the Box is increased.
[0069]
　As a modification of the second embodiment may be used flags instead Shape_type. For example, the contents of EiarubiaitraryRegionOnSphereStrcut, and signals in the RegionOnSphereStruct, may be switched in Shape_type. In addition, it may be changed shape_type for each area.
[0070]
　Further, by limiting the num_points to 3, it may be used shape_type = 2 only representation of the triangular area. For example, the second embodiment, when it is restricted to expression of the triangular area, a triangular area on the sphere can be expressed as shown in FIG. 25. At this time, ShierueiesuesutiaruaiangleRegionOnSphereStruct is as shown in FIG. 26, parameters are defined as shown in FIG. 27.
[0071]
　
　with reference to FIGS. 28 to 38, as a third embodiment of the present technology will be described domain signal how files unit in ISOBMFF.
[0072]
　In the third embodiment, the total coverage of the content ISOBMFF file stores, expressed using signaling method of the first and second embodiments described above. That is, the signal of the region, using the same syntax semantics and the first and second embodiments described above.
[0073]
　For example, in the prior art have been defined only coverage information of track units, when ISOBMFF file consists of multiple track, coverage summarizes total track (= total coverage file units) could not be signals.
[0074]
　In contrast, in the third embodiment, the ISOBMFF composed of a plurality track, it is possible to viewport dependent Processing in file units.
[0075]
　Further, in the third embodiment, the total coverage information in files by the signal, the client can easily obtain the available display area when the file reproduction. For example, if you do not cover all the entire celestial sphere, it is possible to be filled with the specified part that can not be pre-video display client own the video or in the ISOBMFF, data.
[0076]
　For example, in the third embodiment, tcov (Total Coverage Information Box) is placed under the povd (ProjectedOmnidirectionalVideoBox).
[0077]
　In the following description, the system having a tcov only main fraction track the casing 1. Then, in case 1, tcov is a scheme with only total coverage information and case 1-1, tcov is, total addition to coverage information, all fraction track cases a system having a coverage information (main including) 1-2 to.
[0078]
　Further, a system having a tcov to all fraction track the casing 2. Then, in case 2, tcov is a scheme with only total coverage information and case 2-1, tcov is, in addition to the total coverage information, all fraction track cases a system having a coverage information (main including) 2-2 to.
[0079]
　Thus, based on each case, the syntax of the variations of tcov becomes four.
[0080]
　For example, in a first variation of the syntax tcov, information signals in tcov will have only total coverage information, domain signal method is the same method as in the first embodiment described above.
[0081]
　Accordingly, in a first variation of the syntax tcov, the ISOBMFF (CoverageInformationBox) as shown in FIG. 28 is described, EiarubiaitraryRegionOnSphereStruct is the same as those of the above-described FIG. 11 (first embodiment). The parameter is defined as shown in FIG. 29. Incidentally, it is possible to also include a modification of the first embodiment described above.
[0082]
　In the second variation of the syntax tcov, information signals in tcov will have only total coverage information, domain signal method is the same method as the second embodiment described above.
[0083]
　Thus, in the second variation of the syntax tcov, the ISOBMFF (CoverageInformationBox) as shown in FIG. 30 is described, EiarubiaitraryRegionOnSphereStruct is the same as FIG. 19 described above (the second embodiment). The parameter is defined as shown in FIG. 31. Incidentally, it is possible to also include a modification of the second embodiment described above.
[0084]
　In the third variation of the syntax tcov, information signals in tcov, in addition to the total coverage information has the coverage information for all fraction track (including main), domain signal method, first the aforementioned It is the same method as in the embodiment.
[0085]
　Accordingly, in the third variation of the syntax tcov, the ISOBMFF (CoverageInformationBox) as shown in FIG. 32 is described, EiarubiaitraryRegionOnSphereStruct is the same as those of the above-described FIG. 11 (first embodiment). The parameter is defined as shown in FIG. 33. Incidentally, it is possible to also include a modification of the first embodiment described above.
[0086]
　As a modification of the third variation of the syntax tcov, Num_track_partition sets the number excluding the own track with TiotalCoverageInformationBox, it may not signal an track_id of its own track in tp_id.
[0087]
　In the fourth variation Syntax tcov, information signals in tcov, in addition to the total coverage information has the coverage information for all fraction track (including main), domain signal method, second mentioned above It is the same method as in the embodiment.
[0088]
　Therefore, in the fourth variation of the syntax tcov, the ISOBMFF (CoverageInformationBox) as shown in FIG. 34 is described, EiarubiaitraryRegionOnSphereStruct is the same as FIG. 19 described above (the second embodiment). The parameter is defined as shown in FIG. 35. Incidentally, it is possible to also include a modification of the second embodiment described above.
[0089]
　As a modification of the fourth variation of the syntax tcov, Num_track_partition sets the number excluding the own track with TiotalCoverageInformationBox, it may not signal an track_id of its own track in tp_id.
[0090]
　Referring to FIG. 36, in the third embodiment will be described for the case 1 with tcov only main fraction track.
[0091]
　For example, in Case 1, that have a tcov the main fraction track, the no tcov is to fraction track. Then, main fraction track can reference fraction track in Track Reference ( 'ofrc'), fraction track can refer to main fraction track in Track Reference ( 'omfr'). In addition, with the TotalCoverageInformationBox only to the main fraction track.
[0092]
　Here, for example, if tcov of cases 1-1 with only total coverage information, there is no duplicate information regarding coverage, simple representation becomes possible. However, in order to obtain the total coverage, it is necessary to refer to the main fraction track, coverage of the other fraction track may not be obtained and does not refer to the fraction track.
[0093]
　Further, for example, tcov In addition to total coverage information, Case 1-2 with coverage information for all fraction track (including main), can obtain the fraction track of coverage within main fraction track. However, in order to obtain the total coverage, it is necessary to refer to the main fraction track. As a variation of the case 1, it may be provided with an prfr only main fraction track. In addition, in the case of the case 1-2, tref ( 'ofrc') may not be provided.
[0094]
　Referring to FIG. 37, in the third embodiment, all of the fraction track for the case 2 with tcov be described.
[0095]
　For example, in Case 2, main fraction track, distinction fraction track no. Further, it is possible to each fraction track is referenced track reference'omfr 'to each other.
[0096]
　Here, for example, if tcov of cases 2-1 with only total coverage information, any fraction track also because it has a total coverage, it is easy to obtain a total coverage information. However, the file size to have redundant information increases as compared with the case 1-1, the other fraction track coverage can not get and does not refer to the fraction track.
[0097]
　Further, for example, tcov In addition to total coverage information, Case 2-2 with coverage information fraction track (including main), total coverage, can acquire the coverage of each fraction track in one fraction track. However, the file size for having redundant information, case 1-1, case 1-2, and also increases as compared with either case 2-1. In the case of the case 2-2, tref ( 'omfr') may be omitted.
[0098]
　Next, a description will be given actual signal example of the third embodiment.
[0099]
　In Figure 38, the case 2-2, using a fourth variation of the syntax tcov, stored one by one track each side as region. For example, Region [0] is track_id: 1 and then, Region [1] is track_id: a 2, Similarly, Region [5] is track_id: 6 to. Further, the signal of tcov is described as shown in the lower part of FIG. 38.
[0100]
　As a modification of the third embodiment, instead of Total_full_sphere, it may be used flags.
[0101]
　
　with reference to FIGS. 39 to 50, as a fourth embodiment of the present technology will be described domain signal method in the DASH MPD.
[0102]
　For example, it is possible to signal the DASH MPD, a region where each Representation covers.
[0103]
　As the signal process can be used EssentialProperty or SupplementalProperty, EssentialProperty is stored under the AdaptationSet, SupplementalProperty is stored under Representation.
[0104]
　For example, SupplementalProperty is player can not understand this Property, ignore this Property value, its AdaptationSet (or Representation, Sub-Representation) may be utilized. In addition, EssentialProperty is, Player can not understand this Property must ignore the AdaptationSet that have been written of this Property (or Representation, Sub-Representation).
[0105]
　Figure 39 is a first example of an extended DASH MPD are the shown here, the syntax of the first embodiment described above are used.
[0106]
　In such a syntax, coverage: arbitrary, totalcoverage: For arbitrary, 0 ~ 2 are mandatory, and the 3 subsequent respond to num_points. Furthermore, if the coverage is not signaled, the coverage represents a 360degree full. On the other hand, in the case where spatial_set_id of coverage is signaled, the total coverage is not a 360degree full, total coverage with the same spatial_set_id is essential. It may also be collectively Coverage and TotalCoverage to one EssentialProperty or SupplementalProperty.
[0107]
　In FIGS. 40 and 41, the definition of parameters used in the extended DASH MPD as shown in FIG. 39 is shown.
[0108]
　As a modification for using syntax in the first embodiment described above, Coverage, for the case of shape_type = 2 of TotalCoverage, the number of points EssentialProperty shown in FIG. 42 (coverage: arbitrary, totalcoverage: arbitrary ) to the signal. At this time, the order in which connecting points may be in the order of description of EssentialProperty or SupplementalProperty, may have a parameter indicating the order in EssentialProperty or SupplementalProperty.
[0109]
　Further, in FIG. 43 is described definitions of parameters used in the syntax shown in FIG. 42.
[0110]
　Figure 44 is a second example of an extended DASH MPD is shown, here, the syntax of the second embodiment described above is used.
[0111]
　In such a syntax, coverage: arbitrary, totalcoverage: For arbitrary, k is 2 or more, is from 2 to num_points-1, l is from 0 to num_regions-1.
[0112]
　Furthermore, if the coverage is not signaled, the coverage represents a 360degree full. On the other hand, in the case where spatial_set_id of coverage is signaled, the total coverage is not a 360degree full, total coverage with the same spatial_set_id is essential. It may also be collectively Coverage and TotalCoverage to one EssentialProperty or SupplementalProperty.
[0113]
　In FIGS. 45 and 46, the definition of parameters used in the extended DASH MPD as shown in FIG. 44 is shown.
[0114]
　As a modification for using syntax of the second embodiment described above, the number of regions, signaling the EssentialProperty or SupplementalProperty shown in FIG. 47. Then, the total signal area becomes Coverage or Total Coverage.
[0115]
　Next, a description will be given actual signal example according to the fourth embodiment.
[0116]
　In Figure 48, the extended DASH MPD As described above, an example of using the syntax of the second embodiment is shown. That is, as shown in the upper side of FIG. 48, the eight faces of the octahedron is divided into one by one region. Further, on the lower side of FIG. 48 is a signal of point of each region is shown in Figure 49, the description example of MPD that the signal is described is shown.
[0117]
　As a modification of the fourth embodiment, shape_type = 2 in the case coverage, for even total coverage, it may be expressed using the same syntax as shape_type = 0, 1. Parameters are the parameters shown in FIG. 46 is used.
[0118]
　At this time, center_pitch, center_yaw, hor_range, region signaled by ver_range may not match the actual coverage of the content. However, it is included in the actual content coverage, and largest area is signaled. For example, as shown in FIG. 50, be included in the actual content coverage substantially triangular, and the region of approximately rectangular having the largest area is signaled.
[0119]
　
　Referring to FIG. 51 through FIG. 55, the system will be described which distributes the omnidirectional image by a signal region on the sphere as described above.
[0120]
　Figure 51 is a block diagram showing a configuration example of a delivery system according to the present technology.
[0121]
　Distribution system 11 of Figure 51 is composed of a photographing device 12, generator 13, the distribution server 14, the reproduction apparatus 15 and the head-mounted display 16,. Distribution system 11 generates a celestial sphere image from the image taken by the imaging device 12, and displays the display image of the field of view of the viewer by using the omnidirectional image.
[0122]
　Specifically, the photographing device 12 of the distribution system 11 is composed of six cameras 12A-1 to 12A-6 and a microphone 12B. In the following description, when it is not necessary to distinguish the camera 12A-1 to 12A-6, that are collectively camera 12A.
[0123]
　Each camera 12A takes an image of the moving image, the microphone 12B obtains ambient sounds. Distribution system 11 supplies the audio acquired by the captured image and the microphone 12B is a moving image of a photographed six directions, the generator 13 as a moving image content by each camera 12A. The number of cameras imaging device 12 is provided, if a plurality, may be other than six.
[0124]
　Generator 13, by a method using equirectangular generates omnidirectional image from the captured image supplied from the imaging apparatus 12, is encoded by one or more bit rate, Equirectangular of each bit rate to produce a stream. Also, generator 13, the cube mapping, generates a celestial sphere image from the captured image, is encoded with one or more bit rate to produce a cube stream for each bit rate. Further, generating unit 13 encodes the voice supplied from the imaging apparatus 12 generates an audio stream.
[0125]
　Generator 13, Equirectangular stream for each bit rate, for each bit rate cubes stream, and the audio stream and ISOBMFF filing. Generator 13, to upload the results generated ISOBMFF file to the distribution server 14.
[0126]
　Here, although the bit rate of equirectangular stream and cubes stream to be a 1 or more, other than the bit rate conditions (e.g., the size of the image, etc.) may be located in one or more.
[0127]
　Further, generating unit 13 generates the MPD file for managing a segment file of the moving image content is uploaded to the distribution server 14. A segment is for video streams, and filed in hours for about 10 seconds from the seconds audio stream. For example, ISOBMFF including RegionMappingBox is delivered as a segment file.
[0128]
　For example the distribution server 14 for delivery using MEPG-DASH (ISO / IEC 23009-1) stores the uploaded segment files and MPD file from generator 13. Distribution server 14 in response to a request from the reproducing apparatus 15 as a client, and transmits to the playback apparatus 15 segments file containing.
[0129]
　Reproducing apparatus 15 requests the ISOBMFF file to the distribution server 14 receives the ISOBMFF file transmitted in response to the request. The reproduction apparatus 15, based on ISOBMFF file, requests the segment files celestial sphere image generated by the generation method of the celestial sphere image corresponding to the mapping can be performed by the reproducing apparatus 15, the request receiving a segment file transmitted in accordance with the. Reproducing apparatus 15 decodes the cube streams included in the received segment file (or a equirectangular stream). Reproducing apparatus 15, by mapping the omnidirectional image obtained as the result of decoding to the 3D model, to generate a 3D model image.
[0130]
　The reproduction apparatus 15 has a built-in camera 15A, photographs the markers 16A attached to the head mounted display 16. The reproduction device 15 based on the captured image of the marker 16A, detects the viewing position in the coordinate system of the 3D model. Further, the reproducing apparatus 15, the detection result of the gyro sensor 16B of the head-mounted display 16, receives from the head-mounted display 16. Reproducing apparatus 15, based on the detection result of the gyro sensor 16B, to determine the viewing direction of the viewer in the coordinate system of the 3D model. Reproducing apparatus 15, based on the viewing position and viewing direction, to determine the viewer's field of view that is located inside the 3D model.
[0131]
　Reproducing apparatus 15, the focus of the viewing position, by perspective projection of 3D model image the field of view of the viewer, generates an image of the visual field range of the viewer as a display image. Reproducing apparatus 15 supplies the display image on the head mounted display 16.
[0132]
　Head-mounted display 16 is mounted on the head of the viewer, displaying the display image supplied from the reproducing apparatus 15. The head-mounted display 16, the marker 16A is attached to be captured by the camera 15A. Therefore, the viewer, a head-mounted display 16 in a state of mounting on the head, it is possible to specify the viewing position by moving. Further, the head-mounted display 16, a gyro sensor 16B is incorporated, the detection result of the angular velocity by the gyro sensor 16B is transmitted to the reproducing apparatus 15. Therefore, the viewer, by rotating the head wearing the head-mounted display 16, it is possible to specify the line-of-sight direction.
[0133]
　Figure 52 is a block diagram showing a configuration example of a generator.
[0134]
　Generator 13 of FIG. 52 is constituted by the stitching unit 21, the mapping processing unit 22, region-wise packing processing unit 23, an encoder 24, the audio processing unit 25, an encoder 26, the file generating unit 27 and the upload unit 28, that.
[0135]
　Stitching processing unit 21, for each frame, the same camera 12A color and brightness of the six directions of the captured image supplied from FIG. 51, performs a stitching process of connecting to remove overlap. Stitching 21 supplies the captured image frame-by-frame after stitching process to the mapping processing unit 22.
[0136]
　Mapping processor 22, the cube mapping in this example, generates an omnidirectional image from the captured image supplied from the stitching processing unit 21. Specifically, the mapping processing unit 22 maps the cube photographed image after the stitching process as texture, to produce an image of a developed view of the cube as omnidirectional image. Mapping processing unit 22 supplies the omnidirectional image region-wise packing unit 23. Incidentally, stitching processing unit 21 and the mapping processor 22 may be integrated.
[0137]
　region-wise packing processing unit 23 performs a region-wise packing process. That is, the packing (packing) to place Projected frame by changing the position and size for each area on a two-dimensional plane to produce a packed frame. region-wise packing processor 23 also generates RegionMappingBox containing Margin_flag, a Region_margin_type.
[0138]
　The encoder 24 encodes the omnidirectional image supplied from the region-wise packing unit 23 with one or more bit rate to generate a cube stream. The encoder 24 supplies the cube stream for each bit rate file generating unit 27.
[0139]
　Audio processing unit 25 acquires the sound supplied from the microphone 12B of FIG. 51, and supplies the encoder 26. The encoder 26 encodes the audio supplied from the audio processing unit 25, generates an audio stream. The encoder 26 supplies the audio stream to the file generating unit 27.
[0140]
　File generating unit 27, for each bit rate cubes stream, and the audio stream and filed in segments. File generating unit 27 supplies the result generated segment file to the upload unit 28. The file generating unit 27 also generates ISOBMFF file, and supplies the upload unit 28.
[0141]
　At this time, the file generating unit 27 may generate an extended ISOBMFF as described above, in its ISOBMFF, area information is signaled. That is, the file generator 27 signals a plurality of vertices on a sphere, their area information vertex each other to represent an area on the spherical surface by connecting the shortest distance on the sphere (the first embodiment) It generated described in ISOBMFF in. The file generator 27, signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, depending on the number of surface signals generate area information representing an area on the sphere by (second embodiment) is described in ISOBMFF with. Or, the file generator 27 when generating the MPD, likewise, may be the area information in extended MPD is signaled (Fourth Embodiment).
[0142]
　Upload unit 28, a segment files and ISOBMFF file supplied from the file generation unit 27 is uploaded to the distribution server 14 in FIG. 51.
[0143]
　Next, an example in which processing an image, illustrating an example of the configuration of the reproducing apparatus 15.
[0144]
　Figure 53 is a block diagram showing a configuration example of a playback apparatus.
[0145]
　Reproducing apparatus 15 in FIG. 53, closed file obtaining unit 31, the stream extraction unit 32, a decoder 33, Projected frame generation unit 34, the mapping processing unit 35, the drawing unit 36, receiving unit 37, the sight line detection unit 38, and a camera 15A doing.
[0146]
　File acquisition section 31 acquires the file to be played back from the distribution server 14 in FIG. 51. Stream extraction unit 32, from the obtained file by file acquisition unit 31, and extracts the video stream. Decoder 33 decodes the video stream extracted by the stream extraction unit 32. Projected frame generation unit 34 generates a Projected frame from the decoded image data by the decoder 33.
[0147]
　Mapping processor 35 maps the omnidirectional image supplied from Projected frame generation unit 34 as a texture to each of the six sides of the cube.
[0148]
　Drawing unit 36, a 3D model image supplied from the mapping unit 35, as the focus of the viewing position supplied from the sight line detection unit 38, by perspective projection in the visual field range of the viewer, the viewing range of the viewer image is generated as a display image. Drawing unit 36 ​​supplies the display image on the head mounted display 16.
[0149]
　Receiving unit 37, the detection result of the gyro sensor 16B in Figure 51, receives from the head-mounted display 16, and supplies the sight line detection unit 38.
[0150]
　Visual axis detection unit 38 based on the detection result of the gyro sensor 16B supplied from the receiving unit 37 determines the viewing direction of the viewer in the coordinate system of the 3D model. Further, the sight line detection unit 38 obtains the captured image of the markers 16A from the camera 15A, based on the captured image to detect a viewing position in the coordinate system of the 3D model. Line-of-sight detection section 38, based on the viewing position and the viewing direction in the coordinate system of the 3D model to determine the field of view of the viewer in the coordinate system of the 3D model. Visual axis detection unit 38 supplies the drawing unit 36 ​​the viewing position and viewing range of the viewer.
[0151]
　With reference to the flowchart of FIG. 54, the file generation unit 27 of FIG. 52 is for file creation process will be described for execution.
[0152]
　In step S11, the file generator 27, full spherical video determines whether it is divided into a plurality.
[0153]
　In step S11, when it is determined that the full spherical video is divided into a plurality, the process proceeds to step S12, the file generator 27, based on the region information of all the omnidirectional video, tcov and to determine the EssentialProperty (totalcoverage) information.
[0154]
　In step S13, the file generator 27, based on the area information of the individual omnidirectional video, determining respective covi and EssentialProperty the (coverage).
[0155]
　On the other hand, in step S11, when it is determined that the full spherical video is not divided into a plurality, the process proceeds to step S14, the file generator 27, based on the area information of the celestial sphere video, and covi to determine the EssentialProperty (coverage) information.
[0156]
　After the processing in step S13 or S14, the process proceeds to step S15, the file generator 27, after generating the MPD and ISOBMFF, processing is terminated.
[0157]
　With reference to the flowchart of FIG. 55, the file acquiring unit 31 of FIG. 53 is for file acquisition process will be described for execution.
[0158]
　In step S21, the file acquisition unit 31 refers to the EssentialProperty (totalcoverage) of AdaptationSet of MPD, acquires spatial_set_id that a desired total coverage.
[0159]
　In step S22, the file acquisition unit 31 refers to the EssentialProperty of AdaptationSet of MPD (coverage), has spatial_set_id obtained in step S21, and selects the AdaptationSet compatible with viewing direction.
[0160]
　In step S23, the file acquisition unit 31, among the AdaptationSet selected, by selecting the Representation according to the bandwidth, to obtain a referenced file, the process is terminated.
[0161]
　As described above, the file generating unit 27 may generate the MPD and ISOBMFF, the file acquisition unit 31 can acquire the product target file.
[0162]
　Each processing described with reference to the flowchart described above, need not be processed chronologically according to the order described as a flowchart, processing (e.g., parallel processing or object to be executed in parallel or individually by treatment) are also included. Also, the program may be one that is processed by one CPU, or may be subjected to distributed processing by a plurality of CPU.
[0163]
　The series of processes (information processing method) described above can be executed by hardware or can be executed by software. In the case of executing the series of processes by software, a program constituting the software is installed into a computer embedded in dedicated hardware, or by installing various programs to execute various functions it can be, for example, a general-purpose personal computer, the program is installed from a program recorded recording medium.
[0164]
　Figure 56 is a block diagram showing a configuration example of hardware of a computer that executes the series of processes described above.
[0165]
　In the computer, CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, RAM (Random Access Memory) 103 are connected to each other via a bus 104.
[0166]
　The bus 104 further input and output interface 105 is connected. Output interface 105, a keyboard, a mouse, an input unit 106 and a microphone, a display, an output unit 107 including a speaker, a storage unit 108 including a hard disk or a nonvolatile memory, a communication unit 109 including a network interface , magnetic disk, optical disk, magneto-optical disk, and a drive 110 that drives a removable medium 111 such as a semiconductor memory.
[0167]
　Series In the computer configured as described above, CPU 101 is, for example, a program stored in the storage unit 108, output interface 105 and the bus 104 and executes the loaded into RAM 103, the above-mentioned processing of is performed.
[0168]
　Program computer (CPU 101) is executed, for example, magnetic disk (including a flexible disk), optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.), a magneto-optical disk or a semiconductor, being recorded in the removable medium 111 memory is a package medium such as, or a local area network, the Internet, or digital satellite broadcasting is provided via a wired or wireless transmission medium.
[0169]
　The program can be installed in the removable medium 111 into the drive 110, it can be installed via the input and output interface 105, the storage unit 108. The program via a wired or wireless transmission medium and received by the communication unit 109, can be installed in the storage unit 108. Alternatively, the program may be in the ROM102 and the storage unit 108 installed in advance.
[0170]
　
　The present technology can also be configured as below.
(1)
　to signal a plurality of vertices on the sphere, generating unit for generating area information representing an area on the sphere by connecting these vertices each other at the shortest distance on the sphere
　information processing apparatus including a.
(2)
　in the area information, rules connecting a plurality of said vertices is introduced
　an information processing apparatus according to (1).
(3)
　in the area information, the representative points included in the area covered by a plurality of vertices are signal
　processing apparatus according to (1) or (2).
(4)
　the area information is signaled by the extended ISOBMFF
　information processing apparatus according to any one of (1) to (3).
(5)
　the area information is signaled by tcov
　information processing apparatus according to any one of (1) to (3).
(6)
　The area information is signaled by the extended DASH MPD
　information processing apparatus according to any one of (1) to (3).
(7)
　And signaling a plurality of vertices on the sphere, and generates region information representing the region on the sphere by connecting these vertices each other at the shortest distance on the sphere
　information processing method comprising the steps.
(8)
　to signal a plurality of vertices on the sphere, and generates region information representing the region on the sphere by connecting these vertices each other at the shortest distance on the sphere
　program for executing the information processing comprising the steps on a computer .
(9)
　signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, sphere on by the signal depending on the number of surfaces generator for generating a region information representing the region
　information processing apparatus including a.
(10)
　in the area information, rules connecting a plurality of said vertices is introduced, the surface area is signaled by turning the loop according to the number of the surface
　processing apparatus according to (9).
(11)
　in the area information, either to cover the signal region includes a flag indicating whether to cover the non-signal area
　information processing apparatus according to (9) or (10).
(12)
　the area information is signaled by the extended ISOBMFF
　information processing apparatus according to any one of (9) to (11).
(13)
　the area information is signaled by tcov
　information processing apparatus according to any one of (9) to (11).
(14)
　the area information is signaled by the extended DASH MPD
　information processing apparatus according to any one of (9) to (11).
(15)
　signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, sphere on by the signal depending on the number of surfaces It generates area information representing the area
　information processing method comprising the steps.
(16)
　signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, sphere on by the signal depending on the number of surfaces It generates area information representing the area
　program for executing the information processing comprising the steps on a computer.
[0171]
　Note that this embodiment is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present disclosure.
DESCRIPTION OF SYMBOLS
[0172]
　11 distribution system, 12 imaging device, 12A camera, 12B microphone, 13 generator, 14 distribution server, 15 reproducing apparatus, 15A camera, 16 a head mounted display, 16A marker, 16B gyro sensor, 21 stitching processor, 22 mapping process parts, 23 region-wise packing processing unit, 24 an encoder, 25 sound processing section, 26 an encoder, 27 file generation unit, 28 uploader, 31 file acquisition unit, 32 stream extraction unit, 33 a decoder, 34 Projected frame generation unit, 35 mapping processing unit, 36 drawing unit, 37 receiving unit, 38 line-of-sight detecting unit

The scope of the claims

[Requested item 1]And signaling a plurality of vertices on the sphere, generating unit for generating area information representing an area on the sphere by connecting these vertices each other at the shortest distance on the sphere
　information processing apparatus including a.
[Requested item 2]
　The area information, rules connecting a plurality of said vertices is introduced
　an information processing apparatus according to claim 1.
[Requested item 3]
　The area information, the representative points included in the area covered by a plurality of vertices are signal
　processing apparatus according to claim 1.
[Requested item 4]
　The region information is signaled by the extended ISOBMFF
　information processing apparatus according to claim 1.
[Requested item 5]
　The region information is signaled by tcov
　information processing apparatus according to claim 1.
[Requested item 6]
　The region information is signaled by the extended DASH MPD
　information processing apparatus according to claim 1.
[Requested item 7]
　And signaling a plurality of vertices on the sphere, and generates region information representing the region on the sphere by connecting these vertices each other at the shortest distance on the sphere
　information processing method comprising the steps.
[Requested item 8]
　And signaling a plurality of vertices on the sphere, and generates region information representing the region on the sphere by connecting these vertices each other at the shortest distance on the sphere
　program for executing the information processing comprising the steps on a computer.
[Requested item 9]
　Signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, the region on the sphere by the signal depending on the number of surfaces generating unit for generating area information representing
　an information processing apparatus including a.
[Requested item 10]
　Wherein the area information, rules connecting a plurality of said vertices is introduced, the surface area by turning the loop according to the number of the surfaces is signaled
　information processing apparatus according to claim 9.
[Requested item 11]
　Wherein the area information, either to cover the signal region includes a flag indicating whether to cover the non-signal area
　information processing apparatus according to claim 9.
[Requested item 12]
　The region information is signaled by the extended ISOBMFF
　information processing apparatus according to claim 9.
[Requested item 13]
　The region information is signaled by tcov
　information processing apparatus according to claim 9.
[Requested item 14]
　The region information is signaled by the extended DASH MPD
　information processing apparatus according to claim 9.
[Requested item 15]
　Signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, the region on the sphere by the signal depending on the number of surfaces It generates area information representing
　an information processing method comprising the steps.
[Requested item 16]
　Signal an apex of each surface on each surface of the sphere, the surface area formed by connecting these vertices each other at the shortest distance on the sphere, the region on the sphere by the signal depending on the number of surfaces It generates area information representing
　a program for executing the information processing comprising the steps on a computer.