Sign In to Follow Application
View All Documents & Correspondence

Image Processing Device And Method

Abstract: The present invention pertains to an image processing device and method that enable the performance required for decoding to be more accurately understood. The image processing device: generates a file that has an MP4 file format and stores information that groups a plurality of independently decodable partial images within a whole image in a moov and stores encoded partial images in an mdat; and stores the generated file. The present invention may be applied for example to an information processing device such as an image encoding device or an image decoding device.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
15 January 2016
Publication Number
32/2016
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
Parent Application

Applicants

SONY CORPORATION
1 7 1 Konan Minato ku Tokyo 1080075

Inventors

1. HIRABAYASHI Mitsuhiro
c/o SONY CORPORATION 1 7 1 Konan Minato ku Tokyo 1080075
2. HATTORI Shinobu
c/o SONY CORPORATION 1 7 1 Konan Minato ku Tokyo 1080075
3. NAKAGAMI Ohji
c/o SONY CORPORATION 1 7 1 Konan Minato ku Tokyo 1080075

Specification

The present disclosure relates to an information processing apparatus and an information processing method, and, more pat1icularly, to an information processing 10 apparatus and an information processing method which can reCognize performance required for decoding more· accurately. 15 Background Art [0002] 'In.re_ceJlt ye~~) wit.h. the .aim 'of fi.JrtJter imprqye_ment. Qf coding .. efficiency ' compared to that ofMPEG-4 PartlO (Advanced Video Coding, hereinafter, described as ''AVC''), joint collaboration team • video coding (JCTVC) which is a joint standardizing body of international telecommunication union telecommunication standardization sector (ITU-T) and. international organiz_ation for standardization I 20 int~rnational _ electrotechiiical Co~mission oSOtrnc) has proceeded with standardization of a c;:oding scheme called high efficiency vide_o -codiilg (HEVC) (see. for exampl~, Non~Patent Literature 1). [0003] . -HEVC e~ab]es decoding of_Only- a region required to be decoded by 25 -applic~fion by 'utilizing-a tile (Tile) structure. To indicate ih~t a tile region- c:an be-· independently deCoded, in'a Second version arid thereafter ofHEVC (itwludiOgMV-_ HEVC, SHVC, Range Ext., or the like), this is supported by Motion-constrained tile sets SEL . [0004] 30 By the way, as a content distribution technique utilizing hypertext transfer protocol -(HTTP), there is moving picture experts group - dynamic adaptiVe 5 SP353455W002 2/75 streaming over HTTP (MPEG-DASH) (see, for example. Non-Patent Literature 2). With MPEG-DASH, bit streams of image data encoded using a coding scheme such· as HEVC described above are distributed after being formed into a predetermined file format such as, for example, an MP4 file format. Citation List Non-Patent Literature [0005] Non-Patent Literature 1: Benjamin Bross. Woo-Jin Han, Jens-Rainer Ohm, 10 Gary 1 Sullivan, Ye-Kui Wang, Thomas Wiegand, ''High Efficiency Video ·Coding (HEVC) text specification draft 10 (for FillS & Last Call)", JCTVC-LJ003_v34, Joint Collaborative Team on Video Coding (JCT-VC) ofiTU-T SG 16 WP 3 and !SO!IEC JTC 1/SC 29/WG II 12th Meeting: Geneva, CH, 14-23 Jan. 2013 Non-Patent Literature 2: MPEG-DASH (Dynamic Adaptive Streaming over · 15 .I-ITTP). (!JEL:http://mpeg.chiariglione~orglst.andards!rnpeg-:dashlmedia~pre~entation- . description-and-segment -formats/text -isoi ec-23009-120 12-dam-l) Summary of Invention Technical Problem 20 [0006] - However, both in a bit stream ·and in a file fornlat, ·only a value in the whole streiam or a value in units of a layer (Layer) are defined as a level (Level) which is us-ed as a referenC~ for det~rffihlit~ Wh~-ther or not ·a decoder tan decode a stream or information relating to capacity of a buffer (Buffer). 25 [0007] • Therefore, also in application for decoding only. part of the whole image, ·whether or -~ot decoding is possible is determined asSu~ing locid in the case Wher~ -fhe ~hole screen ''is--decoded, which may involve a risk- that -a deCoder with an· unnecessarily high level (Level) is requit:ed. Further, there is alsa: a risk that 30 application which can be distributed may be unnecessarily limited. [0008] 5 SP353455W002 3/75 ------ The present disclosure has been made in view of such circumstances, and is intended to enable recognition of performance required for decoding more accurately. Solution to Problem [0009] According to an aspect of the present technology, there is provided an information processing apparatus including: a file generating unit configured to generate a file of an :M.P4 file format, in which information for grouping a plurality of partial images Which can_ be independently decoded in a whole image is stored in moov and the encoded partial images are stored in mdat; and a storage unit 10 configured to store the tile_ generated by the file generating unit. [00!0] The information for grouping_ the plurality of partial images can include informatiori indicating an ID of a group formed by grouping the plurality of partial - images. 15 [OOII] 20 The information for grouping the plurality of partial- images can include informatiOn indicating respective IDs Of the plurality of p~rtial- irruige~ relating to a group formed by grouping the plurality of partial images. [0012] The_ information for grouping the plurality of partial images can be defined -using VisualSampleGroupEntry _in the mOov. [0013] The file generated by the file generating unit_ call illciude related information indicating the plUrality OfNAL units constitUting the partial ima"ges~ 25 [0014] The reiated "information can include group information indicating a related group for each of the NALtillits. [0015] The related information can include information indicating the number of ao. the pluralityofNALunits. [0016] SP353455W002 4/75 The related information can include information specifying a first NAL unit in the partial images. [0017] The partial image can be Tile in high efficiency video coding (HEVC). 5 [0018] The partial image can include a plurality ofNAL units. [0019] The Partial image can be stored in a first track in the file, and another partial image which can be independently decoded in the whole image can be stored in a 10 track other than the first track. [0020] A tranSmitting unit configured to transmit the ftle stored by-the storage unit to another apparatus can be further iricluded .. [0021] 16 .. According .to anaspectof the present technology, there is provided .. an information processing method including: generating a file of an MP4 file fonnat,. in· which informatiOn for grouping· a plurality Or partiai images which can be independently decoded in a whole image is stored in rnoov and the encoded pardal , images are_stored in mdat; and stming the gellerated fi1e. 20 [0022] According to another a. spect of the present t. echnology, there _. is provided an information prOceSsing apparatus including: a file reproducing unit _configured- to_ reproduce a file of an MP4 file format, in Which infm:mation, for grouping a plurality -of partial iinag~' which can _be independently decoded in a whole image is stored in 25 moov and the'·encOded partial ini.ageS are stored in_mdat. (0023] ' - ' ' ,The informatio~' for groUping the plur~tity of PW:tial-images can inchtde iriformatiOn indicating an ID of a group formed by grouping the phiraJity Of partial images. 30 (0024] The information f~r _grouping the plunility of partiai images can include - SP353455W002 5/75 information indicating respective IDs of the plurality of partial images relating to a group formed by grouping the plurality of partial images. [0025] The information for grouping the plurality of partial images can be defined 5 using VisualSampleGroupEntry in the moov. (0026] The file can include related information indicating the plurality of NAL units constituting the partial images in the moov. (0027] 10 The related information can include group infonnation indicating a related group for each of the NAL units. (0028] The- related information can include information indit;:ating the number of the plura1iiy ofNAL units . .. 15 . [0029] . Tthe related information can include iriformation specitying_a first NAL unit in the partial images. [0030] _ The partial image can be Tile in high ~fficiency video coding (HEVC). 20 . (0031] . lhe partial image can inClude a plurality ofNAL units. [0032] . The partial image can be stored in a first track in the Jile, and another partial im8.ge Which Can be indep'endently decoded in· the whole image_ can be stored in a 25 track other than the first track.· (0033] · ·A receiving unit Configured to feccive th~ file can be further included. The - -_file ~ep;oducing unit ~-an repr~duce the file received by the receiving unit.- (0034] 30 In thi: file, infonnation 'indicating locations of the -partial images in the Whole image, infprm·aiion il~dicating sizes of the partial images a~d the information SP353455W002 6/75 for grouping the plurality of partial images can be stored in VisualSampleGroupEntty. The file reproducing unit can select a region which is desired to be reproduced based on the information indicating the locations of the partial images in the whole image and the information indicating the sizes of the partial images, and acquire data of a 5 partial image corresponding to the region which is desired to be reproduced based on the information for grouping the plurality of partial images and generate a bit stream. (0035] In the file, information indicating locations of the partial images in the whole image, information indicatillg sizes-of the partial images and the inforJ!!.ation 10 for grouping the plurality of partial images can be stored in TileRegionGroupEntry. The file reproducing unit-can select a region whlch is desired to be reproduced based on the information indicating the locations of the partial images in the whole image and the information indicating the size_s of the partial images, acquire a plurality of ti-acks correspOnding to the select~d regio~-which is desired t~ be reproduced based .. 15 on_ ~h~. informat~on for grouping the plurality of_ Parti!ll. lOiaSes, a11d. g~nerat~ bit streanls of partial images cori-esponding to the acquired pluralitY of tracks. [0036] A decoding unit configured to decode bit streams of the partial images reproduced ~nd generated by the file reproducing unit can b_e further included. 20 (0037] Acc_ording to another aspect of the present technolo~y. there is provided an informatioit processing ·method including: reproducing a file of an MP4 file format, -i~- which information· for gro~ping a piurciti-tY of partial images Which can be independently decoded in a whole image is stored in mqov and the encoded partial 25 -_images are stored in mdat. (0038] Ih an aspect of the present technology, a file of an_MP4 file format, in which information fur grouping a plurality of partial images which can be independently decoded in a whole image is stored in' ~oov and the encoded pattiai images 'are 30 stored in mdat, is generated, and the generated file is stored. [0039] 5 SP353455W002 7/75 In another aspect of the present technology, a file of an MP4 file format, in which information for grouping a plurality of partial images which can be independently decoded in a whole image is stored iri moov and the encoded partial images are stored in mdat, is reproduced. Advantageous Effects of Invention [0040] According to the present disclosure, it is possible to encode and decode an tmage. Particularly, it is possible to recognize performance_ required for decoding 10 more accurately. BriefDescription ofDrawings [0041] [FIG I] FIG 1 is -a diagram for explaining an example of application for performing 15 J>art_ial displ_ay_ (FIG 2] FIG 2 is a diagram for explaining another example of the application fur performing partial display. [FIG 3lFIG. 3 is a diagram for explaining ail example of definition of a subsample. [FIG 4] FIG 4 is a diagram for explaining outline ofanMP4 file format. 20 [FIG 5] FIG 5 is a diagram. for explaining outline of an MP4 file format. (FIG 6] FIG 6 is a diagram for explaining ouiline Of an MP4 file-fonnat. (FIG 7] FIG 7 is a diagram illustrating an extension examPle ofa·s;tmple table box. [FIG 8] FIG 8 iS a diagramjllustrating an example of a subsample hint information box. 25 [FIG 9] FIG 9 is a diagram illustrating an--example ofSemantics of independent. fFi:G 10] FIG 10 is a diagram illustrating an eXample of_ a group of subsamples. [FIG 11] FIG 11 iS a diagram illustrating ·anOther example -of the subsample I,int inforrnation box. [FIG. 12] FIG 12 is a diagram illusirating another example Of ihe subsample -hint 30 information box. [FIG 13] FIG 13 is a diagram illustr?ting still another example of the subsample hint SP353455W002 8/75 information box. [FIG 14] FIG 14 is a diagram for explaining outline of an MP4 file format. [FIG 15] FIG 15 is a diagram for explaining outline ofanMP4 file format. [FIG 16] FIG 16 is a diagram illustrating an extension example of a sample table 5 box. [FIG 17] FIG 17 is a diagram illustrating an extension example of a visual sample group entry. [FIG 18] FIG 18 is a diagram illustrating an example of a subsample index. [FIG 19] FIG 19 is a diagram illustrating another extension example of the visual 10 satllple group entry. -. [FIG 20] FIG 20 is a diagram illustrating still another extensiOn example of the visual sample group entry. [FIG 21] FIG 21 is a block diagram illustrating an example ofmcts. [FIG 22] FIG 22is a diagram illustrating an example of syntax ofMCTS SEI. _: _15. [FI(];_ .2~] FJ(i- 23 ~s .. a di In recent yeitrs, an apparatus has been spread which digitally handles image . . . 20 information, and~ 8t that time, performs compr"ession coding on p.n image by uti1izi~g redundancy specific ·to in1a~e infor~ation and employing a· coding 'scheme f~r coffipressing throUgh orthogonal transform such as discrete· Cosine transform and motion compensation with the aim of. high efficient transmiSsion and ·accumulatio-n _ of information.- Thi~ Coding scheme include~ for exa~ple; ffioving picture-experts 25 group (MPEG). [0044] Particularly, MPEG2 (ISO/IEC 13818-2) which is defined as a versatile i~age coding sCheme, is standard which Supports .both an inte~Iaced sc~n image and - -_ a sequential scan image, arid' a standard resolution image and a high- resolution iriJ.age. - 30 For .example, -MPEGi -is _curre~ttY widcly used hi a wide ~ange -~f application intended for professional Use-and for cOnsumer use. Use of a MPEG2 comPression SP353455W002 11/75 scheme enables assignment of a coding amount (bit rate) of 4 to 8 Mbps if, for example, an image is an interlaced scan image with standard resolution having 720x480 pixels. Further, use of the MPEG2 compression scheme enables assignment of a coding amount (bit rate) of 18 to 22 Mbps if, for example, an image 5 is an interlaced scan image with high resolution having 1920x1088 pixels. By this means, it is possible to realize a high compression rate and favorable image quality. [0045) While MPEG2 is intended for high image quality coding mainly adapted to broadcasting, MPEG2 does not support a coding scheme with a lower coding amount 10 (bit rate), that is, a higher compression rate than MPEGI. It is expected ttuit there will be a growing need for such a coding scheme in accordance- with spread Of a mobile terminal in the future, and a MPEG4 coding scheme is standardized to ·address this. As to an image coding scheme, the standard was approved as international standard ofiSO!IEC 14496-2 in December_, 1998 . . 15. (0046) Further, in recent years, initially~ with the aim of image coding for teleconference, -Standardization of H.26L (internatiorial telecomrimnication union · telecommunication standardization sector (ITU-T)) Q6/16 VCEG (Video Coding Expert Group)) has proceeded. It is knoWn that while H.26L requires a more 20 oPeration amount for encoding and decoding than coding schemes in related a·rt such as MPEG2 and MPEG4, H.26L can realize higher coding efficiency. Further, cu-rrently, as part of activity-for MPEG4, standardization for re~lizing higher coding -effi~iency based on H.26L while introducing functions which afe ··not supported in -- H.26L has been performed as Joint Model of Enhanced-Compression Video Coding . . 25 [0047) As 's~hedule for standardization, this high~ coding effiCiency based on H.26L was internationally. standardized in Marc!~ 2003 as. H.264 and MPEG-4 Part· to (Advanced Video Coding, hereinafter, abbreviated as "AVC"). [0048] 30 Further, as 'eXtension of this H.264/AVC~ standardization of-coding tools sUch as RGB, 4;2;2 _and 4:4;4 which are .required for professional use and SP353455W002 12/75 ------ standardization of fidelity range extension (FRExt) including 8x8DCT and a quantization matrix which have been specified in MPEG-2 were completed in February, 2005. By this means, a coding scheme which is capable of favorably expressing also film noise included in a movie using H.264/AVC is realized, and 5 used in a wide range ofapplication such as Blu-RayDisc (trademark). (0049) However, in recent years, there is a growing need for coding at a further higher compression rate such as compression of an image of approximately 400Qx2000 pixels which is four times of a high vision image, and distribution of a 10 high vision image in an eiJVironment with limited transmission capacity, such as Internet. Therefore, the above-described VCEG under ITU-T has continued to study improvement of coding efficiency. (0050] . Thus, with the aim of further improVement of coding efficiency Compared to .. 15 .. that of "AVC», joint collabo;a!ion .ieam - video coding (JC'l'VC) which is a joint .. standardizing body of ITU-T and illternational organization for standardization I _international electrotechnical commission (ISOIIEC) is cu~ntly_ proceeding with _ standardization of a coding scheme called high efficiency video coding (HEVC)_. -Concerning HEVC standard, Committee draft which is a draft specification was 20 issued in January, 2013 (see, for exampl(\ Non-Pat_entLiterature 1). [0051) BEVC enables decoding of only a region required to be decoded by· application by utilizing a tile (Tile) structure. _ To indicate that a tile region can be 25 independently decoded, in a second versiOn and thereaft~r of-irnvc (i~clud-ing MV- 30 . l:iEVC~ SHVC, Range Ext., or the like), this 'is supported by--Motion-cOnstrained -tile sets SEL . [0052) By the way, as a content distribution tech~icj_ue utilizing h}tpertext transfer -protocol (HTTP),_ there is nioVing picture experts group _: dynamic adapti-ve SP353455W002 13/75 ------ streaming over HTTP (MPEG-DASH) (see, for example, Non-Patent Literature 2). With MPEG-DASH, bit streams of image data encoded using a coding scheme such as HEVC described above are distributed after being formed into a predetermined file format such as, for example, MP4. 5 [0053] 10 However, in content distribution such as DASH, only- reproduction (decoding) of the whole image is assumed, and reproduction (decoding) of a pa11ial image which is part of the whole image instead of the whole image is not assumed. (0054] More specifically, only a value in the whole stream or a value in units of layer (Layer), that is, a value for the whole image is defined as a level (Level) which is used as a reference for detemtining whether a decoder can decode a stream and . ' _information relating to buffer (Buffer) c~pacity _bOth ·in a oodi~g scheme- such -as - HEVC and in a file fonnat such as MP4, and there is no inforniation for reproducing_ .. _15 .. only a parti EXamples.- of application for reproducing a partial tmaae include, for example, tile following. [0057] Application is assumed in which, in a system in which a server distributes 30 an.image to. a tenninat as illustrated in, for 'example. FIG I, one screen is divided into a plUrality of pieces and distributed white. a display region is switched. Further,. SP353455W002 14/75 as illustrated in FIG 2, application for selecting a partial region to be displayed (to be distributed) to select an aspect ratio and resolution of an image is assumed. [0058] In the case of application in FIG 1, the whole image can be divided into a 5 plurality of pieces in units of tile (Tile), and, at the terminal, a partial image including one or a plurality of tiles is cut out from the whole image and displayed. A size of a partial image (the number of tiles)_ which can be displayed is determined by, for example. performance (processing capacity or a size of a display (display resolution)) of the terminal, or the like, Further, a location of a partial image to be 10 displayed in the whole image can be designated by a user, or the like. Therefore, a partial image at a desired location in the whole image can be displayed_ at the terminal. That is, a user of the terminal can focus on a desired portion in the whole image. 15 (0059] . In the caseof application in FIG; i,while thppplication in FIG. 2 is basically 'the same_ as the appliciition in FIG 1, a tile is set so that an aspect ratio or resolution of an image to be displayed can b.e selected. and the size of each tile is not - fixed. In a similar manner to a case-in FIG. 1, at the ierminal, a partial image · including one or a plurality of tiles is cut out from the WhOle image and displayed . 20 according to an instruction from the user, or the Jike. -In this manner, only by seleCting a tile to be displayed •. it _is possiblC to make resolution Or the image.to be dispta)red liD; make the size a cinema siZe or an extefided Size. [0060] The resolution which call be displayed is determined by, for example, · 25 . petfonnance (processing capacity or a size of a display (display resolution)) of the terminal, -or the like. [006!] BecauSe such adaptive provision (reproduction) of a partial image according· to performance of the termillat, designation by-a user, or the like, is not assumed in· SO 'related art, even when a partial image which can be independently decoded· is decoded, whether or not decoding is possible is determined assuming load in the case SP353455W002 15/75 where the whole screen is decoded, which may involve a risk that a decoder with an unnecessary high level (Level) is required. Fmther, there is also a risk that application which can be distributed may be unnecessarily limited. [0062] 5 Therefore, subsample information including hint information used as a reference for decoding processing of a subsample which is a partial region which can be independently decoded is generated, a file including encoded data of jmage data is generated, and the generated subsample information is arranged_ in management 10 information of the encoded data in the file. [0063] By this means, the teiminal can recognize performance required for decoding a patiial region according to the subsample information (hint information) and can determine whether or not a decoder of the tenninal can perform decoding ... 15 . proce{iSil18 of the pa,rtial regi()J.l, (subsarllpi_e) 111ore accurately._. that is, -i~ is po~sibl~ to recognize performance req~,-.ired for decoding more accurately. _ It is therefore possible_ to select a decoder whi~h-has perfonnance more appropriate-fori-h-e image data. By this means, it is possible to suppress occurrence of a case where a decoder with an mmecessary high level (Level) is applied to decoding load of the image data._ . . ZO Further, it is possible· to prevent applicatio~ which can be di~trib~-ted _from being unnecessarily limited. [0064] Further, header infb~ation of e~tcoded data (bit st~eiDris) of the partial · region (subsample) is updated to infOrmation as to the partial region (subsample) -25 from information of_th~ ~hoie-image. I~for~ati~n for updating-is .inCluded in a fil~ and transmitted.- _By this means, the terminal -can update tht heRder information of . . . the bit streams to information as to the--partial region (subSample) and ca~ pass the information to the decoder. Therefore, the decoder can determine- whether Or itot ·the decoder can decode the- bit streams more accurately based _on the header 30 information. [0065] SP353455W002 16/75 < Coding scheme and file format > An example where the present technique is applied to a case where an encoding and decoding scheme is HEVC and a file format is MP4 will be described below. 5 [0066] In the following description,. it iS asSumed that a sample ofMP4 is an accessunit (AU) of HEVC. Further, it is assumed that AU includes a plurality of tiles (Tile). In_ a sample table (Sample Table), management is performed in units of 10 sample (Sample). [0067] Further, a subsample is a constituent eleffient of the sample, and is defined_ fur each codec (Codoc), for example, as illustrated in FIG 3. While the present technique can be applied even if the suhsample is any one of these, in the following ~5 description, the present teclmique Vfill. -~~- Outline of an MP4 file format wHl be described next. As illustrated_ in a 20 left part of FIG 4, anMP4 file (MP4 file) which conforms to MPEG-DASH includes ftyp: moov and mdat. In moov, management informatio~ is stored- in a $ample table bOx (Sample Table BoX (stbl) for each S In the present technique, the above-described sample table box is extended so as to be able to be applied in all cases of a case where a tile pattern is fixed for all 5 samples (such as pictures), a case where the tile pattern is variable in all the samples, and a case where the tile pattern is fixed for a predetermined period such as, for example, an IDR interval (a case where a tile pattern is variable for each predetermined period). 10 [0077] For example, in the sample table box, subsample information including hint information used as a reference for decoding processing of a subsample which is a partial region which can be independently decoded is provided as a new box of the sample table box . . l5. [0078] 20 ·The example is illustrated in FIG. 7. As illustrated in :FIG 7, in the sample table box, a subsample hint information box (Subsample Hint Information Box) 11 is newly provided. [0079] The subsampie hint informatio1i bo'l( 11. is subsampl~ iitformation including hint .information.used as a reference for de~·ding processing of a ~bsample ~hich i~ a part!al cegio·n· Which ca:u be itldep_endently.".d~oded, and is a di~6nt box from the suhs~mple ·informatiOn box,· or the .like.~ ·By sepamting. the subsainple hint ·.-information box 11 Which is information for reproducing a partial image from the 25 subSample information box which is infom1ation for reproduCing·the Whole image in · .:· this ~annef, tiie whole box can be ignored (not referred to) in~'norinal reproducing for displaying the whole image, so that it .is possible to facilitate control (0080] A description example of the subsample hint information box 11 is 30 . illustrated in a fight part of FIG 7. As illustrated in this example, in the suhsample hint infoonation bOx 11, inforffiation such as a hint data type (hint_data_type), a 19/75 sample count (sample_count) and hint data (hint_data) is stored. [0081] SP353455W002 The hint data type is information indicating a type of hint information of a subsample stored in this box:. The sample count is information indicating the 5 number of continuous samples associated with this information. The hint data is I 10 hint information of a subsample. Information different for each type of hind data is stored. (0082] A specific example where subsample inforin"ation includina; hint information used as a reference for decoding processing of a subsample which is a partial region which can be independently decoded is provided will be described next. [0083] · 15 . -. -. -. In E~pie 1, the sUt,:mmple hi in i(lformation _bo]{ H.in_ w}Iic4. informatiOn 20 required fur decoding (decode) is stored is. used for each subsample (tile) which can be accessed by the subsampk information box which is extended and defined as described above. [0084] A subsample arid hint information :are associated with each other using a - -table index {table-ind~ in the subsample irifor~ation box. [0085] A descripti~it- example ~f the -subsample -hint information 'box 11 is illustrated in FIG 8. The sUbsample hint inform~tiOn b~x u .. J illustrated in FIG. 8 -25 · is a description ex;ample of Example 1. [0086] As illustrated in FIG 8; in the subsample hint information box 11-1, for exilmple, "sSpf' indicating that the inforniation is profile information for each - subsa~ple iS described as a hitlt data type (hint_ data_type=:"sspf'). 30 [0087] Fmther, m the subsample. hint information box. 11-1, for example, - SP353455W002 20/7S . -- ---- information of any example among examples illustrated in a square 12 is described ·as hint information (hint_data). For example, as in Example (A-1), information indicating a profile level required for decoding the subsample (tile) (that is, level indicating a degree of load of decoding processing of the subsample) 5 (general_lebel_idc) may be described. Further, for example, as in Example (A-2), flag information (independent) indicating whether or not the subsample (tile) can be decoded independently from other subsamples (tiles) may be further described. [0088) An ex~mple of se~1antics of this independent (independent) is illustrated in 10 FIG 9. [0089) Further, for example, as in Example (B-1 ), information to be replaced when 3. SC9uence parameter set (SPS) of bit streams of the subsample (tile) is updated (that is, header information of encoded data of the subsample) (na!UnitLength, na!Unit) .. 15. ·: may b~ d~cribed .... Fllrth~r, . .for .ex~mpl~, -as in Exa,mple. (B:-2), flag information (independent) indicating whether or not the subsample (tile) Cl\11 be decoded -independently from other subsamples (tiles) may be further described. 20 (0090) . As reproduction (provision) of a p3rtial image, as in examples illustrated in FIG I and FIG 2, there is a case where. a plurality of samples are targeted. Therefore, while, in 'E'x:ample 1, hint information_is stored for each subsample (tile), . . in Example 2, such a' piurality of sqbsaniples are arra~ed inio a group, and information iequired for decoding the group is _also provided. 25 (0091) For example, in the case of A in FIG 10, only tile 3 (Tile3) is provided as a group !4-l among the whole image !3 including tile I (Tile!) to tile S (TileS) . . Further, in the case ofB in FIG 10, tile 2 (Tile2) to tile 4 (Tile4) are provided as a group 14-2. Further, in the case ofC in FIG ,10, all the tiles in the whole image 13 . 30 (that is, tile 1 (Tile!) to tileS (TileS)) are provided as a group 14·3. (0092] SP353455W002 21/75 Also in Example 2, the subsample hint information box 11 in which information required for decoding (decode) is stored is used for each subsample (tile) which can be accessed by the subsample information box which is extended and defined as described above. 5 [0093] However, in the case of Example 2, juformation for grouping a plurality of subsamples and information required for decoding each group of tiles (information which is normally not required) are respectively provided as subsample -hint infonnation boxes 11. That is, these pieces of information are stored in boxes 10 -different from each other. -By this- means, it is possible to update a sequence parameter set (SPS) of encoded data of the tile group only using the box storing the information required for decoding each grouped tile group . . [0094) FIG 11 and FIG· 12 illustrate description examples of the subsample hint _15 .. _ illf()rQlation boxes 11:.- ·A subsamp~e h~nt infr>rmation bo}{ 11-2:-.1 i!Justntted in FIG _ _ 11 is a description example of informatiOn for grouping a plurality_ of si.Jbsamples in Example2 . . (0095) As illustrated in FIG 1-1, in the subsample hint information box 11-2-1~ for 20 -example, "ssgp" indi~ating that the ·information is group i~formation of the subsample is desCribed as a hint data type (hint_data_type""1'ssgpu).· (0096] Further~ in the subsa'mj>Ie hint infoimation box 11-2-1, a group index (group index) which is identification information indicating a group to which the 25 . s~bsample belongs is described. For example, in the case of the example of FIG. 10, inforfllatiOn as indicated in a s . . 20 While, in the above description. an _example where the _sample hint information box 11- is· provided has been described, the present technique-in which subsample Jnformation -including hint infonriation used as a reference, for decoding , proc_essing of a sub sam piC which_- is a p~rtia'l region \~,hich ~an· 'be independently, -_decoded is included in a' file, is not -Jimited to this method.- -For example, by 25 -CXtOOdin& the sample group descriptio~ box and the sample to grOup box in an_MP4 file format, subsitmple infoimati()n including hint information used:a~ a refefence for , decoding proces_sing of a , subsa,mple whiCh is- a pa'ttiat, region which can be iridCpendently decoded can be inCluded in a file. (0109) 30 _ As illustrated in FIG 14, in a sample table box of an MP4 file, the sample_ group description box (Sample Group nescriptioll Box) 21 -and the satpple to group 24/75 box (Sample To Group Box) 22 can be provided. (0110] SP353455W002 As illustrated in FIG 15, in the sample group description box 21, as a visual sample group entry (Visua!SampleGroupEntry) 23, information other than basic 5 information of a sample table such as information relating to codec (codec) and access information is stored. (0111] In the sample to gfoup box 22, information associating the visual sample group entry 23 _with respective samples is stored. 10 (0112] By this means, _it is possible to put information which would be redundant if described for each sample~ into one, so that it is possible to r~uce an information amount, [0113] 16 .. · . . In Example 4, subsample information including hint information used as a reference_ for decoditig piocessing of a subsample which is a Partial region which can b~_ irideptmdently decoded is incl~ded in a file using this sampie -group description boX 21 and the sample to group bOx 22. 20 . [0114] The example is illustrated in FIG 16. -A subsample hint_ information box 11~4 illustrated in FIG 16 is a desCription example OfExal!lple_ 3. In Example 4, ·among these description, a-hint data t).pe, and infOrmatiori e-nclosed in a square at alower side including-hint data are stored in the sample group description box 21 as a_ 25- visu~l-s~J)le sfoup ent!j -23 .. Further, among the sub~ample -billt inf~~mation bOx 11-4, information enclosed by a square in an upper Side inCluding an entry count is _-stored in the sample to group box 22 ·as in:furmatio-o-asso~i~ting the visual sample -group entry 23 with the sample-s. 30 [0115] That -is, in the case of this example, it is possible to petform_ index reference from the Sample to group box 22 by storing only a pattern to be utilized. Further, it SP353455W002 25/75 -- --- is possible to compress a table of hint data, so that it is possible to reduce an information amount. [0116] It should be noted that while, in the above description, a case has been 5 described where the method of Example 4 is applied to infofmation of the subsample hint information box of Example 3, the method of Example 4 can be also applied to information of the subsample hint information box in Example 1 and Example 2. That is, information of the subsample hint htformation box described in Example 1 and Example 2 can be a1so stored in the sample group- description box 21 and the 10 sample to group box 22 in a similar manner to the case of Example 3 described above. [0117] A visual sainple group entry 23-1 ·of FIG 17 indicates an-example-of the .15 . visual sample group entry 23 eXtended to store profile info~mation of the subsample (SubSamleProfilelnformation Entcy extehds VisualSampleGroupElltry ('sspi')) in the case where an entry is constituted in a similar manner to the group in the example of FIG 10, In this visual sample group entry, hint informatioll (hint_data) and , .id~ntification-information-ofa group to which the entry ~rresponds (Gr~upiD) are 2() set for each entry. In this case, as illustrated in FIG 17. for example, information of any-~ample a~ong ~xamples as illustrated in-th~ square ti is described as this hint .Information (hint~data). [0118] Further, in this case, a si.tbsampte index wW~h is identification information-_ 25 _of a_ subsample (tile) belonging to each entry is listed as in 'the example within a square 3L . [0119] - An example of entries different froin those in FIG. 10 is illustrated in FIG. 30 18. _In the case of the example ofFIG 18, suhsamples (tiles) are respectively set as entries (groups). That is, in the -case of A in FIG. i8. tile 1 (Tile-1) is prOvided as an SP353455W002 26175 entry 14-4, in the case ofB in FIG 18, tile 2 (Tile2) is provided as an entry 14-5, and in the case of C in FIG 18, tile 3 (Tile3) is provided as an entry 14-6. While not illustrated, in a similar manner, tile 4 (Tile4) and tile 5 (TileS) are respectively provided as different entries. 5 [0120] As in the example of FIG 18, when a plurality of subsample (tiles) are not formed into a group, in other words, when the subsamples (tiles) are respectively set as entries, a visual sample group entry 23 extended to store profile information of the sub_sample {SubSampleaProfilelnforamtionEntry extends 10 · VisualSampleGroupEntry'('sspi')) is as illustrated in the example ofFIG 19. [0121] In this case, as in the visual s!imple group entry 23-2 in FIG 19, for example, information of any example among examples as illUstrated in the square 12 is -described as hint information (hint_dati) for each entry.- Further. a subsample index 15 .. whi(;h is_ identificati()p jnforml_lticm. of a ~ub~ainpl~ .. (til~) belongi_ng .to: ~<:h entry .is. listed as in the example in a square 32. Tluit is, in this case, one subsample index is assigned to each entry. 20 [0122] While, in the ·above description. a case _has been described where, as in the visual sample group entry 23-2 in FIG 20, a subsample index (subs-ample index) is included in the viSual sample group entrj, :for exainple, it is also possible _to store flag information (independent)- indicating .tli~t -'the· subsampie (tile) can be decoded independently from other subsainples (tiles).orinformation such as a rese1ved field 25 '(reserved = 0) along with ihe subsaritple index for each subsample as described below, . [0123] 30 [0124] . unsigned int(2) independent bit(6) reserved ~o; By this means,· because _it is possible tO knOw dependency for each SP363455W002 27/75 subsample, the information can be used as auxiliary information for a system to perform parallel decoding, or the like. (0125] Further, while, in the above description, a case has been described where, as 5 in the visual sample group entry 23-2 in FIG 20, information of any example among examples as illustrated within the square 12 is described as hint information (hint_data), it is also possible to further describe other hint information. For example, it is also possible to store information relating to a size of grouped subsamples (tiles), such as a width (Width) aud a height (height), or store 10 information relating to a location of grouped subsamples (tiles), such aS offset in a ' horizontal direction (H _offset) and offset in a _vertical direction (V offset). (0]26] By storiilg such information, a system can easily acquire size information of the grouped subsaffiples withOut calculating the inforillation from the subsample 15. ..- infoi~at~Qn .~o~ (suiJsatnple .fnform~'on bo~j._ -: (0127] -Further, it iS ·also possible: tO describe mcts_id which is information for identifying a ·partial region whicb cah be indepeitdently decoded in bit streams of HEVC as hint infOrmation (hint_data). 20 (0128] .In .MCTS SEI (Motion constniined tile set Supplemental Enhancement Inform8tion) ofHEVC, a_-pcirtial region whiCh can be indepe~deritly decoded is set _ for eHch reciaOgle set. For ~ainpl~-whn it' is assumed that· a shaded area in a·n upper left part of A in FIG 21 is a parti_a-1 region Which can be independently d~coded, 25 tl~e-_paiiial region is set for.each set' as.illuStmted in B i~ FIG 21 in MCTS SEI. _ Ii should be noted that as in the exampl~ illustrated inC in FIG 21, tiles include By the way, in the case of Example 4,_ a case has been described where the 10 visual sample group entry is extended and a subsalnp1e belonging to each entry is described using a subsample index. In this case, information of the subsample informati()n box is utilized as access inform-ation to tiles in the sample. That is, in this case, it is nece_ssary to int'erpret the meaning of the subsample in a layer _in which the MP4 file is to be parsed. 16 .. [0131].. In Example 5, a methOd will be proposed as a method for accessing tiles within the sample, which can he a substitute for such a method. That is, in place_ of the- subsample information box, a_ configuration of aNAL unit {NAL unit) of bit streams constituting the sample is desci-ibed in-the visual sample group elltry {Map - 20 Group Entry). For e.ample, the visual sample group entry is exten4ed, and NAL units of bit streams ofHEVC are grouped (HEVCNALUUMapGroupEntry). [0132] When the N_AL units are grouped in this mannet~ it is pOssible to support the grouped NALunits with the_same pi-ocessing flow in a layei- in whi_ch the_MP4 file'is - 25 to be parsed regardless of meaning of grouping. (0133] The example is illustrated in FIG 23. As, illustrated in· FiG. 23, fof - _example, a visUal sampJe grOup entry'in whichNALunit's within the sample are to be _mapped (for examPle, grouped for eilch -tile) is- pf~pared, and, for- example, in the 30 visual sample group entry in which video , related information 'such as hint -,information is stOred, the visual sa,mple_group entry in which the' NAL Units within SP363465W002 29/75 the sample are to be mapped is referred to. [0134] Visual sample group entries are associated with each other usmg identification information of the group (GroupiD). It should be noted that when 5 map patterns of the NAL units are all the same, a sample to group box is not required. [0135] An example of syntax of the visual sample group entry (BEVCNALUMapGroupEntryO extends VisualSampleGroupEntry('hcnm')) in which the NAL units in the sample are mapped is illustrated in an upper left part of _ 10 FIG 24. As il1ustrated in FIG 24, in this visual sample group entry, identification information of the group (Groupill) to which eHch NAL unit {NAL unit) belongs is set. [0136] -For example, as illustrated in a loWer left part of FIG 24, 'there are five ... 15 ... s_ul:>1)afllplse. (tiles (Tile)} within the _sample, and t::act., st~l>s.amplt,~js ~ns~itJJ~ed wi~h two NAL units. In this case, association between the NAL unit and the GroupiD (map pattern of the NAL unit) is as in the example illustrated in a right side Of FIG 24. Therefore; the sample is oonstituted with 10 NAL units. NALU..:...count of syntax of the visual sample group entry (HE\fCNALUMapGroupEntryO extends 20 . VisualSampleGroupEntry('hcnm')) illustrated in an upper let\ part of FIG 24 indicates the ntimber ofNAL unit Further, as illustrated in a lower left part ofFIG 24, it is possible to define from which NAL_unit ~ch tile (Tile) starts. In this ex-ample, Tilel starts from -NALl, Tile2 starts frotll NAL3, Tile3 starts- :fi:om NAL5, Tile4 starts from NAL7, and TileS starts from NAL9. ·It is also possible to define 25- _-such information indicating from which NAL_unit each Tile startS as sylltax of the 30 visual sample group . entry (HEVCNALUMapGroupEntryQ extends Visu~lSamjJieGroupEntry('hcnm')) illustrated in the tipp~r left part ofFiG 24. [0137] An example of the visual sainple group entry (SubSampleProfilelnf'ormationEntry extends VisualSampleGroupEntry('sspi')) described in Example 4, in which profile inforination of the subsample is stored, is 5 SP353455W002 30/75 illustrated m FIG. 25. In this visual sample group entry, hint information (hint_ data) and identification information of the group (GroupiD) corresponding to the enhy are set for each entry. [0138] As illustrated in FIG 25, as this hint information (hint_ data), for example, information of any example among examples as illustrated in the square 12 as described in Example 1 to Example 4 is set. [0139] Howe·ver, in FIG 25, as i11ustrated in the square 12, as the hint information, 10 Example (C) is added in addition to Examples (A-1), (A-2), (B-1} and (B-2}. Here, information relating to a location of the grouped subsamples (tiles), such as offset in a horizOntal direction (H offset) and offset in a vertical direction (V _offset) is stored. Further, information relating to a size of the· grouped sub samples (tiles). such as a width (Width} and a height (height) is stored. These are the same as the hint lQ. infcir:mation, .de~crib.e4 WiH~ ref~reJl~~ to .F~G ~(). (0140] Further, 'in the identification informittion of·the group (GioUpiD), any of identification information ·of the groUp (GrouPID) used for mapping NAi. units is set · in the visual_ sample group entry (HEVCNALUMapGroupEntryQ extends 20 VisuaiSampleGrollpEntry('hcnm')) in which NAL t,Inits within-- the sample are mapped deSc~ibed Usi.ng ~he ~xample of inG 24. That is._ this -.identification 25 . information of the group (GroUpii?) indicates ·a g'roup ()f tiles ·as in the example of - FIG 10 . . (0141] It should be noted that, as in the example of FIG. 18, also when a plurality of - ~ubsamples (tiles) are not grouped, infofination similart~-that i~'the example of FIG . 25 is· set as in the example illustfated in FIG 26 in the visual sample group entrY in which _ profile information of the subsamp1e is stored · (SubSampleProfilelnformationEntry extends VisualSampleGroupEntry('sspi')). In 30 this case, the identification information ofthe group (GroupiD) indicates each tile . . (0142j SP353455W002 31/75 By extending the visual sample group entry as described above and setting a configuration of the NAL unit, when the NAL units are grouped, it is possible to support the grouped NAL units with the same -processing flow in a layer in which the :MP4 file is parsed regardless of meaning of grouping. 5 [0143] It should be noted that BOX in which GROUP by MAP GROUP is formed into TILE GROUP may be defined as BOX different from SSPI (SubSample Profile Information). That is; identification information of the group (GroupiD) by -HEVCNALMapEntry corresponding to each entry may be defined in the visual 10 sample group entry extended so as to store a tile group - map entry (TileGroupMapEntry extends VisualSampleGroupEntry('tgpm')), which is a different box from the visual _sample group entry · (SubSampleProfilelnformationEntry extends VisualSampleGroupEntry('sspi')) in which profile informatiori of the subsamples defining hint information (hint_ data) 15 _correspoiid~ng_t() th~ (!lltry is st<;>red .. (0144) In the case of the-example of FIG 25. synta.x ofTGPM may be. for example, set .as follows: [0145) . 20. Class TileGroupMapEntry extends VisualSampleGroupEn!ry ('tgpm') { unsigned int(l6) entry_count; for (i~O; i < eritry count; i++) { 26 } } 30 [0146] unsigned int(l6) TileGroupiD; unsigned iut(l6) group_ count; fur (j9!; j < group_coun!; j++) { unsigned int(l6) GroupiD } With such syntax, in the case of the example of FIG 25, GroupiD is 5 32/75 assigned to TileGroupiD as follows. [0147] [0148] TileGroupiD= 1 =>GroupiD=3 TileGroupiD~2~>GroupiD~2, 3, 4 TileGroupiD=3=>GroupiD=l, 2, 3, 4, 5 SP353455W002 Syntax of SSPI may be, for example, set as follows as a box different from the box. [0149] 10 ·class SubSampleProfileinformationEntry extends VisualSampleGroupEntry c_sspi') { unsigned int(16) entry_count; 15 L } (0150] for (i=O; i < entry_count; i++) { unsigned int(l6) TileGroupiD; unsigned int(xx) hint_ data; It should be noted that content of the hint informatiOn (hint_ data) in this case JS the same as that io the above-d~crib_ed- exa~'ples (informatio~ of any 20. example among examples as illustrated within the square 12 is set). [0151] In this -manner, by .grouping GroupiD in _a i:Jox different from a box of sspi ·defining hint information, or the 1ike, it is posSible "to reduce dependency Or grouping on other infonn3tion, so that grouping can ·be performe~ independelltly from other 25 · information.- ·It is therefore possible to rea-tire -i~ore ver~atile (flexible) _grouping_, ·and uiilize the group of the GrouPID (TileGroupiD)- in more verSatile p~rpose of use. ·_Fqr· exaniple, it is possible to easily- feati~~ hi~rarchized ·and unhierarchized definition of the groupiD without the need or taking into account a configuration of other information such as hint information. 30 [0152]. Furtlter, wbile the example of flag (flag) definition of the subsamples bave · · SP353455W002 33/75 been described with reference to FIG. 3, in the case of Example 5 described above, continuous NAL units grouped by HEVC .NAL Map Group Entry may be further additionally defined. For example, as described below, in flag=5, the continuous NAL units grouped by HEVC NAL Map Group Entry may be additionally defined as 5 sub-sample. (0153] 5:0:NAL-unit-based sub-samples. A sub-sample contains one or more 'contigUous NAL units. A sub-sample is mapped to GroupiD, grouping in HEVC NAL Map Group Entry. 10 (0154] By this means, it is possible to realize byte access to an arbitrary Group - based on NAL units. [0155] <2. Second embodiment> 15 · An example of the MP4 file will be described next. FIG 27 is a diagram for explaining a configuration example of the MP4 file of the tile image, This MP4 file is Obtained by forming bit streams having a tile (Tile) structure into one file. As "illusi-rated in FIG 27, this MP4 file has five-tracks ofTracki to TrackS. 20 (0156] Track I, has an BEVC sall_lple entry (HEVc sample e~try) withi~ the sa~ple descrip_tion,box,_ and its ~odec type is hvcl indicating that the bit streams are 11ormal liEVC bit streams. This Salnple entry (Sample -Entry) has an HEVC decoder ~nfiguratiori record (HEVC Decoder ConflSunition Record) (hvcC box:) jn which - 25 cmiflguiation, information required for, decoding HEVC is stored. Header information such as a Video parameter set (VideO Paraineter Set (VPS)). a sequence , paraineter sei,(Sequence: Pa:l-ameter Set-(SPS)) aild a picture paritmeter set (Picture Parameter Set (PPS)) is also stored in' this hvcC box. SEI may be arbitrarHy stored in this hvcC box. 30 [0157] Trackl has extr~Ctof (extraCtor) Track2 to TrackS for referririg to a tile SP353455W002 34/75 (slice) of each track2 to trackS. The extractor (extractor) Track2 refers to slice (Tilel) of Track2, and the extractor (extractor) Track3 refers to slice (Tile2) of Track3. In a similar manner, the extractor (extractor) Track4 refers to slice (Tile3) ofTrack4, and the extractor (extractor) TrackS refers to slice (Tile4) of TrackS. 5 [0158] In track2 to trackS, slice which is actual data of each Tile 1 to Tile4 is stored. Further, while track2 to trackS have sample entries (Sample Entry), because only HEVC Tile is (independently) stored, a codec type is set as hvtl. The sample ·entries (Sample Entry) of these track2 to trackS have an HEVC ·.decoder 10 configuration record (HEVC Decoder Configuration Record) (hvtC box) required for decoding only the HEVC Tile. It should be noted that it is also possible to store grouped tiles (Tile) in one track. (0159] track2 to trackS also have tile region group entries (TtleRegionGroupEntry) . . 15 ln these. tiie regiol). gro\lp. entries (Tit~~gioi).GiOJJpEo.try) oftrackZ.to .traclP; .value$ of five parameters including GroupiD which is _ identification information for identifying each tile, H offset indicating a location ( off~et) in a horizontal direction of the tile, V offset indicating a location (offset) -in a vertical direction of the tile, H width indicating a size (width) in the horizontal direction of the tile, and V _height -20 ·indicating a size (height) in the vertical direction of the tile are- defined. Further, these may be defined for the grouped tiles (Tile). (0160] · For el [0163] Basic syntax Of an HEVC decoder configuration record (HEVC Decoder Configuration Record) (hvtC box) in which configuration information required for decoding only an liEVC--Tile of the sample entry (Sample Entry) in FIG 27 is stored- 15.. is. set as fullows .. [0164] 20 [0165] C1assHEVCConfigurationBox extends Box('hvtc'){ HEVCTi1eDecoderConfigurationRecord()HEVCTileConfig; } . · A specific example" of syntax of the HEVCTiieDecoderCoDfigurationRecordwill be described next. .FIG. 28 is a diagram for e~plaining the HEVC tile decOderconfiguration record. The HEVC tile_ decoder configuration record in Example 1 is 25 constituted as illustrated in FIG 28. configuration Version, mcts_tier _flag and mcts~level_idc are extensiOnally added. [0166] cOnfiguration Version illdicates version -of the HEVC . tile decoder configuration record. In HEVC, tWo ·types of profiles of tier- having different 30 - Bitrate are defined for the same image size. That is, the two types are main tier and · l1igh tier.· mcts_tier_flag is a flag indicating which of the tier the_ tier- is. SP353455W002 36/75 mcts- level- ide is a level indicating a degree of load of decoding processing of the partial region as decoding load definition information which defines the degree of load of decoding processing of the partial region which can be independently decoded in temporal MCTS SEI (Temporal Motion constratined tile set 5 Supplemental Enhancement Information). (0167) Here, temporal motion constrained tile set SEI (temporal_motion_constrained_tile_sets SEI) will be described. FIG 29 is a diagram illustrating an example of syntax of temporal MCTS SEI. In syntax of 10 temponil MCTS SEI illustrated in FIG 29> various information including mcts tier_ flag, mcts_level_idc, m_ax _ mcts_tier flag and max_ mcts level_id is stored. (0168] - It should be noted that temporal MCTS SEI is substantially the same as MCTS SEI except--the-name. Further, mcts~lev·et~idc-in FIG 28-and FIG 29 is 15 subst::t(ltiatly the_sa~e: 8s generalsjevel_idC iliU:strated in the squ~re. 12 iJ:t FI(J._ 8~ .. FIG. 12, FIG. 13, FIG. 17. FIG. 19, FIG; 20, FIG. 25, FIG. 26, or the like, except the name. (0169] In the example of FIG 28, among pararnters having the same data structure 20- as that of HEVC decodec configuration record and - stored 'in temporal__motion~contrained_tile_s~ts SEI, only parameters required for determining decoding of HEVC Tile, that is, mcts_tier_flag and mcts_1eveljdc are set. In IffiVCTileDecoderConfigu~ationR~~rd -in FIG. 28,- zero ·is -s~t far·-other items because the other items are not required. Alternatively, the same value as that of 25 HEVC decoder configuration record is set. [0170] That is, in this Example 1, ·nothing is stibstanlially st~red in nuniOfArrays. (0171] 30 FIG 30 is a· diagram for explaining an HEVC tile decoder configuration ·record. The HEVC tile decoder configuration record ofExarpp]e 2 is constituted as SP353455W002 37/75 illustrated in FIG. 30. [0172] Example 2 of FIG 30 has basically the saffie configuration as that of Example l of FIG 28, except that, while, in Example 1, nothing is substantially 5 stored in numOfArrays, in Example 2, temporal_motion_constrained_tile_sets SEI corresponding to HEVC Title is stored in numOfArrays. [0173] FIG 31 is a diagram for explaining an HEVC tile decoder configuration 10 record. -The HEVC tile decoder configuration record of Example 3 is constituted as illustrated in FIG 31. (0174] _ As illustrated in FIG 31, in Exaffiple 3, unlike with the examples in FIG 28 an·d FIG 30, instead of the HEVC tile decoder Configuration record being" extended, - 19' ' Jhe p~tfem of _t~e uavc tile dec0de.r configuration r~qord, is _uniquely specified. ' That is, in Exampte'3, in addition to configuration Version, among parameters stored in temporal_ motion_ constrained _tile_ sets SEI, only mcts _tier_ flag· and mcts_leveLidc whic.h are parameters tequired for determiiling decoding ofHEVC Tile are stored. 20 (0175] FIG 32 is .a diagram -for explaining an HEVC tile decoder oonfiguration record. -_The HEVC tile decoder configuratiOn re~ni o-fE~a~pie 4 is constituted as · illustrated in FIG 32. 25 (0176] . As· illustrat~d in FIG; 32~ in Example 4, in additiOn to configuration Version~ only illcts_tier flag, mcts_leVel_idc, max_ trictsj:ier _flag and max _m'cts_level_id are . . - stored ~ parameters required for detennining decoding of HEVC. Tile stored in teinpofal_ motion_ constiained _tile_ sets · SEI. max_ mcts _tier_ flag and 30 max_ mCts...Jevel_id, which are respectively indicate maximum values of mcts~tier_flag and mcts_level_idc, are profile information required for-reproducing 5 - - -- --- --- - - -- ---~--~~,-~ SP353455W002 38/75 other tiles. That is, these are information for maximum Tile in the whole stream. In an example of FIG 36 which will be described later, this is stored in another box (hvte box). [0177] When a size of Tile is different in the case where there are a plurality of Tile in the same stream, there is a case where mcts_tier_flag and mcts_level_idc required for each Tile are different from each other. In this case, max_ mcts tier_ flag and max_mcts_Ievel_idc which are maximuin values are stored with mcts_tier_flag and mcts_level_idc for each Tile, and used as hint information of decoding processing. 10 [0178] FIG 33 is 3 diagram for explaining an HEVC tile decoder configuration record. _The i-mVC-tile decoder configuration record of Example 5 is constituted as ·illustrated in FIG. 33 . ... 15 [0179] . As illustrated in FIG 33 ' m Example 5, temporal_ motion_ constrained _tile_ sets SEI corresp-onding· to HEVC Tile required for determining decoding of I-iEVC Tile is- -stored in nalUnit. ·Therefore, in _ NAL_unit_type. a NALunit type indicating that the type isSEI is stored. 20 [0180] , - FIG 34 is ·a diag~a01 for explaining iln:HEVC tile decoder -configuratiOn - record. The HEVC tile decoder configuration-record of Example 6 is constituted as . illustrated in FIG 34. 25 [0181] As illustrated JnFIG; 34,Examj)le,6 has~ co~figuration in which Exmnple 3 .in· FIG 31 and Exi.mple 5 in FIG -.33 'are synthesized.- That is. part from a row of · configUration Version to a l'()W ofmcts_:_level_idc in Example 3 and part'in a row Ofle~ gthSizeMinusOne and.-ther~after in Example.s are synthesized. In other words, 30 in addition to .confi.gllrationVersion. mcts...,.tier_flag and nlcts_leV_el_idc which are _ pcirani_ters required _ for ·determining decoding · of HEVC · Tile stored in 5 10 SP353455W002 39/75 temporal_ motion_ constrained tile_ sets SEI, and temporal_motion_ constrained tile_sets SEI corresponding to HEVC Tile required for determining decoding ofHEVC Tile are stored. [0182] FIG. 35 is a diagram for explaining an HEVC tile decoder configuration record. The HEVC tile decoder configuration record of Example 7 is constituted as illustrated in FIG 35. (0183] As illustrated in FIG 35, Example 7 has a configuration in which Example 4 in FIG 32 and Example 5' in FIG 33 are synthesized. That is~ part fioni a row of configuration Version to a row of max mcts level ide in Exainple 4 arid part in a row of JerigthSizeMinusOne and thereafter in EXample 5 are synthesized. - In other words, in addition to configufationVersion.- mcts.Jier~flag, 'mcts_level_idc, .. 15. max_mcts_tier_fl~ and max-"-mcts_tevetjd whiCh.-- are. patamters -required for. detemiining decoding of HEVC temporal- motion- constrained- tile- sets - · Tile SEI, stored in and temporal~motion_constrained_tile_sets SEI Corresponding-to HEVC Tile required for detennining decoding ofHEVC Tile are_ stored. 20 [0184] FIG; 36 is·a diagram for expl&ining an ex_ample of a structureofanMP4 file ·of a tile im FIG 38 .i~ a 4iagrarp. fQr ~phti11irjg a11. _roq,tmpl~ of a, .StlJl~Ut:~ of a11.M.P4 .til" . of a tile image. The MP4 file in FIG 38 has basically the same structure as that of the MP4 file in FIG 27, exceptthat, while, in the MP4 file in FIG 27, configuration information· required for decoding only HEVC Tile is stored in hvtCbox of 1:he sample entry of Track2 to Track 5, in the MP4 tile in FIG. 38, not only 20 temporal_motion_constrained_tile_sets SEI is stored in hvtCbox, but also VPS, SPS arid PPS required for decoding only lffiVC Tile are further stored in hvtCbox aS in 'the examples illustrated in FIG 30, FIG 33, FIG 34 and FIG 35. [0189) -By this means, when any ofTile2 to TileS is reproduced, it is nOt neceSsary 26 tO_ access information of Track I which "is a base track to obtain a parameter- set - thereof 30 [0190) <3. Third embodiment> An apparatus for implementing the present, technique as described above and a method .thereof will be described next. FIG 39 is a diagram illustrating an SP353455W002 41/75 ~ -~- --- image encoding apparatus which is one aspect of an image processing apparatus to which the present technique is applied. An image encoding apparatus 100 illustrated in FIG 39 is an apparatus for encoding input image data using an HEVC coding scheme and forming a file using an 1viP4 file format. 5 [0191] 10 As illustrated in FIG 39. the image encoding apparatus 100 has an image encoding unit 101, a subsample information generating unit 102 and an :MP4 file generating unit 103. [0192] The image encoding unit 101 divides the whole image of the input image data into partial images referred to as tiles (Tile), sets each-tile as-a tile (Tile) supported by an HEVC coding scheme and enCodes the image data of the whole image for each tile. That is, bit streams (HEVC bit streams) in the HEVC coding scheme Which can be independently decoded for: each tile are generated~ 16. [OWl] The image encoding unit 101 supplies the obtained HEVC bit streams to the MP4 file generating unit 103. FUrther, the jmage encoding unit 101 supplies tile (Tile) information relating to how the whole image is divided and profile information of each tile to the subsample information generating unit 102 . . 20 [0194] The subsatil.ple_ information· generating unit 102 generates ·subsample information (extended subsitmple information) using the tile informatiOn and the profile Information supplied from -the image encoding. unit 101, the SUbsainple - · informatiori supporting the MP4 file format, and including the tile_ information and 25 the profile information, that· is, including hint infOrmation used as a ~efCrefice- for -decoding processi~g of a- -.subsample whiCh is a Partial region which c~n be independentlY dCcoded in ihe whole image. The subsample information generating · unit 102 supplies the geilerated extended subsample inforination_to the MP4 file generating_ unit 103. 30 (0195] The MP4 file generating unit -103 forms the HEVC bit streams -supPlied SP353455W002 42/75 from the image encoding unit I 01 into a file using the MP4 file format, and stores the extended subsample information supplied fiom the subsample information generating unit 1 02 in management information for managing the HEVC bit streams, of the file including the HEVC bit streams. 5 [0196] At this time, the :MP4 file generating unit 103 arranges the extended subsample information as a subsample hint information box (Subsample Hint Information Box) which is different from a subsample information box (Subsarnple Information Box) of a sample table box (Sample Table Box) of the above·described 10 management information. [0197] A1ternatively, the MP4 file generating uni~ I 03 arranges the extended subsample _ information in a sample group description box (Sample -Group Description Box) of the sample table box (Sample Table Box) ofthe ab~ve-described ..... lQ .. m.anagemeo,t -inJorrnatlou -as a.-visual $ample· group entry .(VtSualSamph!Gn,:mpEJ,rtcy)~ atid arranges infoimation designating a sample to which the subsample information is to be applied in a sample to group box (Sample To Group Box). [0198] It should be- noted that content of the subsample information js the same as 20 any. of the examples described in the first enl!Jodiment. F_or example,- in the case of _Example 5, _the extended subsample _ information generat'ed by the subsainple -inf~~mation generati~g ~nit 102- includes ~at oiily hint info~mation _Used as a -refere~ce for decoding processing of a subsample which is a partial regiofl_ Which can be 'independe-ntly decoded in the whOle- i~age, -but also map group information (Map 26 Group Entry) for grouping NAL unit. [0199] . The MP4 file generating unit 103 then outputs the MP4 fit'e genenited as described above and transfers the MP4 file to, for exa!nple, a decoding side Via a network, a recording medium, or the like, or an information processing apparatus, or 30 the like. (0200] 5 SP353455W002 43/75 By this means, the image encoding apparatus 100 can recognize petformance required for decoding more accurately. [0201] Flow of each processing executed by the above-described image encoding apparatus 100 will be described next. An example of flow of image encoding processing will be described with reference to a flowchart in FIG 40. [0202] When the image encoding processing is started, the image encoding unit 10 101 encodes image data in steP_ SlOI so that ihe image data can be decoded for each subsample (tile). [0203] In step SI02~ the image encoding unit 101 extracts information relating to the tile, such as, for example, tile 'information and profile information of each tile. 16 .. [0204] 20 25 In step Sl03, the subsample inforffiation generating, 'unit 102- generates extended subsampte infoftnation including bi1it informatiOn of the tile using- the infoi-mation relating to the tile extracted in step_ 8102. [0205] In step Sl04, the M:P4 file generating ullit i(n genefat~ an MP4 file_using the eKtended subs8mple information so that hint information_ used as a reference for decoding -.-prOcessing of- a subsample which is a -partial regiOn-- which- c8n be inc}ependently decoded is included in the sample table box of moov . . [0206] •. When the processing in step S I 04 ends, the image encoding processing ends. [0207] 'By executihg -the image' eitcoding' processing a_s described .abo~e, th<;: image -encoding apparatus foo can· recognize performanCe reqqired ror ·decoding more accurately. 30 [OZ08] SP353455W002 44175 Decoding of encoded data encoded as described above will be described next. FIG 41 is a block diagram illustrating main components of an image decoding apparatus cotresponding to the image encoding apparatus 100, which is one 5 aspect of the image processing apparatus to which the present technique is applied. An image decoding apparatus 200 illustrated in FIG 41 decodes the encoded data generated by the image encoding apparatus 100 using a decoding scheme corresponding to the encoding scheme. That is, the image decoding apparatus 200 extracts HEVC bit streams from the MP4 file, decodes the HEVC bit streams, and 10 outputs jmage data. At tills time, the image decoding apparatus 200 ca'n decode a partial image including one or a plurality of tiles (Tile) independently from other parts, for example. by utilizing a tile structure supported by HEVC, At that time, _- the image decoding apparatus 200 can determine whether or not decoding is possible based on hint information used as a reference fof decoding processing of a BubSample 16. whicii .is a partial region which can be independently decoded. [0209] - As -illustrated in FIG 41, the i'.llage decoding apparatus 200 h~ an MP4 file reprodu'e:ing unit 201. a subsample information prOcessing unit 202 and an image decoding unit 203. 20 [0210] __ -The MP4 tile -r~produ~ing unit 201 performs Processing of determi~ing whe~ber or not repl'oduction ofthe inputted MP4 file jg possible; performs processing of reproducing the MP4 file ~nd _performs error processing. The MP4 file --feproducing unit 201 performs these processing by_ utilizing the subSample 25 information processing unit 202, generates HEVC bit-streams of a partial image (of course, it is possible to use the whole image) including one or a plurality of tiles and sUpplies the HEVC 1* streams_ to the image decoding unit 203. [0211] The sUbsample information processing unit 202 performs processing as to - 30 the subsample infofmatlon during the processing of determining whether or not reproduction is _possible an~ reproduction processing. Jt should be noted that SP353455W002 45/75 content of the subsample information is the same as any of the examples described in the first embodiment. For example, in the case of Example 5, the extended subsample information generated by the subsample information generating unit 102 includes not only hint information used as a reference for decoding processing of a 5 subsample which is a partial region which can be independently decoded in the whole image> but also map group information (Map Group Entry) for grouping NAL unit. [0212) The image decoding unit 203 decodes the HEVC_ bit streams generated in 10 the MP4 file reproducing unit 201 and_outputs the image data. [0213) By this means, the image -decoding apparatus 200 can recognize performaitce required for decoding more accurately._ [0214) 16 · · _ An example of_ flow Qf the_- Pro.Cessin& of dete~mining whether QT-··not reprodUctiOn is Possible~ execUted in step 8201 i-n FIG 42 will be described.oextwith reference to a flowchart iri FIG 43. [0224] When the processing of deterffiining whether or not reproduction is possible 30 _ is started, in step ·8221, the MP4 file-·Ieproducing unit 201 acquires a sequence parameter set (SPS) of HEVC bit s. treams included in . the MP4 file from an .H EVC SP353455W002 47/75 sample entry of the sample description box in the sample table box: of the MP4 file. [0225] In step S222, the :MP4 file reproducing unit 201 determines whether or not the profile information included in the sequence parameter set (SPS) is profile 5 information corresponding to the image decoding unit 203. That is, the :MP4 file reproducing unit 201 determines whether or not the image decoding unit 203 can decode the HEVC bit streams of the whole image included in the MP4 file based on information included in the sequellce parameter set (SPS). [0226] 10 If it is determined that decoding is possible, the processing proceeds tO step S223. In step S223, the MP4 file reproducing unit 201 performs control so that reproductiOn is performed. That is, it is detennined to perform reproduction in step 8202 in FIG 42. [0227] . ~p . . Whl;![l . t.h~. pn~ce~sing. in step S2Z3 .~n(j~) tile proc~si11g. of d~termining whether or not reproduction is possible_ends, and the processing returns to FIG 42. _ [0228] _- Further, in step S222,- when it is determined thRt the profile information does not correspond to the image decoding unit 203, that is, when it is determined that the - 20 ini<)ge decoding unit 203 cannot decode the I-ffivc bit streams- Of the whole_ image included in the MP4 file, the _processing proceeds to step S224. In step S224,_ the stibsampl_e · information processing Unit 202 ~uires hint- information of tiles (subsamples) from the sample table box ofthe MP4 file. • (0229]. · 25 · :In step S225, the subsalilple information processing unit 202 determines -- whether ~r nOi the profile informati.on included in the hint information acquired in_ Step S224 is profile informatiOn corresponding to the image decoding unit -203. - That _is, the_-subsample information processing unii 202 dete1mines whether or not the . image decoding unit 203 can decode the HEVC bit streams of a partial.-image 30 including one or a plurality of tiles, inCluded in the MP4 file_ [0230] 5 10 SP353455W002 48/75 If it is determined that decoding is possible, the processing returns to step S223. That is, also in this case, the MP4 file reproducing unit 201 performs control so that reproduction is performed. [023l] Further, in step 8225, when it is determined that the profile information does not correspond to the image decoding unit 203, that is, when it is determined that the image decoding unit 203 cannot decode the HEVC bit streams of the partial image included in the MP4 file, the processing proceeds to step 8226. [0232] In step 8226, the MP4 file reproducing unit 201 performs control so that ' ~rror processing is performed as described above. [0233] . When the proCeSsing in step S226 ends, the processing of determining . - whether or not reprodu~ion is -possible ends, and th~ proce~sing returns tO FIG 42,- 15. [0234] 20 - An example or t10w of reproduction processing executed in- step s2o3 in FIG 42 will be described next with reference to a flowchart in FIG 44. [0235] When the reproduction processing is started, the MP4 file reprodu~i~ u~t 201 -acquires a SfXJueOceparamCter set (SPS) and a picture parameier s~t frOmt~e _MP4 filein stepS241. [0236] In step S242, the subsample-informcitiOn pfocesSing unit_202 acquiies hint - 25 inform~tion of tiles to be reproduced fr~m the MP4 file. [0237] In step. S243,. the MP4 file reproducing unit 201 updates the sequence · .. · parameter set (SPS) acquired iO steP 8241 using the hint information of thC tiles obiained in step Sz4-2. For example; when the hint information is Exa~ple (A-t) or 30 (A-2) in the squai-e -12, the MP4 ~le_ reproducing unit 201 rew1ites information of the -sequence parameter set (SPS) usini--iufofmation (such ~sa profile level) included -in5 SP353455W002 49/75 the hint information. Further, for example, when the hint information is Example (B-1) or (B-2) in the square 12, the .MP4 file reproducing unit 201 replaces the information included in the hint information with the sequence parameter set (SPS). [0238] In step S244, the subsample information processing unit 202 acquires data of tiles to be reproduced from the MP4 file. At this time, in the case of Example l to Example 4, the subsample information processing unit 202 accesses data ofNAL unit constituting the subsamples (tiles) with reference to the subsample information box and acquires the data as in the example in FIG. 6. Futtber, in the case of 10 Example 5, the subsample infofmation processing unit 202 accesses data of NAL - unit constituting the _subsamples (tiles) with reference to association between NAL unit and Group!D (map pattern ofNAL unit) (Map Group Entry), set in the visual sample group entry -(HEVCNALUM8pGroupEntryQ eXtends VisualSmapleGroupEntry('hcnm')) in which NAL units are mspped in the sample ,1,5 . itml.~cq~ire.s the 9ata- ~sin the·~~lll-Ple. in FIG 24,. (0239] - In step S245, the MP4 file reproducing unit 201 gerierates bit streams of tiles (partial image) to be reproduced using the data of the tiles obtained in step S244, the seque_nce param~ter set updated in step S243, or the like. 20 (0240] . -·When the processing in stCp 8245 ends, the processing retur~s to FIG 42. · That is, the generated bit streams of the partial image are decoded. - [0241] - By exiX:~ting each proces~ing as described above, ihe hnage decOding . . 25 apparatus 200 can recognize pefformanOO required for dec-oding ~ore accurately. (0242] Allot her example or' flow of reProduction processing executed in ·step S203 in-FIG-42 will be deScribed next with reference to a :flowchart in FIG 45. 30. (0243] When the reproduction processing is started, the MP4 file reproducing unit 5 SP353455W002 50/75 - --- 201 acquires information relating to a location of the tile (H offset, V offset) and information relating to a size of the tile (Width, Height) from the visual sample group entry in step S26l. [0244] In step S262, the MP4 file reproducing unit 201 selects a tile which is desired _to be reproduced based on the acquired information relating to the location of the tile and information relating to the size of the tile. [0245] - -In step 8263, the .subsarnple information processing unit 202 acqmres 10 infonnation relating to the map pattern ofNAL unit corrC.sponding to the selected tile (NALU _:._count, groupiD) from thC visual sample group entry. - [0246] In· steP S264, the subsample information processing unit 202 acquires data of the tile_ based on the information relating to the map- pattern ofNAL unit acquired . ... Hi . i_n_step S26~, .. . 20 (0247]. In step 8265, the MP4 file reproducing unit 201 reproduces bit streams of the tile acquired in step S264. [0248] When Jhe processing in step '8265 ends,. the pieces-sing retunls to FIG. 42 . That is, .bit _Streams of the feproduced partial imag~ are' decoded._ (0249] _By executing each processing as deScribed above; -the image decoding : apparatuS 20o can recognize performanCe ~uired fo~ d~Odillg ~ore ac~urately. 2!> . (0250] --Anoiher example of flo~ of reproduction processing executed iit step S203 . in FIG-42 will be described next with reference_ to a flowchart in FIG 46. (0251] 30 When the reproduction processing is started, the MP4 file reproducing unit 201 acquires information relating to a location of the tile (H~offset; V ~offset) and SP353455W002 51/75 ------ information relating to a size of the tile (Width, Height) from the visual sample group entry in step S281. [0252] In step S282, the MP4 file reproducing unit 201 selects a region which is 5 desired to be- reproduced based on the acquired information relating to the location of the tile and information relating to the size of the tile. [0253] In step S283, the subsample infonnation processing unit 202 ·acquires a plurality of GroupiDs based on TileGrouplD corresponding to the region which is 10 desired to be reproduced from the visual group entry. [0254] In s~ep S284J the subsample information processing- unit 202 acquires in'fonn Another example of flow of reproduction processing executed in step S203 SP353455W002 52/75 in FIG 42 will be described next with reference to a flowchart in FIG 47. [0260] When the reproduction processing is started, the MP4 file reproducing unit 201 acquires information relating to a location of the tile (H _offset, V offset) and 5 information relating to a size of the tile (Width, Height) from the tile region group entry in step S30 1. [0261] In . step S302~ the MP4 file reproducing unit 201 selects a tile which is desired to be reproduced based on the acquired information relating to the location of. 10 the tile and information relating to th~ size of the tile. [0262] In step S303, the subsample information processing unit 202 acquires tracks cOrrespollding to the tile selected in step 8302. (0263] 1,_5 : ln.~ep.S:l04,.th~,J&>4 file rq>ic;ld.ucing,unit 201 repn:,1du.~s. bit. ~treams .of the tiles corresponding to a plurality of tracks acquired in step 8303. (0264] When the processing in step 8304 ends, the pcoce~sing returns to FIG 42. That is; bit streams of the reproduced partial image are decoded . . 20 (0265] By executing each ·processing as described abOve, the image decoding app 25 _ Another example of flow of reproduction proces-sing executed in step S203 in FIG 42 will be desc[ibed next with reference-toa flowchart in FIG 48. [0267] .. · When the reproduction processing is started, the _MP4 file reproducing uri it_ 201 .acquires information relating to a location of the tile (H _offset, V offset) and 30 . information relating to a size of the tile (Width, Hefght) from the tile region groupentry in step.S321. SP353455W002 53/75 [0268] In step S322, the :MP4 file reproducing unit 20 I selects a region which is desired to be reproduced based on the acquired information relating to the location of the tile and information relating to the size of the tile. 5 [0269] 10 h1 step 8323, the subsample information processing unit 202 acquires a plurality of GroupiDs from the tile region group entry based on TileGroupiD corresponding to the region which is desired to be reproduced. [0270] In step S324, the subsample "information processing unit 202 acquires tracks correspollding to the plurality Of tiles selected in step S323 . . [0271] In step S325, the _MP4 file reproducing unit 201 reproduces bit streams of the plurality of tiles corresponding to a plurality of tracks acquired in step S324. 15. (0272] When the_ processing in step S324 ends,. the processing returns to FIG 42. That is, bit streams of the reproduced partial image are decoded. [0273] -By executing each processing as described . above, the image decoding 20 -- apparatus 260 can recognize perforffiance required for decoding more accurately._ [0274] 25 The present technique can be ·applied tO_ any 'image encoding apparatus and : image decodirig apparatus which can enCode or decode a partial image. [0275] Further, ,the_ present- techruque can b~ , itpp1ied to an i~age encoding . apparatus ·and . an image decoding apparatus used when- image information (~.it · st~eams) Compressed through orthoitonal trallsform such' aS discrete Cosine tnl'risform , and motion compensation, for example, _in MPEQ.'H.26x, or the like, is received Via a network medium suCh as satellite br()adcasting, cable television, Internet and a 30 mobile telephone, Furt-her, the present technique can be applied to an image encoding apparatus ·and an image decoding apparatus used when proCessing is 5 SP353455W002 54/75 performed on a storage medium such as an optical disc, a magnetic disc and a flash memory. [0276] <5. Fifth embodiment> The above-described series of processes can also be performed by hardware and can also be performed by software. When the series of processes is performed by software, a program of the software is installed in a computer. Here, the computer includes a compUter embedded in dedicated hardware and, for example, a. 10 general personal computer· capable of various functions through installation of various programs. [0277] FIG. 49 is a block diagram :illuStrating an -example of a hardware configuration of the computer performing the above-described serieS of processes J5 .... acC()rding tQ ·a progra111 .. (0278] In a compu.t er 900. illustrated in FIG 49, a control processing unit (CPU) 901. , a read-only memory (ROM) 902, and 'a random access memory (RAM) 903 are connected mUtually via a bus 904. 20 (0279] An input and output inteJface 910 i_s also connecte~Uo -the bus 904. -An input unit 911, - the .examples~ For example; -the informatiori_ma}r·be transmitted or rect;,rded as _sep~rate·piec~s of data asSociated with -the ·encOded bit Stre.tm ~ithout being multiplexed in the enCoded bit streain. · Here~ _ 25 the term "associated" means that an image (which may_be a part of an image, such as -a slice or a -block) _included in a bit stream a-nd ·information Correspondif1g to the _-image can :b-e linked at th~-time Of decodi~g. -. That iS;· the 'iriformation may- b-etfansmitted along -a different tran~mission pclth from -the jmag~_:( Or bit stream). · -The. infonnation may be recorded in a different _ recofding medium (or a· different 30 ;ecording area of.the same recording mediUm) -from -the image (or bit stream). Further, th~ info~ma'tion arid' the imaie (or bit streR~) .maY be_ mutually associated. SP353465W002 58/75 ·for example, in any unit such as a plurality of frames, a single frame, or a part of a fi·ame. [0296] Additionally, the present technology may also be configured as below. 5 (!) An image encoding apparatus including: an encoding unit configured to encode image data; . ·a subsample information generating unii configured to generate subsample information of an image of the image data, the subsample information including hint 10 information used as a reference for decoding processing of a subsampJ~ which 'is a partial region which can be independently decoded; and ·a file generating unit configured to generate ·a file including encoded data of · the image data generated 'by the encoding unit and management information of the encoded data, and arrange the subsample information generated by the subsample - 15. - . informatic:m ge_neratiJJ.g u11it in the .rn;,mag~l)161,1.t itrl'orffiatiOri~. - (2) The image encoding apparatus according to any of(!) and (3) to (15), wherein the subsample information generating unit generates subsample information including a hint data type indic3.ting a type Of hillt information included ' 20 in the Subsample informatio~J' a s~mple count indiCatiug the nUmber of cOntinuou's samples associated with the subsample_ information, and the hint information. (3) The image encoding apparatus according to any of(!), (2), and (4) to (15), Wherein -the hint information includes a level indicating a degree of load 'of 25 decoding_processing of the subsample. (4) The image encoding apparatus according to any of (I) to (3) and (5) to (15), · wherein the hint information inCludes_ header information of the encoded d~a of the subsaffiple . . 30 (5) The image encoding apparatus according to any of(!) to (4) and (6) to (15), · SP353465W002 59/75 wherein the subsample information generating unit generates subsample information including a hint data type indicating a type of hint information included in the subsample information, a sample count indicating the number of continuous samples associated with the subsample information, and identification information of 5 a group to which the subsample belongs. (6) The image encoding apparatus according to any of (I) to (5) and (7) to (15), wherein the subsample information generating unit further generates subsample information including a hint data type indicating a type of hint 10 jnformation included in the subsample information. a sample count indicating the number of continuous samples associated with the subsample information, and hint information including a level indicating a degree of load of decoding processing of a group of a subsample. (7) 15 . Th~ im;~ge ~ncnding appara!us accnrdi~g to any of (I)~~ (6) and (8) to (15), .. wherein the 'subsample information generating unit further generates subsitmpie information inc1uding a hint data type indicating a type of hint information included in the subsample -information, a salnple count indicating the number of continuous samples ass·ociated with the subsample information. and hint 20 inforniation includi_ng header illformation of encoded _data of a group of a subsamp_l~. (8) The image ~needing apparatus according to any of(!) to (7) and (9) to (15), whe~in .the subs~ffiple )nformation generating- _unit generates -subsample, information including a hint data type -indicating a type of hint information includW 26 in, the subsample information, a sample 'cOunt indicitting the riumber of continuous . samples assoCiated with the subsamp,le ififormation~ identification infonn3tion of a s~bsample beionging tO a group,_and hint iufon~atio~ of the group. 30 (9) The image encoding apparatus according to any of(!) to (8) and (10) to (15), wherein the hint informatiOn includes a level indicating a degree of load of _ decoding processing of the gmup. (10) SP353456W002 60175 The image encoding apparatus according to any of (1) to (9) and (11) to (15), wherein the hint information includes header information of encoded data of the group. 5 (11) The image encoding apparatus according to any of (1) to (10) and (12) to (15), wherein the subsample information generating unit generates subsample information including information indicating a size and a location of a subsample. 10 (12) The image encoding apparatus according to any of(!) to (ll) and (13) to (15), wherein the subsample information generating unit generates subsample inforinatiOn including illforin~tion i~dicating that a subsample can be independently 16 decoded. (13) The image encoding aPparatus according to any of{l) to (12), (14), and (15), wherein the subsample information generating unit generates s_ubsample information including informiition for grouping NAL units constituting a sample. 20 {14) The image encoding apparatus according to any of(!) to (13) and (15), ,: wherein the file _generat~rig unit airaoges the subsample information as a , subsample hint iilformation box (SubsampleHint Information BOx) different frOm a subsamp)e infor~ation bOx (Sub~mPte Information Box)- of a kample table box 25 {Sa~ple Table Box.) of~he mafiagement inf~rmation. (!~) -Tli~ image ~nooding apparatus according to any or' (1) to (14}, wherein the file generating unit arranges the subsample information in a sample_ group descriptiOn box (Sa~jlle G~oup Description Box) of a sample table _box 30 (Sample Table Box:) of ihe managemerit information as a visual sample group entrY (VisualSampleGroupEOtry), and arranges information designating a sample to which SP353455W002 61175 the subsample information is applied in a sample to group box (Sample To Group Box). (16) The image encoding apparatus according to any of (1) to (15), wherein the 5 file generating unit atTanges the subsample information required for decoding only the pariial image in a sample entiy (Sample Entry) of the sample group description box (Sample Group Description Box) of the sample table box (Sample Table Box) of the management information of a track having the partial image. 10 (17) The. image enCoding apparatu~ ac. cording to any of(l) to (16), wherein the subsample information is a parameter required, for determining decoding of HEVC Tile stored m a temporal motion constrained 'tile set SEI (temporaC.motion_constralned_tile_sets SEI) in the Same data- struCture aS a data structure of an HEVC decodec configuration record. 16 (18) . 20 The imitge enCoding apparatus according to any of (1) to (17), wherein -the parameter includes mcts tear_ 'flag (mcts_tear_:_flag) and mcts _level ide (mcts_leveU~c). (19) The image en-coding apparatus according to any of{l) to- (18), whetein the - - - - partial image information furthef incl~des tempofat motion cOnsti-ained tile set .SEI (temporal~ motion_ <:onst~ained -'-.tile---'-s~ts SEI) correspondillg tt? HEVC Tile: (20) -ThC i~age encoding app~atus· according to any of (I) to (19)? wherein the - 25 subsample inform8tion_further includes 111ax mcts tear flag (max_mctS_teafJlag) and m'ax mctsleVel_idc_'(m3.x mcts_levvel_idc). (21) The image encoding apparatus according to any of (I) to (20), further· including temporal motion - constrained tile set SEI 30 --{temporal_ motion_ cons~rained tile_:sets SEl) oorresp(mding -to HEVC Tile required for determining decoding ufHEVC Tile. SP363455W002 62/75 (22) The image encoding apparatus according to any of (1) to (21), wherein the max mcts tear flag (max_mcts_tear_flag) and the max mcts level ide (max_mcts_level_idc) are arranged in a base track. 6 (23) An image encoding method including: encoding image data; generating subsample information including hint information used as a reference for~ decoding processing of a subsample which is a partiaf region whi?h can 10 be indePendently decoded, of au image 'of the image data; and generating a file including genereated encoded data of the image data and -management information of the encoded _data and arrangiJlg the generated subsample information in the management inforination. (24) 15 .. Animagedecoding ap~aratusincluding: an acqUiring unit configured to- acquire a file inCluding encoded data of image data and management information of the _encoded data in which subsample info~mati~n of an ima'ge of the image.:data is arranged, the subSample informationincluding hint information used as a reference for decod_ing processing of a_ · 20 subsample which is a partial region which can be independently d~coded; a subs'a-mple information ana1:Yziiig unit configured to 3natyze the si.Jbsample information illciuded in the file acquired bY the·acqu-iring unit; - a control unit configured to control decoding of the encoded data based on an- analysis resu_lt of- the subsampte _ information by the sU:b_sampte Information 25 analyzing- u~t; a encoded data generating unit configured to.generate encoded 'data ofthe subsainPie fron{the encoded data irtcluded in th~ file acquired by the acQuiring: unit according to control by the control Unit; and -a decoding unit ConfigUred .to :decode the ~ncOcted data of the subsample - , 30 , generated by the- encoded data gefierating unit accOi:ding -i:o control by the control unit. SP353455W002 63/75 (25) The image decoding apparatus according to (24), wherein the control unit determines whether the decoding unit can decode the encoded data of the subsample based on the hint information of the subsample information and performs control to 5 decode the encoded data of the subsample when the encoded data can be decoded. (26) The image decoding apparatus according to (24) or (25), wherein the encoded data generating unit updates header information of the encoded data of the subsample based_ ori the subsample information. 10 (27) An image decoding method including:_ .acquiring a file including encoded data of image data and mamlgement · information of the ericoded data in which subsample information ofan image of the - image data is- arranged, the subsample information including hint information used as - .. 16 . a referenCe .for .. decoding processin8 of a. subs.a:mple .which js a· .partiat.region which 20 25 30 can be independently decoded; analyzing the subsample information included in the acquired file; controlling decoding of the encoded data based on an analysis result of the subsample information; generating encoded data oft4e subsample from the _encoded data included in the acquired file according to the contrOl; aDd decoding the generate4 -encoded data of the subsample according tO the_ ·cOntrol . (31) An _information proceSsing apparatus including:- a file g~nerating unit configUred to generate a file of an MP4 file forinat,_ in which -information for grouping . a plurality of partial images- which can- be · independently decoded in a whole_ image is stored in moov atid the encoded .partial . im in the file, inf~rmation indicat-ing locations of the partial images in 'the whole image. information indicating sizes of the partial images _and the infofmatioll _for groupiitg- the plurality of partial -images -are -stored in . VisualSampleGroupEntry, and whereiit the file reproducing unit_ 20 selects a region which _is desired to he reproduced based on the 1nfornlation indicating the locations of!he part_ial images ill the whole image and the informatiori indiclitipg the sizes of the partialJmages, and -_ aCquires data of a partial iinage conesponding to the region whichis desired to bC -reproduced based on the information for grouping-the pl~ality_of 25_ pattial images and genetftteS_ a bit st~eam. (57) -The information prOcessing apparaiiis according to any of ( 44) to (56), wherein, in the file, information indicating locations of the partial images in the whole ima:ge, information indicating sizes of the partial images and the 30 information -for grouping the plurality .. of partial images are stored in . -TileRegioitGroupEntry, and 5 SP353455W002 68/75 wherein the file reproducing unit selects a region which is desired to be reproduced based on the infonnation indicating the locations of the partial images in the whole image and the information indicating the sizes of the partial images, acquires a plurality of tracks corresponding to the selected region which is desired to be reproduced based on the information for grouping the plurality of partial images, and _ generates bit streams of partial tmages corresponding to the acquired plurality of tracks. 10 (58) The information processing apparatus according to any of (44) to (57), further including: _a decoding unit conftgUred to decode bit streams of the partial images reproduced

Documents

Application Documents

# Name Date
1 Priority Document [15-01-2016(online)].pdf 2016-01-15
2 Power of Attorney [15-01-2016(online)].pdf 2016-01-15
3 Form 5 [15-01-2016(online)].pdf 2016-01-15
4 Form 3 [15-01-2016(online)].pdf 2016-01-15
5 Form 1 [15-01-2016(online)].pdf 2016-01-15
6 Drawing [15-01-2016(online)].pdf 2016-01-15
7 Description(Complete) [15-01-2016(online)].pdf 2016-01-15
8 201617001545.pdf 2016-01-20
9 201617001545-Form-1-(22-01-2016).pdf 2016-01-22
10 201617001545-Correspondence Others-(22-01-2016).pdf 2016-01-22
11 201617001545-Form-3-(05-05-2016).pdf 2016-05-05
12 201617001545-Correspondence Others-(05-05-2016).pdf 2016-05-05
13 abstract.jpg 2016-06-27
14 Form 3 [04-11-2016(online)].pdf 2016-11-04
15 Form 18 [04-07-2017(online)].pdf 2017-07-04
16 201617001545-MARKED COPIES OF AMENDEMENTS [16-09-2017(online)].pdf 2017-09-16
17 201617001545-AMMENDED DOCUMENTS [16-09-2017(online)].pdf 2017-09-16
18 201617001545-Amendment Of Application Before Grant - Form 13 [16-09-2017(online)].pdf 2017-09-16
19 201617001545-Response to office action [11-02-2020(online)].pdf 2020-02-11
20 201617001545-FER.pdf 2021-10-17

Search Strategy

1 2020-03-09E_09-03-2020.pdf