1. An image processing device comprising: an encoding unit configured to encode the image data with a plurality of layers by performing inter-layer prediction, which is prediction between the plurality of layers, based on inter-layer prediction control information specifying a highest sublayer used for the inter-layer prediction, from a lowest sublayer to the highest sublayer specified by the inter-layer prediction control information. 2.The image processing device according to claim 1, wherein if a current picture of a current layer belongs to the sublayer specified as the sublayer for which the inter-layer prediction is performed by the inter-layer prediction control information, the encoding unit encodes the image data of the current picture using the inter-layer prediction. 3.The image processing device according to claim 1, wherein the inter-layer prediction control information is set for each layer. 4.The image processing device according to claim 1, wherein the inter-layer prediction control information is set as parameters common to all the layers. 5.The image processing device according to claim 1, wherein the encoding unit performs inter-layer pixel prediction as pixel prediction between the plurality of layers based on inter-layer pixel prediction control information that controls whether to perform the inter-layer pixel prediction and that is set as the inter-layer prediction control information, the encoding unit performs inter-layer syntax prediction as syntax prediction between the plurality of layers based on inter-layer syntax prediction control information that controls whether to perform the inter-layer syntax prediction and that is set as the inter-layer prediction control information independently from the inter-layer pixel prediction control information. 6.The image processing device according to claim 5, wherein the inter-layer pixel prediction control information controls using the information related to the sublayer, whether to perform the inter-layer pixel prediction, the encoding unit performs the inter-layer pixel prediction on only the sublayer specified by the inter-layer pixel prediction control information, the inter-layer syntax prediction control information controls whether to perform the inter-layer syntax prediction for each picture or slice, and the encoding unit performs the inter-layer syntax prediction on only the picture or slice specified by the inter-layer syntax prediction control information. 7.The image processing device according to claim 6, further comprising a transmission unit transmitting the inter-layer pixel prediction control information as a nal unit (nal_unit), a video parameter set (VPS (Video Parameter Set)), or an extension video parameter set (vps_extension). 8.The image processing device according to claim 6, further comprising a transmission unit transmitting the inter-layer syntax prediction control information as a nal unit (nal_unit), a picture parameter set (PPS (Picture Parameter Set)), or a slice header (SliceHeader). 9.An image processing method comprising: encoding the image data with a plurality of layers by performing inter-layer prediction, which is prediction between the plurality of layers, based on inter-layer prediction control information specifying a highest sublayer used for the inter-layer prediction, from a lowest sublayer to the highest sublayer specified by the inter-layer prediction control information.

We claim:
1. An image processing device comprising:
an encoding unit configured to encode the image data with a plurality of layers by performing inter-layer prediction, which is prediction between the plurality of layers, based on inter-layer prediction control information specifying a highest sublayer used for the inter-layer prediction, from a lowest sublayer to the highest sublayer specified by the inter-layer prediction control information.
2.The image processing device according to claim 1, wherein if a current picture of a current layer belongs to the sublayer specified as the sublayer for which the inter-layer prediction is performed by the inter-layer prediction control information, the encoding unit encodes the image data of the current picture using the inter-layer prediction.
3.The image processing device according to claim 1, wherein the inter-layer prediction control information is set for each layer.
4.The image processing device according to claim 1, wherein the inter-layer prediction control information is set as parameters common to all the layers.
5.The image processing device according to claim 1, wherein
the encoding unit performs inter-layer pixel prediction as
pixel prediction between the plurality of layers based on
inter-layer pixel prediction control information that controls
whether to perform the inter-layer pixel prediction and that is set as the inter-layer prediction control information,
the encoding unit performs inter-layer syntax prediction as syntax prediction between the plurality of layers based on inter-layer syntax prediction control information that controls whether to perform the inter-layer syntax prediction and that is set as the inter-layer prediction control information independently from the inter-layer pixel prediction control information.
6.The image processing device according to claim 5, wherein
the inter-layer pixel prediction control information controls using the information related to the sublayer, whether to perform the inter-layer pixel prediction,
the encoding unit performs the inter-layer pixel prediction on only the sublayer specified by the inter-layer pixel prediction control information,
the inter-layer syntax prediction control information controls whether to perform the inter-layer syntax prediction for each picture or slice, and
the encoding unit performs the inter-layer syntax prediction on only the picture or slice specified by the inter-layer syntax prediction control information.
7.The image processing device according to claim 6, further comprising a transmission unit transmitting the inter-layer pixel prediction control information as a nal unit (nal_unit), a video parameter set (VPS (Video Parameter Set)), or an extension video parameter set (vps_extension).
8.The image processing device according to claim 6, further comprising a transmission unit transmitting the inter-layer syntax
prediction control information as a nal unit (nal_unit), a picture parameter set (PPS (Picture Parameter Set)), or a slice header (SliceHeader).
9.An image processing method comprising:
encoding the image data with a plurality of layers by performing inter-layer prediction, which is prediction between the plurality of layers, based on inter-layer prediction control information specifying a highest sublayer used for the inter-layer prediction, from a lowest sublayer to the highest sublayer specified by the inter-layer prediction control information.