1
FORM 2
THE PATENTS ACT, 1970
(39 OF 1970)
&
THE PATENTS RULES, 2003

COMPLETE SPECIFICATION
[SEE SECTION 10, RULE 13]
ENCODER AND DECODER, ENCODING METHOD AND DECODING METHOD
WITH PROFILE AND LEVEL DEPENDENT CODING OPTIONS;
FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN
FORSCHUNG E.V., A CORPORATION ORGANIZED AND EXISTING UNDER THE
LAWS OF GERMANY, WHOSE ADDRESS IS HANSASTRAßE 27C, 80686 MÜNCHEN,
GERMANY
THE FOLLOWING SPECIFICATION PARTICULARLY DESCRIBES THE INVENTION
AND THE MANNER IN WHICH IT IS TO BE PERFORMED.

33
We Claim:
1. A video decoder (151) for decoding an encoded video signal comprising encoded
picture data to reconstruct a plurality of pictures of a video, wherein the video
5 decoder (151) comprises:
an input interface (160) configured for receiving the encoded video signal, and
a data decoder (170) configured for reconstructing the plurality of pictures of the
10 video by decoding the encoded picture data,
wherein the data decoder (170) is configured to decode chroma format information
encoded within the encoded video signal,
15 wherein the data decoder (170) is configured to determine motion information for a
chroma subblock of a plurality of chroma subblocks from motion information of one
or more of a plurality of luma subblocks depending on the chroma format
information,
20 wherein the data decoder (170) is configured to reconstruct the plurality of pictures
depending on the motion information of the one or more of the luma subblocks and
depending on the motion information for the chroma subblock.
2. A video decoder (151) according to claim 1,
25
wherein the data decoder (170) is configured to determine a motion vector for said
chroma subblock as the motion information for the chroma subblock,
wherein, if the chroma format information indicates a first format, the data decoder
30 (170) is configured to determine the motion vector for said chroma subblock
depending on a motion vector of exactly one of the luma subblocks, and
wherein, if the chroma format information indicates a format being different from
the first format, the data decoder (170) is configured to determine the motion
35 vector for said chroma subblock depending on each motion vector of at least two
of the luma subblocks.
3. A video decoder (151) according to claim 2,

34
wherein, if the chroma format information indicates a second format, being different
from the first format, the data decoder (170) is configured to determine the motion
vector for said chroma subblock depending on each motion vector of exactly two of
5 the luma subblocks.
4. A video decoder (151) according to claim 3,

wherein, if the chroma format information indicates the second format, the data
10 decoder (170) is configured to determine the motion vector for said chroma
subblock by averaging the motion vectors of said exactly two of the luma
subblocks, or by symmetrically rounding the motion vectors of said exactly two of
the luma subblocks.
15 5. A video decoder (151) according to claim 3 or 4,
wherein a luma block comprises at least four of the luma subblocks, wherein each
row of two or more rows of the luma block comprises at least two of the at least
four of the luma subblocks, wherein each column of two or more columns of the
20 luma block comprises two or more of the at least four of the luma subblocks,
wherein, if the chroma format information indicates the second format, the data
decoder (170) is configured to determine the motion vector for said chroma
subblock depending on said exactly two of the at least four of the luma subblocks.
25
6. A video decoder (151) according to claim 5,
wherein a first row of the two or more rows comprises an upper-left luma subblock,
wherein a second row of the two or more rows comprises a bottom-right luma
30 subblock, wherein the upper-left luma subblock and the bottom-right luma
subblock are diagonally arranged with respect to each other, and
wherein, if the chroma format information indicates the second format, the data
decoder (170) is configured to determine the motion vector for said chroma
35 subblock depending on the motion vector of the upper-left luma subblock and
depending on the motion vector of the bottom-right luma subblock.
7. A video decoder (151) according to claim 5 or 6,

35
wherein, if the chroma format information indicates a third format, being different
from the first format and being different from the second format, the data decoder
(170) is configured to determine the motion vector for said chroma subblock
5 depending on each motion vector of exactly two of the luma subblocks from
exactly one row of the two or more rows of the luma block; or the data decoder
(170) is configured to determine the motion vector for said chroma subblock
depending on each motion vector of exactly two of the luma subblocks from
exactly one column of the two or more columns of the luma block.
10
8. A video decoder (151) according to one of claims 5 to 7
wherein, if the chroma format information indicates the third format, the data
decoder (170) is configured to determine the motion vector for said chroma
15 subblock depending on each motion vector of exactly two of the luma subblocks
from exactly one row of the two or more rows of the luma block; and
wherein, if the chroma format information indicates a fourth format, being different
from the third format and being different from the first format and being different
20 from the first format, the data decoder (170) is configured to determine the motion
vector for said chroma subblock depending on each motion vector of exactly two of
the luma subblocks from exactly one column of the two or more columns of the
luma block.
25 9. A video decoder (151) according to claim 8,
wherein the data decoder (170) is configured to determine the motion vector for
said chroma subblock based on:
30 mvAvgLX = ( mvLX[ ( xSbIdx >> SubWidthC << SubWidthC) ]
[ (ySbIdx>> SubHeightC << SubHeightC) ] +
mvLX[ ( xSbIdx >> SubWidthC << SubWidthC ) + SubWidthC ]
[ (ySbIdx>> SubHeightC << SubHeightC) + SubHeightC ] )
35 wherein mvAvgLX is the motion vector for said chroma subblock,
wherein mvLX[][] is the motion vector of one of the luma subblocks,

36
wherein xSbIdx is an x-index of said one of the luma subblocks,
wherein ySbIdx is an y-index of one of the luma subblocks,
5 wherein mvAvgLX[ 0 ] is defined according to
mvAvgLX[ 0 ] = ( mvAvgLX[ 0 ] >= 0 ?
( mvAvgLX[ 0 ] + 1) >> 1 :
− ( (− mvAvgLX[ 0 ] + 1 ) >>1 ) )
10
wherein mvAvgLX[ 1 ] is defined according to
mvAvgLX[ 1 ] = ( mvAvgLX[ 1 ] >= 0 ?
( mvAvgLX[ 1 ] + 1) >> 1 :
15 − ( (− mvAvgLX[ 1 ] + 1 ) >> 1 ) ).
wherein SubWidthC and SubHeightC are defined according to:
Chroma Format SubWidthC SubHeightC
4:2:0 1 1
4:2:2 1 0
4:4:4 0 0
20 10. A video encoder (101) for encoding a plurality of pictures of a video by generating
an encoded video signal, wherein each of the plurality of pictures comprises
original picture data, wherein the video encoder (101) comprises:
a data encoder (110) configured for generating the encoded video signal
25 comprising encoded picture data, wherein the data encoder (110) is configured to
encode the plurality of pictures of the video into the encoded picture data, and
an output interface (120) configured for outputting the encoded picture data of
each of the plurality of pictures,
30
wherein the data encoder (110) is configured to generate the encoded video signal
such that the encoded video signal comprises an encoding of chroma format

37
information and an encoding of motion information of one or more of a plurality of
luma subblocks.
11. A method for decoding an encoded video signal comprising encoded picture data
5 to reconstruct a plurality of pictures of a video, wherein the method comprises:
for receiving the encoded video signal, and
reconstructing the plurality of pictures of the video by decoding the encoded
10 picture data,
wherein reconstructing the plurality of pictures comprises decoding chroma format
information encoded within the encoded video signal,
15 wherein reconstructing the plurality of pictures comprises determining motion
information for a chroma subblock of a plurality of chroma subblocks from motion
information of one or more of a plurality of luma subblocks depending on the
chroma format information,
20 wherein reconstructing the plurality of pictures is conducted depending on the
motion information of the one or more of the luma subblocks and depending on the
motion information for the chroma subblock.
12. A method for encoding a plurality of pictures of a video by generating an encoded
25 video signal, wherein each of the plurality of pictures comprises original picture
data, wherein the method comprises:
generating the encoded video signal comprising encoded picture data, wherein
generating the encoded video signal comprises encoding the plurality of pictures of
30 the video into the encoded picture data, and
outputting the encoded picture data of each of the plurality of pictures,
wherein generating the encoded video signal is conducted such that the encoded
35 video signal comprises an encoding of chroma format information and an encoding
of motion information of one or more of a plurality of luma subblocks.

38
13. A computer program for implementing the method of claim 11 or 12 when being
executed on a computer or signal processor.
14. An encoded video signal encoding a picture, wherein the encoded video signal
5 comprises encoded picture data encoding the picture,

wherein the encoded video signal further comprises an encoding of chroma format
information and an encoding of motion information of one or more of a plurality of
luma subblocks.
10
15. A system comprising:
the video encoder (101) according to claim 10, and
15 the video decoder (151) according to one of claims 1 to 9,
wherein the video encoder (101) configured to generate the encoded video signal,
and
20 wherein the video decoder (151) is configured to decode the encoded video signal
to reconstruct the picture of the video.
16. A video encoder (101) for encoding a plurality of pictures of a video by generating
an encoded video signal, wherein each of the plurality of pictures comprises
25 original picture data, wherein the video encoder (101) comprises:
a data encoder (110) configured for generating the encoded video signal
comprising encoded picture data, wherein the data encoder (110) is configured to
encode the plurality of pictures of the video into the encoded picture data, and
30
an output interface (120) configured for outputting the encoded picture data of
each of the plurality of pictures,
wherein a video session comprises a plurality of coded video sequences, wherein
35 a CVS profile of a plurality of video profiles is assigned to each coded video
sequence of the plurality of coded video sequences, wherein the CVS profile of
said coded video sequence defines one or more tools of a plurality of tools that are
needed to decode said coded video sequence, wherein each of the plurality of

39
video profiles defines at least one tool that is needed to decode at least one of the
plurality of coded video sequences,
wherein the data encoder (110) is configured to determine a session profile for the
5 video session depending on the CVS profiles of the plurality of coded video
sequences of the video session, wherein the session profile defines at least one
tool from the plurality of tools that is needed to decode the plurality of coded video
sequences of the video session,
10 wherein the data encoder (110) is configured to generate the encoded video signal
such that the encoded video signal comprises an encoding of an indication that
indicates the session profile,
wherein the data encoder (110) is configured to determine the session profile from
15 the plurality of video profiles such that the session profile comprises all tools of the
plurality of tools that are needed to decode all coded video sequences of the video
session.
17. A video encoder (101) according to claim 16,
20
wherein the data encoder (110) is configured to determine the session profile such
that the session profile is a union of at least two of the plurality of video profiles, if
there exists no video profile among the plurality of video profiles that comprises all
tools of the plurality of tools that are needed to decode all coded video sequences
25 of the video session.
18. A video decoder (151) for decoding an encoded video signal comprising encoded
picture data to reconstruct a plurality of pictures of a video, wherein the video
decoder (151) comprises:
30
an input interface (160) configured for receiving the encoded video signal, and
a data decoder (170) configured for reconstructing the plurality of pictures of the
video by decoding the encoded picture data,
35
wherein the data decoder (170) is configured to decode from the encoded video
signal a session profile for a video session comprising a plurality of coded video
sequences, wherein each of a plurality of video profiles defines at least one tool

40
from a plurality of tools that is needed to decode at least one of the plurality of
coded video sequences, wherein the session profile defines at least one tool from
the plurality of tools that is needed to decode the plurality of coded video
sequences of the video session,
5
wherein the data decoder (170) is configured to reconstruct the plurality of pictures
of the video depending on the session profile.
19. A video decoder (151) according to claim 18,
10
wherein the session profile is a union of at least two of the plurality of video
profiles.
20. A method for encoding a plurality of pictures of a video by generating an encoded
15 video signal, wherein each of the plurality of pictures comprises original picture
data, wherein the method comprises:
generating the encoded video signal comprising encoded picture data, wherein
generating the encoded video signal comprises encoding the plurality of pictures of
20 the video into the encoded picture data, and
outputting the encoded picture data of each of the plurality of pictures,
wherein a video session comprises a plurality of coded video sequences, wherein
25 a CVS profile of a plurality of video profiles is assigned to each coded video
sequence of the plurality of coded video sequences, wherein the CVS profile of
said coded video sequence defines one or more tools of a plurality of tools that are
needed to decode said coded video sequence, wherein each of the plurality of
video profiles defines at least one tool that is needed to decode at least one of the
30 plurality of coded video sequences,
wherein the method comprises determining a session profile for the video session
depending on the CVS profiles of the plurality of coded video sequences of the
video session, wherein the session profile defines at least one tool from the
35 plurality of tools that are needed to decode the plurality of coded video sequences
of the video session,

41
wherein generating the encoded video signal is conducted such that the encoded
video signal comprises an encoding of an indication that indicates the session
profile,
5 wherein determining the session profile from the plurality of video profiles is
conducted such that the session profile comprises all tools of the plurality of tools
that are needed to decode all coded video sequences of the video session.
21. A method for decoding an encoded video signal comprising encoded picture data
10 to reconstruct a plurality of pictures of a video, wherein the method comprises:
for receiving the encoded video signal, and
reconstructing the plurality of pictures of the video by decoding the encoded
15 picture data,
wherein the method comprises decoding from the encoded video signal a session
profile for a video session comprising a plurality of coded video sequences,
wherein each of a plurality of video profiles defines at least one tool from a plurality
20 of tools that is needed to decode at least one of the plurality of coded video
sequences, wherein the session profile defines at least one tool from the plurality
of tools that is needed to decode the plurality of coded video sequences of the
video session,
25 wherein reconstructing the plurality of pictures of the video is conducted depending
on the session profile.
22. A computer program for implementing the method of claim 20 or 21 when being
executed on a computer or signal processor.
30
23. An encoded video signal encoding a picture, wherein the encoded video signal
comprises encoded picture data encoding the picture,

wherein a video session comprises a plurality of coded video sequences, wherein
35 a CVS profile of a plurality of video profiles is assigned to each coded video
sequence of the plurality of coded video sequences, wherein the CVS profile of
said coded video sequence defines one or more tools of a plurality of tools that are
needed to decode said coded video sequence, wherein each of the plurality of

42
video profiles defines at least one tool that is needed to decode at least one of the
plurality of coded video sequences,
wherein the session profiles for the video session depends on the CVS profiles of
5 the plurality of coded video sequences of the video session,
wherein the encoded video signal comprises an encoding of an indication that
indicates the session profile,
10 wherein the session profile comprises all tools of the plurality of tools that are
needed to decode all coded video sequences of the video session.
24. A system comprising:
15 the video encoder (101) according to claim 16 or 17, and
the video decoder (151) according to claim 18 or 19,
wherein the video encoder (101) configured to generate the encoded video signal,
20 and
wherein the video decoder (151) is configured to decode the encoded video signal
to reconstruct the picture of the video.
25 25. A video encoder (101) for encoding a plurality of pictures of a video by generating
an encoded video signal, wherein each of the plurality of pictures comprises
original picture data, wherein the video encoder (101) comprises:
a data encoder (110) configured for generating the encoded video signal
30 comprising encoded picture data, wherein the data encoder (110) is configured to
encode the plurality of pictures of the video into the encoded picture data, and
an output interface (120) configured for outputting the encoded picture data of
each of the plurality of pictures,
35
wherein the data encoder (110) is configured to generate the encoded video signal
by encoding a sequence parameter set and by encoding a supplemental
enhancement information message, wherein the sequence parameter set relates

43
to two or more of the plurality of pictures and comprise a first group of one or more
syntax elements of a plurality of syntax elements, and wherein the supplemental
enhancement information message relates to exactly one of the plurality of
pictures and comprises a second group of one or more syntax elements of the
5 plurality of syntax elements,
wherein the data encoder (110) is configured to generate the sequence parameter
set and the supplemental enhancement information message such that the
sequence parameter set does not comprise at least one syntax element of the
10 second group of syntax elements of the supplemental enhancement information
message, and such that the sequence parameter set does not comprise length
information for said at least one syntax element of the second group of syntax
elements of the supplemental enhancement information message.
15 26. A video encoder (101) according to claim 25,
wherein the data encoder (110) is configured to generate the sequence parameter
set and the supplemental enhancement information message such that the
sequence parameter set does not comprise at least one further syntax element of
20 the second group of syntax elements of the supplemental enhancement
information message, and such that the sequence parameter set does not
comprise presence information for said at least one further syntax element of the
second group of syntax elements of the supplemental enhancement information
message.
25
27. A video encoder (101) according to claim 25 or 26,
wherein the data encoder (110) is configured to generate the sequence parameter
set such that the sequence parameter set comprises at least one first syntax
30 element of the plurality of syntax elements that comprises session negotiation
information and/or capability negotiation information,
wherein the data encoder (110) is configured to generate the supplemental
enhancement information message such that the supplemental enhancement
35 information message does not comprise said at least one first syntax element that
comprises the session negotiation information and/or the capability negotiation
information,

44
wherein the data encoder (110) is configured to generate the supplemental
enhancement information message such that the supplemental enhancement
information message comprises at least one second syntax element of the plurality
of syntax elements that does not comprise the session negotiation information
5 and/or the capability negotiation information, and
wherein the data encoder (110) is configured to generate the sequence parameter
set such that the sequence parameter set does not comprise said at least one
second syntax element that does not comprise session negotiation information
10 and/or capability negotiation information.
28. A video encoder (101) according to one of claims 25 to 27,
wherein the data encoder (110) is configured to generate the sequence parameter
15 set such that the sequence parameter set comprises all syntax elements of the
plurality of syntax elements that comprise session negotiation information and/or
capability negotiation information,
wherein the data encoder (110) is configured to generate the supplemental
20 enhancement information message such that the supplemental enhancement
information message does not comprise said any of the plurality of syntax
elements that comprises the session negotiation information and/or the capability
negotiation information,
25 wherein the data encoder (110) is configured to generate the supplemental
enhancement information message such that the supplemental enhancement
information message comprises all syntax elements of the plurality of syntax
elements that do not comprise the session negotiation information and/or the
capability negotiation information, and
30
wherein the data encoder (110) is configured to generate the sequence parameter
set such that the sequence parameter set does not comprise any of the plurality of
syntax elements that does not comprise session negotiation information and/or
capability negotiation information.
35
29. A video encoder (101) according to one of claims 25 to 28,

45
wherein the supplemental enhancement information message is a Buffering Period
supplemental enhancement information message, or is a Timing supplemental
enhancement information message, or is a Decoding Unit supplemental
enhancement information message.
5
30. A video encoder (101) according to one of claims 25 to 29,
wherein, for at least one syntax element of the plurality of syntax elements, the
data encoder (110) is configured to generate the sequence parameter set and the
10 supplemental enhancement information message such that the sequence
parameter set comprises said at least one syntax element and such that the
supplemental enhancement information message also comprises said syntax
element, and
15 wherein the data encoder (110) is configured to generate the sequence parameter
set and the supplemental enhancement information message such that for each of
the plurality of syntax elements that is present in the sequence parameter set and
that is also present in the supplemental enhancement information message, a
value of said syntax element is equal in the sequence parameter set and in the
20 supplemental enhancement information message.
31. A video decoder (151) for decoding an encoded video signal comprising encoded
picture data to reconstruct a plurality of pictures of a video, wherein the video
decoder (151) comprises:
25
an input interface (160) configured for receiving the encoded video signal, and
a data decoder (170) configured for reconstructing the plurality of pictures of the
video by decoding the encoded picture data,
30
wherein the data decoder (170) is configured to decode from the encoded video
signal a sequence parameter set and a supplemental enhancement information
message, wherein the sequence parameter set relates to two or more of the
plurality of pictures and comprise a first group of one or more syntax elements of a
35 plurality of syntax elements, and wherein the supplemental enhancement
information message relates to exactly one of the plurality of pictures and
comprises a second group of one or more syntax elements of the plurality of
syntax elements, wherein the sequence parameter set does not comprise at least

46
one syntax element of the second group of syntax elements of the supplemental
enhancement information message, and wherein the sequence parameter set
does not comprise length information for said at least one syntax element of the
second group of syntax elements of the supplemental enhancement information
5 message.
wherein the data decoder (170) is configured to reconstruct the plurality of pictures
of the video depending on the sequence parameter set and depending on the
supplemental enhancement information message.

32. A video decoder (151) according to claim 31,
wherein, for at least one syntax element of the plurality of syntax elements, the
sequence parameter set comprises said at least one syntax element and such that
15 the supplemental enhancement information message also comprises said syntax
element, and
wherein, for each of the plurality of syntax elements that is present in the sequence
parameter set and that is also present in the supplemental enhancement
20 information message, a value of said syntax element is equal in the sequence
parameter set and in the supplemental enhancement information message.