“METHOD AND SYSTEM FOR STREAMING MJPEG IMAGES SUPERIMPOSED OVER A RUNNING VIDEO”

APPLICANT
(a) NAME: MYBOX TECHNOLOGIES PVT. LTD.
(b) NATIONALITY: Indian
(c) ADDRESS: A 27, 2nd Floor, Mohan Cooperative Industrial Estate New Delhi – 110044, INDIA

The following specification particularly describes and ascertains the nature of this invention and the manner in which it is to be performed.
FIELD OF INVENTION
[001] The present invention generally relates to video and image streaming systems and method. More particularly, the present invention relates to method and system for streaming image data continuously superimposed on a running video.

BACKGROUND OF INVENTION
[002] A well-known concept of video broadcast called Picture in Picture (PIP) is used to show one video superimposed in window on top of another running video. Two simultaneous videos can thus be shown to the user on the display device such as a TV.
[003] A set top box for a television is built around a SOC with software running on it to show content on a connected display device like a TV. This set top box can be showing video from a terrestrial antenna, a cable connection, a satellite link or an internet connection for streaming video. To keep the costs low, most STB SOC have a single video decoder which means only a single stream of video can be decoded and shown to the user at a time. If another video is to be shown then the previous video has to be switched for the new one so a picture in picture mode is not possible in this form with a single decoder.
[004] A variety of technologies exist around PIP functionality. One of the patented technology such as a patent numbered KR980013397A displays a camera signal of a door phone on a sub-screen of a PIP screen in a television having a PIP (Picture In Picture) function, so that even if a separate door phone dedicated display device is not provided, and a switching IC for selecting one of a sub-picture signal and a door phone camera signal by using a door phone built-in PIP function built-in television, and a microcomputer for recognizing and automatically controlling the signal.
[005] Another patent numbered JPH07250310A provides the superimposition processing a command onto a synchronizing signal to a television camera 1 and a universal head 2 with an encoder 4 and the extract processing extracting a telemetry superimposed on a video signal from a television camera 1 and the universal head 2 by a decoder 8 via a CPU 3 are implemented only within a prescribed period and the execution of the other processing is inhibited within the period. After the end of the execution of the superimposing processing and the extract processing, the inhibited execution is released. The superimposing processing, the extract processing and the other processing are executed as separate tasks. Since one processor is enough for the processing, the controller is economical and since there is no period when the processor is not in operation, the processing efficiency is improved
[006] However, the existing technologies, including the above patents, usually have more than one decoders in order to have a PIP functionality or to show a video superimposed on the video streaming, or they have a single decoder to just a single image banner on a streaming video.
[007] Additionally, in order to view an image data captured from a camera which is either connected to the TV or to the set top box, while viewing a video, one needs to stop or pause the running video, switch the mode in the TV to camera mode, and view the image. The user is not able to view the camera mode simultaneously superimposed over the running video. Also, the user is not able to view a video being captured from the camera simultaneously superimposed over the running video. One has to switch the video mode to the camera mode to view any type of feed from the camera.
[008] Hence, none of the existing technologies have the ability to provide a video superimposed over a running video with a conventional set top box with only one decoder, where the image or the video is captured from a camera connected to the display device such as TV or to the set top box.
[009] Therefore, there is a need for a method and a system that provides capability to the set top boxes present in the market to continuously stream images captured from a digital capturing device and superimpose the image stream over a running video at a display device, such as TV, hence simulating a video effect superimposed over a streaming video.

SUMMARY OF INVENTION
[0010] Therefore, it is an objective of the present invention to improve features and functionalities of the set top boxes conventionally present in the market.
[0011] The present invention aims to improve the conventional set top boxes by providing the conventional set top boxes with the capability to continuously stream a plurality of images one after the other, in quick succession, being superimposed over a playing video, thereby simulating video superimposed over a video functionality.
[0012] The present invention provides the conventional set top boxes to receive image feed in motion JPEG format from a digital capturing device; transmit image sequence in motion JPEG format to a display device and superimpose the motion JPEG images over a running video.
[0013] It is an objective of the present invention to employ the conventional set top boxes, with a single decoder, to superimpose motion JPEG images, in quick succession one after the other, over a running video in order to simulate a video effect being streamed over a running video, without a need for the conventional set top boxes to include a second decoder for having a PIP or video over video functionality, and without a need for a user to switch from video display in set top box mode into camera mode.
[0014] One more object of the invention relates to providing streaming the images, in the JPEG format in a sequence received from the digital capturing device, to the display device by way of mimicking/transformation of the images in sequential playback to resemble a video which is capable of being displayed/ superimposed on the running broadcast/telecast/stream.
[0015] Yet another object of the invention is to provide a system for viewing multiple images played in a sequence as a video in motion JPEG format on a layer superimposed over a running video/image by using a set top box, wherein using mimicking/transformation means for sequential playback of images to resemble a video for superimposing on top of broadcasting video.
[0016] The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular descriptions of exemplary embodiments of the invention.

BRIEF DESCRIPTION OF DRAWINGS
[0017] FIG. 1 illustrates an exemplary environment showing a set top box connected to a digital capturing device and a display device, according to an embodiment of the present invention; and
[0018] FIG. 2 illustrates an exemplary environment including the display device which displays a video broadcasted via the set top box in conjunction with simultaneously displaying MJPEG image sequence received from the digital capturing device, in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION
[0019] This patent describes the subject matter for patenting with specificity to meet statutory requirements. However, the description itself is not intended to limit the scope of this patent. The principles described herein may be embodied in many different forms.
[0020] In the known method of viewing a video, the video capturing device usually records and transmits compressed data(audio, video and images) to a decoder which in then turn processes the data(audio video and images) and reencodes it for the suitable display to be broadcasted on by the device. Hence if there is a need to view a video feed on top of another video feed as in picture in picture or video in video mode, you would require one decoder for each video received and broadcasted. Our invention simplifies the process and is able to give you a feed of simulated video superimposed on the existing video or broadcast, by simply using images captured sequentially from a capturing device using motion JPEG and then playing those images in fast sequential order to mimic/transform or give an illusion of video which is superimposed on the existing broadcast or stream currently running which is done on the set top box using a single decoder used just for main broadcast or stream. The mimicking and transformation of the images are performed by arranging the images in a sequential manner, preferably in a compact way and transmitting it to the display device via the set top box. The set top box is capable of transmitting and displaying the arranged sequence of images as if it is a video Which makes it possible to have a similar picture in picture mode or a video in video mode without having the need for the user to switch from the video display in the set top box mode into camera mode. i.e using a single decoder or equivalent means.
[0021] Illustrative embodiments of the invention now will be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. Indeed, the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like numbers refer to like elements throughout.
[0022] The present invention relates to a method for viewing multiple images played in a sequence as a video in MJPEG format on a layer superimposed over a running video/image by using a set top box using a single decoder; the said method comprising steps of:
i. continuously capturing unconstrained images/video sequence in motion JPEG format of an object/scene via a digital capturing device 104;
ii. transmitting the images/video sequence from the digital capturing device 104 to the set top box 102 which is connected to the digital capturing device and a display device over the communication link 108;
iii. displaying the images, in the JPEG format in a sequence received from the digital capturing device 104, in the display device 202 by means of mimicking/transformation of the images in sequential playback to resemble a video, said display device includes a display window 202A over which a broadcasted video is streamed, said display window 202A includes one or more display windows 202B which is superimposed in the form of fast JPEG’s played sequential which appears in the form of a video over the display window 202A, and
iv. simultaneously viewing the images/video received from the digital capturing device 104 at the display window 202B, superimposed over the display 202A, without changing the view mode from the video mode to the camera mode.
[0023] Another embodiment of the present invention relates to a method/system wherein the display device 106 is any device capable of displaying images and video such as televisions, monitors, screens, projectors. Further, present invention also relates to a method/system wherein the digital capturing device 104 is any device which is capable of capturing image and video in motion JPEG format among other format and includes and is not limited to a digital camera or cellphone.
[0024] Yet another embodiment of the present invention relates to a method/system wherein the display device 106 includes and is not limited to HDMI cable connection, display port, optical cable connection, analog cable connection, wireless streaming among others. Further, the method of the invention involves the wireless connection between the set top box 102 and the display device 106 includes and is not limited to WLAN, Wifi, Bluetooth, infrared, NFC(near field communications) and the like and the display device 106 is available within the same network as the set top box 102.
[0025] One more embodiment of the present invention relates to a system for viewing multiple images played in a sequence as a video in motion JPEG format on a layer superimposed over a running video/image by using a set top box comprising:
a digital capturing device (104) for capturing video/images and connected to a set top box 102 via a wired or a wireless connection link 108 for capturing unconstrained images/video sequence in motion JPEG format of an object;
the set top box 102 is connected to a display device 106 via a wired or a wireless connection link 110;
the display device for displaying the images, in the JPEG format, received from the digital capturing device 104, in the display device 202,
Wherein:
the system 100 utilizes a layer on top of a video which is streaming at the display device 106 via the set top box 102, which is conventionally used for displaying images like a channel banner etc. to display image sequences received from the digital capturing device 104;
the set top box 102 conventionally streams a broadcasted video (received from a broadcasting channel) to the display device 106 over the communication link 110; simultaneously, the set top box 102 transmits the received image data from the digital capturing device 104 to the display device 106 over the communication link 110; and displays the received image data from the digital capturing device 104 over the layer superimposed 202B on top of the broadcasting video 202A using mimicking/transformation means for sequential playback of images to resemble a video for superimposing on the layer 202B on top of broadcasting video 202A, said mimicking/transformation means is located in the set top box 102.

[0026] Yet another embodiment of the present invention relates to the system wherein the wireless connection between the set top box 102 and the display device 106 includes and is not limited to WLAN, Wifi, Bluetooth, infrared, NFC(near field communications) and the like and the display device 106 is available within the same network as the set top box 102.
[0027] The present invention provides an improvement in the conventional set top boxes. According to the present invention, the conventional set top box is connected to a digital camera which is able to capture image/video data of an object. The set top box receives the image data from the camera and is able to superimpose and display the image as an overlay on top of a running video without stopping the video stream and changing viewing mode to camera mode for viewing the image from the camera.
[0028] Also, multiple images from the camera are displayed in quick succession on the display device. Such displaying of the motion JPEG images in quick succession simulates a video from the camera. This camera video operates on a much slower frame rate from the TV video but is sufficient to get a quick look at the camera view.
[0029] According to the present invention, the set top box is connected to a digital capturing device, such as a digital camera, that continuously captures unconstrained image and/or video sequence of an object. The digital camera captures the images in the format of Motion JPEG images (MJEPG) stream so the camera used should be capable of sending out a stream with MJPEG compression. JPEG images in this sequence can be shown on a layer used for showing graphics on top of the running video in the set top box.
[0030] Therefore, a user viewing a video at a display device, such as a TV, streamed through a set top box, does not need to change the viewing mode at the display device from set top box to the camera mode for viewing the motion JPEG images captured by the camera. Also, since the camera is able to capture motion JPEG images and transmit the images in motion JPEG format, the set top box is able to display a continuous sequence of motion JPEG images in quick succession over the running video from the set top box. Hence, the set top box does not require any change in configuration or an additional decoder for being able to show the camera mode simultaneously and superimposed over a running video at the display device, and also to simulate a video superimposed over a running video by showing a sequence of motion JPEG images on a layer superimposed over a running video.
[0031] FIG. 1 illustrates an exemplary environment showing a set top box connected to a digital capturing device and a display device, according to an embodiment of the present invention. A method/system 100 includes a set top box 102 connected to a digital capturing device 104 via a wired or a wireless connection link 108. In an embodiment, the wired connection between the set top box 102 and the digital capturing device 104 includes and is not limited to LAN, Ethernet, cable connection, optical cable connection, among others. In an embodiment, the wireless connection between the set top box 102 and the digital capturing device 104 includes and is not limited to WLAN, Wifi, Bluetooth, infrared and the like. While being connected via a WLAN, the digital capturing device 104 is available within the same network as the set top box 102.
[0032] Further, the set top box 102 is connected to a display device 106 via a wired or a wireless connection link 110. In an embodiment, the wired connection between the set top box 102 and the display device 106 includes and is not limited to HDMI cable connection, optical cable connection, analog cable connection among others. In an embodiment, the wireless connection between the set top box 102 and the display device 106 includes and is not limited to WLAN, Wifi, Bluetooth, infrared and the like. While being connected via a WLAN, the display device 106 is available within the same network as the set top box 102.
[0033] In an embodiment, the display device 106 is any device capable of displaying images and video and includes and is not limited to a TV, a monitor display, a laptop, a computer screen, and other display screen. In an embodiment, the digital capturing device 104 is any device which is capable of capturing image and video in motion JPEG format among other format and includes and is not limited to a digital camera.
[0034] According to the present invention, the system 100 utilizes a layer on top of a video, streaming at the display device 106 via the set top box 102, which is conventionally used for displaying images like a channel banner etc. to display images sequence received from the digital capturing device 104. In an embodiment, video sequence received from the digital capturing device 104 may also be displayed, in low format, on the layer on top of the video that is streamed at the display device 106 via the set top box 102.
[0035] The digital capturing device 104 continuously captures unconstrained images/video sequence of an object. The digital capturing device 104 has the capability to stream images sequence in motion JPEG format and so, the digital capturing device 104 continuously captures image data in motion JPEG format (MJPEG) also. The image data in MJPEG format is transmitted from the digital capturing device 104 to the set top box 102 over the communication link 108.
[0036] The set top box 102 conventionally streams a broadcasted video (received from a broadcasting channel) to the display device 106 over the communication link 110. Simultaneously, the set top box 102 transmits the received image data from the digital capturing device 104 to the display device 106 over the communication link 110; and displays the received image data from the digital capturing device 104 over the layer superimposed on top of the broadcasted video. Therefore, the system 100 is able to display an image data received from the digital capturing device 104 over the layer superimposed on top of the broadcasted video via the set top box 102, without a need for the user to change a viewing mode at the display device 106 from the set top box mode or video mode to a camera mode. This is because the image data from the digital capturing device 104 is shown as an overlay on top of the running video without stopping the video stream at the display device 106.
[0037] Furthermore, the set top box 102 also receives multiple sequenced images in the MJPEG format from the digital capturing device 104 over the communication link 108 and transmits the same image sequence in MJPEG format at the display device 106 over the communication link 110. The set top box 102, further, displays the image sequence in MJPEG format as being superimposed over the running broadcasted video at the display device 106. The image sequence in MJPEG format is transmitted and displayed at the display device 106 in quick succession, one after the other, which simulates a video running in MJPEG format over the broadcasted video at the display device 106.
[0038] Therefore, when multiple images from the digital capturing device 104 are shown in quick succession, it looks like a video from the digital capturing device 104 is being displayed at the display device 106. This video from the digital capturing device 104 operates on a much slower frame rate from the display device 106 video but is sufficient to get a quick look of the view from the digital capturing device 104.
[0039] FIG. 2 illustrates an exemplary environment including the display device which displays a video broadcasted via the set top box in conjunction with simultaneously displaying MJPEG image sequence received from the digital capturing device, in accordance with an embodiment of the present invention. The exemplary environment 200 shows a display screen 202 of the display device 106. The display screen 202 includes a display 202A over which a broadcasted video is streamed. This video is received by the set top box 102 from a broadcasting network and is decoded by the set top box 102 before being transmitted to the display device 106, over the communication link 110, and displayed at the portion of display 202A. The display screen 202 also includes a display window 202B which is a layer superimposed over the display 202A. The images, in the MJPEG format, received from the digital capturing device 104, are displayed over the display 202B. Hence, the images from the digital capturing device 104 are simultaneously viewed at the display window 202B, superimposed over the display 202A, without changing the view mode from the video mode to the camera mode.
[0040] Advantageously, the present invention provides a system for viewing multiple images in MJPEG format on a layer superimposed over a running video at the display device. The present invention does not require any change in the configuration of the conventional set top box, including need of more decoders, for allowing the conventional set top box to receive, transmit and display multiple images in MJPEG format as being superimposed over a running video at the display device.
[0041] Further, the present invention improves the conventional set top box to display multiple images in MJPEG format, in quick succession one after the other, as being superimposed over a running video at the display device, which provides a simulation of video over video functionality to the set top box and the display device, without using multiple decoders in the set top box. Furthermore, the present invention does not require a user to change the view mode of broadcasting video to camera mode for viewing camera feed, because the present invention improves the conventional set top box to simultaneously display multiple images in MJPEG format as being superimposed over a running video at the display device.
[0042] While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the present disclosure. Indeed, the novel methods, devices, and systems described herein may be embodied in a variety of other forms. Furthermore, various omissions, substitutions, and changes in the form of the methods, devices, and systems described herein may be made without departing from the spirit of the present disclosure.

,CLAIMS:We claim:
1. A method for viewing multiple images played in a sequence as a video in MJPEG format on a layer superimposed over a running video/image by using a set top box using a single decoder; the said method comprising steps of:

i. continuously capturing unconstrained images/video sequence in motion JPEG format of an object/scene via a digital capturing device 104;
ii. transmitting the images/video sequence from the digital capturing device 104 to the set top box 102 which is connected to the digital capturing device and a display device over the communication link 108;
iii. displaying the images, in the JPEG format in a sequence received from the digital capturing device 104, in the display device 202 by means of mimicking/transformation of the images in sequential playback to resemble a video, said display device includes a display window 202A over which a broadcasted video is streamed, said display window 202A includes one or more display windows 202B which is superimposed in the form of fast JPEG’s played sequential which appears in the form of a video over the display window 202A, and
iv. simultaneously viewing the images/video received from the digital capturing device 104 at the display window 202B, superimposed over the display 202A, without changing the view mode from the video mode to the camera mode.

2. The method as claimed in claim 1, wherein the display device 106 is any device capable of displaying images and video such as televisions, monitors, screens, projectors.

3. The method as claimed in claim 1 or 2 wherein the digital capturing device 104 is any device which is capable of capturing image and video in motion JPEG format among other format and includes and is not limited to a digital camera or cellphone.

4. The method as claimed in any one of claims 1,2 or 3 wherein the display device 106 includes and is not limited to HDMI cable connection, display port, optical cable connection, analog cable connection, wireless streaming among others.

5. The method as claimed in anyone of claims 1,2,3 or 4 wherein the wireless connection between the set top box 102 and the display device 106 includes and is not limited to WLAN, Wifi, Bluetooth, infrared, NFC(near field communications) and the like and the display device 106 is available within the same network as the set top box 102.

6. A system for viewing multiple images played in a sequence as a video in motion JPEG format on a layer superimposed over a running video/image by using a set top box comprising:
a digital capturing device (104) for capturing video/images and connected to a set top box 102 via a wired or a wireless connection link 108 for capturing unconstrained images/video sequence in motion JPEG format of an object;
the set top box 102 is connected to a display device 106 via a wired or a wireless connection link 110;
the display device for displaying the images, in the JPEG format, received from the digital capturing device 104, in the display device 202,
Wherein:
the system 100 utilizes a layer on top of a video which is streaming at the display device 106 via the set top box 102, which is conventionally used for displaying images like a channel banner etc. to display image sequences received from the digital capturing device 104;
the set top box 102 conventionally streams a broadcasted video (received from a broadcasting channel) to the display device 106 over the communication link 110; simultaneously, the set top box 102 transmits the received image data from the digital capturing device 104 to the display device 106 over the communication link 110; and displays the received image data from the digital capturing device 104 over the layer superimposed 202B on top of the broadcasting video 202A using mimicking/transformation means for sequential playback of images to resemble a video for superimposing on the layer 202B on top of broadcasting video 202A, said mimicking/transformation means is located in the set top box 102.

7. The system as claimed in claim 6, wherein the display device 106 is any device capable of displaying images and video such as televisions, monitors, screens, projectors.

8. The system as claimed in claim 6 or 7 wherein the digital capturing device 104 is any device which is capable of capturing image and video in motion JPEG format among other format and includes and is not limited to a digital camera or cellphone.

9. The system as claimed in any one of the claims 6,7 or 8 wherein the display device 106 includes and is not limited to HDMI cable connection, display port, optical cable connection, analog cable connection, wireless streaming among others.

10. The system as claimed in any one of the claims 6,7,8 or 9 wherein the wireless connection between the set top box 102 and the display device 106 includes and is not limited to WLAN, Wifi, Bluetooth, infrared, NFC(near field communications) and the like and the display device 106 is available within the same network as the set top box 102.