FORM-2
THE PATENTS ACT, 1970
(39 OF 1970)
COMPLETE SPECIFICATION
"A SYSTEM FOR LIVE INTERACTIVE VIDEO STREAMING FOR
MASSES"
Vmukti Solutions Pvt. Ltd.
A Company Incorporated under the Indian Companies Act,
Having address at, VMukti House,
13, Aaryan Corporate Park, Shilaj-Thaltej Road,
Thaltej, Ahmedabad-380 064,
Gujarat State, INDIA
The following specification particularly describes the nature of this invention and the manner in which it is to be performed: -
FIELD OF INVENTION:
The present invention relates to a system for live interactive video streaming for masses (live talk and interactive video conference). It more particularly relates to a system which broadcasts any event in real time with low bandwidth and minimum streaming delay timing in full screen with high quality video.
BACKGROUND OF THE INVENTION:
There are several systems available which broadcast live event in real time. Live Event Streaming allows a user to broadcast a live event in real time via Internet. Broadcasting is the distribution of audio and video content to a dispersed audience via radio, television, or other media (internet), often digital transmission media. Web casting is the broadcasting of any data via internet. With the evolution of Broadband, Web casting (in terms of broadcasting) is used as a premier business communication tool in everyday business activities. There are several types of web casting/broadcasting available including: Live broadcasting, Scheduled broadcasting, On-demand broadcasting and Embed live video.
A successful Live Streaming Event broadcast is the full screen broadcast. Full screen broadcast refers to a high quality audio and video, which should be viewed by each one of the audience members without any difficulties with high quality wherein high quality refers to a full screen broadcast with minimum streaming delay and also with having low bandwidth availability.
Streaming delay refers to a broadcast delay wherein a broadcast delay is the difference in time between the point when live audio and video is encoded and when it is played back and it is created primarily by the buffers that store digital media data.
Mainly three factors require to be consider for high quality live streaming broadcast which are; Network Capacity, Server Capacity, Audience bandwidth availability.
• Network capacity deals with the maximum upload speed of the Internet connection at the location of the Live Event Broadcast.
• Server Capacity deals with the multiple hardware parts of the system.
• Audience bandwidth availability deals with the connection capabilities of the audience. Whether they have dial up connection or broadband/bandwidth.
Bandwidth is a key feature for broadcasting any event in real time. Bandwidth refers to a rate of data transfer via internet. Generally at remote area, users do not have the availability of high bandwidth. With low bandwidth they do not get high quality streaming at their end. To get the high quality live streaming broadcast, user must be equipped with high bandwidth which is costly and sometime non available also.
Bandwidth utilization is dependant on the compression and decompression of audio-video media signal. The said audio-video media signals consume huge amount of bandwidth. Codec is used for the said compression and decompression of the said audio-video media signal. There are many types of Codec available but they are quit costly which further cost to the whole system.
Bandwidth is a key feature for broadcasting of any event. Audio-video media signals consume huge amounts of bandwidth depending on the preferred transmission quality. As a result, data compression of audio-video signal has key role in broadcasting. High quality output is mainly depending on the type of Codec used for the said data compression. In the present system a Codec is used for the said compression and decompression of the said media signal.
There are many types of Codec available. Generally most of the Codec used in broadcasting models are lossy Codec meaning loss data during compression and decompression of the media signal. Some of the Codec are lossless which are used to get quality output, but these Codec use more bandwidth utilization as costly. A video signal may change from sight to sight.
Moreover, there are various systems available which broadcast events in real time having one-to-many interactivity through which a guest cannot communicate with /ask any question to the host video.
PRIOR ART:
US Patent No 7,679,637 discloses time-shifted web conferencing which, in one aspect has time-shifting capabilities. Session content is recorded so that participants are able to observe the session in real-time, delayed while the session is still in progress, or after the session has completed. Participants are also able to observe the session at normal, slower, or
faster speeds, while maintaining substantially consistent perceived audio quality.
US Patent No 7,412,531 discloses a method for recording a complete stream of live data packets from a server in a media cache with reduced server-cache bandwidth includes utilizing a first amount of server-cache bandwidth to receive only a portion of the complete stream of live data packets from the server, determining when the stream of live data packets from the server finishes, thereafter utilizing a second amount of server-cache bandwidth to receive missing portions of the complete stream of live data packets, and combining the portion of the complete stream of live data packets and the missing portions of the complete stream of live data packets to form the complete stream of live data packets in the memory.
US Patent no 7,734,088 discloses Methods and systems for Low-bandwidth image streaming which are disclosed for processing image frames to reduce the bandwidth requirements. Embodiment of the present invention may include mode-specific image frame rendering in photorealistic and non-photorealistic modes, such as outline and cartoon modes. In embodiments, update regions may be identified and reduced by an edge position mask. In embodiments, update regions may be bounded by rectangles and such regions may be reduced in number by merging regions together using various no-cost or cost approaches. To improve compressibility, regions to be transmitted that do not require updating at the receiver may be encoded as transparent.
DISADVANTAGES OF PRIOR ART:
The above patented innovation numbered as 7,679,637 discloses time-shifted web conferencing which does not have any option for live interactivity nor is defined with low bandwidth.
US Patent no 7,412,531 discloses the methods and apparatus for caching and serving streaming media with reduced server-cache bandwidth consumption and increased performance wherein live Streaming interactivity is not defined as well as it has comparatively high streaming delay timing.
US Patent no 7,734,088 relates to reducing the bandwidth required to transmit video images wherein real time interactivity and system for reducing streaming delay timing is not defined.
As described above a variety of approaches have been used previously which deliver live streaming media data to multiple client systems in real time. Some systems for broadcasting streaming media to multiple clients are known as Ustream broadcast model, Dimdim broadcast model, live stream broadcast model and alike.
Popularly available systems have following drawbacks:
• Requirement of high bandwidth (more than 100 kbps).
• No facility for live interactivity.
• High streaming delay timing. (> 4-5 seconds).
• Most of them do not provide full screen high quality video.
• Most of them do not provide video library of live as well as pre-recorded events.
• Most of them do not allow thousands of participants in a single server.
• Most of them do not provide facility for one-to-many interactivity through which guest can ask a query to the host video.
In view of above, there is a need of a system which provides a live interactive video streaming for masses which can broadcast any event in real time with full screen high quality video, available with low bandwidth also and which provides minimum streaming delay timing thus making the system economical.
OBJECTS OF THE INVENTION:
The main object of the present invention is to provide a system for live interactive video streaming for masses which broadcast any event in real time with low bandwidth and minimum streaming delay timing.
Another object of the present invention is to provide a system for live interactive video streaming for masses which provides broadcasting of full screen high quality audio-video resolutions.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which provides live interactivity with full screen.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which can also be used in remote area due to the broadcasting of any event in real time with low bandwidth.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which facilitates presentation sharing and moderated audio-video interactivity including chat functionality.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which provides one-to-many interactivity through which guest can ask a query to the host video by chat functionality.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which allows more than 15,000 participants on single server.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which allows host and the administrator to record live sessions and upload them using auto upload functionality.
Yet another object of the present invention is to provide a system for live interactive video streaming for masses which provides online education.
Further object of the present invention is to provide a system for live interactive video streaming for masses which is user friendly and economical.
BRIEF DESCRIPTION OF THE DRAWINGS;
Fig. 1 shows the block diagram of the system for live interactive video streaming for masses.
Fig.2 shows the flowchart representing the functionality of the encoder client (EC).
Fig.3 shows the block diagram representing the processing of encoded data.
Fig.4 shows the flowchart representing the functionality of the encoder server (ES).
Fig.5 shows the flowchart representing the functionality of the decoder viewer (ES),
Fig.6 shows the block diagram representing the multiple participants (up to 15,000), participating on single server.
Fig.7 shows the block diagram representing the classroom setup for online education.
DETAIL DESCRIPTION OF THE INVENTION:
A system for live interactive video streaming for masses as shown in Fig. 1, characterized in which the said system mainly comprises of:
• Encoder Client (EC);
• Encoder Server (ES) and
• Decoder Viewer (DV).
The present system for live interactive video streaming, provides the screen capture, live videos, recorded videos, mobile live, live interaction between the participants by chat functionality and uploading recorded videos facilities in the following manner.
As shown in Fig. 1, the communicating media signals between client and viewer is through the encoder server (ES), wherein a encoder client (EC) compresses the audio-video data input and creates the compressed media signals which are transferred to the encoder server (ES), which further transfers the said compressed media signals to the decoder viewer (DV) for decompressing the said signals. The decoder viewer (DV) decompresses the received compressed media signals and allows the viewer to view the decoded data. A Codec used in the encoder client (EC) and the decoder viewer (DV) respectively for compression and decompression is H.264.
Referring to Fig.2, the working of encoder client (EC) characterized in the present system is verified, when the client wants to broadcast any live event or recording of any such events, in form of audio-video. In case of successful working of the encoder client (EC), the input data is compressed successfully and in case of failure of the working of the said
encoder client (EC), internet connectivity is verified. If the internet is connected, the availability of the port 8080 is verified and if the internet is not connected, verification from primary level starts again. In case, the port 8080 is available, the encoder client (EC) connects to the audio-video device and if the said port 8080 is not available, an error message is received and verification from primary level starts again. Once the encoder client (EC) is connected with the audio-video device, the proxy authentication is checked and in case of the failure of the connection with the said device, an error message is received and verification from primary level starts again. In case of successful proxy authentication, the configuration file is verified and in case of failure of the proxy authentication, an error message is received and verification from primary level starts again. If the configuration file is found to be correct in XML Parser, the input data is encoded through the H.264 Codec and if configuration file is incorrect, verification from primary level starts again. Once the data from the client is encoded successfully by encoder client (EC), the compressed media signals for the encoded data, are transferred to the encoder server (ES).
As shown in Fig. 3, after the input data is encoded by the encoder client (EC), the height- width, format and rate of the encoded data are verified by the identification module. The selection module selects the audio/video type data and handles them according to their type. The process frame module processes the audio/video frames and writing module writes the said audio/video frames to the new files. The new files where the audio/video frames are written have .AVI extension.
The audio-video file from particular client is stored on the particular device from where that particular file is encoded. After the encoding of the input audio-video file by the encoder client (EC) successfully, that
particular file is uploaded on the portal given to the user for viewing that particular audio-video file.
The encoder server (ES) connects the particular viewer to particular client by video name. The encoder client (EC) sends the encoded data to the encoder server (ES) over given server IP with a video name and the decoder viewer (DV) receives the said data form the same server via video name and decodes them to enable the viewer to view that particular audio-video file. In the present system, no data is stored in the encoder server (ES), which reduces the server load significantly
Referring to Fig.4, the working of the encoder server (ES) characterized in the present system is verified. In case of successful working of the encoder server (ES), the request from client or viewer is accepted and in case of failure of the working of the said encoder server (ES), the availability of port 80 is checked. If the bort 80 is available, the configuration file is verified and in case of failure of port 80 availability, an error message is received and the configuration file is corrected and verification from primary level starts again. If the configuration file is found to be correct in XML Parser, the encoder server (ES) accepts the request from client/viewer and if configuration file is incorrect, the said configuration file is corrected and verification from primary level starts again.
The viewer sends the request to the encoder server (ES) for viewing particular audio-video file by the name and on acceptance of such request by the said encoder server (ES), the portal for viewing the particular requested audio-video file is provided to the viewer.
The decoder viewer (DV) decodes the audio-video available to viewers. encoder client (EC) and makes the decoded data available to viewers.
The present system works on rate control algorithm, wherein, the size of the rate buffer at decoder side is the key factor, which determines how much the bit allocation can vary locally in Constant Bit Rate (CBR) operation. In case, the rate buffer in the decoder is small, there is relatively less ability for the local bit allocation for a segment of the audio-video content to vary. However, if the rate buffer is large, the buffer can be used effectively (although with high end-to-end delay) to allow the number of bits per picture to vary in different parts of the content while retaining CBR flowing into the buffer.
The present system allows the minimum streaming delay which is 2 seconds.
Referring to Fig.5, the decoder viewer (DV) characterized in the present system, receives the encoded data from the encoder server (ES). The said encoder server (ES) provides portal to viewers for viewing the particular audio-video file and verifies the auto detect proxy logic for connection portal and it is found to be valid, Retbytes is verified. If the Retbytes is found to be within range, data length is verified and if it is found to be appropriate, viewer starts viewing the video and incase of wrong length, the viewer is not able to view the video. In case, if the Retbytes is not within the range, the viewer fails to view the file.
The present system facilitates the viewers, to have live interactivity with full screen high quality audio-video resolutions.
As shown in Fig.6, multiple participants up to 15,000 are allowed to participate on single server. As shown in the figure, the present system allows 15,000 encoder clients (EC) and decoder viewers (DV) to connect on the single encoder server (ES). As the capacity of one encoder server
(ES) exceeds, the requests from the new clients and viewers are automatically passed to the other encoder server (ES).
WORKING OF THE INVENTION:
The present system can be operated for viewing any real time event/ recorded video/ presentation and uploading any video/presentation. Streaming through the encoder client (EC) can be started by first clicking on "Encoder Client", then login with provided username and password. Then search the desired video/presentation by typing the specific name of that video/presentation and select audio and video source from the drop down list, followed by selecting the video size and clicking on start button. A message delivers on successful streaming and the viewer is able to view the desired live event video/recorded video/presentation on the particular portal provided.
The viewers can also interact with presenter/host by passing the text message or by clicking on "Raise Hand" button and if the said presenter/host allows the request from the said viewer, they both can have live interaction.
Any prerecorded video or presentation can be uploaded through the present system by first log in with provided username and password in the streaming portal and click on upload button, followed by putting the video/presentation name and all other information and select the video type recorded/video type presentation. Then click on the browser button and select the particular video/presentation to be uploaded. Agree the terms and conditions and click on the submit button to successfully upload the video/presentation.
ADVANTAGES OF THE INVENTION:
- The present system provides minimum streaming delay which is 2 seconds.
- The present system provides live delivery of trainings, communications and broadcasts to geographically dispersed participants in a cost effective manner.
- The present system allows the participants to ask questions online through a chat box to their host which can be answered in real time thus giving real classroom/conference room environment.
- The present system avoids the need of arranging extra sessions for those participants who were absent in the session for some reasons.
- The present system supports 15,000 participants on a single server.
EXAMPLE:
1) Typical classroom setup for online education is shown in Fig.7 wherein, the host is connected to the multiple classrooms via the live interactive streaming system. The host is having camera, microphones, speakers and computer/laptop with the present system, through which it is connected to the live streaming encoder. Various classrooms are provided with the, computer/laptop with browser having internet connection with broadband 100kbps, projector, microphone, speaker system and
camera for connecting with the host through live interactive streaming system. This type of setup enables the viewers to have live interaction with the host and can ask the queries during such online sessions. This type of sessions can even be attended at home or at office desk or while on a short trip in another city.
WE CLAIM,
1. A system for live interactive video streaming for masses as shown in Fig. 1, characterized in which the said system mainly comprises of:
• Encoder Client (EC);
• Encoder Server (ES) and
• Decoder Viewer (DV).
In the said system, the communicating media signals between client and viewer is through the encoder server (ES), wherein a encoder client (EC) compresses the audio-video data input and creates the compressed media signals which are transferred to the encoder server (ES), which further transfers the said compressed media signals to the decoder viewer (DV) for decompressing the said signals. The decoder viewer (DV) decompresses the received compressed media signals and allows the viewer to view the decoded data.
2. A system for live interactive video streaming for masses as claimed in claim 1, wherein the working of encoder client (EC) characterized in the present system is verified, when the client wants to broadcast any live event or recording of any such events, in form of audio-video. In case of successful working of the encoder client (EC), the input data is compressed successfully and in case of failure of the working of the said encoder client (EC), internet connectivity is verified. If the internet is connected, the availability of the port 8080 is verified and if the internet is not connected,
verification from primary level starts again. In case, the port 8080 is available, the encoder client (EC) connects to the audio-video device and if the said port 8080 is not available, an error message is received and verification from primary level starts again. Once the encoder client (EC) is connected with the audio-video device, the proxy authentication is checked and in case of the failure of the connection with the said device, an error message is received and verification from primary level starts again. In case of successful proxy authentication, the configuration file is verified and in case of failure of the proxy authentication, an error message is received and verification from primary level starts again. If the configuration file is found to be correct in XML Parser, the input data is encoded through the H.264 Codec and if configuration file is incorrect, verification from primary level starts again. Once the data from the client is encoded successfully by encoder client (EC), the compressed media signals for the encoded data, are transferred to the encoder server (ES).
3. A system for live interactive video strearming for masses as claimed in claims 1 and 2, wherein after the input data is encoded by the encoder client (EC), the height- width, format and rate of the encoded data are verified by the identification module. The selection module selects the audio/video type data and handles them according to their type. The process frame module processes the audio/video frames and writing module writes the said audio/video frames to the new files. The new files where the audio/video frames are written have .AVI extension.
4. A system for live interactive video streaming for masses as claimed in claims 1 and 2, wherein the audio-video file from particular
client is stored on the particular device from where that particular file is encoded.
5. A system for live interactive video streaming for masses as claimed in claim 1, wherein after the successful encoding of the input audio-video file by the encoder client (EC), that particular file is uploaded on the portal, which is given to the user for viewing that particular audio-video file.
6. A system for live interactive video streaming for masses as claimed in claim 1, wherein the working of the encoder server (ES) characterized in the present system is verified. In case of successful working of the encoder server (ES), the request from client or viewer is accepted and in case of failure of the working of the said encoder server (ES), the availability of port 80 is checked. If the port 80 is available, the configuration file is verified and in case of failure of port 80 availability, an error message is received and the configuration file is corrected and verification from primary level starts again. If the configuration file is found to be correct in XML Parser, the encoder server (ES) accepts the request from client/viewer and if configuration file is incorrect, the said configuration file is corrected and verification from primary level starts again.
7. A system for live interactive video streaming for masses as claimed in claim 1, works on rate control algorithm, wherein, the size of the rate buffer at decoder side is the key factor, which determines how much the bit allocation can vary locally in Constant Bit Rate (CBR) operation. In case, the rate buffer in the decoder is small, there is relatively less ability for the local bit allocation for a segment of the audio-video content to vary. However, if the rate buffer is large, the
buffer can be used effectively (although with high end-to-end delay) to allow the number of bits per picture to vary in different parts of the content while retaining CBR flowing into the buffer.
8. A system for live interactive video streaming for masses as claimed in claim 1, allows the minimum streaming delay which is 2 seconds.
9. A system for live interactive video streaming for masses as claimed in claim 1, wherein the decoder viewer (DV) characterized in the present system, receives the encoded data from the encoder server (ES). The said encoder server (ES) provides portal to viewers for viewing the particular audio-video file and verifies the auto detect proxy logic for connection portal and it is found to be valid, Retbytes is verified. If the Retbytes is found to be within range, data length is verified and if it is found to be appropriate, viewer starts viewing the video and incase of wrong length, the viewer is not able to view the video. In case, if the Retbytes is not within the range, the viewer fails to view the file.
10. A system for live interactive video streaming for masses as claimed in claim 1, wherein the encoder client (EC) sends the encoded data to the encoder server (ES) over given server IP with a video name and the decoder viewer (DV) receives the said data form the same server via video name and decodes them to enable the viewer to view that particular audio-video file.
11. A system for live interactive video streaming for masses as claimed in claim 1, allows 15,000 participants on a single server.