FORM 2
THE PATENTS ACT, 1970 (39 of 1970)
& THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
[See section 10]
A SYSTEM AND A METHOD FOR OBTAINING BANDWIDTH OPTIMIZED STREAMING OF MULTIPLEX DATA


GREAT SOFTWARE PRIVATE LIMITED, A COMPANY INCORPORATED UNDER THE COMPANIES ACT 1956, WHOSE ADDRESS IS VISHWAKALYAN, S.No. 149/3, Off.ITI ROAD, PUNE-411007, MAHARASHTRA, INDIA.

THE FOLLOWING SPECIFICATION PARTICULARLY DESCRIBES THE NATURE OF THIS INVENTION AND THE MANNER IN WHICH IT IS TO BE PERFORMED.


Field of the invention
The present invention generally relates to multimedia communications. More particularly, the invention relates to streaming of multiplex data over a diverse network connection.
Prior Art
Rich streaming multimedia based collaboration and communication tools are now widely available for online meeting, training and discussion purposes. With the proliferation of internet connectivity, more and more people are using these online tools to meet their collaboration needs. However, the real time streaming multimedia experience for end user is not quite satisfactory due to frequent bandwidth bottlenecks in delivery path introducing packet loss and significant delay.
Usually any multimedia stream has to travel through a very diverse IP network where bandwidth is not at all homogenously distributed. For example a stream originating from an institution first passes through a managed LAN (typically has good bandwidth), then uses a fixed bandwidth link to reach public internet and finally travels through a narrow subscribed link to the end user (Endpoint) for delivery. In case we have multiple endpoints subscribing to the same stream, then the unicast IP network makes multiple copies of the same stream from end to end. If we observe the network path of the stream; the multiple copies though redundant may not affect a high bandwidth LAN, but they definitely choke up the fixed bandwidth internet link of institution significantly. Soon the institution runs out of necessary bandwidth to carry those streams to public internet, which leads to following issues:
a. It can only serve a very few number of outside users
b. Quality degrades if there is even a few more
c. Affects other internet usage email, web within institution
There are standard solution of overcoming redundant stream issues like IP Multicast and Content Caching. IP multicast is deployed only within few islands and it poses its own deployment issues, where as Content Caching though works well for static pre-fetchable content but can not be effective in case of real time stream. Therefore, it is essential to utilize the fixed amount of bandwidth in smart way for minimal impact on end user experience.

SUMMARY OF THE INVENTION
One aspect of the invention includes a method for obtaining bandwidth optimized streaming of multiplexed data across a diverse network. The method further includes the steps of receiving at a server a first data by a publisher of the data, located at a node on the first network and receiving at a server a second data by at least one publisher of the data, located at a node on the second network. The method involves integrating the first data of the first network and the second data of the second network to obtain an integrated data. The method also includes identifying a recipient for streaming of the integrated data, wherein the recipient includes a public or a private network and generating a copy of the integrated data depending on the type of recipient identified. The method finally includes synchronously streaming the integrated data to a plurality of endpoints across the network.
Another aspect of the invention includes a system for bandwidth optimized streaming of multiplexed data across a diverse network. A first server is configured for retrievably storing a first data published by at one node located on a first network. A second server is configured for retrievably storing a second data published by a node located on a second network. Further, the systems includes an integrator coupled to each of the first server and second server for integrating the first data and the second data. An identifier is configured on each of the first server and the second server for locating a recipient for streaming of the integrated data, wherein the recipient includes a public or a private network. The system also includes a replicator that is coupled to the identifier for generating at one copy of the integrated data depending on the type of recipient identified. A streaming unit is provided in the system for synchronously streaming the integrated data to a plurality of endpoints across the network.
BRIEF DESCRIPTION OF THE DRAWINGS
So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to various embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are therefore not to


be considered limiting of its scope, for the invention may admit to other equally effective embodiments.
FIG. 1 shows a system architecture orientation in a hub and spoke layout according to an embodiment of the invention.
FIG.2 shows a schematic flow of streamed data across a diverse network, according to an embodiment of the invention.
FIG. 3 shows a schematic representation of data integration for a distributed session in a segment of a hub and spoke layout, according to an embodiment of the invention.
FIG. 4 shows an example of data aggregation to achieve optimized bandwidth while serving a multimedia session, according to an embodiment of the invention.
FIG.5 illustrates the process of replication according to an embodiment of the invention.
FIG.6 shows a flow chart depicting the process of replication of a data to be streamed between publisher node and edge node on a network in an example of the invention.
FIG.7 shows a flow chart depicting the process of replication of a data to be streamed between subscriber node and edge node on a network in another example of the invention.
FIG.8 illustrates the process of aggregation according to an embodiment of the inventin.
FIG.9 shows a flow chart depicting the process of aggregation of a data between endpoint node and edge node on a network in an example of the invention.
FIG. 10 shows a flow chart depicting the process of aggregation of a data between endpoint node and public node on a network in another example of the invention.
FIG. 11 shows the schematic layout of the arrangement of the system according to an embodiment of the invention.
DETAILED DESCRIPTION OF INVENTION
Various embodiments of the invention provide a method for obtaining bandwidth optimized streaming of multiplex data. The invention employs certain

disciplines on stream delivery by having Edge Servers server at the edge of manage LAN within institutions and Public Server available to all the Edge Servers and any other internet connected end users in a hosted data center capable of serving high volume network traffic.
Figure 1 shows a system architecture orientation in a hub and spoke layout according to an embodiment of the invention. In one example of the invention, the hub and spoke layout 100 includes three high level layers arranged in the form of rings. The center of the ring includes a Public Server (PS) 102. A plurality of Edge Servers (ES) 104 is provided in the second layer of the hub and spoke layout. Each of the ES 104 is connected to the PS 102 via fixed bandwidth link 103. Further, each of the ES 104 is connected to a plurality of Endpoints (EP) 106 through a managed LAN configuration 105.
FIG.2 shows a schematic flow of streamed data across a diverse network connection, according to an embodiment of the invention. An endpoint 211 situated at a first location, say location 1, publishes a stream 201. The endpoint 211 is connected to a public server 215 through a public internet connection. The stream 201 received by the public server 215 is then copied at least once to obtain a copy session stream 202. The copy session stream 202 is then broadcast to a plurality of endpoints 213 as a remote subscribe stream 205 over the public internet connection. Further, the copy session stream 202 is also transmitted as a local subscribe stream 203 and/or a remote subscribe stream 205 to a plurality of endpoints 223 over a managed network through an edge server 225. Alternatively, the process of publishing a stream 201 can occur at an endpoint 221 connected to the managed network.
FIG. 3 shows a schematic representation of a stream mixing for a distributed session in a segment of a hub and spoke layout, according to an embodiment of the invention. Endpoints 311 and 313 simultaneously publish a stream 301 and 303 respectively, through a public network connection. The published streams 301 and 303 are received by a public server 315 connected to the endpoints 311 and 313. A stream mixer 302 is provided at the public server 315. The mixer integrates the incoming streams 301 and 303 to generate a mixed stream 304. The mixed stream 304 is published back to the endpoints 311 and 313 as a local subscribe stream 305. Alternatively, endpoints 312, 314, 316 connected over a managed network

simultaneously publish stream 307, 308, 309 respectively. An edge server 325 connected over the managed network to the endpoints 312, 314, and 316 receives the publish stream 308, 310 and 312. A stream mixer 302 provided at the edge server 325 integrates the publish streams 308, 310 and 312 to generate a mixed stream 304. The mixed stream 304 is transmitted back to the endpoints 312, 314 and 316 as a subscribe stream 303. Further, the mixer 302 configured on the public server 315 and edge server 325 transmits the mixed stream 304 received through a single bridge stream 306 across the network.
FIG. 4 shows an example of stream aggregation to achieve optimized bandwidth while serving a multimedia session, according to an embodiment of the invention. The Endpoints connected to Edge Server (es) are publishing streams a, b, c; where as stream e, f are published at Edge Server es'. The Public Server also has a connected Endpoint publishing stream d. All the Endpoints are finally subscribing to a Mixed Stream for the entire session [a+b+c+d+e+f] which takes a fixed amount of bandwidth equivalent to a single Publish Stream say a or b. The Bridge Streams [a+b+c], [d+e+f], [a+b+c+d], [e+fj are representative of various mixer outputs and like Mixed Stream they consume bandwidth equivalent to a single Publish Stream. Hence, stream aggregation smartly collating multiple streams cut the bandwidth consumption by significant factors.
FIG. 5 illustrates the process of data replication according to an embodiment of the invention. FIG. 6 and FIG.7 shows a flow chart depicting the process of stream replication during a particular instance of initiation of the step of replication for a data originating in a diverse network.
FIG. 8 shows the process of stream aggregation for a plurality of endpoints spanned across two Edge Servers and a Public Server according to an alternate embodiment of the invention. Endpoint epA joins session s at Edge Server es. Endpoint epB joins session s at Edge Server es. Endpoint epD joins session s at Public Server. Endpoint epE joins session s at Edge Server es'. Endpoint epF joins session s at Edge Server es'. FIG. 9 and FIG. 10 shows the flowcharts depicting the process of stream aggregation during a particular instance of initiation of the step of aggregation for a data originating in a diverse network.


FIG. 11 shows the schematic layout of the arrangement of the system according to an embodiment of the invention. The FIG also depicts the flow of the data to be streamed across the system.
Figures 1 to 11 generally describes the method of optimized streaming of multiplex data. The optimization method facilitates minimal bandwidth consumption without compromising on the quality of the streamed multiplex data. Further, the optimization method is scalable and tunable depending on the source of multiplex data and the nature of transmission. The optimization method further enables aggregation and replication of various types of multimedia, which includes audio, video and textual data.
In one embodiment of the invention, the method includes the steps of receiving at a server a first data by a publisher of the data, located at a node on the first network and receiving at a server a second data by at least one publisher of the data, located at a node on the second network. The method further includes integrating the first data of the first network and the second data of the second network to obtain an integrated data. The method also includes identifying a recipient for streaming of the integrated data, wherein the recipient includes a public or a private network and generating a copy of the integrated data depending on the type of recipient identified. The method finally includes synchronously streaming the integrated data to a plurality of endpoints across the network.
In one embodiment of the invention, the first network and the second network may include a local area network (LAN), a wide area network (WAN) or a managed network. In an example of the invention, the first network is a LAN and the second network is a managed network.
FIG.5 generally refers to the process of replication of an multiplexed data at a server for streaming the data across a diverse network. More particularly, FIG.6 shows a flowchart depicting the process of replication according to an example of the invention, wherein the replication of the data published by an endpoint occurs during the streaming of the data at an edge server. The method of replication is initiated with the step of identifying the recipient of the data stream. The recipient can be public and/or private. In the example shown in FIG.6 at each point of entry into a node on the network, say edge servers, the method verifies the need for a data to be copied in

order to be able to be streamed to all further nodes downstream of the entry node on the network. If the method detects that at the recognized edge server needs the data to be copied before it is streamed, then the replication step is initiated to make one copy of the data to be streamed. The copied data is then streamed to the node The process of verifying the need to replicate a data, initiating replication and streaming the replicated data progressively occurs until the method recognizes no further node at which the data needs to be replicated and streamed.
FIG.8 generally refers to the process of aggregation of plurality of data at any node on a diverse network. More particularly, FIG.9 shows a flowchart depicting the process of integration according to an example of the invention, wherein the integration occurs between an endpoint and an edge server of FIG.8. During aggregation, the method recognizes the entry of the endpoint to access the edge server for either receiving a data or publishing a data. Further, the method has a deciding step wherein the server decides whether to aggregate the data input received by the endpoint. If the received data is already aggregated, then the method processes the data and prepares it for being streamed. If the data is not integrated, then the aggregation step is initiated to aggregate the plurality of the data received at the edge server by a plurality of endpoints subscribing to the edge server. The method is also capable of recognizing whether the data received at the edge server is only from one network or a plurality of networks. If the edge server is receiving data from the public server, which is a part of a second network, then again the aggregation step is initiated. The process of detecting the data received from a plurality of nodes in either part of the diverse network cumulatively progresses until the method recognizes no further addition of nodes which either receives or publishes data.
FIG. 10 depicts another instance of implementation of the aggregation step of the method wherein the data received is at an endpoint situated on the network comprising the public server.
Another aspect of the invention includes a system for bandwidth optimized streaming of multiplexed data across a diverse network. FIG.l 1 shows the schematic layout of the arrangement of the system according to an embodiment of the invention. The system is provided with a first server for receiving a data published by at least one node located on a first network. The server is also capable for storing the data received


for retrieval at a later stage. In one example of the invention, the first server can be a public server located over a LAN, WAN or a managed private network. Further, a second server is provided for receiving a data published by at least one node located on a second network. In one example of the invention, the first server can be a public server located over a LAN, WAN or a managed private network. The server is also capable for storing the data received at a later stage. In one example of the invention, the second server can be a edge server located over a LAN, WAN or a managed private network.
The data received by the first server and the server can be an audio data, a video data and/or textual data. In an example of the invention, each of the first and the second server can receive at least one audio data, one video data and at least one textual data. Further, the origin of the data received by each of the first server and the second server can occur from at least two distinct nodes on the network. Alternatively, each of the audio data, the video data and the textual data can originate from a single node on the network.
The system is also provided with an integrator, which is coupled to each of the first server and second server. The integrator receives the at least one data each from the first server and the second server for obtaining an integrated data file. In one example of the invention, the integrator takes at least two data to create a data stream that occupies less space than summation of size of each of the individual data integrated. Further, each of the data integrated can be at least one from an audio data, video data and a textual data. In one embodiment of the invention, the integrator is a executable code implemented in a computer with a processor. Alternatively, the integrator can also be implemented in a hardware, a firmware.
Further, each of the first server and the second server is provided with an identifier. The identifier is adapted to locate a recipient for streaming of the integrated data. The streaming of the integrated data depends upon whether the recipient is a public network or a private network. In one example of the invention, the public network can be a wired internet connection, a wireless internet connection or a combination of the wired and wireless forms of internet connection with a fixed bandwidth allotted for operation. Further, the private network is a managed private network connection with a large bandwidth. The identifier verifies the presence of a


public network and the private network and passes the instructions to a replicator for replicating the integrated data before streaming. In one embodiment of the invention, the identifier is a executable code implemented in a computer with a processor. Alternatively, the integrator can also be implemented in a hardware, a firmware.
The replicator is coupled to the identifier for generating at least one copy of the integrated data depending on the type of recipient identified. If the recipient is a public network with a fixed bandwidth, the replicator generates copy of the data to be streamed. Further, the replicator is adapted to generate more copies of the data if it recognizes that more nodes are present for streaming of the data. Also, the replicator is configured to remove the plurality of copies of the data when the node subscribing to the session exits from the network. In an alternate embodiment of the invention, the replicator can also be initiated independent to the initiation of the integrator. In one embodiment of the invention, the identifier is a executable code implemented in a computer with a processor. Alternatively, the integrator can also be implemented in a hardware, a firmware.
A streaming unit is provided downstream of the replicator for synchronously streaming the integrated data to a plurality of endpoints across the network. In one embodiment of the invention, the streaming unit can be a player capable of streaming the diverse data that is integrated. Further, the player can be any thin client player such as flash player for easy viewing of the streamed data.
Industrial Application:
In one example of the invention, the hub and spoke layout includes three high level layers arranged in the form of rings. Any multimedia stream may travel through all these layers, however the rings enforce certain hierarchy, A multimedia stream may include an audio input, a video input and/or a textual input. Further, a multimedia stream may include a combination of at least two of the input stated herein before. The peer level communication always happen through higher layer. If an Endpoint (ep) connected to an Edge Server (es) at the outmost layer chooses to subscribe to a stream published by another Endpoint (ep') under another Edge Server (es'), the resulting stream will follow the path [ep' -> es' -> os -> es -> ep].


A publish stream transmitted by an Endpoint is viewed by multiple subscribers without any super imposition. The Edge Server and Public Server collectively run distributed algorithm so that there is only one copy of a session stream over the fixed bandwidth link. The Copy Stream then in turn gets replicated at the Edge or Public Server for final delivery.
There is certain type of multimedia stream, which can be mixed and user effectively perceives the Mixed Stream as representation of collective interaction. For example, audio streams can be mixed and can be represented by a single Mixed Stream instead of individual Publish Streams. The system maintains multiple mixers in the localized context within each layer. In one embodiment of the invention, there are two mixers for a distributed session one each at Edge Server and Public Server. The Endpoints connected to either of them subscribe to Mixed Stream from local mixers. Where as there is a single Bridge Stream, which connects those two mixers so that Endpoints can have a Mixed Stream for entire session. Bridge Streams provided optimally connect and disconnects those mixers as when publisher and subscriber joins and/or leaves the session.
The most important characteristic of Mixed Stream is that it consumes effectively same bandwidth equivalent to a single Publish Stream while representing whole or a significant part of any conversation. Figure 4 depicts how Stream Aggregation method conserves bandwidth while serving a multimedia session, where users are connected to different Edge Servers and Public Server. The Endpoints connected to Edge Server (es) are publishing streams a, b, c; where as stream e, fare published at Edge Server es'. The Public Server also has a connected Endpoint publishing stream d. All the Endpoints are finally subscribing to a Mixed Stream for the entire session [a+b+c+d+e+fj which takes a fixed amount of bandwidth equivalent to a single Publish Stream say a or b. The Bridge Streams [a+b+c], [d+e+fj, [a+b+c+d], [e+f] are representative of various mixer outputs and like Mixed Stream they consume bandwidth equivalent to a single Publish Stream. Hence, Stream Aggregation smartly collating multiple streams cut the bandwidth consumption by significant factors.
The invention as described in detail herein and as illustrated by the drawing provides a method for obtaining bandwidth optimized streaming of multiplex data.

The method enables real time streaming of multiplex data independent of the bandwidth capability at the end user without compromising on the quality of the data streamed.
The foregoing description of the invention has been set for merely to illustrate the invention and is not intended to be limiting. Since modifications of the disclosed embodiments incorporating the spirit and substance of the invention may occur to person skilled in the art, the invention should be construed to include everything within the scope of the appended claims and equivalents thereof.
12

CLAIM
1. A method for obtaining bandwidth optimized streaming of multiplexed data
across a diverse network, the method comprising:
receiving at a server a first data by at least one publisher of the data,
located at least one node on the first network;
receiving at a server a second data by at least one publisher of the data,
located at least one node on the second network;
integrating the first data of the first network and the second data of the
second network to obtain an integrated data;
identifying a recipient for streaming of the integrated data, wherein the
recipient includes a public or a private network;
generating at least one copy of the integrated data depending on the
type of recipient identified; and
synchronously streaming the integrated data to a plurality of endpoints
across the network.
2. The method according to claim 1, wherein the synchronous streaming of the integrated data is achieved in real time.
3. The method according to claim 1, wherein the first data includes at least one from an audio data, a video data and a textual data.
4. The method according to claim 1, wherein the second data includes at least one from an audio data, a video data and a textual data.
5. The method according to claim 1, wherein the step of identifying includes determining the bandwidth capability of the network for receiving the synchronous stream of integrated data.
6. A system for bandwidth optimized streaming of multiplexed data across a diverse network, the system comprising:
a first server configured for retrievably storing a first data published by at least one node located on a first network;
a second server configured for retrievably storing a second data published by at least one node located on a second network;


an integrator coupled to each of the first server and second server for
integrating the first data and the second data;
an identifier configured on each of the first server and the second server
for locating a recipient for streaming of the integrated data, wherein the
recipient includes a public or a private network;
a replicator coupled to the identifier for generating at least one copy of
the integrated data depending on the type of recipient identified; and
a streaming unit for synchronously streaming the integrated data to a
plurality of endpoints across the network.
7. The system according to claim 6, wherein the first network includes at least one of local area network, wide area network or a managed network.
8. The system according to claim 6, wherein the second network includes at least one of local area network, wide area network or a managed network.