A METHOD AND SYSTEM OF PROCESSING MULTIMEDIA CONTENT ON A GRAPHIC CLOUD

FIELD OF THE INVENTION

[0001] The present invention relates to the field of processing multimedia content on a graphic cloud.

BACKGROUND

[0002] Processing multimedia content on a graphic cloud is becoming increasingly essential as multiple multimedia devices can be rendered with the multimedia content simultaneously. Examples of the multimedia content include, but are not limited to, games, photo galleries, animations and video streams. Examples of the multimedia devices include, but are not limited to, an Internet Protocol Television (IPTV), a mobile phone, a tablet PC, a personal digital assistant (PDA) and a smart phone.

[0003] Conventionally, a graphic card is used for processing the multimedia content. A user of a multimedia device can purchase the graphic card for processing the multimedia content. Various graphic cards are available such that the user can purchase the graphic card based on one or more factors for processing the multimedia content. In one example, a game manufacturer will recommend a graphic card using which the game can run on the multimedia device. The graphic card is designed based on the factors such as capacity required for running the game. Hence, the user purchases the graphic card for running the game. Upon purchasing the graphic card, the user can access the graphic cloud for storing and processing the multimedia content. The graphic cloud includes various hardware and software units for processing the multimedia content. However, such hardware and software units are graphic card specific. Hence, it is mandatory for the user using a particular graphic card to utilize corresponding hardware and software units for processing the multimedia content. Also, if the user wishes to change the multimedia content, then the user is required to purchase another graphic card for processing the multimedia content. Further, some multimedia devices include an inbuilt graphic card for processing the multimedia content and hence do not enable the user to alter the graphic card dynamically based on requirement.

[0004] In the light of the foregoing discussion there is a need for an efficient method and a system for creating a hybrid graphic cloud that supports a plurality of graphic cards for processing the multimedia content.

SUMMARY

[0005] Embodiments of the present disclosure described herein provide a method and system for processing multimedia content on a graphic cloud.

[0006] An example of a method of processing multimedia content on a graphic cloud includes determining a multimedia instance. The multimedia instance is being initiated by a user for receiving a multimedia stream. The method also includes determining a load balance associated with the multimedia instance. Further, the method includes selecting a graphic card from a plurality of graphic cards for processing the multimedia instance. Selection is being performed based on a plurality of factors. Furthermore, the method includes activating a plurality of ports associated with the graphic card for rendering the multimedia stream to a plurality of multimedia devices. Moreover, the method includes transmitting the multimedia stream to the user.

[0007] An example of a system for processing multimedia content on a graphic cloud includes a multimedia device. The system also includes a communication interface for establishing communication. The system further includes a memory that stores instructions. The system further includes a processor responsive to the instructions to determine a multimedia instance; to select a graphic card from a plurality of graphic cards for processing the multimedia instance; to activate a plurality of ports associated with the graphic card for rendering the multimedia stream to a plurality of multimedia devices; and to transmit the multimedia stream to the user.

BRIEF DESCRIPTION OF FIGURES

[0008] The accompanying figure, similar reference numerals may refer to identical or functionally similar elements. These reference numerals are used in the detailed description to illustrate various embodiments and to explain various aspects and advantages of the present disclosure.

[0009] FIG. 1 is a block diagram of an environment, in accordance with which various embodiments can be implemented;

[0010] FIG. 2 is a block diagram of a graphic virtualization server for processing multimedia content on a graphic cloud, in accordance with one embodiment; and

[0011] FIG. 3 is a flow chart illustrating a method of processing multimedia content on a graphic cloud, in accordance with one embodiment.

DETAILED DESCRIPTION

[0012] It should be observed the method steps and system components have been represented by conventional symbols in the figure, showing only specific details which are relevant for an understanding of the present disclosure. Further, details may be readily apparent to person ordinarily skilled in the art may not have been disclosed. In the present disclosure, relational terms such as first and second, and the like, may be used to distinguish one entity from another entity, without necessarily implying any actual relationship or order between such entities.

[0013] Embodiments of the present disclosure described herein provide a method and system for processing multimedia content on a graphic cloud.

[0014] The environment 100 includes various multimedia devices, for example, a multimedia device 1 105a, a multimedia device 2 105b and a multimedia device 3 105c. The system 100 also includes a graphic virtualization server 115 that is connected to the multimedia devices through a graphic cloud 110. Examples of the multimedia devices include, but are not limited to, computers, laptops, mobile phones, handheld devices personal digital assistants (PDA) and telecommunication devices. The graphic cloud can be accessed through, for example a local area network (LAN), a wide area network (WAN) and wireless networks.

[0015] The multimedia devices are operable to receive and display multimedia stream to a user. Examples of the multimedia stream include, but are not limited to, games, photo galleries, animations and video streams.

[0016] In one example, the user of the multimedia device 1 105a initiates a multimedia instance, for example, a game instance. The multimedia instance is initiated by using a graphic call. Further, the graphic call, used for initiation of the game instance, is forwarded to the graphic virtualization server 115. Operating system (OS) included in the multimedia device 1 105a is configured to forward the graphic call to the graphic virtualization server 115.

[0017] Also, the graphic virtualization server 115 detects the graphic call and further determines a load balance associated with the game instance. The load balance determines processing power and virtual memory required for processing the game instance.

[0018] Upon determining the load balance associated with the game instance, a graphic card is selected from a plurality of graphic cards stacked on the graphic virtualization server 115. The graphic card is selected to enable processing of the game instance such that the game instance is rendered to the user of the multimedia device 1 105a. The plurality of graphic cards is provided by a plurality of graphic card vendors. The graphic card is selected based on a plurality of factors.

[0019] Further, upon selecting the graphic card, the graphic virtualization server 115 activates a plurality of ports associated with the graphic card. Further, one or more parameters are set by the graphic virtualization server 115 to define display settings of a multimedia stream associated with the game instance. The multimedia stream associated with the game instance can be rendered to the multimedia devices based on number of ports that are activated.

[0020] Furthermore, upon activation of the ports associated with the graphic card, the multimedia stream associated with the game instance is transmitted to the user of the multimedia device 1 105a.

[0021] Hence, the graphic cloud that includes the graphic cards, of the graphic card vendors, for processing multimedia streams can be created. By performing selection, a graphic card that is appropriate is used for processing the multimedia streams.

[0022] FIG. 2 is a block diagram of the graphic virtualization server 115 for processing multimedia content on a graphic cloud, in accordance with one embodiment.

[0023] The graphic virtualization server 115 includes a bus 205 or other communication mechanism for communicating information, and a processor 210 coupled with the bus 205 for processing information. The graphic virtualization server 115 also includes a memory 215, for example a random access memory (RAM) or other dynamic storage device, coupled to the bus 205 for storing information and instructions to be executed by the processor 210. The memory 215 can be used for storing temporary variables or other intermediate information during execution of instructions by the processor 210. The graphic virilization server 115 further includes a read only memory (ROM) 220 or other static storage device coupled to the bus 205 for storing static information and instructions for the processor 210. A storage unit 225, for example a magnetic disk or optical disk, is provided and coupled to the bus 205 for storing information, for example a plurality of frames associated with a multimedia stream.

[0024] The graphic virtualization server 115 can be coupled via the bus 205 to a display 230, for example a cathode ray tube (CRT), for displaying the multimedia stream. The input device 235, including alphanumeric and other keys, is coupled to the bus 205 for communicating information and command selections to the processor 210. Another type of user input device is the cursor control 240, for example a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to the processor 210 and for controlling cursor movement on the display 230.

[0025] Various embodiments are related to the use of the graphic virtualization server 115 for implementing the techniques described herein. In some embodiments, the techniques are performed by the graphic virtualization server 115 in response to the processor 210 executing instructions included in the memory 215. Such instructions can be read into the memory 215 from another machine-readable medium, for example the storage unit 225. Execution of the instructions included in the memory 215 causes the processor 210 to perform the process steps described herein.

[0026] In some embodiments, the processor 210 can include one or more processing units for performing one or more functions of the processor 210. The processing units are hardware circuitry used in place of or in combination with software instructions to perform specified functions.

[0027] The term "machine-readable medium" as used herein refers to any medium that participates in providing data that causes a machine to perform a specific function. In an embodiment implemented using the graphic virtualization server 115, various machine-readable media are involved, for example, in providing instructions to the processor 210 for execution. The machine-readable medium can be a storage medium, either volatile or non-volatile. A volatile medium includes, for example, dynamic memory, such as the memory 215. A non-volatile medium includes, for example, optical or magnetic disks, for example the storage unit 225. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.

[0028] Common forms of machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic media, a CD-ROM, any other optical media, punchcards, papertape, any other physical media with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge.

[0029] In another embodiment, the machine-readable media can be transmission media including coaxial cables, copper wire and fiber optics, including the wires that include the bus 205. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. Examples of machine-readable media may include, but are not limited to, a carrier wave as described hereinafter or any other media from which the graphic virtualization server 115 can read. For example, the instructions can initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to the graphic virtualization server 115 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on the bus 205. The bus 205 carries the data to the memory 215, from which the processor 210 retrieves and executes the instructions. The instructions received by the memory 215 can optionally be stored on the storage unit 225 either before or after execution by the processor 210. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.

[0030] The graphic virtualization server 115 also includes a communication interface 245 coupled to the bus 205. The communication interface 245 provides a two-way data communication coupling to the processor 210. For example, the communication interface 245 can be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, the communication interface 245 can be a local area network (LAN) card to provide a data communication connection to a compatible LAN. In any such implementation, the communication interface 245 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.

[0031] The processor 210 in the graphic virtualization server 115 is configured to determine a multimedia instance. The multimedia instance is being initiated by a user, using a graphic call, for receiving the multimedia stream. The processor 210 determines the multimedia instance upon receiving the graphic call.

[0032] The processor 210 is also operable to determine a load balance associated with the multimedia instance. A load balancer unit 250 included in the graphic virtualization server 115 is used for determining the load balance associated with the multimedia instance. The load balance, determined by the load balancer unit 250, is used to identify processing power and virtual memory required for processing the multimedia instance. The load balancer unit 250 further stores the load balance associated with a plurality of graphic cards.

[0033] The processor 210 is also operable to select a graphic card from a plurality of graphic cards for processing the multimedia instance. An assignment unit 255 is used to perform selection based on a plurality of factors. Examples of the factors include, but are not limited to, graphical processing unit (GPU) usage by the multimedia instance, minimum, maximum and average GPU usage of the graphic cards, frame per second (fps) requirement of the multimedia instance, run time dependency associated with the graphic cards, resolution and color depth of the multimedia instance, hardware and software requirements for processing the multimedia instance in runtime and cost of the graphic cards.

[0034] The selection is performed such that the graphic card selected enables offloading of tasks associated during the processing of the multimedia instance, pre processing of the multimedia instance8, post processing of the multimedia instance and rendering of the multimedia instance.

[0035] The processor 210 included in the graphic virtualization server 115 is also configured to activate a plurality of ports associated with the graphic card for rendering the multimedia stream to a plurality of multimedia devices. A virtual port managing unit 260 upon receiving an activation command from the processor 210 activates the ports associated with the graphic card.

[0036] Further, the virtual port managing unit 260 is configured to activate one or more parameters that are used to define display settings associated with the multimedia stream. Examples of the parameters include, but are not limited to, resolution, color depth and the like.

[0037] Further the graphic virtualization server 115 includes an advance renderer module 265 that is operable to store the multimedia stream in a non-paged memory or a virtual memory. If the multimedia stream includes an increased buffer rate, then the multimedia stream can be processed and stored in the non-paged memory. Further, if multimedia stream includes a lowered buffer rate, then the multimedia stream can be processed and stored in the virtual memory.

[0038] Storing of the multimedia stream, by the advance Tenderer module 265, in a non-paged memory or a virtual memory is performed to enable efficient processing of the multimedia stream with reduced delay time.

[0039] Furthermore the graphic virtualization server 115 includes a media streaming server 270 that is operable to compress the multimedia stream prior to transmitting the multimedia stream to the user. One or more compressing techniques are used, by the media streaming server 270, for compressing the multimedia stream. Compression is used to obtain reduced bandwidth during the transmission of the multimedia stream.

[0040] The media streaming server 270 is also configured to transmit the multimedia stream to the user. Further, the media streaming server 270 is operable to decompress the multimedia stream prior to displaying the multimedia stream to the user.

[0041] A method of processing multimedia content on a graphic cloud is explained in detail in conjunction with FIG. 3.

[0042] FIG. 3 is a flow chart illustrating a method of processing multimedia content on a graphic cloud, in accordance with one embodiment.

[0043] The method starts at step 305.

[0044] At step 310 a multimedia instance is determined. The multimedia instance may be initiated by a user for receiving a multimedia stream. The multimedia instance may be initiated using a graphic call. The multimedia instance is determined upon receiving the graphic call by a processor, for example, the processor 210.

[0045] At step 315 a load balance associated with the multimedia instance is determined. The load balance indicates processing power and virtual memory required for processing the multimedia instance. A load balancer unit, for example, the load balancer unit 250, is used for determining the load balance.

[0046] Further, each graphic card is associated with a load balance that indicates the processing power of the graphic card for processing multimedia instances. Also, the method includes storage of the load balance associated with each graphic card present in the graphic cloud. The load balancer unit is used for storing the load balance associated with each graphic card.

[0047] At step 320, a graphic card is selected, from a plurality of graphic cards, for processing the multimedia instance. The graphic cards, from a plurality of graphic card vendors, are present on a graphic cloud. The graphic cloud is referred to as a hybrid graphic cloud since the graphic cloud includes graphic cards from various graphic card vendors. Selection of the graphic card is performed based a plurality of factors. Examples of the factors include, but are not limited to, GPU usage by the multimedia instance, minimum, maximum and average, GPU usage of the graphic cards, fps requirement of the multimedia instance, run time dependency associated with the graphic cards, resolution and color depth of the multimedia instance, hardware and software requirements for processing the multimedia instance in runtime and cost of the graphic card.

[0048] Further, each multimedia instance is associated with a profile that includes information associated with the processing power and the virtual memory required for processing the multimedia instance. The profile enables selection of the graphic card that is appropriate for processing the multimedia instance.

[0049] The graphic card selected enables to offload tasks associated during the processing of the multimedia instance, pre processing of the multimedia instance, post processing of the multimedia instance and rendering of the multimedia instance.

[0050] Also, the graphic card selected is such that the graphic card enables rendering of the multimedia stream on the multimedia devices that do not support alteration of graphic cards.

[0051] At step 325 a plurality of ports associated with the graphic card is activated for rendering the multimedia stream to a plurality of multimedia devices. An activation command provided by a processor, for example the processor 210 to a virtual port managing unit, for example the virtual port managing unit 260 is used to activate the ports.

[0052] Further one or more parameters are activated for defining display settings associated with the multimedia stream. Examples of the parameters include, but are not limited to, resolution, color depth and the like.

[0053] The method also includes storage of the multimedia stream in one of a non-paged memory and a virtual memory. The storage is performed based on a processing speed associated with the multimedia stream. Further the storage of the multimedia stream in the non-paged memory or the virtual memory is performed to enable efficient processing of the multimedia stream with reduced delay time.

[0054] In one example, if the fps associated with the multimedia stream is relatively low, then the multimedia stream can be stored in the virtual memory. Further, if the fps associated with the multimedia stream is relatively high, then the multimedia stream can be stored in the non-paged memory.

[0055] Further the method includes compression of the multimedia stream prior to transmission of the multimedia stream to the user. The compression is performed to ensure efficient bandwidth consumption during the transmission.

[0056] At step 330 the multimedia stream is transmitted to the user. Upon the transmission, the multimedia stream is decompressed and further displayed to the user of a multimedia device.

[0057] The method stops at step 335.

[0058] Advantageously, the embodiments specified in the present disclosure provide an efficient method to develop a hybrid graphic cloud that includes a plurality of graphic cards, from various graphic card vendors, for processing multimedia streams. Also, the graphic cloud that is hybrid enables selection of a graphic card in real time such that the graphic card, selected, processes the multimedia streams independent of the hardware and software applications thereby, preventing the user from explicitly purchasing graphic cards for processing. Further, the method enables selection of the graphic card that is appropriate for processing different multimedia streams.

[0059] In the preceding specification, the present disclosure and its advantages have been described with reference to specific embodiments. However, it will be apparent to a person of ordinary skill in the art that various modifications and changes can be made, without departing from the scope of the present disclosure, as set forth in the claims below. Accordingly, the specification and figures are to be regarded as illustrative examples of the present disclosure, rather than in restrictive sense. All such possible modifications are intended to be included within the scope of present disclosure.

I/We claim:

1 A method of processing multimedia content on a graphic cloud, the method comprising:

determining a multimedia instance, the multimedia instance being initiated by a user for receiving a multimedia stream;

determining a load balance associated with the multimedia instance;

selecting a graphic card from a plurality of graphic cards for processing the multimedia instance, selection being performed based on a plurality of factors;

activating a plurality of ports associated with the graphic card for rendering the multimedia stream to a plurality of multimedia devices; and

transmitting the multimedia stream to the user.

2 The method as claimed in claim 1, wherein the graphic cloud comprises the plurality of graphic cards.

3 The method as claimed in claim 1 and further comprising:

storing a profile associated with a plurality of multimedia instances for the selection of one of a graphic card from the plurality of graphic cards for processing each of the plurality of multimedia instances.

4 The method as claimed in claim 1 and further comprising:

activating one or more parameters, the parameters being used to define display settings associated with the multimedia stream.

5 The method as claimed in claim 1 and further comprising:

storing the multimedia stream in one of a non-paged memory and a virtual memory, storage being performed based on a processing speed associated with the multimedia stream.

6 The method as claimed in claim 1 and further comprising:

compressing the multimedia stream prior to transmitting the multimedia stream to the user.

7 A system for processing multimedia content on a graphic cloud, the system comprising:

a multimedia device;

a communication interface for establishing communication;

a memory that stores instructions; and

a processor responsive to the instructions to

determine a multimedia instance, the multimedia instance being initiated by a user for receiving a multimedia stream;

determine a load balance associated with the multimedia instance;

select a graphic card from a plurality of graphic cards for processing the multimedia instance, selection being performed based on a plurality of factors;

activate a plurality of ports associated with the graphic card for rendering the multimedia stream to a plurality of multimedia devices; and

transmit the multimedia stream to the user.

8 The system as claimed in claim 7 and further comprising:

a load balancer unit that determines a load balance associated with the multimedia instance.

9 The system as claimed in claim 7 and further comprising:

an assignment unit that selects a graphic card, from a plurality of graphic cards, for processing the multimedia instance.

10 The system as claimed in claim 7 and further comprising:

a virtual port managing unit that activates a plurality of ports associated with the graphic card for rendering the multimedia stream to a plurality of multimedia devices.

11 The system as claimed in claim 7 and further comprising:

an advance renderer module that stores the multimedia stream in one of a non-paged memory and a virtual memory.

12 The system as claimed in claim 7 and further comprising:

a media streaming server that compresses the multimedia stream prior to transmitting the multimedia stream to the user.