-2-
FIELD OF THE INVENTION
The present invention relates to a method and system for real-time streaming of
selective desktop / screen display over a network. In particular the invention
relates to introduction of user selected desktop views by live streaming from a
sender system to a receiver system.
BACKGROUND OF THE INVENTION
Document US 6, 717, 596 Bl provides a method and system for controlling
complementary user interface on a display surface. The alternate display
content controller is used for controlling a further video display which is in
addition to the content displayed on the display surface of the operating system.
This alternate display content controller, in the case of a monitor in a computer,
interacts with the computer utility operating system and hardware drivers for
controlling display space allocation and for creation and control of additional
parallel graphical user interfaces. The alternate display content controller may
also be an application running on the operating system of the computer. It may
include content and operating software delivered over internet, any other LAN or
it may be provided in a television decoder or set-top box.

-3-
US 5, 307, 055 discloses a hand-held display control with key switches for
controlling the primary monitor. An auxiliary monitor is used for presentation of
information on the primary display. The options available to an operator for
viewing are a duplicate of the image displayed on the main monitor, the next
image to be displayed, a list of images available from the image generator, etc.
US Patent 6, 522, 309 describes a multiple monitor video display method and
device for a computer for providing real-time display of the current document
and another display showing a previously opened document. The device is
configured as a peripheral with two video ports connected between video output
port of the computer and video input port of the primary monitor. A third video
port is connected to the video input port of the secondary monitor.
In US document 2005/0091610 Al a method, an apparatus and signal bearing
medium are provided for selecting a subset of a plurality of windows displayed
on an output device and sending the subset to an auxiliary output device, like a
projector. The selection of the subset is based on group applications of the
plurality of windows. Thus the displayed content on the auxiliary output device
can be selectively controlled for an effective presentation.

-4-
Document EP 1 526 445 A2 discloses a method for wireless projection of content
to an alternate display, like for example, a projector, from a computing device.
The prior art systems described do not address selective real-time streaming of
desktop display from a system, like a personal computer, to other systems. The
prior art systems described may further require additional hardware, including
adaptor, or hand-held display control, including key switches providing control of
the main monitor and the auxiliary monitor enabling viewer to view one of the
available options.
There was therefore, a need for real-time streaming of selected portion of the
desktop to other systems via a network.
SUMMARY OF THE INVENTION
One object of the present invention is to provide live streaming of user selected
desktop views from a sender system to other systems connected through a
network.

-5-
The sender and receiver systems may be portable computers or mobile devices
or any display device. The network can be a wired or wireless network
established between the systems.
While sharing the desktop view, all the current contents of the desktop are
displayed on all the monitors of the connected personal computers.
The user while watching videos, pictures or any application on a system (e.g., a
PC), would be able to stream a particular section of the desktop for view-ability
to some other network-connected PC /UMPC / Laptop / Mobile display device /
display devices user.
Another object of the present invention is to control the masking / filtering and
corresponding streaming of specific portion of the desktop view to other systems
(e.g. a PC) with the aid of an application.

-6-
Means are provided to facilitate the process of selectively filtering the desktop
view and packetizing the same before streaming to other system. This
comprises a CPU in each of the sender and receiver computer. The streaming of
desktop data to other connected PCs can be with the aid of existing display card,
ethernet adaptor and interfaces.
Streaming of the selected portion shall take place after successful filtering the
desktop view from frame buffer and its packetization. Filtering and packetizing
can be carried out with any operating system used in the sender or receiver
computer systems.
An encoder is provided for formatting the information on selection of the display
portion to be streamed.
Thus the present invention provides a method for real-time streaming of
selective desktop display over a network from a sender system to a receiver
system, comprising the steps of: establishing a connection via a network
between a sender system and a receiver system; capturing user event on display
screen of the sender system;

-7-
streaming in real-time display buffer data from the sender system to the receiver
system over the network after encoding of data; decoding the encoded data
received from the receiver system and rendering it on the screen of the receiver
system; and displaying the decoded data on the receiver system in the same
resolution as sent from the sender system or in full screen mode.
BREIF DESCRIPTION OF THE ACCOMPANYING DRAWINGS
The invention can now be described in detail with the help of the figures of the
accompanying drawing in which
Figures 1(a)
and 1(b) show real-time streaming of selective
desktop display of the present invention.
Figure 2 shows the architecture of the sender / receiver
computer system of the present invention.

-8-
Figure 3 shows the flow chart for connection management and
corresponding architecture of the sender / receiver
system of the present invention.
Figure 4 shows the receiver system (R.S.) catalogue
architecture and stream behaviour.
Figure 5 shows ROI selection in sender system and
ROI output on the receiver system.
DETAILED DESCRIPTION OF THE INVENTION
In the present invention the user can select a particular section of the desktop
view and stream the same in real-time to other system.
A region / portion of desktop display is selected, as shown in Figure 1(a), to be
streamed in real-time to other systems, for example, a personal computer /
laptop and at the same time the primary computer can be used for executing
other applications. Filtering the frame buffer can be carried out for a controlled

-9-
streaming to any other network connected display device. The method uses
existing graphics card and its interface. As shown in Figure 1(b) the data display
on the receiver system can be in the same resolution as sent from the sender
system or in full screen mode.
Figure 2 shows the architecture of the sender or receiver computer systems
which comprises a region of interest (ROI) engine, which is a user mode
application that explicitly allows the user to select the area / region of interest to
be displayed on the other connected display device. The selected region is
marked and the module keeps track of it.
A display driver (GDI) is provided which is a kernel mode driver and works as a
wrapper to the existing primary display driver installed in the system and
intercepts display related data communication between graphics engine (GDI)
and existing display driver. It is used to filter graphics rendering functions and
works in conjunction with the splitter engine.
A network engine uses the extracted region of interest buffer from the ROI
engine to be sent through the sockets that have been created and initialized by
the network engine itself with the other PC connected through internet. Its basic
functionality is to send data through sockets that it has established with the
other PC connected over the Internet.

-10-
An ethernet driver / network adapter is provided which interacts with the
network engine to send the encoded data for real-time streaming to the receiver
PC.
The system also includes an encoder for transforming the information it receives
from ROI engine to other format.
A decoder transforms the information received from network engine to other
format and passes the same to the render engine.
Finally the render engine displays the formatted content on the screen. It
"paints" on the window of the selected streaming application, which is displayed
on a monitor or a display device or laptop screen.

-11-
WE CLAIM
1. A method for real-time streaming of selective desktop display over a
network from a sender system to a receiver system, comprising the steps
of:
- establishing a connection via a network between a sender system
and a receiver system;
- capturing user event on display screen of the sender system;
- streaming in real-time display buffer data from the sender system
to the receiver system over the network after encoding of data;
- decoding the encoded data received from the receiver system and
rendering it on the screen of the receiver system; and
- displaying the decoded data on the receiver system in the same
resolution as sent from the sender system or in full screen mode.

-12-
2. The method as claimed in claim 1, wherein said sender and receiver
systems are portable or mobile devices.
3. The method as claimed in claim 2, wherein said network can be a wired
or wireless network established between the portable systems.
4. The method as claimed in claim 1, wherein a process of selectively
filtering the desktop view is carried out and the same is packetized before
streaming to other systems.
5. The method as claimed in claim 4, wherein the filtering and packetizing
can be carried out with any operating system used on either the sender
system or the receiver system.
6. The method as claimed in claim 1, wherein filtering or masking the
desktop display and streaming the same to other system is carried out
with the aid of an application.

-13-
7. The method as claimed in claim 1, wherein streaming the desktop data to
other connected pieces can be carried out with aid of existing display
cards, ethernet adapter and interfaces.
8. A system for real-time streaming of selective desktop display over a
network from a sender system to a receiver system comprising:

- a network capable of interconnecting the sender system to a plurality of
other receiver systems;
- means for facilitating the process of selective filtering the desktop view,
packetizing the same;
- an encoder for formatting information on the selected desktop display
before streaming it to the receiver computer over said internet in real-
time; and
- a decoder for decoding the information received from the sender
computer provided with means for displaying the formatted content on
the screen of said receiver system.

-14-
9. The system as claimed in claim 8, wherein said means for facilitating the
process of selective filtering of desktop display, packetizing, encoding and
streaming it to the receiver system are a central processing unit (CPU)
provided in the sender and the receiver systems.
10. A method for real-time streaming of selective desktop display over a
network from a sender system to a receiver system, substantially as
herein described and illustrated in the accompanying drawings.
Dated this 24th day of October 2007

One object of the present invention is to provide live streaming of user selected
desktop views from a sender system to other systems connected through a network.
The sender and receiver systems may be portable computers or mobile devices or any display device. The network can be a wired or wireless network established between the systems.
While sharing the desktop view, all the current contents of the desktop are displayed on all the monitors of the connected personal computers.
The user while watching videos, pictures or any application on a system (e.g., a PC), would be able to stream a particular section of the desktop for view-ability to some other network-connected PC /UMPC / Laptop / Mobile display device / display devices user.
Another object of the present invention is to control the masking / filtering and
corresponding streaming of specific portion of the desktop view to other systems (e.g. a PC) with the aid of an application.
Means are provided to facilitate the process of selectively filtering the desktop view and packetizing the same before streaming to other system. This comprises a CPU in each of the sender and receiver computer. The streaming of
desktop data to other connected PCs can be with the aid of existing display card, ethernet adaptor and interfaces.
Streaming of the selected portion shall take place after successful filtering the
desktop view from frame buffer and its packetization. Filtering and packetizing
can be carried out with any operating system used in the sender or receiver computer systems.
An encoder is provided for formatting the information on selection of the display
portion to be streamed.
Thus the present invention provides a method for real-time streaming of selective desktop display over a network from a sender system to a receiver
system, comprising the steps of: establishing a connection via a network between a sender system and a receiver system; capturing user event on display screen of the sender system;
streaming in real-time display buffer data from the sender system to the receiver system over the network after encoding of data; decoding the encoded data received from the receiver system and rendering it on the screen of the receiver
system; and displaying the decoded data on the receiver system in the same resolution as sent from the sender system or in full screen mode.